2024-09-13T06:15:12.408 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T06:15:12.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T06:15:12.516 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289 branch: wip-tejas-testing-2024-09-09-1611-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} email: tchandra@redhat.com first_in_suite: false job_id: '7903289' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-tejas-testing-2024-09-09-1611-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-tejas-testing-2024-09-09-1611-squid sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 owner: scheduled_tchandra@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9276 sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 sleep_before_teardown: 0 suite: rgw suite_branch: wip-tejas-testing-2024-09-09-1611-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQIvBmH59o1V+TDT1bLxFaSCJkPfX48s8HPE8Cb2CA6kRW6BzeThxbFdKETHTaQmPOr2sLpb5yioYypkF3swZo= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5kV3F85sRdiz7JRIh2cWG/RFN6kJs8vEBT93FNSkl8HgFxferfQUWmVXejPVGMHGKmHh4gmz1HMQXUK5k7P+o= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_05:06:18 tube: smithi user: tchandra verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T06:15:12.516 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa; will attempt to use it 2024-09-13T06:15:12.516 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa/tasks 2024-09-13T06:15:12.517 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T06:15:12.518 INFO:teuthology.task.internal:Checking packages... 2024-09-13T06:15:12.539 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7162ca8a22368558b9ec845c47e93c7afc45e8c3' 2024-09-13T06:15:12.539 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T06:15:12.540 INFO:teuthology.packaging:ref: None 2024-09-13T06:15:12.540 INFO:teuthology.packaging:tag: None 2024-09-13T06:15:12.540 INFO:teuthology.packaging:branch: wip-tejas-testing-2024-09-09-1611-squid 2024-09-13T06:15:12.540 INFO:teuthology.packaging:sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:15:12.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-tejas-testing-2024-09-09-1611-squid 2024-09-13T06:15:12.689 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:15:12.691 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T06:15:12.698 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T06:15:12.698 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T06:15:12.719 INFO:teuthology.task.internal:Saving configuration 2024-09-13T06:15:12.732 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T06:15:12.738 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T06:15:12.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 06:09:19.660163', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOvJ7EUGaHC2nd5zGdeXm3UZX0EfUbTXL7GxHrXTgZDr'} 2024-09-13T06:15:12.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 06:09:19.658393', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDwH7WMHdxisKxc6lDHjZyYbJrJxeViRjg6F03e0ZXWz'} 2024-09-13T06:15:12.799 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T06:15:12.806 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T06:15:12.806 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T06:15:12.806 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T06:15:12.885 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f69c029fbe0>, signals=[15]) 2024-09-13T06:15:12.885 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T06:15:12.891 INFO:teuthology.task.internal:Opening connections... 2024-09-13T06:15:12.891 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-13T06:15:12.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:15:12.984 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:15:12.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:15:13.073 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T06:15:13.079 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-13T06:15:13.084 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-13T06:15:13.084 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-13T06:15:13.135 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T06:15:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-09-13T06:15:13.137 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-13T06:15:13.167 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-13T06:15:13.173 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-13T06:15:13.173 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-13T06:15:13.221 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T06:15:13.221 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-09-13T06:15:13.221 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-09-13T06:15:13.221 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T06:15:13.222 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-09-13T06:15:13.222 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-13T06:15:13.250 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T06:15:13.259 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T06:15:13.265 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T06:15:13.266 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-13T06:15:13.268 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-13T06:15:13.273 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T06:15:13.279 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T06:15:13.279 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-13T06:15:13.317 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-13T06:15:13.326 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T06:15:13.395 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T06:15:13.410 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T06:15:13.411 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T06:15:13.411 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T06:15:13.411 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T06:15:13.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:15:13.416 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-13T06:15:13.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:15:13.417 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-13T06:15:13.464 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-09-13T06:15:13.464 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.15.0-56-generic 2024-09-13T06:15:13.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-13T06:15:13.465 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-56-generic 2024-09-13T06:15:13.466 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.15.0-56-generic 2024-09-13T06:15:13.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-09-13T06:15:13.582 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-13T06:15:13.619 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-09-13T06:15:13.733 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T06:15:13.770 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:15:13.772 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T06:15:13.772 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T06:15:13.833 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:15:13.835 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T06:15:13.914 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T06:15:13.941 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T06:15:14.009 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T06:15:14.048 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T06:15:14.052 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T06:15:14.054 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T06:15:14.054 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T06:15:14.055 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T06:15:14.075 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T06:15:14.078 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T06:15:14.078 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T06:15:14.081 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T06:15:14.082 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T06:15:14.089 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T06:15:14.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T06:15:14.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T06:15:14.090 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T06:15:14.091 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T06:15:14.111 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T06:15:14.117 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T06:15:14.121 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T06:15:14.122 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T06:15:14.122 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T06:15:14.152 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T06:15:14.152 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T06:15:14.157 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T06:15:14.157 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T06:15:14.164 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T06:15:14.168 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T06:15:14.168 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T06:15:14.169 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T06:15:14.211 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T06:15:14.211 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T06:15:14.211 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T06:15:14.211 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T06:15:14.212 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T06:15:14.217 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T06:15:14.219 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T06:15:14.263 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T06:15:14.269 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T06:15:14.270 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T06:15:14.329 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T06:15:14.352 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T06:15:14.363 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T06:15:14.382 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T06:15:14.387 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T06:15:14.388 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T06:15:14.388 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T06:15:14.390 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T06:15:14.390 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T06:15:14.390 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T06:15:14.392 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T06:15:14.393 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T06:15:14.404 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T06:15:14.410 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T06:15:14.421 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T06:15:14.422 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T06:15:14.422 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T06:15:14.423 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T06:15:14.604 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T06:15:14.763 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T06:15:14.777 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T06:15:14.777 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T06:15:14.779 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T06:15:14.849 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T06:15:14.860 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T06:15:14.861 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T06:15:14.884 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T06:15:14.915 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T06:15:14.920 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T06:15:14.929 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T06:15:14.930 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T06:15:14.930 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T06:15:15.003 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T06:15:15.003 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T06:15:15.005 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T06:15:15.006 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T06:15:15.006 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T06:15:15.010 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T06:15:15.011 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T06:15:15.092 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T06:15:15.094 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T06:15:20.416 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 16.0 MB in 2s (7,369 kB/s) 2024-09-13T06:15:20.455 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 16.0 MB in 2s (7,487 kB/s) 2024-09-13T06:15:21.842 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-13T06:15:21.860 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:15:21.864 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-13T06:15:21.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:15:21.921 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-13T06:15:21.945 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-13T06:15:22.130 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-13T06:15:22.130 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-13T06:15:22.132 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-13T06:15:22.133 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-13T06:15:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:15:22.298 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:15:22.298 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:15:22.299 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:15:22.299 INFO:teuthology.orchestra.run.smithi112.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T06:15:22.299 INFO:teuthology.orchestra.run.smithi112.stdout: python2.7-minimal 2024-09-13T06:15:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:15:22.300 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-13T06:15:22.300 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:15:22.300 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T06:15:22.301 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T06:15:22.302 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-13T06:15:22.302 INFO:teuthology.orchestra.run.smithi112.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T06:15:22.302 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-13T06:15:22.302 INFO:teuthology.orchestra.run.smithi112.stdout: thermald 2024-09-13T06:15:22.306 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:15:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:15:22.306 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:15:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:15:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T06:15:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: python2.7-minimal 2024-09-13T06:15:22.307 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:15:22.308 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-09-13T06:15:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:15:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T06:15:22.309 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T06:15:22.310 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-09-13T06:15:22.310 INFO:teuthology.orchestra.run.smithi169.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T06:15:22.311 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-09-13T06:15:22.311 INFO:teuthology.orchestra.run.smithi169.stdout: thermald 2024-09-13T06:15:22.344 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-13T06:15:22.344 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:15:22.344 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T06:15:22.345 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T06:15:22.346 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-13T06:15:22.346 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T06:15:22.361 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-09-13T06:15:22.361 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:15:22.361 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T06:15:22.362 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T06:15:22.363 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-09-13T06:15:22.363 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T06:15:22.524 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:15:22.525 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 113 MB of archives. 2024-09-13T06:15:22.525 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T06:15:22.525 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T06:15:22.543 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:15:22.543 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 113 MB of archives. 2024-09-13T06:15:22.543 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T06:15:22.543 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T06:15:23.938 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T06:15:24.176 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T06:15:24.285 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T06:15:24.525 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T06:15:26.472 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T06:15:26.472 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T06:15:26.473 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T06:15:26.716 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T06:15:26.716 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T06:15:26.716 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T06:15:26.815 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T06:15:26.893 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T06:15:27.045 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T06:15:27.125 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T06:15:27.294 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 113 MB in 5s (25.0 MB/s) 2024-09-13T06:15:27.449 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T06:15:27.527 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 113 MB in 5s (23.8 MB/s) 2024-09-13T06:15:27.670 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T06:15:29.444 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T06:15:29.448 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:29.530 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:29.658 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T06:15:29.662 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:29.836 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:31.970 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T06:15:31.991 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:32.078 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:32.331 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T06:15:32.353 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:32.445 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:32.523 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T06:15:32.544 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:32.582 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:32.860 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T06:15:32.881 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:32.909 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:39.306 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:15:39.388 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:15:39.433 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:15:39.513 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:15:39.775 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:15:39.838 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:15:39.903 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:15:39.966 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:15:40.244 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T06:15:40.254 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T06:15:40.294 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:15:40.306 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T06:15:40.329 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T06:15:40.364 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:15:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T06:15:45.680 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:45.709 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:46.265 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T06:15:46.303 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:15:46.340 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:48.719 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:15:48.845 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:15:48.952 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:15:49.078 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:15:49.550 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:15:50.045 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:15:50.158 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:50.284 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T06:15:50.366 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:50.412 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:50.492 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T06:15:50.629 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:51.749 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:15:51.749 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T06:15:51.749 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:15:51.749 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T06:15:51.898 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:51.962 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:15:51.963 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T06:15:51.963 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:15:51.963 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T06:15:52.141 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:53.324 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:53.550 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:54.717 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T06:15:54.843 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T06:15:54.918 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T06:15:54.977 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:55.042 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T06:15:55.042 INFO:teuthology.orchestra.run.smithi112.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:15:55.052 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T06:15:55.170 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:15:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T06:15:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:16:08.774 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T06:16:08.774 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub' 2024-09-13T06:16:08.780 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:16:08.799 INFO:teuthology.orchestra.run.smithi112.stdout:Generating grub configuration file ... 2024-09-13T06:16:09.052 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:16:09.064 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T06:16:09.064 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub' 2024-09-13T06:16:09.067 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:16:09.082 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:16:09.098 INFO:teuthology.orchestra.run.smithi169.stdout:Generating grub configuration file ... 2024-09-13T06:16:09.371 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:16:09.376 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:16:09.377 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:16:09.397 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:16:09.447 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:16:09.452 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:16:09.608 INFO:teuthology.orchestra.run.smithi112.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:16:09.608 INFO:teuthology.orchestra.run.smithi112.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:16:09.609 INFO:teuthology.orchestra.run.smithi112.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:16:09.654 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-13T06:16:09.702 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:16:09.708 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:16:09.780 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:16:09.786 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:16:09.943 INFO:teuthology.orchestra.run.smithi169.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:16:09.943 INFO:teuthology.orchestra.run.smithi169.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:16:09.943 INFO:teuthology.orchestra.run.smithi169.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:16:09.987 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-09-13T06:16:10.154 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-13T06:16:10.177 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.121.121 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:16:10.178 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-13T06:16:10.179 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-13T06:16:10.179 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:16:10.179 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-13T06:16:10.180 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T06:16:10.180 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T06:16:10.180 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T06:16:10.180 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T06:16:10.180 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T06:16:10.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-13T06:16:10.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-13T06:16:10.453 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-09-13T06:16:10.456 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:16:10.466 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:16:10.476 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-09-13T06:16:10.476 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-09-13T06:16:10.476 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.121.121 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:16:10.477 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-09-13T06:16:10.478 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T06:16:10.478 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T06:16:10.478 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T06:16:10.478 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T06:16:10.478 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T06:16:10.478 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-09-13T06:16:10.483 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:16:10.578 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:16:10.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-09-13T06:16:10.754 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:16:10.881 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:16:10.958 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:16:11.041 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:16:11.774 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-13T06:16:11.793 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:16:11.846 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-13T06:16:12.039 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-13T06:16:12.039 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-13T06:16:12.150 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-13T06:16:12.168 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:16:12.216 INFO:teuthology.orchestra.run.smithi112.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T06:16:12.216 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:16:12.217 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:16:12.217 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:16:12.217 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:16:12.217 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:16:12.217 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:16:12.217 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:16:12.231 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-13T06:16:12.259 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:16:12.260 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:16:12.314 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.121.121 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:16:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-13T06:16:12.315 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-13T06:16:12.359 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.9vexdA7SBj 2024-09-13T06:16:12.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9vexdA7SBj 2024-09-13T06:16:12.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.9vexdA7SBj 2024-09-13T06:16:12.436 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-13T06:16:12.437 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-13T06:16:12.531 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.9vexdA7SBj is 10KB 2024-09-13T06:16:12.544 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.9vexdA7SBj 2024-09-13T06:16:12.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T06:16:12.602 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:16:12.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T06:16:12.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T06:16:12.625 INFO:teuthology.orchestra.run.smithi169.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T06:16:12.625 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:16:12.625 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:16:12.625 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:16:12.626 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:16:12.626 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:16:12.626 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:16:12.626 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:16:12.669 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:16:12.670 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T06:16:12.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo update-grub 2024-09-13T06:16:12.671 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:16:12.687 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.121.121 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:16:12.688 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-09-13T06:16:12.688 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-13T06:16:12.732 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.NUiAqmLAqp 2024-09-13T06:16:12.732 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NUiAqmLAqp 2024-09-13T06:16:12.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.NUiAqmLAqp 2024-09-13T06:16:12.915 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.NUiAqmLAqp is 10KB 2024-09-13T06:16:12.927 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.NUiAqmLAqp 2024-09-13T06:16:12.932 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T06:16:12.988 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:16:12.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T06:16:12.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T06:16:13.059 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T06:16:13.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo update-grub 2024-09-13T06:16:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-09-13T06:16:13.864 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:16:13.866 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-13T06:16:14.039 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:16:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:16:14.275 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub' 2024-09-13T06:16:14.277 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:16:14.280 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-09-13T06:16:14.282 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:16:14.286 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:16:14.325 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:16:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:16:14.435 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:16:14.435 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:16:14.435 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:16:14.447 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-13T06:16:14.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-13T06:16:14.460 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:16:14.466 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:16:14.689 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:16:14.694 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:16:14.741 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:16:14.747 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:16:14.890 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:16:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:16:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:16:14.902 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-09-13T06:16:14.913 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-09-13T06:16:44.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T06:16:44.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:16:44.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:16:44.916 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T06:16:44.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-13T06:16:44.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:17:19.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-13T06:17:19.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-13T06:17:28.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:17:28.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:17:28.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-13T06:17:28.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:17:46.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-13T06:17:58.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:17:58.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:17:58.580 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-13T06:18:13.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:18:13.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:18:13.852 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-13T06:18:14.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:18:14.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T06:18:14.386 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-13T06:18:14.434 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-121-generic 2024-09-13T06:18:14.435 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T06:18:14.435 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T06:18:14.435 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T06:18:15.436 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T06:18:15.436 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T06:18:15.801 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-13T06:18:15.826 DEBUG:teuthology.parallel:result is None 2024-09-13T06:18:28.433 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T06:18:40.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-13T06:18:40.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:18:40.666 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-13T06:18:41.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-13T06:18:41.226 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-13T06:18:41.226 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-13T06:18:41.274 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-121-generic 2024-09-13T06:18:41.274 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T06:18:41.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T06:18:41.275 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T06:18:42.275 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T06:18:42.276 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T06:18:42.628 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-09-13T06:18:42.649 DEBUG:teuthology.parallel:result is None 2024-09-13T06:18:42.649 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T06:18:42.658 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T06:18:42.658 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T06:18:42.661 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T06:18:42.666 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T06:18:42.675 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T06:18:42.681 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T06:18:42.682 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T06:18:42.709 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T06:18:42.815 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T06:18:42.822 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T06:18:42.823 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T06:18:42.825 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T06:18:42.846 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:18:42.847 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:18:42.854 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:18:42.855 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:18:42.857 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T06:18:42.865 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T06:18:42.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T06:18:42.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T06:18:42.915 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T06:18:42.926 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T06:18:42.927 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T06:18:42.957 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T06:18:42.966 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T06:18:43.009 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T06:18:43.056 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:18:43.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T06:18:43.112 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T06:18:43.118 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T06:18:43.167 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:18:43.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T06:18:43.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-13T06:18:43.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-13T06:18:43.298 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T06:18:43.306 INFO:teuthology.task.internal:Starting timer... 2024-09-13T06:18:43.306 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T06:18:43.319 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T06:18:43.328 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-09-13T06:18:43.328 DEBUG:teuthology.task.selinux:Excluding smithi169: OS 'ubuntu' does not support SELinux 2024-09-13T06:18:43.328 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T06:18:43.328 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T06:18:43.328 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T06:18:43.328 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T06:18:43.337 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T06:18:43.340 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T06:18:43.487 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T06:18:43.498 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T06:18:43.499 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T06:26:16.634 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-13T06:26:16.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:26:16.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:26:16.728 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-13T06:26:16.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-13T06:26:16.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-13T06:26:16.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:26:16.915 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-13T06:26:16.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-13T06:26:16.998 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T06:26:17.013 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T06:26:17.013 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T06:26:17.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:26:17.016 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T06:26:17.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Command line: ntpd -gq 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: ---------------------------------------------------- 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: corporation. Support and training for ntp-4 are 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: available at https://www.nwtime.org/support 2024-09-13T06:26:17.044 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: ---------------------------------------------------- 2024-09-13T06:26:17.045 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: proto: precision = 0.043 usec (-24) 2024-09-13T06:26:17.045 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: basedate set to 2022-02-04 2024-09-13T06:26:17.045 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: gps base set to 2022-02-06 (week 2196) 2024-09-13T06:26:17.046 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:26:17.046 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:26:17.046 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:26:17.047 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listen normally on 4 lo [::1]:123 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-09-13T06:26:17.048 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:17 ntpd[18518]: Listening on routing socket on fd #22 for interface updates 2024-09-13T06:26:17.067 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Command line: ntpd -gq 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: ---------------------------------------------------- 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: corporation. Support and training for ntp-4 are 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: available at https://www.nwtime.org/support 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: ---------------------------------------------------- 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: proto: precision = 0.044 usec (-24) 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: basedate set to 2022-02-04 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: gps base set to 2022-02-06 (week 2196) 2024-09-13T06:26:17.068 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:26:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:26:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listen normally on 3 enp3s0f1 172.21.15.169:123 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listen normally on 4 lo [::1]:123 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f4d%5]:123 2024-09-13T06:26:17.070 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:17 ntpd[18525]: Listening on routing socket on fd #22 for interface updates 2024-09-13T06:26:18.044 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:18 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:18.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:18 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:18.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:18 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:18.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:18 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:18.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:18 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:18.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:18 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:18.065 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:18 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:19 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:19 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:19 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:19 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:19 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:19 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:19 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:19 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:20 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:20 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:20 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:20 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:20 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:20 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:20.065 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:20 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:20 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:20 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:20 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:20 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:20 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.047 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.047 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:21.047 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:21 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:21 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:22 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:22 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:22 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:22 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:22 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:22 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:22 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:22 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:22 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:22 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:22 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:22 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:23.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:23 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:23.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:23.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:23.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:23.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:23.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:23.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:23 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:24.045 INFO:teuthology.orchestra.run.smithi112.stdout:13 Sep 06:26:24 ntpd[18518]: ntpd: time slew +0.001359 s 2024-09-13T06:26:24.046 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew +0.001359s 2024-09-13T06:26:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T06:26:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:13 Sep 06:26:24 ntpd[18518]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T06:26:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:26:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:26:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:26:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:26:24.066 INFO:teuthology.orchestra.run.smithi169.stdout:13 Sep 06:26:24 ntpd[18525]: ntpd: time slew -0.001426 s 2024-09-13T06:26:24.066 INFO:teuthology.orchestra.run.smithi169.stdout:ntpd: time slew -0.001426s 2024-09-13T06:26:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T06:26:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:13 Sep 06:26:24 ntpd[18525]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T06:26:24.095 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:26:24.096 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-13T06:26:24.096 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.096 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.096 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.096 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:26:24.118 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-09-13T06:26:24.118 INFO:teuthology.orchestra.run.smithi169.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.119 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:26:24.120 INFO:teuthology.run_tasks:Running task install... 2024-09-13T06:26:24.134 DEBUG:teuthology.task.install:project ceph 2024-09-13T06:26:24.134 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}} 2024-09-13T06:26:24.134 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'} 2024-09-13T06:26:24.134 INFO:teuthology.task.install:Using flavor: default 2024-09-13T06:26:24.142 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T06:26:24.142 INFO:teuthology.task.install:extra packages: [] 2024-09-13T06:26:24.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-09-13T06:26:24.143 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-key list | grep Ceph 2024-09-13T06:26:24.201 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T06:26:24.221 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T06:26:24.229 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T06:26:24.229 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T06:26:24.230 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T06:26:24.230 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:26:24.255 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T06:26:24.255 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T06:26:24.256 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T06:26:24.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:26:24.393 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-13T06:26:24.394 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:26:24.406 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-13T06:26:24.407 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:26:24.520 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:26:24.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T06:26:24.527 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:26:24.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T06:26:24.533 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-13T06:26:24.542 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-09-13T06:26:24.758 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T06:26:24.764 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T06:26:24.779 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T06:26:24.785 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T06:26:24.802 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T06:26:24.808 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T06:26:24.824 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-13T06:26:24.830 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T06:26:24.856 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T06:26:24.863 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-13T06:26:27.219 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:26:27.291 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:26:27.373 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:26:27.881 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:26:28.091 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:26:28.093 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:26:28.107 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:26:28.125 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:26:28.260 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 28.9 kB in 4s (8,208 B/s) 2024-09-13T06:26:28.413 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 28.9 kB in 4s (7,829 B/s) 2024-09-13T06:26:29.277 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-13T06:26:29.293 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:26:29.357 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-13T06:26:29.416 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-13T06:26:29.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:26:29.497 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-13T06:26:29.564 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-13T06:26:29.565 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-13T06:26:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-13T06:26:29.708 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-13T06:26:29.771 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:26:29.771 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:26:29.771 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:26:29.771 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:26:29.772 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:26:29.772 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:26:29.772 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:26:29.773 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-09-13T06:26:29.773 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T06:26:29.773 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T06:26:29.773 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T06:26:29.773 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T06:26:29.775 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T06:26:29.775 INFO:teuthology.orchestra.run.smithi169.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T06:26:29.775 INFO:teuthology.orchestra.run.smithi169.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T06:26:29.776 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet zip 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T06:26:29.777 INFO:teuthology.orchestra.run.smithi169.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T06:26:29.778 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-09-13T06:26:29.778 INFO:teuthology.orchestra.run.smithi169.stdout: btrfs-tools 2024-09-13T06:26:29.881 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-09-13T06:26:29.881 INFO:teuthology.orchestra.run.smithi169.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T06:26:29.881 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T06:26:29.881 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T06:26:29.881 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T06:26:29.881 INFO:teuthology.orchestra.run.smithi169.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T06:26:29.882 INFO:teuthology.orchestra.run.smithi169.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T06:26:29.883 INFO:teuthology.orchestra.run.smithi169.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:26:29.884 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T06:26:29.885 INFO:teuthology.orchestra.run.smithi169.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T06:26:29.916 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T06:26:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:26:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T06:26:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet zip 2024-09-13T06:26:29.921 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-13T06:26:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T06:26:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T06:26:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T06:26:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T06:26:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T06:26:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T06:26:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T06:26:29.922 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-13T06:26:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T06:26:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T06:26:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T06:26:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 181 MB of archives. 2024-09-13T06:26:30.025 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T06:26:30.026 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-13T06:26:30.167 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T06:26:30.167 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 181 MB of archives. 2024-09-13T06:26:30.167 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T06:26:30.167 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-13T06:26:30.204 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-13T06:26:30.254 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-13T06:26:30.265 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-13T06:26:30.271 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-13T06:26:30.272 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-13T06:26:30.275 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-13T06:26:30.276 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-13T06:26:30.281 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-13T06:26:30.407 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-13T06:26:30.408 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-13T06:26:30.418 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-13T06:26:30.848 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-13T06:26:31.029 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-13T06:26:31.072 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-13T06:26:31.099 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-13T06:26:31.102 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-13T06:26:31.103 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-13T06:26:31.108 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-13T06:26:31.117 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-13T06:26:31.147 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-13T06:26:31.148 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-13T06:26:31.177 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-13T06:26:31.179 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-13T06:26:31.209 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-13T06:26:31.233 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-13T06:26:31.782 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-13T06:26:31.785 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-13T06:26:31.790 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-13T06:26:31.791 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-13T06:26:31.794 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-13T06:26:31.806 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-13T06:26:31.843 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-13T06:26:31.853 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-13T06:26:31.855 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-13T06:26:31.883 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-13T06:26:32.081 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-13T06:26:32.082 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-13T06:26:33.230 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-13T06:26:33.309 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-13T06:26:33.312 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-13T06:26:33.313 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-13T06:26:33.344 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T06:26:33.359 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-13T06:26:33.438 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T06:26:33.440 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T06:26:33.457 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T06:26:33.518 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-13T06:26:33.520 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T06:26:33.527 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T06:26:33.542 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T06:26:33.547 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T06:26:33.547 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T06:26:33.548 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T06:26:33.557 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T06:26:33.560 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T06:26:33.562 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T06:26:33.564 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T06:26:33.564 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T06:26:33.578 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T06:26:33.580 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T06:26:33.582 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T06:26:33.582 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T06:26:33.583 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T06:26:33.594 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T06:26:33.595 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T06:26:33.595 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T06:26:33.595 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T06:26:33.596 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T06:26:33.600 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-13T06:26:33.602 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-13T06:26:33.603 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-13T06:26:33.611 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T06:26:33.612 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T06:26:33.615 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T06:26:33.615 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T06:26:33.615 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T06:26:33.628 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T06:26:33.629 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T06:26:33.630 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T06:26:33.630 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T06:26:33.631 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T06:26:33.645 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T06:26:33.646 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T06:26:33.655 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T06:26:33.655 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T06:26:33.655 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T06:26:33.662 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T06:26:33.664 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T06:26:33.665 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T06:26:33.666 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T06:26:33.668 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T06:26:33.679 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T06:26:33.682 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T06:26:33.683 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T06:26:33.684 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T06:26:33.688 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T06:26:33.737 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T06:26:33.742 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T06:26:33.743 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T06:26:33.743 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T06:26:33.744 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T06:26:33.745 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T06:26:33.762 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T06:26:33.764 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T06:26:33.764 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T06:26:33.779 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T06:26:33.779 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T06:26:33.780 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T06:26:33.780 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T06:26:33.780 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T06:26:33.781 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T06:26:33.794 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T06:26:33.795 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T06:26:33.798 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T06:26:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T06:26:33.813 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T06:26:33.813 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T06:26:33.817 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T06:26:33.819 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T06:26:33.820 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T06:26:33.821 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T06:26:33.828 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T06:26:33.829 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T06:26:33.832 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T06:26:33.845 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T06:26:33.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T06:26:33.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T06:26:33.847 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T06:26:33.848 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T06:26:33.855 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T06:26:33.855 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T06:26:33.862 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T06:26:33.864 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T06:26:33.865 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T06:26:34.073 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-13T06:26:34.156 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T06:26:34.168 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T06:26:34.186 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-13T06:26:34.187 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-13T06:26:34.203 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-13T06:26:34.246 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-13T06:26:34.249 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T06:26:34.255 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-13T06:26:34.257 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-13T06:26:34.279 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-13T06:26:34.477 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T06:26:34.488 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T06:26:34.494 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-13T06:26:34.494 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-13T06:26:34.517 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T06:26:34.526 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T06:26:34.527 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T06:26:34.528 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T06:26:34.547 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T06:26:34.551 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T06:26:34.555 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T06:26:34.560 INFO:teuthology.orchestra.run.smithi169.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T06:26:34.639 INFO:teuthology.orchestra.run.smithi169.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T06:26:34.644 INFO:teuthology.orchestra.run.smithi169.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T06:26:34.648 INFO:teuthology.orchestra.run.smithi169.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T06:26:34.652 INFO:teuthology.orchestra.run.smithi169.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T06:26:34.653 INFO:teuthology.orchestra.run.smithi169.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T06:26:34.654 INFO:teuthology.orchestra.run.smithi169.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T06:26:34.656 INFO:teuthology.orchestra.run.smithi169.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T06:26:34.656 INFO:teuthology.orchestra.run.smithi169.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T06:26:34.657 INFO:teuthology.orchestra.run.smithi169.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T06:26:34.723 INFO:teuthology.orchestra.run.smithi169.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T06:26:34.740 INFO:teuthology.orchestra.run.smithi169.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T06:26:34.740 INFO:teuthology.orchestra.run.smithi169.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T06:26:34.741 INFO:teuthology.orchestra.run.smithi169.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T06:26:34.746 INFO:teuthology.orchestra.run.smithi169.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T06:26:34.747 INFO:teuthology.orchestra.run.smithi169.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T06:26:34.748 INFO:teuthology.orchestra.run.smithi169.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T06:26:34.749 INFO:teuthology.orchestra.run.smithi169.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T06:26:34.806 INFO:teuthology.orchestra.run.smithi169.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T06:26:34.806 INFO:teuthology.orchestra.run.smithi169.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T06:26:34.889 INFO:teuthology.orchestra.run.smithi169.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T06:26:34.889 INFO:teuthology.orchestra.run.smithi169.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T06:26:34.890 INFO:teuthology.orchestra.run.smithi169.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T06:26:34.891 INFO:teuthology.orchestra.run.smithi169.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T06:26:34.902 INFO:teuthology.orchestra.run.smithi169.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T06:26:34.902 INFO:teuthology.orchestra.run.smithi169.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T06:26:34.903 INFO:teuthology.orchestra.run.smithi169.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T06:26:34.968 INFO:teuthology.orchestra.run.smithi169.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T06:26:34.970 INFO:teuthology.orchestra.run.smithi169.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T06:26:34.974 INFO:teuthology.orchestra.run.smithi169.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T06:26:35.049 INFO:teuthology.orchestra.run.smithi169.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T06:26:35.052 INFO:teuthology.orchestra.run.smithi169.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T06:26:35.053 INFO:teuthology.orchestra.run.smithi169.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T06:26:35.058 INFO:teuthology.orchestra.run.smithi169.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T06:26:35.059 INFO:teuthology.orchestra.run.smithi169.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T06:26:35.061 INFO:teuthology.orchestra.run.smithi169.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T06:26:35.065 INFO:teuthology.orchestra.run.smithi169.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T06:26:35.224 INFO:teuthology.orchestra.run.smithi169.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T06:26:35.225 INFO:teuthology.orchestra.run.smithi169.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T06:26:35.227 INFO:teuthology.orchestra.run.smithi169.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T06:26:35.227 INFO:teuthology.orchestra.run.smithi169.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T06:26:35.229 INFO:teuthology.orchestra.run.smithi169.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T06:26:35.297 INFO:teuthology.orchestra.run.smithi169.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T06:26:35.300 INFO:teuthology.orchestra.run.smithi169.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T06:26:35.301 INFO:teuthology.orchestra.run.smithi169.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T06:26:35.325 INFO:teuthology.orchestra.run.smithi169.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T06:26:35.325 INFO:teuthology.orchestra.run.smithi169.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T06:26:35.390 INFO:teuthology.orchestra.run.smithi169.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T06:26:35.391 INFO:teuthology.orchestra.run.smithi169.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T06:26:35.391 INFO:teuthology.orchestra.run.smithi169.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T06:26:35.392 INFO:teuthology.orchestra.run.smithi169.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T06:26:35.393 INFO:teuthology.orchestra.run.smithi169.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T06:26:35.394 INFO:teuthology.orchestra.run.smithi169.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T06:26:35.399 INFO:teuthology.orchestra.run.smithi169.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T06:26:35.472 INFO:teuthology.orchestra.run.smithi169.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T06:26:35.474 INFO:teuthology.orchestra.run.smithi169.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T06:26:35.475 INFO:teuthology.orchestra.run.smithi169.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T06:26:35.553 INFO:teuthology.orchestra.run.smithi169.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T06:26:35.559 INFO:teuthology.orchestra.run.smithi169.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T06:26:35.561 INFO:teuthology.orchestra.run.smithi169.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T06:26:35.563 INFO:teuthology.orchestra.run.smithi169.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T06:26:35.574 INFO:teuthology.orchestra.run.smithi169.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T06:26:35.575 INFO:teuthology.orchestra.run.smithi169.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T06:26:35.582 INFO:teuthology.orchestra.run.smithi169.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T06:26:35.634 INFO:teuthology.orchestra.run.smithi169.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T06:26:35.636 INFO:teuthology.orchestra.run.smithi169.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T06:26:35.637 INFO:teuthology.orchestra.run.smithi169.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T06:26:35.715 INFO:teuthology.orchestra.run.smithi169.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T06:26:35.717 INFO:teuthology.orchestra.run.smithi169.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T06:26:35.734 INFO:teuthology.orchestra.run.smithi169.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T06:26:35.735 INFO:teuthology.orchestra.run.smithi169.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T06:26:35.736 INFO:teuthology.orchestra.run.smithi169.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T06:26:35.741 INFO:teuthology.orchestra.run.smithi169.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T06:26:35.743 INFO:teuthology.orchestra.run.smithi169.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T06:26:36.321 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-13T06:26:36.324 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-13T06:26:36.325 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-13T06:26:36.373 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 181 MB in 6s (30.6 MB/s) 2024-09-13T06:26:36.500 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T06:26:36.599 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T06:26:36.603 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T06:26:36.633 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-13T06:26:36.674 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:26:36.986 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T06:26:37.012 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T06:26:37.052 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:26:37.211 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 181 MB in 7s (27.4 MB/s) 2024-09-13T06:26:37.382 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T06:26:37.397 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T06:26:37.424 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T06:26:37.472 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:26:37.483 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T06:26:37.488 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T06:26:37.572 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:26:37.884 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T06:26:37.909 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T06:26:37.910 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:26:37.935 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T06:26:37.952 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:26:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:26:38.312 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T06:26:38.339 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T06:26:38.345 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T06:26:38.372 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:26:38.379 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:26:38.412 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:26:38.749 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T06:26:38.757 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T06:26:38.775 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:26:38.783 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:26:38.815 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:26:38.823 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:26:39.160 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T06:26:39.186 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T06:26:39.218 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:26:39.219 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T06:26:39.246 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:26:39.277 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:26:39.571 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librados2. 2024-09-13T06:26:39.597 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T06:26:39.597 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:39.624 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:26:39.638 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:39.663 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:26:39.991 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T06:26:40.018 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T06:26:40.058 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:26:40.074 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librbd1. 2024-09-13T06:26:40.100 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:40.140 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:40.405 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-09-13T06:26:40.429 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:40.469 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:40.585 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T06:26:40.611 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:40.652 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:40.839 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-09-13T06:26:40.865 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:40.897 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:40.904 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rados. 2024-09-13T06:26:40.919 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:40.954 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:41.273 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T06:26:41.300 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T06:26:41.300 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:26:41.326 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:41.340 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:41.366 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:41.576 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T06:26:41.591 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:41.634 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:41.652 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-09-13T06:26:41.679 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:41.719 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:41.928 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T06:26:41.944 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:26:41.978 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:42.021 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T06:26:42.048 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:26:42.088 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:42.248 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T06:26:42.274 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T06:26:42.290 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T06:26:42.306 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:42.315 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:42.643 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T06:26:42.651 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T06:26:42.670 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:26:42.677 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T06:26:42.709 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:42.718 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T06:26:42.962 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T06:26:42.988 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:43.028 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:43.037 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T06:26:43.064 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T06:26:43.104 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:26:43.365 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T06:26:43.391 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T06:26:43.415 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T06:26:43.431 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:26:43.442 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T06:26:43.515 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T06:26:43.725 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T06:26:43.741 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T06:26:43.742 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T06:26:43.758 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:43.784 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:26:43.792 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:44.095 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T06:26:44.104 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T06:26:44.121 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T06:26:44.131 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T06:26:44.162 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:26:44.170 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:26:44.448 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua5.1. 2024-09-13T06:26:44.463 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T06:26:44.498 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:26:44.818 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-any. 2024-09-13T06:26:44.833 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T06:26:44.876 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T06:26:45.215 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T06:26:45.241 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T06:26:45.245 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package zip. 2024-09-13T06:26:45.271 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T06:26:45.282 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:26:45.429 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T06:26:45.576 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T06:26:45.592 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T06:26:45.643 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:26:45.732 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package unzip. 2024-09-13T06:26:45.747 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T06:26:45.782 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:26:45.972 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-09-13T06:26:45.998 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T06:26:46.038 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:26:46.202 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package luarocks. 2024-09-13T06:26:46.229 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T06:26:46.269 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:26:46.316 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-09-13T06:26:46.331 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T06:26:46.366 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T06:26:46.602 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-09-13T06:26:46.617 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T06:26:46.643 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librgw2. 2024-09-13T06:26:46.669 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T06:26:46.671 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:46.710 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:47.005 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-09-13T06:26:47.031 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T06:26:47.072 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:26:47.288 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T06:26:47.314 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:47.371 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:47.425 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-09-13T06:26:47.441 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T06:26:47.475 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:26:47.674 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T06:26:47.700 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T06:26:47.732 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:26:47.833 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-09-13T06:26:47.860 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:47.899 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:48.051 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T06:26:48.078 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:48.118 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:48.427 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T06:26:48.453 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:48.494 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:48.546 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-common. 2024-09-13T06:26:48.573 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:48.613 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:48.830 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T06:26:48.856 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T06:26:48.897 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:26:49.174 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T06:26:49.201 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:49.645 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-09-13T06:26:49.671 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:49.711 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:50.079 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-base. 2024-09-13T06:26:50.105 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:50.154 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:50.825 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T06:26:50.851 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T06:26:50.899 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:26:51.150 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-09-13T06:26:51.176 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:26:51.225 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:26:51.269 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T06:26:51.295 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T06:26:51.336 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:26:51.672 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T06:26:51.699 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T06:26:51.739 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:26:51.779 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T06:26:51.794 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T06:26:51.837 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:26:52.042 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T06:26:52.068 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T06:26:52.108 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:26:52.140 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T06:26:52.167 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T06:26:52.207 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:26:52.495 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T06:26:52.509 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T06:26:52.521 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T06:26:52.525 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T06:26:52.559 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:26:52.570 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:26:52.846 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T06:26:52.872 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T06:26:52.906 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T06:26:52.912 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:26:52.932 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T06:26:52.973 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T06:26:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T06:26:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T06:26:53.275 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-portend. 2024-09-13T06:26:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:26:53.302 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T06:26:53.342 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T06:26:53.584 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T06:26:53.600 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T06:26:53.634 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T06:26:53.687 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T06:26:53.713 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T06:26:53.762 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T06:26:53.913 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-09-13T06:26:53.939 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T06:26:53.979 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T06:26:54.131 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T06:26:54.158 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T06:26:54.206 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T06:26:54.348 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T06:26:54.543 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T06:26:54.559 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T06:26:54.593 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T06:26:54.651 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T06:26:54.678 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T06:26:54.717 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:26:54.905 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T06:26:54.932 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T06:26:54.971 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T06:26:55.013 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T06:26:55.040 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T06:26:55.071 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T06:26:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T06:26:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T06:26:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:26:55.566 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T06:26:55.593 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T06:26:55.633 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T06:26:55.835 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-mako. 2024-09-13T06:26:55.862 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T06:26:55.902 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:26:55.927 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T06:26:55.954 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T06:26:55.994 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:26:56.205 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T06:26:56.232 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T06:26:56.247 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-09-13T06:26:56.272 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:26:56.273 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T06:26:56.313 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:26:56.558 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T06:26:56.585 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T06:26:56.625 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:26:56.658 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T06:26:56.685 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T06:26:56.725 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:26:56.927 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webob. 2024-09-13T06:26:56.954 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T06:26:56.994 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:26:57.061 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T06:26:57.088 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T06:26:57.136 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:26:57.339 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T06:26:57.365 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T06:26:57.405 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-09-13T06:26:57.408 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:26:57.421 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T06:26:57.455 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:26:57.717 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T06:26:57.743 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T06:26:57.750 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T06:26:57.765 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T06:26:57.783 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:26:57.804 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:26:58.045 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-paste. 2024-09-13T06:26:58.071 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T06:26:58.120 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:26:58.144 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T06:26:58.171 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T06:26:58.228 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:26:58.480 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-09-13T06:26:58.481 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T06:26:58.496 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:26:58.539 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:26:58.792 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T06:26:58.808 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T06:26:58.850 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T06:26:58.851 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:26:58.866 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T06:26:58.909 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:26:59.154 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T06:26:59.180 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T06:26:59.187 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T06:26:59.228 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:26:59.229 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T06:26:59.531 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T06:26:59.540 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T06:26:59.558 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T06:26:59.567 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T06:26:59.598 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T06:26:59.606 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:26:59.970 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T06:26:59.997 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T06:27:00.037 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T06:27:00.359 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T06:27:00.386 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T06:27:00.740 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-idna. 2024-09-13T06:27:00.750 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:27:00.766 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T06:27:00.798 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:27:01.109 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T06:27:01.122 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T06:27:01.136 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T06:27:01.149 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T06:27:01.176 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:27:01.189 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T06:27:01.505 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests. 2024-09-13T06:27:01.517 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-09-13T06:27:01.531 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T06:27:01.543 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T06:27:01.571 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:27:01.583 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:27:01.853 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T06:27:01.868 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T06:27:01.882 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T06:27:01.903 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:27:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T06:27:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:27:02.190 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-09-13T06:27:02.216 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T06:27:02.235 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T06:27:02.256 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:27:02.262 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:02.302 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:02.559 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T06:27:02.585 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T06:27:02.625 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:27:02.640 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T06:27:02.667 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:02.698 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:02.928 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T06:27:02.955 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:03.003 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:03.068 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T06:27:03.095 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T06:27:03.143 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T06:27:03.368 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:03.400 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:03.454 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T06:27:03.481 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T06:27:03.540 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T06:27:03.711 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T06:27:03.737 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T06:27:03.777 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:27:03.916 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T06:27:03.944 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:03.990 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:04.064 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T06:27:04.090 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T06:27:04.130 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T06:27:04.402 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T06:27:04.429 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:04.469 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:04.483 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T06:27:04.510 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:04.550 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:04.886 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T06:27:04.913 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:04.944 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:05.114 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T06:27:05.141 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:05.180 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:05.698 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T06:27:05.725 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:05.764 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:06.384 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph. 2024-09-13T06:27:06.411 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:06.442 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:06.761 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T06:27:06.788 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:06.826 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-09-13T06:27:06.828 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:07.170 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T06:27:07.186 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:07.207 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T06:27:07.229 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:07.233 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:07.273 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:07.590 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T06:27:07.617 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:07.618 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephadm. 2024-09-13T06:27:07.644 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:07.657 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:07.676 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:08.021 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T06:27:08.047 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-09-13T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:08.087 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:08.398 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T06:27:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T06:27:08.414 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:27:08.419 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T06:27:08.448 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:08.462 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T06:27:08.748 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T06:27:08.764 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:27:08.807 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:09.470 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-babel. 2024-09-13T06:27:09.497 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:27:09.536 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:09.745 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-09-13T06:27:09.772 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:27:09.803 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:09.873 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T06:27:09.899 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T06:27:09.939 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:27:10.081 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T06:27:10.108 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T06:27:10.147 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:27:10.276 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T06:27:10.303 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:10.342 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:10.459 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T06:27:10.488 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:10.525 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:10.679 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T06:27:10.706 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T06:27:10.746 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T06:27:10.812 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T06:27:10.828 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T06:27:10.903 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T06:27:11.049 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-routes. 2024-09-13T06:27:11.075 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T06:27:11.115 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:27:11.215 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-09-13T06:27:11.242 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T06:27:11.281 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:27:11.460 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T06:27:11.487 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:11.526 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:11.609 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T06:27:11.636 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:12.824 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T06:27:12.851 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T06:27:12.890 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:27:13.385 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T06:27:13.401 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T06:27:13.412 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T06:27:13.428 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T06:27:13.451 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:27:13.467 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:27:13.805 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T06:27:13.821 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T06:27:13.855 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:27:13.856 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T06:27:13.885 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T06:27:13.923 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:27:14.133 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T06:27:14.160 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T06:27:14.199 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:27:14.226 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T06:27:14.253 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T06:27:14.292 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:27:14.933 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T06:27:14.961 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:14.967 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T06:27:14.996 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:15.093 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:15.111 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:16.048 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T06:27:16.075 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T06:27:16.114 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T06:27:16.256 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T06:27:16.284 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T06:27:16.323 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T06:27:16.384 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T06:27:16.412 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T06:27:16.450 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:27:16.601 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T06:27:16.628 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T06:27:16.667 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:27:16.954 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T06:27:16.954 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T06:27:16.970 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T06:27:16.981 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T06:27:17.004 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:27:17.012 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:27:17.307 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T06:27:17.324 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T06:27:17.334 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T06:27:17.350 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T06:27:17.373 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T06:27:17.390 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T06:27:17.644 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T06:27:17.671 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T06:27:17.702 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T06:27:17.702 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T06:27:17.729 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T06:27:17.768 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T06:27:18.022 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T06:27:18.049 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T06:27:18.072 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T06:27:18.088 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:27:18.099 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T06:27:18.130 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:27:18.408 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T06:27:18.435 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T06:27:18.475 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T06:27:18.500 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T06:27:18.527 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T06:27:18.575 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T06:27:18.778 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T06:27:18.805 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T06:27:18.844 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:27:18.912 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T06:27:18.938 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T06:27:18.978 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:27:19.475 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T06:27:19.491 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:19.525 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:19.617 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T06:27:19.633 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:19.675 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:19.844 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T06:27:19.872 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T06:27:19.911 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:27:20.003 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T06:27:20.031 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T06:27:20.069 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:27:20.264 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T06:27:20.292 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:27:20.330 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:27:20.415 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T06:27:20.442 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:27:20.481 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:27:20.558 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-09-13T06:27:20.586 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:27:20.616 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T06:27:20.717 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package jq. 2024-09-13T06:27:20.744 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:27:20.783 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T06:27:20.835 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-09-13T06:27:20.851 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T06:27:20.894 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:27:21.103 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package socat. 2024-09-13T06:27:21.131 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T06:27:21.178 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:27:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T06:27:21.225 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T06:27:21.263 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:27:21.607 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T06:27:21.634 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T06:27:21.634 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-09-13T06:27:21.662 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:21.673 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:27:21.701 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:22.103 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-test. 2024-09-13T06:27:22.130 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:22.177 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:23.972 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T06:27:23.999 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:24.038 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:24.359 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T06:27:24.375 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:24.417 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:24.515 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T06:27:24.543 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:27:24.582 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:24.737 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T06:27:24.764 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T06:27:24.803 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:27:24.894 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T06:27:24.921 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:24.960 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:25.133 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T06:27:25.160 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T06:27:25.199 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:27:25.314 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T06:27:25.341 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T06:27:25.380 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:27:25.545 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T06:27:25.572 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T06:27:25.611 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:27:25.701 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T06:27:25.729 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T06:27:25.759 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:27:26.025 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-09-13T06:27:26.053 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T06:27:26.091 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:27:26.139 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T06:27:26.166 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T06:27:26.205 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:27:26.603 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T06:27:26.610 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package pkg-config. 2024-09-13T06:27:26.619 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T06:27:26.638 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T06:27:26.661 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:27:26.677 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:27:26.938 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T06:27:26.954 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T06:27:26.996 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:27:27.114 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T06:27:27.142 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T06:27:27.180 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T06:27:27.483 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T06:27:27.511 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T06:27:27.550 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T06:27:27.700 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T06:27:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T06:27:27.766 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T06:27:27.862 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T06:27:27.890 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T06:27:27.920 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:27:28.069 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T06:27:28.096 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T06:27:28.135 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T06:27:28.214 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T06:27:28.242 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T06:27:28.281 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T06:27:28.447 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T06:27:28.475 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T06:27:28.505 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:27:28.626 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-09-13T06:27:28.654 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T06:27:28.692 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T06:27:28.775 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T06:27:28.802 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T06:27:28.841 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T06:27:28.996 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T06:27:29.023 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T06:27:29.062 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:27:29.128 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-py. 2024-09-13T06:27:29.155 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T06:27:29.186 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T06:27:29.465 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T06:27:29.492 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T06:27:29.499 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T06:27:29.528 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T06:27:29.531 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:27:29.566 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-09-13T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T06:27:30.019 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T06:27:30.047 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T06:27:30.085 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:27:30.238 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T06:27:30.266 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T06:27:30.304 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:27:30.348 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-toml. 2024-09-13T06:27:30.376 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T06:27:30.415 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T06:27:30.716 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:27:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T06:27:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T06:27:30.784 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:27:31.011 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T06:27:31.039 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T06:27:31.077 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:27:31.104 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T06:27:31.132 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T06:27:31.171 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:27:31.415 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T06:27:31.443 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T06:27:31.482 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:27:31.823 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-09-13T06:27:31.850 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:31.889 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:32.203 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package radosgw. 2024-09-13T06:27:32.230 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:32.269 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:32.667 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T06:27:32.695 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:32.734 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:33.021 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T06:27:33.055 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T06:27:33.083 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:27:33.122 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:33.272 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:27:33.423 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:27:33.452 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T06:27:33.685 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:27:33.687 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T06:27:33.811 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:27:34.046 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T06:27:34.068 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T06:27:34.402 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T06:27:34.434 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T06:27:34.500 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:34.854 INFO:teuthology.orchestra.run.smithi169.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T06:27:34.981 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:35.000 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-09-13T06:27:35.156 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:27:35.433 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:27:35.900 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user cephadm....done 2024-09-13T06:27:36.053 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T06:27:36.162 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:27:36.287 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:27:36.413 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T06:27:36.546 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:27:36.740 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:27:36.797 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:27:36.932 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:27:37.108 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T06:27:37.183 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T06:27:37.368 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T06:27:37.418 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:27:37.535 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T06:27:37.669 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:27:37.837 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:27:37.921 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:27:38.172 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:27:38.189 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T06:27:38.431 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:27:38.448 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T06:27:38.699 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:38.716 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:27:38.951 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:27:38.975 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:27:39.084 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:27:39.210 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:27:39.211 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:27:39.336 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:27:39.487 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:27:39.587 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:27:39.763 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:39.967 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T06:27:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T06:27:40.038 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:27:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:27:40.217 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T06:27:40.299 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:27:40.408 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:27:40.576 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:40.642 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:27:40.685 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T06:27:40.945 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:27:41.012 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T06:27:41.032 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T06:27:41.104 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:27:41.212 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:27:41.230 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T06:27:41.514 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T06:27:41.623 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:27:41.749 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T06:27:42.017 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:27:42.284 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:27:42.317 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:27:42.568 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:27:42.611 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T06:27:42.702 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:27:42.820 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:27:43.068 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:27:43.113 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T06:27:43.481 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T06:27:43.732 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:27:43.839 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:27:44.107 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:27:44.117 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:27:44.233 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:27:44.359 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:27:44.418 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:27:44.651 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:27:45.012 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:27:45.044 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T06:27:45.138 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:45.312 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:27:45.705 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:27:45.782 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:27:46.032 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:27:46.375 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:27:46.626 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:27:46.769 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:47.021 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:27:47.111 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:27:47.398 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:27:47.462 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:27:47.541 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T06:27:47.808 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:27:47.934 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:27:48.044 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:27:48.337 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:27:48.588 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T06:27:48.685 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:27:48.839 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:27:48.945 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:27:48.948 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:27:49.104 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T06:27:49.258 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:27:49.389 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:27:49.509 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T06:27:49.523 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:27:49.632 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:27:49.761 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T06:27:49.934 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:27:50.035 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:27:50.201 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T06:27:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T06:27:50.469 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:27:50.595 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:27:50.648 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T06:27:50.905 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:27:50.932 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:27:51.067 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:27:51.181 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T06:27:51.351 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:27:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T06:27:51.635 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:27:51.708 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:27:51.878 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:27:51.951 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T06:27:51.996 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:27:52.114 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:52.186 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T06:27:52.219 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:27:52.370 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T06:27:52.432 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:27:52.567 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:27:52.671 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:27:52.797 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:27:52.951 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:27:53.090 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:27:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T06:27:53.312 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T06:27:53.383 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:27:53.571 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:27:53.672 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:27:53.784 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:27:53.910 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:27:53.990 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:27:54.044 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:27:54.149 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T06:27:54.283 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:27:54.387 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:27:54.539 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:27:54.559 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T06:27:54.685 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T06:27:54.945 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T06:27:54.949 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:27:55.200 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T06:27:55.212 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:27:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T06:27:55.540 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:27:55.577 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:27:55.711 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:27:55.942 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T06:27:56.071 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:27:56.243 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:27:56.397 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:27:56.588 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:27:56.665 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T06:27:56.730 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:56.791 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T06:27:56.856 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:56.982 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:27:57.050 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T06:27:57.278 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:57.318 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:27:57.404 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:57.529 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T06:27:57.663 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:27:57.806 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:57.932 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:58.056 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T06:27:58.066 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:58.262 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:27:58.263 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:27:58.341 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:27:58.677 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:27:58.743 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:58.803 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:58.861 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:58.929 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:58.986 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:59.055 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:27:59.112 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:27:59.383 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:59.484 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:27:59.602 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T06:27:59.903 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.054 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.239 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.343 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.469 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.476 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:28:00.476 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:28:00.595 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.704 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:00.940 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:01.066 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:01.192 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:01.318 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:28:01.332 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-09-13T06:28:01.649 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-09-13T06:28:01.768 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-09-13T06:28:01.781 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T06:28:01.915 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T06:28:02.246 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T06:28:02.522 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:02.648 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:02.732 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:02.774 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:02.874 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:02.883 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:02.984 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:03.338 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:28:03.338 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:28:03.510 INFO:teuthology.orchestra.run.smithi169.stdout:Adding group ceph....done 2024-09-13T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:03.887 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user ceph....done 2024-09-13T06:28:04.038 INFO:teuthology.orchestra.run.smithi169.stdout:Setting system user ceph properties....done 2024-09-13T06:28:04.053 INFO:teuthology.orchestra.run.smithi169.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T06:28:04.142 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T06:28:04.188 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T06:28:04.494 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T06:28:04.612 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:04.835 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:28:04.835 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:28:04.952 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:05.078 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:05.272 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:05.501 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:28:05.501 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:28:05.533 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:28:05.533 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:28:05.971 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:05.984 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:06.265 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:28:06.265 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:28:06.317 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T06:28:06.765 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:06.766 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:06.892 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:06.977 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:28:06.977 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:28:07.052 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:07.262 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:28:07.262 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:28:07.436 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:07.641 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:28:07.641 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:28:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:08.074 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:08.143 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:08.449 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:28:08.449 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:28:08.688 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T06:28:08.805 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T06:28:08.949 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T06:28:08.978 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:09.371 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:09.523 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:09.736 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:28:09.736 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:28:10.084 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T06:28:10.190 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:10.333 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:10.459 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:10.610 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:28:10.740 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T06:28:10.747 DEBUG:teuthology.parallel:result is None 2024-09-13T06:28:10.980 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T06:28:11.089 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T06:28:11.316 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T06:28:12.449 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T06:28:13.083 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T06:28:13.087 DEBUG:teuthology.parallel:result is None 2024-09-13T06:28:13.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:28:13.237 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-09-13T06:28:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:28:13.257 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:28:13.258 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-13T06:28:13.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:28:13.407 DEBUG:teuthology.orchestra.run.smithi169:> dpkg-query -W -f '${Version}' ceph 2024-09-13T06:28:13.426 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:28:13.426 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:28:13.427 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-13T06:28:13.428 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T06:28:13.429 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:13.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T06:28:13.443 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:13.443 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T06:28:13.484 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T06:28:13.484 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:13.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T06:28:13.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T06:28:13.556 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:13.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T06:28:13.570 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T06:28:13.623 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T06:28:13.623 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:13.623 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T06:28:13.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T06:28:13.696 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:13.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T06:28:13.710 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T06:28:13.762 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T06:28:13.763 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:13.763 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T06:28:13.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T06:28:13.836 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:13.836 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T06:28:13.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T06:28:13.908 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T06:28:13.994 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T06:28:13.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-13T06:28:13.997 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-09-13T06:28:14.011 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T06:28:14.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T06:28:14.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T06:28:14.066 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T06:28:14.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T06:28:14.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T06:28:14.131 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T06:28:14.132 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T06:28:14.132 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289', 'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}', 'email': 'tchandra@redhat.com', 'first_in_suite': False, 'job_id': '7903289', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'owner': 'scheduled_tchandra@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9276, 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQIvBmH59o1V+TDT1bLxFaSCJkPfX48s8HPE8Cb2CA6kRW6BzeThxbFdKETHTaQmPOr2sLpb5yioYypkF3swZo=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5kV3F85sRdiz7JRIh2cWG/RFN6kJs8vEBT93FNSkl8HgFxferfQUWmVXejPVGMHGKmHh4gmz1HMQXUK5k7P+o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_05:06:18', 'tube': 'smithi', 'user': 'tchandra', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T06:28:14.132 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T06:28:14.162 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T06:28:14.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T06:28:14.210 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T06:28:14.228 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:14.228 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T06:28:14.269 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T06:28:14.269 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-13 06:22:38.963142430 +0000 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-13 06:22:38.727144538 +0000 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-13 06:22:38.727144538 +0000 2024-09-13T06:28:14.317 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-13T06:28:14.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T06:28:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-13T06:28:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-13T06:28:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000407518 s, 1.3 MB/s 2024-09-13T06:28:14.372 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T06:28:14.424 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-13T06:28:14.473 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T06:28:14.473 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:14.473 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-13T06:28:14.473 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:14.474 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-13 06:22:39.463137963 +0000 2024-09-13T06:28:14.474 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-13 06:22:39.235140000 +0000 2024-09-13T06:28:14.474 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-13 06:22:39.235140000 +0000 2024-09-13T06:28:14.474 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-13T06:28:14.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T06:28:14.528 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-13T06:28:14.528 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-13T06:28:14.528 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000439721 s, 1.2 MB/s 2024-09-13T06:28:14.529 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T06:28:14.582 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-13T06:28:14.629 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T06:28:14.629 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:14.629 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-13T06:28:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-13 06:22:39.935133747 +0000 2024-09-13T06:28:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-13 06:22:39.691135927 +0000 2024-09-13T06:28:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-13 06:22:39.691135927 +0000 2024-09-13T06:28:14.630 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-13T06:28:14.630 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T06:28:14.683 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-13T06:28:14.683 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-13T06:28:14.683 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000365768 s, 1.4 MB/s 2024-09-13T06:28:14.685 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T06:28:14.734 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-13T06:28:14.780 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T06:28:14.780 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:14.781 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-13T06:28:14.781 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:14.781 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-13 06:22:40.427129353 +0000 2024-09-13T06:28:14.781 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-13 06:22:40.167131675 +0000 2024-09-13T06:28:14.781 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-13 06:22:40.167131675 +0000 2024-09-13T06:28:14.781 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-13T06:28:14.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T06:28:14.834 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-13T06:28:14.835 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-13T06:28:14.835 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000392583 s, 1.3 MB/s 2024-09-13T06:28:14.836 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T06:28:14.886 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T06:28:14.886 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:14.886 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T06:28:14.892 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T06:28:14.892 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-13 06:22:40.048743547 +0000 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-13 06:22:39.772746012 +0000 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-13 06:22:39.772746012 +0000 2024-09-13T06:28:14.940 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-13T06:28:14.941 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T06:28:14.994 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-13T06:28:14.994 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-13T06:28:14.994 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000457113 s, 1.1 MB/s 2024-09-13T06:28:14.996 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T06:28:15.046 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-13T06:28:15.091 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T06:28:15.091 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:15.092 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-13T06:28:15.092 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:15.092 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-13 06:22:40.552739046 +0000 2024-09-13T06:28:15.092 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-13 06:22:40.280741474 +0000 2024-09-13T06:28:15.092 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-13 06:22:40.280741474 +0000 2024-09-13T06:28:15.092 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-13T06:28:15.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T06:28:15.146 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-13T06:28:15.146 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-13T06:28:15.146 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.00042828 s, 1.2 MB/s 2024-09-13T06:28:15.147 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T06:28:15.197 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-13T06:28:15.243 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T06:28:15.243 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:15.243 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-13T06:28:15.244 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:15.244 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-13 06:22:41.040734686 +0000 2024-09-13T06:28:15.244 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-13 06:22:40.768737116 +0000 2024-09-13T06:28:15.244 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-13 06:22:40.768737116 +0000 2024-09-13T06:28:15.244 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-13T06:28:15.244 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T06:28:15.298 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-13T06:28:15.298 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-13T06:28:15.298 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000367613 s, 1.4 MB/s 2024-09-13T06:28:15.299 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T06:28:15.350 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-13T06:28:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T06:28:15.399 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:28:15.399 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-13T06:28:15.399 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:28:15.400 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-13 06:22:41.556730077 +0000 2024-09-13T06:28:15.400 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-13 06:22:41.304732328 +0000 2024-09-13T06:28:15.400 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-13 06:22:41.304732328 +0000 2024-09-13T06:28:15.400 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-13T06:28:15.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T06:28:15.455 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-13T06:28:15.456 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-13T06:28:15.456 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.00038217 s, 1.3 MB/s 2024-09-13T06:28:15.457 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T06:28:15.504 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:28:15.505 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T06:28:15.505 INFO:tasks.ceph:Generating config... 2024-09-13T06:28:15.506 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T06:28:15.506 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T06:28:15.506 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T06:28:15.506 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T06:28:15.506 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T06:28:15.506 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T06:28:15.506 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T06:28:15.506 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T06:28:15.507 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T06:28:15.507 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T06:28:15.508 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T06:28:15.508 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T06:28:15.508 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T06:28:15.508 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T06:28:15.508 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T06:28:15.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T06:28:15.543 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T06:28:15.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T06:28:15.635 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:28:15.688 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112')] 2024-09-13T06:28:15.689 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T06:28:15.689 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:15.689 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T06:28:15.738 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:15.812 INFO:teuthology.orchestra.run.smithi112.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:28:15.812 INFO:teuthology.orchestra.run.smithi112.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:28:15.813 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:15.813 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 80dec8ae-a3b9-43d1-a264-f2d38c8a985d 2024-09-13T06:28:15.813 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = quincy 2024-09-13T06:28:15.813 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2024-09-13T06:28:15.813 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 80dec8ae-a3b9-43d1-a264-f2d38c8a985d 2024-09-13T06:28:15.813 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2024-09-13T06:28:15.818029+0000 2024-09-13T06:28:15.814 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-13T06:28:15.818029+0000 2024-09-13T06:28:15.814 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 17 (quincy) 2024-09-13T06:28:15.814 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2024-09-13T06:28:15.814 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2024-09-13T06:28:15.814 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T06:28:15.815 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T06:28:15.861 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 80dec8ae-a3b9-43d1-a264-f2d38c8a985d... 2024-09-13T06:28:15.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T06:28:15.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T06:28:15.934 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-13T06:28:15.934 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-13T06:28:15.935 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-13T06:28:15.936 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.937 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = 172.21.15.112 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 80dec8ae-a3b9-43d1-a264-f2d38c8a985d 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-13T06:28:15.938 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.939 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-13T06:28:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-13T06:28:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-13T06:28:15.940 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: debug objclass = 20 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-13T06:28:15.941 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:28:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-13T06:28:15.943 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.944 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: rgw gc obj min wait = 15 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: debug rgw = 20 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: setgroup = ceph 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout: setuser = ceph 2024-09-13T06:28:15.945 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-13T06:28:15.947 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-13T06:28:15.947 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-13T06:28:15.947 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T06:28:15.947 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-13T06:28:15.947 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.947 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-13T06:28:15.948 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-13T06:28:15.949 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-13T06:28:15.950 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = 172.21.15.112 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 80dec8ae-a3b9-43d1-a264-f2d38c8a985d 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.951 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-13T06:28:15.952 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: debug objclass = 20 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-09-13T06:28:15.953 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-13T06:28:15.954 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-13T06:28:15.955 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-13T06:28:15.956 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: rgw gc obj min wait = 15 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: debug rgw = 20 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: setgroup = ceph 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout: setuser = ceph 2024-09-13T06:28:15.957 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-13T06:28:15.958 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T06:28:15.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T06:28:16.037 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T06:28:16.037 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:16.037 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T06:28:16.042 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:16.042 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T06:28:16.088 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-13T06:28:16.089 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:16.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T06:28:16.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:28:16.152 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:16.153 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:16.201 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:28:16.201 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:16.201 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T06:28:16.201 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:28:16.224 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:16.224 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:16.271 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T06:28:16.271 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T06:28:16.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T06:28:16.356 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T06:28:16.364 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T06:28:16.364 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T06:28:16.364 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T06:28:16.440 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T06:28:16.451 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T06:28:16.451 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T06:28:16.451 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T06:28:16.465 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T06:28:16.465 INFO:tasks.ceph:role: osd.0 2024-09-13T06:28:16.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-13T06:28:16.466 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:28:16.529 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:28:16.983 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-13T06:28:16.984 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-13T06:28:16.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T06:28:17.081 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T06:28:17.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:28:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:28:17.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:17.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:17.189+0000 7f44b90a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T06:28:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:17.197+0000 7f44b90a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T06:28:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:17.197+0000 7f44b90a47c0 -1 bdev(0x564935215800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T06:28:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:17.197+0000 7f44b90a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T06:28:20.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T06:28:20.603 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T06:28:20.617 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:28:20.617 INFO:tasks.ceph:role: osd.1 2024-09-13T06:28:20.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:28:20.617 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T06:28:20.679 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:28:20.679 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:28:20.679 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:28:20.679 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:28:20.679 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:28:20.680 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:28:20.680 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:28:20.680 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:28:20.680 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:28:20.680 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:28:21.129 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-13T06:28:21.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-13T06:28:21.132 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T06:28:21.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T06:28:21.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:28:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:28:21.258 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T06:28:21.310 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:28:21.311 INFO:tasks.ceph:role: osd.2 2024-09-13T06:28:21.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:28:21.311 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:28:21.377 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:28:21.378 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:28:21.839 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-13T06:28:21.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-13T06:28:21.842 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T06:28:21.989 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T06:28:22.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:28:22.000 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:28:22.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T06:28:22.054 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:28:22.054 INFO:tasks.ceph:role: osd.3 2024-09-13T06:28:22.054 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:28:22.054 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T06:28:22.117 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:28:22.117 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:28:22.117 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:28:22.117 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:28:22.117 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:28:22.118 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:28:22.118 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:28:22.118 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:28:22.118 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:28:22.118 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:28:22.610 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-13T06:28:22.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-13T06:28:22.612 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T06:28:22.740 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T06:28:22.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:28:22.751 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:28:22.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:22.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:22.857+0000 7f1be93917c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T06:28:22.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:22.857+0000 7f1be93917c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T06:28:22.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:22.857+0000 7f1be93917c0 -1 bdev(0x559c4eb5d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T06:28:22.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:22.857+0000 7f1be93917c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T06:28:25.975 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T06:28:25.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:26.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:26.065+0000 7ff006f587c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T06:28:26.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:26.065+0000 7ff006f587c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T06:28:26.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:26.065+0000 7ff006f587c0 -1 bdev(0x55cd44f1b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T06:28:26.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:26.065+0000 7ff006f587c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T06:28:29.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T06:28:29.287 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:29.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:29.365+0000 7f959d6dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T06:28:29.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:29.365+0000 7f959d6dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T06:28:29.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:29.365+0000 7f959d6dc7c0 -1 bdev(0x55e203a31800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T06:28:29.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:29.365+0000 7f959d6dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T06:28:32.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T06:28:32.596 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T06:28:32.596 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:32.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T06:28:32.610 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:32.610 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T06:28:32.651 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:32.651 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T06:28:32.706 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:32.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T06:28:32.763 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:32.763 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T06:28:32.818 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:32.818 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T06:28:32.867 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T06:28:32.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCB2+Nmi7N+CxAAgSgsG59IZuunu5OAKArsJQ== 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCA2+NmMMRdFRAAFigtdk7fKMmySjyxidxWmQ== 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCG2+NmtkhoMxAA0RAZ14B7T3jsh85LxRRiJA== 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCK2+NmBsY3BBAA+EecDEVULBqr/Sr03AR2Hw== 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCN2+NmfiQUFhAAujJgDxDHYT2wdxhJia2Nuw== 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-13T06:28:32.880 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCA2+NmoNhTGhAAOmjVL6fJtbRJ+pXyfCq3Zw== 2024-09-13T06:28:32.881 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:28:32.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T06:28:33.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:28:33.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:28:33.220 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:28:33.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T06:28:33.393 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T06:28:33.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T06:28:33.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T06:28:33.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T06:28:33.504 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:28:33.551 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T06:28:33.552 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T06:28:33.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T06:28:33.597 INFO:tasks.ceph.mon.a:Started 2024-09-13T06:28:33.597 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T06:28:33.597 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T06:28:33.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T06:28:33.600 INFO:tasks.ceph.mgr.x:Started 2024-09-13T06:28:33.600 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T06:28:33.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2ccd8f6640 1 Processor -- start 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2ccd8f6640 1 -- start start 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2ccd8f6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2cc812e6f0 0x7f2cc812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2ccd8f6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc8098d50 con 0x7f2cc812f1c0 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2ccd8f6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc806eba0 con 0x7f2cc812e6f0 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2cc6ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2cc812e6f0 0x7f2cc812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2cbe7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2cc812f1c0 0x7f2cc812b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35972/0 (socket says 172.21.15.112:35972) 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2cbe7fc640 1 -- 172.21.15.112:0/3426541670 learned_addr learned my addr 172.21.15.112:0/3426541670 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:33.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.717+0000 7f2cc6ffd640 1 --2- 172.21.15.112:0/3426541670 >> v2:172.21.15.112:3300/0 conn(0x7f2cc812e6f0 0x7f2cc812ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56008/0 (socket says 172.21.15.112:56008) 2024-09-13T06:28:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.733+0000 7f2cc67fc640 1 -- 172.21.15.112:0/3426541670 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568691694 0 0) 0x7f2cb0001120 con 0x7f2cc812f1c0 2024-09-13T06:28:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.733+0000 7f2cc67fc640 1 -- 172.21.15.112:0/3426541670 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb4003530 con 0x7f2cc812f1c0 2024-09-13T06:28:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.733+0000 7f2cc6ffd640 1 -- 172.21.15.112:0/3426541670 >> v1:172.21.15.112:6789/0 conn(0x7f2cc812f1c0 legacy=0x7f2cc812b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.733+0000 7f2cc6ffd640 1 -- 172.21.15.112:0/3426541670 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc806ed60 con 0x7f2cc812e6f0 2024-09-13T06:28:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2cc6ffd640 1 --2- 172.21.15.112:0/3426541670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc812ec80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009740 tx=0x7f2cb801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf673858860c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2cc67fc640 1 -- 172.21.15.112:0/3426541670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb80b0070 con 0x7f2cc812e6f0 2024-09-13T06:28:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2cc67fc640 1 -- 172.21.15.112:0/3426541670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb80ab530 con 0x7f2cc812e6f0 2024-09-13T06:28:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2cc67fc640 1 -- 172.21.15.112:0/3426541670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb80ab810 con 0x7f2cc812e6f0 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/3426541670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 msgr2=0x7f2cc812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 --2- 172.21.15.112:0/3426541670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc812ec80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009740 tx=0x7f2cb801c370 comp rx=0 tx=0).stop 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/3426541670 shutdown_connections 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 --2- 172.21.15.112:0/3426541670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc812ec80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/3426541670 >> 172.21.15.112:0/3426541670 conn(0x7f2cc80a1030 msgr2=0x7f2cc80a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/3426541670 shutdown_connections 2024-09-13T06:28:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/3426541670 wait complete. 2024-09-13T06:28:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 Processor -- start 2024-09-13T06:28:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.737+0000 7f2ccd8f6640 1 -- start start 2024-09-13T06:28:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2ccd8f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc8130990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2ccd8f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8137610 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc8130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc8130990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56014/0 (socket says 172.21.15.112:56014) 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc6ffd640 1 -- 172.21.15.112:0/2809426702 learned_addr learned my addr 172.21.15.112:0/2809426702 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc6ffd640 1 -- 172.21.15.112:0/2809426702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc8132de0 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc6ffd640 1 --2- 172.21.15.112:0/2809426702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc8130990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8018f80 tx=0x7f2cb8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb80b8070 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb80aca20 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc81332a0 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb80b0040 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc81310a0 con 0x7f2cc812e6f0 2024-09-13T06:28:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2cb80bb070 con 0x7f2cc812e6f0 2024-09-13T06:28:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2cb80bd790 con 0x7f2cc812e6f0 2024-09-13T06:28:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.741+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc8132170 con 0x7f2cc812e6f0 2024-09-13T06:28:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.745+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2cb8015ff0 con 0x7f2cc812e6f0 2024-09-13T06:28:33.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.809+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2cc812ec80 con 0x7f2cc812e6f0 2024-09-13T06:28:33.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2cc4ff9640 1 -- 172.21.15.112:0/2809426702 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2cb80acd00 con 0x7f2cc812e6f0 2024-09-13T06:28:33.808 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 msgr2=0x7f2cc8130990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 --2- 172.21.15.112:0/2809426702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc8130990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8018f80 tx=0x7f2cb8019110 comp rx=0 tx=0).stop 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 shutdown_connections 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 --2- 172.21.15.112:0/2809426702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc812e6f0 0x7f2cc8130990 secure :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8018f80 tx=0x7f2cb8019110 comp rx=0 tx=0).stop 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 >> 172.21.15.112:0/2809426702 conn(0x7f2cc80a1030 msgr2=0x7f2cc809b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 shutdown_connections 2024-09-13T06:28:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:33.813+0000 7f2ccd8f6640 1 -- 172.21.15.112:0/2809426702 wait complete. 2024-09-13T06:28:33.825 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T06:28:33.825 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T06:28:33.825 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-13T06:28:33.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T06:28:33.837 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:33.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T06:28:33.851 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:33.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T06:28:33.906 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-13T06:28:33.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T06:28:33.916 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:33.913+0000 7f479d999180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T06:28:33.927 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new ec3bcd50-e4f1-4997-81f9-56e0d140212c 0 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4be669640 1 Processor -- start 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4be669640 1 -- start start 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4be669640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe4b8110b60 0x7fe4b806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4be669640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b806d000 con 0x7fe4b806cae0 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4be669640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b806d1d0 con 0x7fe4b8110b60 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4b7fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe4b8110b60 0x7fe4b806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4b7fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe4b8110b60 0x7fe4b806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33386/0 (socket says 172.21.15.169:33386) 2024-09-13T06:28:34.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4b7fff640 1 -- 172.21.15.169:0/117926940 learned_addr learned my addr 172.21.15.169:0/117926940 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:34.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4af7fe640 1 --1- 172.21.15.169:0/117926940 >> v1:172.21.15.112:6789/0 conn(0x7fe4b806cae0 0x7fe4b811c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:44216/0 (socket says 172.21.15.169:44216) 2024-09-13T06:28:34.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4b7fff640 1 -- 172.21.15.169:0/117926940 >> v1:172.21.15.112:6789/0 conn(0x7fe4b806cae0 legacy=0x7fe4b811c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.089+0000 7fe4b7fff640 1 -- 172.21.15.169:0/117926940 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b811eb30 con 0x7fe4b8110b60 2024-09-13T06:28:34.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4b7fff640 1 --2- 172.21.15.169:0/117926940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b8110b60 0x7fe4b806c4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097f0 tx=0x7fe4a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432d8773b77ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4b77fe640 1 -- 172.21.15.169:0/117926940 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a80b0070 con 0x7fe4b8110b60 2024-09-13T06:28:34.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4b77fe640 1 -- 172.21.15.169:0/117926940 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a80ab530 con 0x7fe4b8110b60 2024-09-13T06:28:34.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4b77fe640 1 -- 172.21.15.169:0/117926940 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a80ab830 con 0x7fe4b8110b60 2024-09-13T06:28:34.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 -- 172.21.15.169:0/117926940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b8110b60 msgr2=0x7fe4b806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 --2- 172.21.15.169:0/117926940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b8110b60 0x7fe4b806c4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097f0 tx=0x7fe4a801c430 comp rx=0 tx=0).stop 2024-09-13T06:28:34.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 -- 172.21.15.169:0/117926940 shutdown_connections 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 --2- 172.21.15.169:0/117926940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b8110b60 0x7fe4b806c4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 -- 172.21.15.169:0/117926940 >> 172.21.15.169:0/117926940 conn(0x7fe4b806fff0 msgr2=0x7fe4b8072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 -- 172.21.15.169:0/117926940 shutdown_connections 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 -- 172.21.15.169:0/117926940 wait complete. 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 Processor -- start 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.093+0000 7fe4be669640 1 -- start start 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4be669640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 0x7fe4b81af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4be669640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b811e7f0 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 0x7fe4b81af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 0x7fe4b81af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33402/0 (socket says 172.21.15.169:33402) 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b7fff640 1 -- 172.21.15.169:0/3685399212 learned_addr learned my addr 172.21.15.169:0/3685399212 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b7fff640 1 -- 172.21.15.169:0/3685399212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b81af6a0 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b7fff640 1 --2- 172.21.15.169:0/3685399212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 0x7fe4b81af0d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8019040 tx=0x7fe4a80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a80bb070 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b81af8d0 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a80aa820 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a80b0040 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b81a9170 con 0x7fe4b806cae0 2024-09-13T06:28:34.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4a80be070 con 0x7fe4b806cae0 2024-09-13T06:28:34.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe4a80c0d20 con 0x7fe4b806cae0 2024-09-13T06:28:34.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.097+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b806c560 con 0x7fe4b806cae0 2024-09-13T06:28:34.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.105+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe4a80c5020 con 0x7fe4b806cae0 2024-09-13T06:28:34.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.173+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec3bcd50-e4f1-4997-81f9-56e0d140212c", "id": 0} v 0) -- 0x7fe4b8110b60 con 0x7fe4b806cae0 2024-09-13T06:28:34.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.173+0000 7fe4b57fa640 1 -- 172.21.15.169:0/3685399212 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec3bcd50-e4f1-4997-81f9-56e0d140212c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe4a80160b0 con 0x7fe4b806cae0 2024-09-13T06:28:34.178 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 msgr2=0x7fe4b81af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 --2- 172.21.15.169:0/3685399212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 0x7fe4b81af0d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8019040 tx=0x7fe4a80191d0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 shutdown_connections 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 --2- 172.21.15.169:0/3685399212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4b806cae0 0x7fe4b81af0d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 >> 172.21.15.169:0/3685399212 conn(0x7fe4b806fff0 msgr2=0x7fe4b8119c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 shutdown_connections 2024-09-13T06:28:34.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.177+0000 7fe4be669640 1 -- 172.21.15.169:0/3685399212 wait complete. 2024-09-13T06:28:34.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7 1 2024-09-13T06:28:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e2dffb640 1 Processor -- start 2024-09-13T06:28:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e2dffb640 1 -- start start 2024-09-13T06:28:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e2dffb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e2806d4b0 0x7f2e2806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e2dffb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2806e280 con 0x7f2e2806ddd0 2024-09-13T06:28:34.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e2dffb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2e2811e940 con 0x7f2e2806d4b0 2024-09-13T06:28:34.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e277fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e2806d4b0 0x7f2e2806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e26ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2e2806ddd0 0x7f2e2811c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:44228/0 (socket says 172.21.15.169:44228) 2024-09-13T06:28:34.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e26ffd640 1 -- 172.21.15.169:0/2328474526 learned_addr learned my addr 172.21.15.169:0/2328474526 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:28:34.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e277fe640 1 -- 172.21.15.169:0/2328474526 >> v1:172.21.15.112:6789/0 conn(0x7f2e2806ddd0 legacy=0x7f2e2811c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.317+0000 7f2e277fe640 1 -- 172.21.15.169:0/2328474526 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2811eac0 con 0x7f2e2806d4b0 2024-09-13T06:28:34.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e277fe640 1 --2- 172.21.15.169:0/2328474526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e2806d890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009740 tx=0x7f2e1801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec952988b79b0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e267fc640 1 -- 172.21.15.169:0/2328474526 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e180b1070 con 0x7f2e2806d4b0 2024-09-13T06:28:34.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e267fc640 1 -- 172.21.15.169:0/2328474526 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e180ac520 con 0x7f2e2806d4b0 2024-09-13T06:28:34.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e267fc640 1 -- 172.21.15.169:0/2328474526 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e180ac820 con 0x7f2e2806d4b0 2024-09-13T06:28:34.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- 172.21.15.169:0/2328474526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 msgr2=0x7f2e2806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 --2- 172.21.15.169:0/2328474526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e2806d890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009740 tx=0x7f2e1801c370 comp rx=0 tx=0).stop 2024-09-13T06:28:34.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- 172.21.15.169:0/2328474526 shutdown_connections 2024-09-13T06:28:34.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 --2- 172.21.15.169:0/2328474526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e2806d890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- 172.21.15.169:0/2328474526 >> 172.21.15.169:0/2328474526 conn(0x7f2e28071360 msgr2=0x7f2e28073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- 172.21.15.169:0/2328474526 shutdown_connections 2024-09-13T06:28:34.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- 172.21.15.169:0/2328474526 wait complete. 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 Processor -- start 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- start start 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e281aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.321+0000 7f2e2dffb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2811e5c0 con 0x7f2e2806d4b0 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e277fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e281aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e277fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e281aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33426/0 (socket says 172.21.15.169:33426) 2024-09-13T06:28:34.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e277fe640 1 -- 172.21.15.169:0/4144528829 learned_addr learned my addr 172.21.15.169:0/4144528829 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:34.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e277fe640 1 -- 172.21.15.169:0/4144528829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e281af4d0 con 0x7f2e2806d4b0 2024-09-13T06:28:34.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e277fe640 1 --2- 172.21.15.169:0/4144528829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e281aef00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e180af040 tx=0x7f2e1801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e180b1050 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e281af700 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e180b2040 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e281a8fa0 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e180aba00 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e180abc20 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2e180bd070 con 0x7f2e2806d4b0 2024-09-13T06:28:34.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.325+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2806d890 con 0x7f2e2806d4b0 2024-09-13T06:28:34.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.333+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e180a9070 con 0x7f2e2806d4b0 2024-09-13T06:28:34.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.401+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7", "id": 1} v 0) -- 0x7f2e2806ddd0 con 0x7f2e2806d4b0 2024-09-13T06:28:34.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e1ffff640 1 -- 172.21.15.169:0/4144528829 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2e18015ff0 con 0x7f2e2806d4b0 2024-09-13T06:28:34.409 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 msgr2=0x7f2e281aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 --2- 172.21.15.169:0/4144528829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e281aef00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e180af040 tx=0x7f2e1801abb0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 shutdown_connections 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 --2- 172.21.15.169:0/4144528829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e2806d4b0 0x7f2e281aef00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 >> 172.21.15.169:0/4144528829 conn(0x7f2e28071360 msgr2=0x7f2e281198e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 shutdown_connections 2024-09-13T06:28:34.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.405+0000 7f2e2dffb640 1 -- 172.21.15.169:0/4144528829 wait complete. 2024-09-13T06:28:34.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 671f8491-70ba-44a6-a22f-17f0501b8378 2 2024-09-13T06:28:34.453 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:34.449+0000 7f479d999180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f122a37a640 1 Processor -- start 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f122a37a640 1 -- start start 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f122a37a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1224112010 0x7f12241123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f122a37a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1224112ab0 con 0x7f1224117c60 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f122a37a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1224118820 con 0x7f1224112010 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f1223fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1224112010 0x7f12241123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f1223fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1224112010 0x7f12241123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33442/0 (socket says 172.21.15.169:33442) 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f12237fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1224117c60 0x7f1224118110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:44234/0 (socket says 172.21.15.169:44234) 2024-09-13T06:28:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f1223fff640 1 -- 172.21.15.169:0/1661357929 learned_addr learned my addr 172.21.15.169:0/1661357929 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:34.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f1223fff640 1 -- 172.21.15.169:0/1661357929 >> v1:172.21.15.112:6789/0 conn(0x7f1224117c60 legacy=0x7f1224118110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.545+0000 7f1223fff640 1 -- 172.21.15.169:0/1661357929 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12241189d0 con 0x7f1224112010 2024-09-13T06:28:34.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f1223fff640 1 --2- 172.21.15.169:0/1661357929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241123f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1218009e50 tx=0x7f121801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6172d20dece6b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f1222ffd640 1 -- 172.21.15.169:0/1661357929 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1218009200 con 0x7f1224112010 2024-09-13T06:28:34.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f1222ffd640 1 -- 172.21.15.169:0/1661357929 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12180a56d0 con 0x7f1224112010 2024-09-13T06:28:34.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f1222ffd640 1 -- 172.21.15.169:0/1661357929 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12180a59d0 con 0x7f1224112010 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- 172.21.15.169:0/1661357929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 msgr2=0x7f12241123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 --2- 172.21.15.169:0/1661357929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241123f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1218009e50 tx=0x7f121801c980 comp rx=0 tx=0).stop 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- 172.21.15.169:0/1661357929 shutdown_connections 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 --2- 172.21.15.169:0/1661357929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241123f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- 172.21.15.169:0/1661357929 >> 172.21.15.169:0/1661357929 conn(0x7f122406e660 msgr2=0x7f122406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- 172.21.15.169:0/1661357929 shutdown_connections 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- 172.21.15.169:0/1661357929 wait complete. 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 Processor -- start 2024-09-13T06:28:34.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- start start 2024-09-13T06:28:34.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.549+0000 7f122a37a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1224120950 con 0x7f1224112010 2024-09-13T06:28:34.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1223fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1223fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33446/0 (socket says 172.21.15.169:33446) 2024-09-13T06:28:34.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1223fff640 1 -- 172.21.15.169:0/2054072779 learned_addr learned my addr 172.21.15.169:0/2054072779 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:34.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1223fff640 1 -- 172.21.15.169:0/2054072779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12241af600 con 0x7f1224112010 2024-09-13T06:28:34.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1223fff640 1 --2- 172.21.15.169:0/2054072779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241af030 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1218019590 tx=0x7f1218019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12180bc020 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1218007980 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12241af830 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1218009510 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12241a90d0 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f12180bf020 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f12180b6860 con 0x7f1224112010 2024-09-13T06:28:34.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.553+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1224112470 con 0x7f1224112010 2024-09-13T06:28:34.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.561+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f12180c6030 con 0x7f1224112010 2024-09-13T06:28:34.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.629+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "671f8491-70ba-44a6-a22f-17f0501b8378", "id": 2} v 0) -- 0x7f1224117c60 con 0x7f1224112010 2024-09-13T06:28:34.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f1220ff9640 1 -- 172.21.15.169:0/2054072779 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "671f8491-70ba-44a6-a22f-17f0501b8378", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1218016600 con 0x7f1224112010 2024-09-13T06:28:34.637 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 msgr2=0x7f12241af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 --2- 172.21.15.169:0/2054072779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241af030 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1218019590 tx=0x7f1218019720 comp rx=0 tx=0).stop 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 shutdown_connections 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 --2- 172.21.15.169:0/2054072779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1224112010 0x7f12241af030 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 >> 172.21.15.169:0/2054072779 conn(0x7f122406e660 msgr2=0x7f1224115e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 shutdown_connections 2024-09-13T06:28:34.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.633+0000 7f122a37a640 1 -- 172.21.15.169:0/2054072779 wait complete. 2024-09-13T06:28:34.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 8ef95871-b245-4c2f-be69-6cd8c52f9019 3 2024-09-13T06:28:34.666 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:34.661+0000 7f479d999180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T06:28:34.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34bb882640 1 Processor -- start 2024-09-13T06:28:34.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34bb882640 1 -- start start 2024-09-13T06:28:34.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34bb882640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34b41170b0 0x7f34b41194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34bb882640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b4119a70 con 0x7f34b41144a0 2024-09-13T06:28:34.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34bb882640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34b411ac70 con 0x7f34b41170b0 2024-09-13T06:28:34.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34b8e1d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34b41170b0 0x7f34b41194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34b961e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f34b41144a0 0x7f34b4114880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:44236/0 (socket says 172.21.15.169:44236) 2024-09-13T06:28:34.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34b961e640 1 -- 172.21.15.169:0/3521377278 learned_addr learned my addr 172.21.15.169:0/3521377278 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:28:34.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.777+0000 7f34b8e1d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34b41170b0 0x7f34b41194a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33460/0 (socket says 172.21.15.169:33460) 2024-09-13T06:28:34.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.781+0000 7f34b8e1d640 1 -- 172.21.15.169:0/3521377278 >> v1:172.21.15.112:6789/0 conn(0x7f34b41144a0 legacy=0x7f34b4114880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.781+0000 7f34b8e1d640 1 -- 172.21.15.169:0/3521377278 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b411ae20 con 0x7f34b41170b0 2024-09-13T06:28:34.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.781+0000 7f34b8e1d640 1 --2- 172.21.15.169:0/3521377278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41170b0 0x7f34b41194a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34a400a8e0 tx=0x7f34a401d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f0fa8a67df0cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.781+0000 7f34abfff640 1 -- 172.21.15.169:0/3521377278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34a40b3070 con 0x7f34b41170b0 2024-09-13T06:28:34.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.781+0000 7f34abfff640 1 -- 172.21.15.169:0/3521377278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a40a66e0 con 0x7f34b41170b0 2024-09-13T06:28:34.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.781+0000 7f34abfff640 1 -- 172.21.15.169:0/3521377278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34a400b040 con 0x7f34b41170b0 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/3521377278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41170b0 msgr2=0x7f34b41194a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 --2- 172.21.15.169:0/3521377278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41170b0 0x7f34b41194a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34a400a8e0 tx=0x7f34a401d740 comp rx=0 tx=0).stop 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/3521377278 shutdown_connections 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 --2- 172.21.15.169:0/3521377278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41170b0 0x7f34b41194a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/3521377278 >> 172.21.15.169:0/3521377278 conn(0x7f34b406f840 msgr2=0x7f34b4071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/3521377278 shutdown_connections 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/3521377278 wait complete. 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 Processor -- start 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- start start 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 0x7f34b41a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:34.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34b411a970 con 0x7f34b41144a0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34b961e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 0x7f34b41a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34b961e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 0x7f34b41a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:33462/0 (socket says 172.21.15.169:33462) 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34b961e640 1 -- 172.21.15.169:0/2581808880 learned_addr learned my addr 172.21.15.169:0/2581808880 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34b961e640 1 -- 172.21.15.169:0/2581808880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b41a7fa0 con 0x7f34b41144a0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34b961e640 1 --2- 172.21.15.169:0/2581808880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 0x7f34b41a7a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c3b0 tx=0x7f34b000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0005c20 con 0x7f34b41144a0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b41a8230 con 0x7f34b41144a0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0005dc0 con 0x7f34b41144a0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0004940 con 0x7f34b41144a0 2024-09-13T06:28:34.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b41ac170 con 0x7f34b41144a0 2024-09-13T06:28:34.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34b001a020 con 0x7f34b41144a0 2024-09-13T06:28:34.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f34b0005600 con 0x7f34b41144a0 2024-09-13T06:28:34.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.785+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4114880 con 0x7f34b41144a0 2024-09-13T06:28:34.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.793+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f34b0021070 con 0x7f34b41144a0 2024-09-13T06:28:34.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.861+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ef95871-b245-4c2f-be69-6cd8c52f9019", "id": 3} v 0) -- 0x7f34b4117080 con 0x7f34b41144a0 2024-09-13T06:28:34.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34a9ffb640 1 -- 172.21.15.169:0/2581808880 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ef95871-b245-4c2f-be69-6cd8c52f9019", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f34b0005030 con 0x7f34b41144a0 2024-09-13T06:28:34.871 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 msgr2=0x7f34b41a7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 --2- 172.21.15.169:0/2581808880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 0x7f34b41a7a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c3b0 tx=0x7f34b000c870 comp rx=0 tx=0).stop 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 shutdown_connections 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 --2- 172.21.15.169:0/2581808880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34b41144a0 0x7f34b41a7a60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 >> 172.21.15.169:0/2581808880 conn(0x7f34b406f840 msgr2=0x7f34b4071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 shutdown_connections 2024-09-13T06:28:34.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:34.869+0000 7f34bb882640 1 -- 172.21.15.169:0/2581808880 wait complete. 2024-09-13T06:28:34.887 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T06:28:34.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T06:28:34.890 INFO:tasks.ceph.osd.0:Started 2024-09-13T06:28:34.890 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T06:28:34.890 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T06:28:34.892 INFO:tasks.ceph.osd.1:Started 2024-09-13T06:28:34.892 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T06:28:34.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T06:28:34.894 INFO:tasks.ceph.osd.2:Started 2024-09-13T06:28:34.895 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T06:28:34.895 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T06:28:34.897 INFO:tasks.ceph.osd.3:Started 2024-09-13T06:28:34.897 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:28:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e13489640 1 Processor -- start 2024-09-13T06:28:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e13489640 1 -- start start 2024-09-13T06:28:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e13489640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e0c06dbd0 0x7f2e0c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e13489640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0c071c10 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e13489640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c072230 con 0x7f2e0c06dbd0 2024-09-13T06:28:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e10a24640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e0c06dbd0 0x7f2e0c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e11225640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2e0c06d0e0 0x7f2e0c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35984/0 (socket says 172.21.15.112:35984) 2024-09-13T06:28:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e10a24640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e0c06dbd0 0x7f2e0c131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56020/0 (socket says 172.21.15.112:56020) 2024-09-13T06:28:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e11225640 1 -- 172.21.15.112:0/2304858976 learned_addr learned my addr 172.21.15.112:0/2304858976 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e10a24640 1 -- 172.21.15.112:0/2304858976 >> v1:172.21.15.112:6789/0 conn(0x7f2e0c06d0e0 legacy=0x7f2e0c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.021+0000 7f2e10a24640 1 -- 172.21.15.112:0/2304858976 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c0709e0 con 0x7f2e0c06dbd0 2024-09-13T06:28:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e10a24640 1 --2- 172.21.15.112:0/2304858976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06dbd0 0x7f2e0c131e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009740 tx=0x7f2e0801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5845bf9fb539a565 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e03fff640 1 -- 172.21.15.112:0/2304858976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e080b0070 con 0x7f2e0c06dbd0 2024-09-13T06:28:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e03fff640 1 -- 172.21.15.112:0/2304858976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e080ab530 con 0x7f2e0c06dbd0 2024-09-13T06:28:35.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e03fff640 1 -- 172.21.15.112:0/2304858976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e080ab830 con 0x7f2e0c06dbd0 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- 172.21.15.112:0/2304858976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06dbd0 msgr2=0x7f2e0c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 --2- 172.21.15.112:0/2304858976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06dbd0 0x7f2e0c131e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009740 tx=0x7f2e0801c370 comp rx=0 tx=0).stop 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- 172.21.15.112:0/2304858976 shutdown_connections 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 --2- 172.21.15.112:0/2304858976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06dbd0 0x7f2e0c131e60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- 172.21.15.112:0/2304858976 >> 172.21.15.112:0/2304858976 conn(0x7f2e0c099a50 msgr2=0x7f2e0c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- 172.21.15.112:0/2304858976 shutdown_connections 2024-09-13T06:28:35.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- 172.21.15.112:0/2304858976 wait complete. 2024-09-13T06:28:35.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 Processor -- start 2024-09-13T06:28:35.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- start start 2024-09-13T06:28:35.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 0x7f2e0c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e13489640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c134d40 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e11225640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 0x7f2e0c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e11225640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 0x7f2e0c06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56036/0 (socket says 172.21.15.112:56036) 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e11225640 1 -- 172.21.15.112:0/4048773555 learned_addr learned my addr 172.21.15.112:0/4048773555 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.025+0000 7f2e11225640 1 -- 172.21.15.112:0/4048773555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c096e90 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e11225640 1 --2- 172.21.15.112:0/4048773555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 0x7f2e0c06e1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c480 tx=0x7f2dfc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dfc017070 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc005c20 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dfc007070 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c06fb70 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c08b1a0 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2dfc01a070 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2dfc01cbf0 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0c06d4c0 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.029+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2dfc01c440 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e0c072710 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e01ffb640 1 -- 172.21.15.112:0/4048773555 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f2dfc01c620 con 0x7f2e0c06d0e0 2024-09-13T06:28:35.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:35.085 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":6,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:28:34.872562+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:28:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 msgr2=0x7f2e0c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 --2- 172.21.15.112:0/4048773555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 0x7f2e0c06e1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c480 tx=0x7f2dfc00c940 comp rx=0 tx=0).stop 2024-09-13T06:28:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 shutdown_connections 2024-09-13T06:28:35.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 --2- 172.21.15.112:0/4048773555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e0c06d0e0 0x7f2e0c06e1f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:35.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 >> 172.21.15.112:0/4048773555 conn(0x7f2e0c099a50 msgr2=0x7f2e0c12aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:35.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 shutdown_connections 2024-09-13T06:28:35.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:35.089+0000 7f2e13489640 1 -- 172.21.15.112:0/4048773555 wait complete. 2024-09-13T06:28:35.103 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T06:28:35.103 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T06:28:35.247 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.245+0000 7f479d999180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T06:28:35.301 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.297+0000 7f479d999180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T06:28:35.353 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.349+0000 7f479d999180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T06:28:35.430 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.425+0000 7f479d999180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T06:28:35.482 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.477+0000 7f479d999180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T06:28:35.506 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:28:35.559 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.557+0000 7f479d999180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T06:28:35.612 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.609+0000 7f479d999180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T06:28:35.627 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.629+0000 7f7fa6b10640 1 Processor -- start 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.629+0000 7f7fa6b10640 1 -- start start 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.629+0000 7f7fa6b10640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fa0131810 0x7f7fa0133c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.629+0000 7f7fa6b10640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa0098270 con 0x7f7fa0097780 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.629+0000 7f7fa6b10640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa009af60 con 0x7f7fa0131810 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa48ac640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7fa0097780 0x7f7fa0097b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35990/0 (socket says 172.21.15.112:35990) 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa48ac640 1 -- 172.21.15.112:0/3751220645 learned_addr learned my addr 172.21.15.112:0/3751220645 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:35.628 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9ffff640 1 --2- 172.21.15.112:0/3751220645 >> v2:172.21.15.112:3300/0 conn(0x7f7fa0131810 0x7f7fa0133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:35.629 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9f7fe640 1 -- 172.21.15.112:0/3751220645 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515870953 0 0) 0x7f7fa0098270 con 0x7f7fa0097780 2024-09-13T06:28:35.629 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9f7fe640 1 -- 172.21.15.112:0/3751220645 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f88003530 con 0x7f7fa0097780 2024-09-13T06:28:35.629 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9ffff640 1 -- 172.21.15.112:0/3751220645 >> v1:172.21.15.112:6789/0 conn(0x7f7fa0097780 legacy=0x7f7fa0097b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:35.629 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9ffff640 1 -- 172.21.15.112:0/3751220645 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa009b440 con 0x7f7fa0131810 2024-09-13T06:28:35.630 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9ffff640 1 --2- 172.21.15.112:0/3751220645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0131810 0x7f7fa0133c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009740 tx=0x7f7f9401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec291ba64d0bb45c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:35.630 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9f7fe640 1 -- 172.21.15.112:0/3751220645 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f940b1070 con 0x7f7fa0131810 2024-09-13T06:28:35.631 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9f7fe640 1 -- 172.21.15.112:0/3751220645 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f940ac520 con 0x7f7fa0131810 2024-09-13T06:28:35.631 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7f9f7fe640 1 -- 172.21.15.112:0/3751220645 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f940ac820 con 0x7f7fa0131810 2024-09-13T06:28:35.631 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 -- 172.21.15.112:0/3751220645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0131810 msgr2=0x7f7fa0133c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:35.631 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 --2- 172.21.15.112:0/3751220645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0131810 0x7f7fa0133c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009740 tx=0x7f7f9401c370 comp rx=0 tx=0).stop 2024-09-13T06:28:35.632 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 -- 172.21.15.112:0/3751220645 shutdown_connections 2024-09-13T06:28:35.632 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 --2- 172.21.15.112:0/3751220645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0131810 0x7f7fa0133c00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:35.632 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 -- 172.21.15.112:0/3751220645 >> 172.21.15.112:0/3751220645 conn(0x7f7fa00a0fd0 msgr2=0x7f7fa00a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:35.632 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 -- 172.21.15.112:0/3751220645 shutdown_connections 2024-09-13T06:28:35.632 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.633+0000 7f7fa6b10640 1 -- 172.21.15.112:0/3751220645 wait complete. 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 Processor -- start 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 -- start start 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 0x7f7fa01c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0136ae0 con 0x7f7fa0097780 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa48ac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 0x7f7fa01c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa48ac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 0x7f7fa01c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56054/0 (socket says 172.21.15.112:56054) 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa48ac640 1 -- 172.21.15.112:0/48579297 learned_addr learned my addr 172.21.15.112:0/48579297 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:35.633 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa48ac640 1 -- 172.21.15.112:0/48579297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa00728a0 con 0x7f7fa0097780 2024-09-13T06:28:35.634 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa48ac640 1 --2- 172.21.15.112:0/48579297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 0x7f7fa01c5f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000c450 tx=0x7f7f9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:35.634 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f90017070 con 0x7f7fa0097780 2024-09-13T06:28:35.634 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f90005c20 con 0x7f7fa0097780 2024-09-13T06:28:35.635 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa0126720 con 0x7f7fa0097780 2024-09-13T06:28:35.635 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f90007070 con 0x7f7fa0097780 2024-09-13T06:28:35.635 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa01c64c0 con 0x7f7fa0097780 2024-09-13T06:28:35.635 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f9001a070 con 0x7f7fa0097780 2024-09-13T06:28:35.635 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7f90007720 con 0x7f7fa0097780 2024-09-13T06:28:35.635 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.637+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa0097be0 con 0x7f7fa0097780 2024-09-13T06:28:35.636 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.641+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7f9001c440 con 0x7f7fa0097780 2024-09-13T06:28:35.697 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fa0073a50 con 0x7f7fa0097780 2024-09-13T06:28:35.698 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7f9d7fa640 1 -- 172.21.15.112:0/48579297 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f7f9001c680 con 0x7f7fa0097780 2024-09-13T06:28:35.698 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-13T06:28:35.698 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":6,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:28:34.872562+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 msgr2=0x7f7fa01c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 --2- 172.21.15.112:0/48579297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 0x7f7fa01c5f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000c450 tx=0x7f7f9000c910 comp rx=0 tx=0).stop 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 shutdown_connections 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 --2- 172.21.15.112:0/48579297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa0097780 0x7f7fa01c5f80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 >> 172.21.15.112:0/48579297 conn(0x7f7fa00a0fd0 msgr2=0x7f7fa01306b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 shutdown_connections 2024-09-13T06:28:35.699 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:35.701+0000 7f7fa6b10640 1 -- 172.21.15.112:0/48579297 wait complete. 2024-09-13T06:28:35.714 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T06:28:35.762 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.757+0000 7f479d999180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T06:28:35.823 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:35.821+0000 7f479d999180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T06:28:36.451 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-09-13T06:28:36.449+0000 7f99238d67c0 -1 Falling back to public interface 2024-09-13T06:28:36.480 INFO:tasks.ceph.mgr.x.smithi169.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T06:28:36.480 INFO:tasks.ceph.mgr.x.smithi169.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T06:28:36.480 INFO:tasks.ceph.mgr.x.smithi169.stderr: from numpy import show_config as show_numpy_config 2024-09-13T06:28:36.519 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-09-13T06:28:36.517+0000 7f829c97a7c0 -1 Falling back to public interface 2024-09-13T06:28:36.534 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:36.529+0000 7f479d999180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T06:28:36.662 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-13T06:28:36.665+0000 7f8e6e8707c0 -1 Falling back to public interface 2024-09-13T06:28:36.686 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:36.681+0000 7f479d999180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:28:36.865 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:36.861+0000 7f479d999180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T06:28:36.936 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:36.933+0000 7f479d999180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T06:28:37.016 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-09-13T06:28:37.013+0000 7fc56802a7c0 -1 Falling back to public interface 2024-09-13T06:28:37.080 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:37.077+0000 7f479d999180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:28:37.679 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:37.677+0000 7f479d999180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T06:28:37.754 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:37.749+0000 7f479d999180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T06:28:37.936 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:37.933+0000 7f479d999180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T06:28:38.009 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:38.005+0000 7f479d999180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T06:28:38.302 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:38.297+0000 7f479d999180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T06:28:38.364 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:38.361+0000 7f479d999180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T06:28:39.398 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-13T06:28:39.393+0000 7f47444d0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T06:28:40.998 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-13T06:28:41.001+0000 7f8e6e8707c0 -1 osd.0 0 log_to_monitors true 2024-09-13T06:28:41.234 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-09-13T06:28:41.229+0000 7f99238d67c0 -1 osd.3 0 log_to_monitors true 2024-09-13T06:28:41.365 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-09-13T06:28:41.361+0000 7f829c97a7c0 -1 osd.1 0 log_to_monitors true 2024-09-13T06:28:41.465 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-09-13T06:28:41.461+0000 7fc56802a7c0 -1 osd.2 0 log_to_monitors true 2024-09-13T06:28:42.118 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:28:42.240 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06b5662640 1 Processor -- start 2024-09-13T06:28:42.240 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06b5662640 1 -- start start 2024-09-13T06:28:42.241 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06b5662640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06b0094240 0x7f06b0094620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06b5662640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b0099590 con 0x7f06b0094b60 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06b5662640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f06b0098be0 con 0x7f06b0094240 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06aeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06b0094240 0x7f06b0094620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06aeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06b0094240 0x7f06b0094620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42650/0 (socket says 172.21.15.112:42650) 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06aeffd640 1 -- 172.21.15.112:0/1409598541 learned_addr learned my addr 172.21.15.112:0/1409598541 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06aeffd640 1 -- 172.21.15.112:0/1409598541 >> v1:172.21.15.112:6789/0 conn(0x7f06b0094b60 legacy=0x7f06b0132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06aeffd640 1 -- 172.21.15.112:0/1409598541 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b0096680 con 0x7f06b0094240 2024-09-13T06:28:42.242 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06adffb640 1 -- 172.21.15.112:0/1409598541 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202220922 0 0) 0x7f06b0099590 con 0x7f06b0094b60 2024-09-13T06:28:42.243 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06aeffd640 1 --2- 172.21.15.112:0/1409598541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0094620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009820 tx=0x7f06a401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f0319808d2e009 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:42.243 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.245+0000 7f06adffb640 1 -- 172.21.15.112:0/1409598541 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a40b0070 con 0x7f06b0094240 2024-09-13T06:28:42.243 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06adffb640 1 -- 172.21.15.112:0/1409598541 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a40ab530 con 0x7f06b0094240 2024-09-13T06:28:42.244 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06adffb640 1 -- 172.21.15.112:0/1409598541 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a40ab830 con 0x7f06b0094240 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/1409598541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 msgr2=0x7f06b0094620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 --2- 172.21.15.112:0/1409598541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0094620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009820 tx=0x7f06a401c3b0 comp rx=0 tx=0).stop 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/1409598541 shutdown_connections 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 --2- 172.21.15.112:0/1409598541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0094620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/1409598541 >> 172.21.15.112:0/1409598541 conn(0x7f06b0099c40 msgr2=0x7f06b009a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/1409598541 shutdown_connections 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/1409598541 wait complete. 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 Processor -- start 2024-09-13T06:28:42.245 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- start start 2024-09-13T06:28:42.247 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0131930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:42.247 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06b01371c0 con 0x7f06b0094240 2024-09-13T06:28:42.247 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06aeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0131930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:42.247 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06aeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0131930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42656/0 (socket says 172.21.15.112:42656) 2024-09-13T06:28:42.247 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06aeffd640 1 -- 172.21.15.112:0/390628422 learned_addr learned my addr 172.21.15.112:0/390628422 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:42.247 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06aeffd640 1 -- 172.21.15.112:0/390628422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b01246c0 con 0x7f06b0094240 2024-09-13T06:28:42.248 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06aeffd640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0131930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009820 tx=0x7f06a40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:42.248 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a40b0040 con 0x7f06b0094240 2024-09-13T06:28:42.248 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a40b4550 con 0x7f06b0094240 2024-09-13T06:28:42.248 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a40b4850 con 0x7f06b0094240 2024-09-13T06:28:42.248 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b0124890 con 0x7f06b0094240 2024-09-13T06:28:42.249 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b0132040 con 0x7f06b0094240 2024-09-13T06:28:42.249 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b0094620 con 0x7f06b0094240 2024-09-13T06:28:42.249 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f06a40bb030 con 0x7f06b0094240 2024-09-13T06:28:42.249 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06977fe640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f069c035d20 0x7f069c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:42.250 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.249+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1318+0+0 (secure 0 0 0) 0x7f06a40b9070 con 0x7f06b0094240 2024-09-13T06:28:42.250 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.253+0000 7f06ae7fc640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f069c035d20 0x7f069c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:42.250 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.253+0000 7f06ae7fc640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f069c035d20 0x7f069c0381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f06a0007fd0 tx=0x7f06a0007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:42.252 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.257+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f06a40c2060 con 0x7f06b0094240 2024-09-13T06:28:42.410 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.413+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06b0096fe0 con 0x7f06b0094240 2024-09-13T06:28:42.410 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.413+0000 7f06977fe640 1 -- 172.21.15.112:0/390628422 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4153 (secure 0 0 0) 0x7f06a4016090 con 0x7f06b0094240 2024-09-13T06:28:42.411 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-13T06:28:42.411 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":7,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:28:41.446144+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:28:42.413 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f069c035d20 msgr2=0x7f069c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:42.413 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f069c035d20 0x7f069c0381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f06a0007fd0 tx=0x7f06a0007940 comp rx=0 tx=0).stop 2024-09-13T06:28:42.413 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 msgr2=0x7f06b0131930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0131930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009820 tx=0x7f06a40191b0 comp rx=0 tx=0).stop 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 shutdown_connections 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f069c035d20 0x7f069c0381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 --2- 172.21.15.112:0/390628422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06b0094240 0x7f06b0131930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 >> 172.21.15.112:0/390628422 conn(0x7f06b0099c40 msgr2=0x7f06b009bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 shutdown_connections 2024-09-13T06:28:42.414 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:42.417+0000 7f06b5662640 1 -- 172.21.15.112:0/390628422 wait complete. 2024-09-13T06:28:42.428 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T06:28:43.276 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-13T06:28:43.281+0000 7f8e6b02b640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T06:28:43.296 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-13T06:28:43.301+0000 7f8e6263d640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:28:43.890 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-09-13T06:28:43.885+0000 7f8299135640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T06:28:43.912 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-09-13T06:28:43.909+0000 7f8290747640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:28:43.961 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-09-13T06:28:43.957+0000 7f9920091640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T06:28:43.989 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-09-13T06:28:43.985+0000 7f99176a3640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:28:44.455 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-09-13T06:28:44.453+0000 7fc5647e5640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T06:28:44.484 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-09-13T06:28:44.481+0000 7fc55bdf7640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:28:48.832 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:28:48.955 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f8422f0b640 1 Processor -- start 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f8422f0b640 1 -- start start 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f8422f0b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f841c12f7a0 0x7f841c131b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f8422f0b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c096130 con 0x7f841c093470 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f8422f0b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f841c096760 con 0x7f841c12f7a0 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f841bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f841c12f7a0 0x7f841c131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f841bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f841c12f7a0 0x7f841c131b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42670/0 (socket says 172.21.15.112:42670) 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f841bfff640 1 -- 172.21.15.112:0/2129266043 learned_addr learned my addr 172.21.15.112:0/2129266043 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.956+0000 7f8420ca7640 1 --1- 172.21.15.112:0/2129266043 >> v1:172.21.15.112:6789/0 conn(0x7f841c093470 0x7f841c093850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55374/0 (socket says 172.21.15.112:55374) 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f841bfff640 1 -- 172.21.15.112:0/2129266043 >> v1:172.21.15.112:6789/0 conn(0x7f841c093470 legacy=0x7f841c093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:48.956 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f841bfff640 1 -- 172.21.15.112:0/2129266043 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c098be0 con 0x7f841c12f7a0 2024-09-13T06:28:48.958 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f841bfff640 1 --2- 172.21.15.112:0/2129266043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c12f7a0 0x7f841c131b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f840c009820 tx=0x7f840c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58227fa12149ea30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:48.958 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f841b7fe640 1 -- 172.21.15.112:0/2129266043 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c0b0070 con 0x7f841c12f7a0 2024-09-13T06:28:48.958 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f841b7fe640 1 -- 172.21.15.112:0/2129266043 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0ab530 con 0x7f841c12f7a0 2024-09-13T06:28:48.958 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f841b7fe640 1 -- 172.21.15.112:0/2129266043 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c0ab830 con 0x7f841c12f7a0 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 -- 172.21.15.112:0/2129266043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c12f7a0 msgr2=0x7f841c131b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 --2- 172.21.15.112:0/2129266043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c12f7a0 0x7f841c131b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f840c009820 tx=0x7f840c01c410 comp rx=0 tx=0).stop 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 -- 172.21.15.112:0/2129266043 shutdown_connections 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 --2- 172.21.15.112:0/2129266043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c12f7a0 0x7f841c131b90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 -- 172.21.15.112:0/2129266043 >> 172.21.15.112:0/2129266043 conn(0x7f841c099c40 msgr2=0x7f841c09a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 -- 172.21.15.112:0/2129266043 shutdown_connections 2024-09-13T06:28:48.959 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.960+0000 7f8422f0b640 1 -- 172.21.15.112:0/2129266043 wait complete. 2024-09-13T06:28:48.961 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 Processor -- start 2024-09-13T06:28:48.961 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 -- start start 2024-09-13T06:28:48.961 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 0x7f841c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f841c134c80 con 0x7f841c093470 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8420ca7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 0x7f841c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8420ca7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 0x7f841c072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42676/0 (socket says 172.21.15.112:42676) 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8420ca7640 1 -- 172.21.15.112:0/4088605397 learned_addr learned my addr 172.21.15.112:0/4088605397 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8420ca7640 1 -- 172.21.15.112:0/4088605397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c123840 con 0x7f841c093470 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8420ca7640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 0x7f841c072160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f841000c410 tx=0x7f841000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8410007410 con 0x7f841c093470 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100075b0 con 0x7f841c093470 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8410004920 con 0x7f841c093470 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c123400 con 0x7f841c093470 2024-09-13T06:28:48.962 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c072870 con 0x7f841c093470 2024-09-13T06:28:48.963 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c093850 con 0x7f841c093470 2024-09-13T06:28:48.963 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f841001a020 con 0x7f841c093470 2024-09-13T06:28:48.963 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f84197fa640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8408035d20 0x7f84080381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:48.964 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f8410047c20 con 0x7f841c093470 2024-09-13T06:28:48.964 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f841bfff640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8408035d20 0x7f84080381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:48.964 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.964+0000 7f841bfff640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8408035d20 0x7f84080381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f840c0ad000 tx=0x7f840c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:48.967 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:48.968+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f841001b940 con 0x7f841c093470 2024-09-13T06:28:49.131 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.132+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f841c097210 con 0x7f841c093470 2024-09-13T06:28:49.132 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f84197fa640 1 -- 172.21.15.112:0/4088605397 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8002 (secure 0 0 0) 0x7f841001bba0 con 0x7f841c093470 2024-09-13T06:28:49.132 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-13T06:28:49.132 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":14,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:28:48.919101+0000","last_up_change":"2024-09-13T06:28:44.898147+0000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:28:46.475423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6801","nonce":389376018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6803","nonce":389376018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6807","nonce":389376018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6805","nonce":389376018}]},"public_addr":"172.21.15.112:6801/389376018","cluster_addr":"172.21.15.112:6803/389376018","heartbeat_back_addr":"172.21.15.112:6807/389376018","heartbeat_front_addr":"172.21.15.112:6805/389376018","state":["exists","up"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6809","nonce":3492903297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6811","nonce":3492903297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6815","nonce":3492903297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6813","nonce":3492903297}]},"public_addr":"172.21.15.169:6809/3492903297","cluster_addr":"172.21.15.169:6811/3492903297","heartbeat_back_addr":"172.21.15.169:6815/3492903297","heartbeat_front_addr":"172.21.15.169:6813/3492903297","state":["exists","up"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6817","nonce":1749135367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6819","nonce":1749135367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6823","nonce":1749135367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6821","nonce":1749135367}]},"public_addr":"172.21.15.169:6817/1749135367","cluster_addr":"172.21.15.169:6819/1749135367","heartbeat_back_addr":"172.21.15.169:6823/1749135367","heartbeat_front_addr":"172.21.15.169:6821/1749135367","state":["exists","up"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6801","nonce":747740583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6803","nonce":747740583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6807","nonce":747740583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6805","nonce":747740583}]},"public_addr":"172.21.15.169:6801/747740583","cluster_addr":"172.21.15.169:6803/747740583","heartbeat_back_addr":"172.21.15.169:6807/747740583","heartbeat_front_addr":"172.21.15.169:6805/747740583","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:41.983902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.376898+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.428265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.208789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8408035d20 msgr2=0x7f84080381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8408035d20 0x7f84080381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f840c0ad000 tx=0x7f840c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 msgr2=0x7f841c072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 0x7f841c072160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f841000c410 tx=0x7f841000c8d0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 shutdown_connections 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8408035d20 0x7f84080381e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 --2- 172.21.15.112:0/4088605397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f841c093470 0x7f841c072160 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 >> 172.21.15.112:0/4088605397 conn(0x7f841c099c40 msgr2=0x7f841c129080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 shutdown_connections 2024-09-13T06:28:49.135 INFO:teuthology.misc.health.smithi112.stderr:2024-09-13T06:28:49.136+0000 7f8422f0b640 1 -- 172.21.15.112:0/4088605397 wait complete. 2024-09-13T06:28:49.150 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T06:28:49.150 INFO:tasks.ceph:Creating RBD pool 2024-09-13T06:28:49.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T06:28:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45e0291640 1 Processor -- start 2024-09-13T06:28:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45e0291640 1 -- start start 2024-09-13T06:28:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45e0291640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45d812e6f0 0x7f45d812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45e0291640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d8098d50 con 0x7f45d812f1c0 2024-09-13T06:28:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45e0291640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45d806eba0 con 0x7f45d812e6f0 2024-09-13T06:28:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45de02d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45d812e6f0 0x7f45d812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45dd82c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f45d812f1c0 0x7f45d812b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55378/0 (socket says 172.21.15.112:55378) 2024-09-13T06:28:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45dd82c640 1 -- 172.21.15.112:0/3121656262 learned_addr learned my addr 172.21.15.112:0/3121656262 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45de02d640 1 -- 172.21.15.112:0/3121656262 >> v1:172.21.15.112:6789/0 conn(0x7f45d812f1c0 legacy=0x7f45d812b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45de02d640 1 -- 172.21.15.112:0/3121656262 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d806ed60 con 0x7f45d812e6f0 2024-09-13T06:28:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45de02d640 1 --2- 172.21.15.112:0/3121656262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d812ec80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009740 tx=0x7f45d401c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd4947b9d71d2da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45dd02b640 1 -- 172.21.15.112:0/3121656262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45d40b1070 con 0x7f45d812e6f0 2024-09-13T06:28:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45dd02b640 1 -- 172.21.15.112:0/3121656262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d40a4d80 con 0x7f45d812e6f0 2024-09-13T06:28:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.276+0000 7f45dd02b640 1 -- 172.21.15.112:0/3121656262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45d40ac590 con 0x7f45d812e6f0 2024-09-13T06:28:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3121656262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 msgr2=0x7f45d812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 --2- 172.21.15.112:0/3121656262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d812ec80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009740 tx=0x7f45d401c200 comp rx=0 tx=0).stop 2024-09-13T06:28:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3121656262 shutdown_connections 2024-09-13T06:28:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 --2- 172.21.15.112:0/3121656262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d812ec80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3121656262 >> 172.21.15.112:0/3121656262 conn(0x7f45d80a1030 msgr2=0x7f45d80a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3121656262 shutdown_connections 2024-09-13T06:28:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3121656262 wait complete. 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 Processor -- start 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- start start 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d8130a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45d8137610 con 0x7f45d812e6f0 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45de02d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d8130a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45de02d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d8130a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42694/0 (socket says 172.21.15.112:42694) 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45de02d640 1 -- 172.21.15.112:0/3357352739 learned_addr learned my addr 172.21.15.112:0/3357352739 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45de02d640 1 -- 172.21.15.112:0/3357352739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d8132f90 con 0x7f45d812e6f0 2024-09-13T06:28:49.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45de02d640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d8130a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45d40af040 tx=0x7f45d4018fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45d40b9070 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d40b5410 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45d40b1040 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d8133450 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d8131110 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.280+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d812ec80 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.284+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f45d40bc070 con 0x7f45d812e6f0 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.284+0000 7f45ceffd640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f45bc035d20 0x7f45bc0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.284+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f45d40e2130 con 0x7f45d812e6f0 2024-09-13T06:28:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.284+0000 7f45dd82c640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f45bc035d20 0x7f45bc0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.284+0000 7f45dd82c640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f45bc035d20 0x7f45bc0381e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f45c80019d0 tx=0x7f45c8007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:49.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.288+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45d4015f10 con 0x7f45d812e6f0 2024-09-13T06:28:49.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.452+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f45d8131b70 con 0x7f45d812e6f0 2024-09-13T06:28:49.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.924+0000 7f45ceffd640 1 -- 172.21.15.112:0/3357352739 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f45d40b5730 con 0x7f45d812e6f0 2024-09-13T06:28:49.921 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'rbd' created 2024-09-13T06:28:49.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f45bc035d20 msgr2=0x7f45bc0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:49.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f45bc035d20 0x7f45bc0381e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f45c80019d0 tx=0x7f45c8007a10 comp rx=0 tx=0).stop 2024-09-13T06:28:49.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 msgr2=0x7f45d8130a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d8130a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45d40af040 tx=0x7f45d4018fa0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 shutdown_connections 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f45bc035d20 0x7f45bc0381e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 --2- 172.21.15.112:0/3357352739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d812e6f0 0x7f45d8130a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 >> 172.21.15.112:0/3357352739 conn(0x7f45d80a1030 msgr2=0x7f45d809b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 shutdown_connections 2024-09-13T06:28:49.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:49.928+0000 7f45e0291640 1 -- 172.21.15.112:0/3357352739 wait complete. 2024-09-13T06:28:49.946 DEBUG:teuthology.orchestra.run.smithi112:> rbd --cluster ceph pool init rbd 2024-09-13T06:28:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:28:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:28:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa61bc2f80 1 Processor -- start 2024-09-13T06:28:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa61bc2f80 1 -- start start 2024-09-13T06:28:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa61bc2f80 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d9596fb7a0 0x55d959796140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa61bc2f80 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d959586ea0 con 0x55d9596facb0 2024-09-13T06:28:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa61bc2f80 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55d95957be20 con 0x55d9596fb7a0 2024-09-13T06:28:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa5fed5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d9596fb7a0 0x55d959796140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa606d6640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55d9596facb0 0x55d9596fb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55234/0 (socket says 172.21.15.112:55234) 2024-09-13T06:28:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa606d6640 1 -- 172.21.15.112:0/2422906523 learned_addr learned my addr 172.21.15.112:0/2422906523 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa5fed5640 1 -- 172.21.15.112:0/2422906523 >> v1:172.21.15.112:6789/0 conn(0x55d9596facb0 legacy=0x55d9596fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.016+0000 7ffa5fed5640 1 -- 172.21.15.112:0/2422906523 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95956d180 con 0x55d9596fb7a0 2024-09-13T06:28:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa5fed5640 1 --2- 172.21.15.112:0/2422906523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596fb7a0 0x55d959796140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800a610 tx=0x7ffa4801d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5570bf7b64cc903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:50.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa5f6d4640 1 -- 172.21.15.112:0/2422906523 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa480a5dc0 con 0x55d9596fb7a0 2024-09-13T06:28:50.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa5f6d4640 1 -- 172.21.15.112:0/2422906523 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4800a0d0 con 0x55d9596fb7a0 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa5f6d4640 1 -- 172.21.15.112:0/2422906523 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4800a3d0 con 0x55d9596fb7a0 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/2422906523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596fb7a0 msgr2=0x55d959796140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/2422906523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596fb7a0 0x55d959796140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800a610 tx=0x7ffa4801d140 comp rx=0 tx=0).stop 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/2422906523 shutdown_connections 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/2422906523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596fb7a0 0x55d959796140 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/2422906523 >> 172.21.15.112:0/2422906523 conn(0x55d959703bf0 msgr2=0x55d959700030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/2422906523 shutdown_connections 2024-09-13T06:28:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/2422906523 wait complete. 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 Processor -- start 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- start start 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 0x55d959790970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa61bc2f80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d9595d2800 con 0x55d9596facb0 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa606d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 0x55d959790970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa606d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 0x55d959790970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34330/0 (socket says 172.21.15.112:34330) 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.020+0000 7ffa606d6640 1 -- 172.21.15.112:0/661195447 learned_addr learned my addr 172.21.15.112:0/661195447 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa606d6640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d959557990 con 0x55d9596facb0 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa606d6640 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 0x55d959790970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b340 tx=0x7ffa5800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa58006200 con 0x55d9596facb0 2024-09-13T06:28:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa580063a0 con 0x55d9596facb0 2024-09-13T06:28:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9596fd470 con 0x55d9596facb0 2024-09-13T06:28:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa58004180 con 0x55d9596facb0 2024-09-13T06:28:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d959782740 con 0x55d9596facb0 2024-09-13T06:28:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7ffa58019020 con 0x55d9596facb0 2024-09-13T06:28:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5cecf640 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffa400345c0 0x7ffa40036a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7ffa580469b0 con 0x55d9596facb0 2024-09-13T06:28:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d9597911e0 con 0x55d9596facb0 2024-09-13T06:28:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5fed5640 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffa400345c0 0x7ffa40036a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.024+0000 7ffa5fed5640 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffa400345c0 0x7ffa40036a80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa480ae000 tx=0x7ffa480a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.932+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7ffa580115b0 con 0x55d9596facb0 2024-09-13T06:28:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.932+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa4800a0d0 con 0x55d9596facb0 2024-09-13T06:28:50.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.936+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ffa58003460 con 0x55d9596facb0 2024-09-13T06:28:50.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.936+0000 7ffa5eed3640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7ffa44002af0 con 0x55d9596facb0 2024-09-13T06:28:50.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.944+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa5801ac90 con 0x55d9596facb0 2024-09-13T06:28:50.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.944+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 9 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7ffa5801a3a0 con 0x55d9596facb0 2024-09-13T06:28:50.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.948+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d9596fb7a0 0x55d959780870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:50.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.948+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x55d9597a6c50 con 0x55d9596fb7a0 2024-09-13T06:28:50.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.948+0000 7ffa61938640 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d9596fb7a0 0x55d959780870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:50.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.948+0000 7ffa61938640 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d9596fb7a0 0x55d959780870 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:50.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.952+0000 7ffa61938640 1 -- 172.21.15.112:0/661195447 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7ffa5000a4c0 con 0x55d9596fb7a0 2024-09-13T06:28:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.956+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55d9597f81a0 con 0x55d9596fb7a0 2024-09-13T06:28:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.960+0000 7ffa61938640 1 -- 172.21.15.112:0/661195447 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffa5000a4c0 con 0x55d9596fb7a0 2024-09-13T06:28:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.960+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55d9597f72b0 con 0x55d9596fb7a0 2024-09-13T06:28:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.960+0000 7ffa61938640 1 -- 172.21.15.112:0/661195447 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffa5000a4c0 con 0x55d9596fb7a0 2024-09-13T06:28:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:50.960+0000 7ffa5e6d2640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7ffa38001f10 con 0x55d9596facb0 2024-09-13T06:28:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:51.944+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7ffa58011890 con 0x55d9596facb0 2024-09-13T06:28:51.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:51.944+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7ffa4003a2d0 con 0x55d9596facb0 2024-09-13T06:28:51.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:51.948+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 11 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7ffa5804a420 con 0x55d9596facb0 2024-09-13T06:28:51.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:51.948+0000 7ffa5eed3640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7ffa44005690 con 0x55d9596fb7a0 2024-09-13T06:28:51.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:51.952+0000 7ffa61938640 1 -- 172.21.15.112:0/661195447 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa5000a4c0 con 0x55d9596fb7a0 2024-09-13T06:28:51.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:51.952+0000 7ffa5e6d2640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7ffa38003360 con 0x55d9596facb0 2024-09-13T06:28:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.952+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7ffa58020030 con 0x55d9596facb0 2024-09-13T06:28:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.952+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7ffa4003a2d0 con 0x55d9596facb0 2024-09-13T06:28:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.952+0000 7ffa5cecf640 1 -- 172.21.15.112:0/661195447 <== mon.0 v2:172.21.15.112:3300/0 13 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7ffa580103a0 con 0x55d9596facb0 2024-09-13T06:28:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.952+0000 7ffa5eed3640 1 -- 172.21.15.112:0/661195447 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7ffa44005a30 con 0x55d9596fb7a0 2024-09-13T06:28:52.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.960+0000 7ffa61938640 1 -- 172.21.15.112:0/661195447 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa5000a4c0 con 0x55d9596fb7a0 2024-09-13T06:28:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d9596fb7a0 msgr2=0x55d959780870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d9596fb7a0 0x55d959780870 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffa400345c0 msgr2=0x7ffa40036a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffa400345c0 0x7ffa40036a80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa480ae000 tx=0x7ffa480a7070 comp rx=0 tx=0).stop 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 msgr2=0x55d959790970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 0x55d959790970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b340 tx=0x7ffa5800b800 comp rx=0 tx=0).stop 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 shutdown_connections 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d9596fb7a0 0x55d959780870 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffa400345c0 0x7ffa40036a80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 --2- 172.21.15.112:0/661195447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d9596facb0 0x55d959790970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 >> 172.21.15.112:0/661195447 conn(0x55d959703bf0 msgr2=0x55d959779b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 shutdown_connections 2024-09-13T06:28:52.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:52.964+0000 7ffa61bc2f80 1 -- 172.21.15.112:0/661195447 wait complete. 2024-09-13T06:28:52.968 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T06:28:52.968 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T06:28:52.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T06:28:52.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T06:28:52.969 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T06:28:53.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.096+0000 7febb9673640 1 Processor -- start 2024-09-13T06:28:53.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb9673640 1 -- start start 2024-09-13T06:28:53.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb9673640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febb412f390 0x7febb4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb9673640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb40984f0 con 0x7febb412e760 2024-09-13T06:28:53.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb9673640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7febb4098dc0 con 0x7febb412f390 2024-09-13T06:28:53.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb27fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febb412f390 0x7febb4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb2ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7febb412e760 0x7febb412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55250/0 (socket says 172.21.15.112:55250) 2024-09-13T06:28:53.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb2ffd640 1 -- 172.21.15.112:0/2033419928 learned_addr learned my addr 172.21.15.112:0/2033419928 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:53.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb27fc640 1 -- 172.21.15.112:0/2033419928 >> v1:172.21.15.112:6789/0 conn(0x7febb412e760 legacy=0x7febb412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb27fc640 1 -- 172.21.15.112:0/2033419928 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb40981a0 con 0x7febb412f390 2024-09-13T06:28:53.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb1ffb640 1 -- 172.21.15.112:0/2033419928 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825428261 0 0) 0x7febb40984f0 con 0x7febb412e760 2024-09-13T06:28:53.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb27fc640 1 --2- 172.21.15.112:0/2033419928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412f390 0x7febb4133a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009740 tx=0x7feb9c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c0adae2c95ecb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb1ffb640 1 -- 172.21.15.112:0/2033419928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb9c0b1070 con 0x7febb412f390 2024-09-13T06:28:53.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb1ffb640 1 -- 172.21.15.112:0/2033419928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c0ac570 con 0x7febb412f390 2024-09-13T06:28:53.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.100+0000 7febb1ffb640 1 -- 172.21.15.112:0/2033419928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb9c0ac870 con 0x7febb412f390 2024-09-13T06:28:53.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/2033419928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412f390 msgr2=0x7febb4133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 --2- 172.21.15.112:0/2033419928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412f390 0x7febb4133a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009740 tx=0x7feb9c01c400 comp rx=0 tx=0).stop 2024-09-13T06:28:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/2033419928 shutdown_connections 2024-09-13T06:28:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 --2- 172.21.15.112:0/2033419928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412f390 0x7febb4133a80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/2033419928 >> 172.21.15.112:0/2033419928 conn(0x7febb40a10a0 msgr2=0x7febb40a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/2033419928 shutdown_connections 2024-09-13T06:28:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/2033419928 wait complete. 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 Processor -- start 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- start start 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 0x7febb412fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7febb4136b70 con 0x7febb412e760 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 0x7febb412fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 0x7febb412fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34342/0 (socket says 172.21.15.112:34342) 2024-09-13T06:28:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb2ffd640 1 -- 172.21.15.112:0/1176613774 learned_addr learned my addr 172.21.15.112:0/1176613774 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:53.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb2ffd640 1 -- 172.21.15.112:0/1176613774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb4128f50 con 0x7febb412e760 2024-09-13T06:28:53.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb2ffd640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 0x7febb412fa60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feba400c420 tx=0x7feba400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feba4018070 con 0x7febb412e760 2024-09-13T06:28:53.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba40074d0 con 0x7febb412e760 2024-09-13T06:28:53.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feba4004960 con 0x7febb412e760 2024-09-13T06:28:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb4133240 con 0x7febb412e760 2024-09-13T06:28:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb4132380 con 0x7febb412e760 2024-09-13T06:28:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb4132670 con 0x7febb412e760 2024-09-13T06:28:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feba401b070 con 0x7febb412e760 2024-09-13T06:28:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febab7fe640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb94035db0 0x7feb94038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.104+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7feba4047aa0 con 0x7febb412e760 2024-09-13T06:28:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.108+0000 7febb27fc640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb94035db0 0x7feb94038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.108+0000 7febb27fc640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb94035db0 0x7feb94038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae000 tx=0x7feb9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.112+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7febb4132670 con 0x7febb412e760 2024-09-13T06:28:53.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.312+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7febb4132e90 con 0x7febb412e760 2024-09-13T06:28:53.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.312+0000 7febab7fe640 1 -- 172.21.15.112:0/1176613774 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84181 (secure 0 0 0) 0x7feba40368f0 con 0x7febb412e760 2024-09-13T06:28:53.311 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:53.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb94035db0 msgr2=0x7feb94038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb94035db0 0x7feb94038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae000 tx=0x7feb9c008040 comp rx=0 tx=0).stop 2024-09-13T06:28:53.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 msgr2=0x7febb412fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 0x7febb412fa60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feba400c420 tx=0x7feba400c8e0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 shutdown_connections 2024-09-13T06:28:53.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb94035db0 0x7feb94038270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 --2- 172.21.15.112:0/1176613774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb412e760 0x7febb412fa60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 >> 172.21.15.112:0/1176613774 conn(0x7febb40a10a0 msgr2=0x7febb412c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:53.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 shutdown_connections 2024-09-13T06:28:53.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.316+0000 7febb9673640 1 -- 172.21.15.112:0/1176613774 wait complete. 2024-09-13T06:28:53.329 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2981546611},{"type":"v1","addr":"172.21.15.169:6825","nonce":2981546611}]},"active_addr":"172.21.15.169:6825/2981546611","active_change":"2024-09-13T06:28:38.389945+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3035882765}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3500570563}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3695017848}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":2886367751}]}]} 2024-09-13T06:28:53.333 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T06:28:53.333 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T06:28:53.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:28:53.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc7791640 1 Processor -- start 2024-09-13T06:28:53.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc7791640 1 -- start start 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc7791640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecc012e760 0x7fecc012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc7791640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc00984f0 con 0x7fecc012f1c0 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc7791640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fecc0098dc0 con 0x7fecc012e760 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc552d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecc012e760 0x7fecc012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc4d2c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fecc012f1c0 0x7fecc012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55256/0 (socket says 172.21.15.112:55256) 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.452+0000 7fecc4d2c640 1 -- 172.21.15.112:0/3067497581 learned_addr learned my addr 172.21.15.112:0/3067497581 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecbffff640 1 -- 172.21.15.112:0/3067497581 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364173516 0 0) 0x7fecc00984f0 con 0x7fecc012f1c0 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecbffff640 1 -- 172.21.15.112:0/3067497581 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feca8003530 con 0x7fecc012f1c0 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc552d640 1 -- 172.21.15.112:0/3067497581 >> v1:172.21.15.112:6789/0 conn(0x7fecc012f1c0 legacy=0x7fecc012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc552d640 1 -- 172.21.15.112:0/3067497581 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc012f5a0 con 0x7fecc012e760 2024-09-13T06:28:53.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc552d640 1 --2- 172.21.15.112:0/3067497581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc012ec80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6714a9155f24b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecbffff640 1 -- 172.21.15.112:0/3067497581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb00b2070 con 0x7fecc012e760 2024-09-13T06:28:53.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecbffff640 1 -- 172.21.15.112:0/3067497581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb00a56f0 con 0x7fecc012e760 2024-09-13T06:28:53.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecbffff640 1 -- 172.21.15.112:0/3067497581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb00a59f0 con 0x7fecc012e760 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 -- 172.21.15.112:0/3067497581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 msgr2=0x7fecc012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 --2- 172.21.15.112:0/3067497581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc012ec80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb001c950 comp rx=0 tx=0).stop 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 -- 172.21.15.112:0/3067497581 shutdown_connections 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 --2- 172.21.15.112:0/3067497581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc012ec80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 -- 172.21.15.112:0/3067497581 >> 172.21.15.112:0/3067497581 conn(0x7fecc00a10a0 msgr2=0x7fecc00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 -- 172.21.15.112:0/3067497581 shutdown_connections 2024-09-13T06:28:53.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.456+0000 7fecc7791640 1 -- 172.21.15.112:0/3067497581 wait complete. 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 Processor -- start 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 -- start start 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc00972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fecc0136e30 con 0x7fecc012e760 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc552d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc00972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc552d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc00972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34358/0 (socket says 172.21.15.112:34358) 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc552d640 1 -- 172.21.15.112:0/3248669008 learned_addr learned my addr 172.21.15.112:0/3248669008 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc552d640 1 -- 172.21.15.112:0/3248669008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0132e90 con 0x7fecc012e760 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc552d640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc00972f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fecb001a580 tx=0x7fecb00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb00bd030 con 0x7fecc012e760 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb00b8470 con 0x7fecc012e760 2024-09-13T06:28:53.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc0134210 con 0x7fecc012e760 2024-09-13T06:28:53.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb00b2040 con 0x7fecc012e760 2024-09-13T06:28:53.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc0097830 con 0x7fecc012e760 2024-09-13T06:28:53.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fecb00c0070 con 0x7fecc012e760 2024-09-13T06:28:53.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc012ec80 con 0x7fecc012e760 2024-09-13T06:28:53.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecbdffb640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fecac035db0 0x7fecac038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fecb00be070 con 0x7fecc012e760 2024-09-13T06:28:53.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc4d2c640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fecac035db0 0x7fecac038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.460+0000 7fecc4d2c640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fecac035db0 0x7fecac038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007fd0 tx=0x7fecb4007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.464+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecb00c7070 con 0x7fecc012e760 2024-09-13T06:28:53.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.620+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecc0133d50 con 0x7fecc012e760 2024-09-13T06:28:53.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.624+0000 7fecbdffb640 1 -- 172.21.15.112:0/3248669008 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9901 (secure 0 0 0) 0x7fecb0016540 con 0x7fecc012e760 2024-09-13T06:28:53.621 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:53.621 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:28:52.946660+0000","last_up_change":"2024-09-13T06:28:44.898147+0000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:28:46.475423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:28:49.493974+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6801","nonce":389376018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6803","nonce":389376018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6807","nonce":389376018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6805","nonce":389376018}]},"public_addr":"172.21.15.112:6801/389376018","cluster_addr":"172.21.15.112:6803/389376018","heartbeat_back_addr":"172.21.15.112:6807/389376018","heartbeat_front_addr":"172.21.15.112:6805/389376018","state":["exists","up"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6809","nonce":3492903297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6811","nonce":3492903297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6815","nonce":3492903297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6813","nonce":3492903297}]},"public_addr":"172.21.15.169:6809/3492903297","cluster_addr":"172.21.15.169:6811/3492903297","heartbeat_back_addr":"172.21.15.169:6815/3492903297","heartbeat_front_addr":"172.21.15.169:6813/3492903297","state":["exists","up"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6817","nonce":1749135367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6819","nonce":1749135367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6823","nonce":1749135367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6821","nonce":1749135367}]},"public_addr":"172.21.15.169:6817/1749135367","cluster_addr":"172.21.15.169:6819/1749135367","heartbeat_back_addr":"172.21.15.169:6823/1749135367","heartbeat_front_addr":"172.21.15.169:6821/1749135367","state":["exists","up"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6801","nonce":747740583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6803","nonce":747740583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6807","nonce":747740583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6805","nonce":747740583}]},"public_addr":"172.21.15.169:6801/747740583","cluster_addr":"172.21.15.169:6803/747740583","heartbeat_back_addr":"172.21.15.169:6807/747740583","heartbeat_front_addr":"172.21.15.169:6805/747740583","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:41.983902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.376898+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.428265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.208789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:28:53.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fecac035db0 msgr2=0x7fecac038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fecac035db0 0x7fecac038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007fd0 tx=0x7fecb4007980 comp rx=0 tx=0).stop 2024-09-13T06:28:53.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 msgr2=0x7fecc00972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc00972f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fecb001a580 tx=0x7fecb00196f0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 shutdown_connections 2024-09-13T06:28:53.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fecac035db0 0x7fecac038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 --2- 172.21.15.112:0/3248669008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc012e760 0x7fecc00972f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 >> 172.21.15.112:0/3248669008 conn(0x7fecc00a10a0 msgr2=0x7fecc0125d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:53.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 shutdown_connections 2024-09-13T06:28:53.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.628+0000 7fecc7791640 1 -- 172.21.15.112:0/3248669008 wait complete. 2024-09-13T06:28:53.639 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T06:28:53.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:28:53.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b89e6640 1 Processor -- start 2024-09-13T06:28:53.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b89e6640 1 -- start start 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b89e6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79b406d0e0 0x7f79b406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b89e6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b4071c10 con 0x7f79b406da00 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b89e6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f79b4072230 con 0x7f79b406d0e0 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79b406d0e0 0x7f79b406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79b406d0e0 0x7f79b406d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34366/0 (socket says 172.21.15.112:34366) 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b259c640 1 -- 172.21.15.112:0/2012068683 learned_addr learned my addr 172.21.15.112:0/2012068683 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:53.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b259c640 1 -- 172.21.15.112:0/2012068683 >> v1:172.21.15.112:6789/0 conn(0x7f79b406da00 legacy=0x7f79b412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b159a640 1 -- 172.21.15.112:0/2012068683 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026688148 0 0) 0x7f79b4071c10 con 0x7f79b406da00 2024-09-13T06:28:53.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.760+0000 7f79b259c640 1 -- 172.21.15.112:0/2012068683 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b40709e0 con 0x7f79b406d0e0 2024-09-13T06:28:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b259c640 1 --2- 172.21.15.112:0/2012068683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406d4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79a80097f0 tx=0x7f79a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4770755f32cdd58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b159a640 1 -- 172.21.15.112:0/2012068683 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80b0070 con 0x7f79b406d0e0 2024-09-13T06:28:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b159a640 1 -- 172.21.15.112:0/2012068683 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80ab530 con 0x7f79b406d0e0 2024-09-13T06:28:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b159a640 1 -- 172.21.15.112:0/2012068683 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80ab830 con 0x7f79b406d0e0 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- 172.21.15.112:0/2012068683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 msgr2=0x7f79b406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 --2- 172.21.15.112:0/2012068683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406d4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79a80097f0 tx=0x7f79a801c430 comp rx=0 tx=0).stop 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- 172.21.15.112:0/2012068683 shutdown_connections 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 --2- 172.21.15.112:0/2012068683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406d4c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- 172.21.15.112:0/2012068683 >> 172.21.15.112:0/2012068683 conn(0x7f79b4099a50 msgr2=0x7f79b40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- 172.21.15.112:0/2012068683 shutdown_connections 2024-09-13T06:28:53.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- 172.21.15.112:0/2012068683 wait complete. 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 Processor -- start 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- start start 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b89e6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4134e80 con 0x7f79b406d0e0 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34372/0 (socket says 172.21.15.112:34372) 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.764+0000 7f79b259c640 1 -- 172.21.15.112:0/349334055 learned_addr learned my addr 172.21.15.112:0/349334055 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b259c640 1 -- 172.21.15.112:0/349334055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b412bd70 con 0x7f79b406d0e0 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b259c640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406e1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79a8019040 tx=0x7f79a801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80b0040 con 0x7f79b406d0e0 2024-09-13T06:28:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a8004020 con 0x7f79b406d0e0 2024-09-13T06:28:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b406fa10 con 0x7f79b406d0e0 2024-09-13T06:28:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80abe60 con 0x7f79b406d0e0 2024-09-13T06:28:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b406fed0 con 0x7f79b406d0e0 2024-09-13T06:28:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b406d4c0 con 0x7f79b406d0e0 2024-09-13T06:28:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79a80b3070 con 0x7f79b406d0e0 2024-09-13T06:28:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79a2ffd640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7994035db0 0x7f7994038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f79a80e2b20 con 0x7f79b406d0e0 2024-09-13T06:28:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b1d9b640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7994035db0 0x7f7994038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.768+0000 7f79b1d9b640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7994035db0 0x7f7994038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f70 tx=0x7f79a4007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:53.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.772+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f79a80c3030 con 0x7f79b406d0e0 2024-09-13T06:28:53.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.928+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79b4073790 con 0x7f79b406d0e0 2024-09-13T06:28:53.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.928+0000 7f79a2ffd640 1 -- 172.21.15.112:0/349334055 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9901 (secure 0 0 0) 0x7f79a80ba030 con 0x7f79b406d0e0 2024-09-13T06:28:53.927 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:53.927 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:28:52.946660+0000","last_up_change":"2024-09-13T06:28:44.898147+0000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:28:46.475423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:28:49.493974+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6801","nonce":389376018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6803","nonce":389376018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6807","nonce":389376018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6805","nonce":389376018}]},"public_addr":"172.21.15.112:6801/389376018","cluster_addr":"172.21.15.112:6803/389376018","heartbeat_back_addr":"172.21.15.112:6807/389376018","heartbeat_front_addr":"172.21.15.112:6805/389376018","state":["exists","up"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6809","nonce":3492903297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6811","nonce":3492903297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6815","nonce":3492903297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6813","nonce":3492903297}]},"public_addr":"172.21.15.169:6809/3492903297","cluster_addr":"172.21.15.169:6811/3492903297","heartbeat_back_addr":"172.21.15.169:6815/3492903297","heartbeat_front_addr":"172.21.15.169:6813/3492903297","state":["exists","up"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6817","nonce":1749135367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6819","nonce":1749135367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6823","nonce":1749135367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6821","nonce":1749135367}]},"public_addr":"172.21.15.169:6817/1749135367","cluster_addr":"172.21.15.169:6819/1749135367","heartbeat_back_addr":"172.21.15.169:6823/1749135367","heartbeat_front_addr":"172.21.15.169:6821/1749135367","state":["exists","up"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6801","nonce":747740583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6803","nonce":747740583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6807","nonce":747740583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6805","nonce":747740583}]},"public_addr":"172.21.15.169:6801/747740583","cluster_addr":"172.21.15.169:6803/747740583","heartbeat_back_addr":"172.21.15.169:6807/747740583","heartbeat_front_addr":"172.21.15.169:6805/747740583","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:41.983902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.376898+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.428265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.208789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7994035db0 msgr2=0x7f7994038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7994035db0 0x7f7994038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f70 tx=0x7f79a4007930 comp rx=0 tx=0).stop 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 msgr2=0x7f79b406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406e1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79a8019040 tx=0x7f79a801ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 shutdown_connections 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7994035db0 0x7f7994038270 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f70 tx=0x7f79a4007930 comp rx=0 tx=0).stop 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 --2- 172.21.15.112:0/349334055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b406d0e0 0x7f79b406e1f0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79a8019040 tx=0x7f79a801ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 >> 172.21.15.112:0/349334055 conn(0x7f79b4099a50 msgr2=0x7f79b409b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 shutdown_connections 2024-09-13T06:28:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:53.932+0000 7f79b89e6640 1 -- 172.21.15.112:0/349334055 wait complete. 2024-09-13T06:28:53.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T06:28:53.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T06:28:53.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T06:28:53.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f9646d53640 1 Processor -- start 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f9646d53640 1 -- start start 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f9646d53640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f964006e180 0x7f964012ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f9646d53640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964006e560 con 0x7f964012f200 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f9646d53640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f964006ee90 con 0x7f964006e180 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f9644aef640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f964006e180 0x7f964012ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f963ffff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f964012f200 0x7f964012b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55282/0 (socket says 172.21.15.112:55282) 2024-09-13T06:28:54.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.052+0000 7f963ffff640 1 -- 172.21.15.112:0/4150545159 learned_addr learned my addr 172.21.15.112:0/4150545159 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f9644aef640 1 -- 172.21.15.112:0/4150545159 >> v1:172.21.15.112:6789/0 conn(0x7f964012f200 legacy=0x7f964012b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f963f7fe640 1 -- 172.21.15.112:0/4150545159 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209467425 0 0) 0x7f964006e560 con 0x7f964012f200 2024-09-13T06:28:54.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f9644aef640 1 -- 172.21.15.112:0/4150545159 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9640096710 con 0x7f964006e180 2024-09-13T06:28:54.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61bafb9640 1 Processor -- start 2024-09-13T06:28:54.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61bafb9640 1 -- start start 2024-09-13T06:28:54.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61bafb9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f61b4129540 0x7f61b4129920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61bafb9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b406beb0 con 0x7f61b412c5f0 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61bafb9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f61b40979a0 con 0x7f61b4129540 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b8d55640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f61b4129540 0x7f61b4129920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b3fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f61b412c5f0 0x7f61b412ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55294/0 (socket says 172.21.15.112:55294) 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b3fff640 1 -- 172.21.15.112:0/4291670077 learned_addr learned my addr 172.21.15.112:0/4291670077 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b8d55640 1 -- 172.21.15.112:0/4291670077 >> v1:172.21.15.112:6789/0 conn(0x7f61b412c5f0 legacy=0x7f61b412ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b37fe640 1 -- 172.21.15.112:0/4291670077 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688516679 0 0) 0x7f61b406beb0 con 0x7f61b412c5f0 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b8d55640 1 -- 172.21.15.112:0/4291670077 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b41290f0 con 0x7f61b4129540 2024-09-13T06:28:54.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb6b79640 1 Processor -- start 2024-09-13T06:28:54.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb6b79640 1 -- start start 2024-09-13T06:28:54.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30cc22c640 1 Processor -- start 2024-09-13T06:28:54.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb6b79640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcb0096c70 0x7fdcb0133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb6b79640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb006beb0 con 0x7fdcb0096180 2024-09-13T06:28:54.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb6b79640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb0097f50 con 0x7fdcb0096c70 2024-09-13T06:28:54.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30cc22c640 1 -- start start 2024-09-13T06:28:54.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcaffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcb0096c70 0x7fdcb0133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb4915640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdcb0096180 0x7fdcb0096560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55310/0 (socket says 172.21.15.112:55310) 2024-09-13T06:28:54.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcb4915640 1 -- 172.21.15.112:0/3567126015 learned_addr learned my addr 172.21.15.112:0/3567126015 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f9644aef640 1 --2- 172.21.15.112:0/4150545159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f964012ecc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9634009740 tx=0x7f963401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60721981440a0d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcaffff640 1 -- 172.21.15.112:0/3567126015 >> v1:172.21.15.112:6789/0 conn(0x7fdcb0096180 legacy=0x7fdcb0096560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7fdcaffff640 1 -- 172.21.15.112:0/3567126015 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb006c360 con 0x7fdcb0096c70 2024-09-13T06:28:54.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f963f7fe640 1 -- 172.21.15.112:0/4150545159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96340b0070 con 0x7f964006e180 2024-09-13T06:28:54.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30cc22c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30c412b500 0x7f30c412b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30cc22c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c4093fa0 con 0x7f30c412be20 2024-09-13T06:28:54.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30cc22c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f30c40753e0 con 0x7f30c412b500 2024-09-13T06:28:54.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c9fc8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30c412b500 0x7f30c412b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c97c7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f30c412be20 0x7f30c41281e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55322/0 (socket says 172.21.15.112:55322) 2024-09-13T06:28:54.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c97c7640 1 -- 172.21.15.112:0/644975138 learned_addr learned my addr 172.21.15.112:0/644975138 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c8fc6640 1 -- 172.21.15.112:0/644975138 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071020243 0 0) 0x7f30c4093fa0 con 0x7f30c412be20 2024-09-13T06:28:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c8fc6640 1 -- 172.21.15.112:0/644975138 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30b0003530 con 0x7f30c412be20 2024-09-13T06:28:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f61b8d55640 1 --2- 172.21.15.112:0/4291670077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4129920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009770 tx=0x7f61a801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac14061efcee5fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b37fe640 1 -- 172.21.15.112:0/4291670077 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80b0070 con 0x7f61b4129540 2024-09-13T06:28:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b37fe640 1 -- 172.21.15.112:0/4291670077 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a80ab530 con 0x7f61b4129540 2024-09-13T06:28:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b37fe640 1 -- 172.21.15.112:0/4291670077 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80ab830 con 0x7f61b4129540 2024-09-13T06:28:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f963f7fe640 1 -- 172.21.15.112:0/4150545159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96340ab530 con 0x7f964006e180 2024-09-13T06:28:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f963f7fe640 1 -- 172.21.15.112:0/4150545159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96340b0070 con 0x7f964006e180 2024-09-13T06:28:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/4150545159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 msgr2=0x7f964012ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 --2- 172.21.15.112:0/4150545159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f964012ecc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9634009740 tx=0x7f963401c400 comp rx=0 tx=0).stop 2024-09-13T06:28:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/4150545159 shutdown_connections 2024-09-13T06:28:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 --2- 172.21.15.112:0/4150545159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f964012ecc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/4150545159 >> 172.21.15.112:0/4150545159 conn(0x7f964009f010 msgr2=0x7f964009f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/4150545159 shutdown_connections 2024-09-13T06:28:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/4150545159 wait complete. 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/4291670077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 msgr2=0x7f61b4129920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 --2- 172.21.15.112:0/4291670077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4129920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009770 tx=0x7f61a801c340 comp rx=0 tx=0).stop 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/4291670077 shutdown_connections 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 --2- 172.21.15.112:0/4291670077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4129920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/4291670077 >> 172.21.15.112:0/4291670077 conn(0x7f61b409ab00 msgr2=0x7f61b409af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/4291670077 shutdown_connections 2024-09-13T06:28:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/4291670077 wait complete. 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 Processor -- start 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- start start 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f96401ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9640137370 con 0x7f964006e180 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 Processor -- start 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- start start 2024-09-13T06:28:54.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9644aef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f96401ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9644aef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f96401ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34410/0 (socket says 172.21.15.112:34410) 2024-09-13T06:28:54.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9644aef640 1 -- 172.21.15.112:0/132167440 learned_addr learned my addr 172.21.15.112:0/132167440 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcaffff640 1 --2- 172.21.15.112:0/3567126015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096c70 0x7fdcb0133fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009740 tx=0x7fdc9c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2dea478228b0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9644aef640 1 -- 172.21.15.112:0/132167440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9640072030 con 0x7f964006e180 2024-09-13T06:28:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcaf7fe640 1 -- 172.21.15.112:0/3567126015 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc9c0b0070 con 0x7fdcb0096c70 2024-09-13T06:28:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcaf7fe640 1 -- 172.21.15.112:0/3567126015 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0ab530 con 0x7fdcb0096c70 2024-09-13T06:28:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcaf7fe640 1 -- 172.21.15.112:0/3567126015 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc9c0ab830 con 0x7fdcb0096c70 2024-09-13T06:28:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61b4135140 con 0x7f61b4129540 2024-09-13T06:28:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9644aef640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f96401ca800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9634019010 tx=0x7f96340191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b8d55640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b8d55640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34412/0 (socket says 172.21.15.112:34412) 2024-09-13T06:28:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b8d55640 1 -- 172.21.15.112:0/422373322 learned_addr learned my addr 172.21.15.112:0/422373322 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c9fc8640 1 -- 172.21.15.112:0/644975138 >> v1:172.21.15.112:6789/0 conn(0x7f30c412be20 legacy=0x7f30c41281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.056+0000 7f30c9fc8640 1 -- 172.21.15.112:0/644975138 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c4094880 con 0x7f30c412b500 2024-09-13T06:28:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96340b9070 con 0x7f964006e180 2024-09-13T06:28:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96340aba20 con 0x7f964006e180 2024-09-13T06:28:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96340b0040 con 0x7f964006e180 2024-09-13T06:28:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9640073120 con 0x7f964006e180 2024-09-13T06:28:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96400728d0 con 0x7f964006e180 2024-09-13T06:28:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b8d55640 1 -- 172.21.15.112:0/422373322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b412e9f0 con 0x7f61b4129540 2024-09-13T06:28:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f30c9fc8640 1 --2- 172.21.15.112:0/644975138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c412b8e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009740 tx=0x7f30c001e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cce690753959d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b8d55640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4071370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f61a8019f70 tx=0x7f61a801ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f30c8fc6640 1 -- 172.21.15.112:0/644975138 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c00b3070 con 0x7f30c412b500 2024-09-13T06:28:54.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcb6b79640 1 -- 172.21.15.112:0/3567126015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096c70 msgr2=0x7fdcb0133fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/3567126015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096c70 0x7fdcb0133fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009740 tx=0x7fdc9c01c370 comp rx=0 tx=0).stop 2024-09-13T06:28:54.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80b0050 con 0x7f61b4129540 2024-09-13T06:28:54.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/422373322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b4072eb0 con 0x7f61b4129540 2024-09-13T06:28:54.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f30c8fc6640 1 -- 172.21.15.112:0/644975138 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c00ae540 con 0x7f30c412b500 2024-09-13T06:28:54.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61bafb9640 1 -- 172.21.15.112:0/422373322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b412dc40 con 0x7f61b4129540 2024-09-13T06:28:54.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a80b1040 con 0x7f61b4129540 2024-09-13T06:28:54.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f30c8fc6640 1 -- 172.21.15.112:0/644975138 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c00ae820 con 0x7f30c412b500 2024-09-13T06:28:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcb6b79640 1 -- 172.21.15.112:0/3567126015 shutdown_connections 2024-09-13T06:28:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/3567126015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096c70 0x7fdcb0133fc0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009740 tx=0x7fdc9c01c370 comp rx=0 tx=0).stop 2024-09-13T06:28:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7fdcb6b79640 1 -- 172.21.15.112:0/3567126015 >> 172.21.15.112:0/3567126015 conn(0x7fdcb009a700 msgr2=0x7fdcb009aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.060+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f96340bc070 con 0x7f964006e180 2024-09-13T06:28:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9620000f90 con 0x7f964006e180 2024-09-13T06:28:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963d7fa640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9624035db0 0x7f9624038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- 172.21.15.112:0/3567126015 shutdown_connections 2024-09-13T06:28:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f96340e2a30 con 0x7f964006e180 2024-09-13T06:28:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/644975138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 msgr2=0x7f30c412b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 --2- 172.21.15.112:0/644975138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c412b8e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009740 tx=0x7f30c001e580 comp rx=0 tx=0).stop 2024-09-13T06:28:54.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963d7fa640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f962403b530 0x7f962403d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80ab530 con 0x7f61b4129540 2024-09-13T06:28:54.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/644975138 shutdown_connections 2024-09-13T06:28:54.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 --2- 172.21.15.112:0/644975138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c412b8e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/644975138 >> 172.21.15.112:0/644975138 conn(0x7f30c409d4c0 msgr2=0x7f30c409d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f962403e080 con 0x7f962403b530 2024-09-13T06:28:54.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f96340e4e60 con 0x7f964006e180 2024-09-13T06:28:54.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61b4129920 con 0x7f61b4129540 2024-09-13T06:28:54.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- 172.21.15.112:0/3567126015 wait complete. 2024-09-13T06:28:54.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963ffff640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9624035db0 0x7f9624038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f96452f0640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f962403b530 0x7f962403d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61a80be030 con 0x7f61b4129540 2024-09-13T06:28:54.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 Processor -- start 2024-09-13T06:28:54.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/644975138 shutdown_connections 2024-09-13T06:28:54.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/644975138 wait complete. 2024-09-13T06:28:54.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6198035f40 0x7f6198038400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f61a80bc070 con 0x7f61b4129540 2024-09-13T06:28:54.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- start start 2024-09-13T06:28:54.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f96452f0640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f962403b530 0x7f962403d9b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f619803b6c0 0x7f619803db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f619803e210 con 0x7f619803b6c0 2024-09-13T06:28:54.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f61a80e3880 con 0x7f61b4129540 2024-09-13T06:28:54.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b3fff640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6198035f40 0x7f6198038400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f963ffff640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9624035db0 0x7f9624038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f962c007fd0 tx=0x7f962c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 0x7fdcb0122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb01370b0 con 0x7fdcb0096180 2024-09-13T06:28:54.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b9556640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f619803b6c0 0x7f619803db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb4915640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 0x7fdcb0122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb4915640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 0x7fdcb0122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34422/0 (socket says 172.21.15.112:34422) 2024-09-13T06:28:54.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb4915640 1 -- 172.21.15.112:0/683558450 learned_addr learned my addr 172.21.15.112:0/683558450 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb4915640 1 -- 172.21.15.112:0/683558450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb0124240 con 0x7fdcb0096180 2024-09-13T06:28:54.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 Processor -- start 2024-09-13T06:28:54.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- start start 2024-09-13T06:28:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b3fff640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6198035f40 0x7f6198038400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb4915640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 0x7fdcb0122cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c480 tx=0x7fdca400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f61b9556640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f619803b6c0 0x7f619803db40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdca4017070 con 0x7fdcb0096180 2024-09-13T06:28:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca4005c20 con 0x7fdcb0096180 2024-09-13T06:28:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb0072180 con 0x7fdcb0096180 2024-09-13T06:28:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdca4007070 con 0x7fdcb0096180 2024-09-13T06:28:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb01248d0 con 0x7fdcb0096180 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c4090530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f30c412c3b0 con 0x7f30c412b500 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30c9fc8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c4090530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30c9fc8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c4090530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34432/0 (socket says 172.21.15.112:34432) 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30c9fc8640 1 -- 172.21.15.112:0/2958806210 learned_addr learned my addr 172.21.15.112:0/2958806210 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30c9fc8640 1 -- 172.21.15.112:0/2958806210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c408d9e0 con 0x7f30c412b500 2024-09-13T06:28:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcb0096560 con 0x7fdcb0096180 2024-09-13T06:28:54.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30c9fc8640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c4090530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30c00b1040 tx=0x7f30c001b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c00bc020 con 0x7f30c412b500 2024-09-13T06:28:54.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c00ae6f0 con 0x7f30c412b500 2024-09-13T06:28:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdca401a070 con 0x7fdcb0096180 2024-09-13T06:28:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c00b3040 con 0x7f30c412b500 2024-09-13T06:28:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c408d100 con 0x7f30c412b500 2024-09-13T06:28:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.064+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c408e4e0 con 0x7f30c412b500 2024-09-13T06:28:54.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcad7fa640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdc94035db0 0x7fdc94038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f962403e080 con 0x7f962403b530 2024-09-13T06:28:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fdca4047a20 con 0x7fdcb0096180 2024-09-13T06:28:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcad7fa640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fdc9403b530 0x7fdc9403d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc9403e080 con 0x7fdc9403b530 2024-09-13T06:28:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fdca404c2a0 con 0x7fdcb0096180 2024-09-13T06:28:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcaffff640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdc94035db0 0x7fdc94038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcb5116640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fdc9403b530 0x7fdc9403d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f30c00bf020 con 0x7f30c412b500 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30c412b8e0 con 0x7f30c412b500 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f30a8035e00 0x7f30a80382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f30c00ab070 con 0x7f30c412b500 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f30a803b580 0x7f30a803da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30a803e0d0 con 0x7f30a803b580 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f30c00eb050 con 0x7f30c412b500 2024-09-13T06:28:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f619803e210 con 0x7f619803b6c0 2024-09-13T06:28:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ca7c9640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f30a803b580 0x7f30a803da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30c97c7640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f30a8035e00 0x7f30a80382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcaffff640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdc94035db0 0x7fdc94038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0ad000 tx=0x7fdc9c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcb5116640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fdc9403b530 0x7fdc9403d9b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ca7c9640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f30a803b580 0x7f30a803da00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30c97c7640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f30a8035e00 0x7f30a80382c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30b4000f70 tx=0x7f30b40010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30a803e0d0 con 0x7f30a803b580 2024-09-13T06:28:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.068+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc9403e080 con 0x7fdc9403b530 2024-09-13T06:28:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.080+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9620002c80 con 0x7f962403b530 2024-09-13T06:28:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.080+0000 7f963d7fa640 1 -- 172.21.15.112:0/132167440 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9620002c80 con 0x7f962403b530 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f962403b530 msgr2=0x7f962403d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f962403b530 0x7f962403d9b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9624035db0 msgr2=0x7f9624038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9624035db0 0x7f9624038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f962c007fd0 tx=0x7f962c007920 comp rx=0 tx=0).stop 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 msgr2=0x7f96401ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f96401ca800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9634019010 tx=0x7f96340191a0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 shutdown_connections 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f962403b530 0x7f962403d9b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9624035db0 0x7f9624038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 --2- 172.21.15.112:0/132167440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f964006e180 0x7f96401ca800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 >> 172.21.15.112:0/132167440 conn(0x7f964009f010 msgr2=0x7f9640099510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 shutdown_connections 2024-09-13T06:28:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7f9646d53640 1 -- 172.21.15.112:0/132167440 wait complete. 2024-09-13T06:28:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcb0094610 con 0x7fdc9403b530 2024-09-13T06:28:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcad7fa640 1 -- 172.21.15.112:0/683558450 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdcb0094610 con 0x7fdc9403b530 2024-09-13T06:28:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fdc9403b530 msgr2=0x7fdc9403d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fdc9403b530 0x7fdc9403d9b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdc94035db0 msgr2=0x7fdc94038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdc94035db0 0x7fdc94038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0ad000 tx=0x7fdc9c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:28:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 msgr2=0x7fdcb0122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 0x7fdcb0122cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c480 tx=0x7fdca400c940 comp rx=0 tx=0).stop 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 shutdown_connections 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fdc9403b530 0x7fdc9403d9b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdc94035db0 0x7fdc94038270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 --2- 172.21.15.112:0/683558450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb0096180 0x7fdcb0122cc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 >> 172.21.15.112:0/683558450 conn(0x7fdcb009a700 msgr2=0x7fdcb0099490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 shutdown_connections 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.084+0000 7fdcb6b79640 1 -- 172.21.15.112:0/683558450 wait complete. 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61b412c5f0 con 0x7f619803b6c0 2024-09-13T06:28:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f61b17fa640 1 -- 172.21.15.112:0/422373322 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f61b412c5f0 con 0x7f619803b6c0 2024-09-13T06:28:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f619803b6c0 msgr2=0x7f619803db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f619803b6c0 0x7f619803db40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6198035f40 msgr2=0x7f6198038400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6198035f40 0x7f6198038400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0007980 comp rx=0 tx=0).stop 2024-09-13T06:28:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 msgr2=0x7f61b4071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4071370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f61a8019f70 tx=0x7f61a801ab80 comp rx=0 tx=0).stop 2024-09-13T06:28:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30c412be20 con 0x7f30a803b580 2024-09-13T06:28:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 shutdown_connections 2024-09-13T06:28:54.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f619803b6c0 0x7f619803db40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6198035f40 0x7f6198038400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 --2- 172.21.15.112:0/422373322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61b4129540 0x7f61b4071370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 >> 172.21.15.112:0/422373322 conn(0x7f61b409ab00 msgr2=0x7f61b4098600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 shutdown_connections 2024-09-13T06:28:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f619effd640 1 -- 172.21.15.112:0/422373322 wait complete. 2024-09-13T06:28:54.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30ba7fc640 1 -- 172.21.15.112:0/2958806210 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f30c412be20 con 0x7f30a803b580 2024-09-13T06:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f30a803b580 msgr2=0x7f30a803da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f30a803b580 0x7f30a803da00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f30a8035e00 msgr2=0x7f30a80382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f30a8035e00 0x7f30a80382c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30b4000f70 tx=0x7f30b40010b0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 msgr2=0x7f30c4090530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c4090530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30c00b1040 tx=0x7f30c001b320 comp rx=0 tx=0).stop 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 shutdown_connections 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f30a803b580 0x7f30a803da00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f30a8035e00 0x7f30a80382c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 --2- 172.21.15.112:0/2958806210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30c412b500 0x7f30c4090530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 >> 172.21.15.112:0/2958806210 conn(0x7f30c409d4c0 msgr2=0x7f30c4098380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 shutdown_connections 2024-09-13T06:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.096+0000 7f30cc22c640 1 -- 172.21.15.112:0/2958806210 wait complete. 2024-09-13T06:28:54.104 INFO:teuthology.orchestra.run.smithi112.stdout:42949672965 2024-09-13T06:28:54.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:28:54.106 INFO:teuthology.orchestra.run.smithi112.stdout:42949672964 2024-09-13T06:28:54.106 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:28:54.117 INFO:teuthology.orchestra.run.smithi112.stdout:42949672965 2024-09-13T06:28:54.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:28:54.119 INFO:teuthology.orchestra.run.smithi112.stdout:38654705668 2024-09-13T06:28:54.120 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:28:54.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7ecdd0640 1 Processor -- start 2024-09-13T06:28:54.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7ecdd0640 1 -- start start 2024-09-13T06:28:54.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7ecdd0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7e80974f0 0x7fb7e8131880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7ecdd0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e8098790 con 0x7fb7e80952d0 2024-09-13T06:28:54.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7ecdd0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e8098db0 con 0x7fb7e80974f0 2024-09-13T06:28:54.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7e5d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7e80974f0 0x7fb7e8131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7e659c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb7e80952d0 0x7fb7e80956b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55338/0 (socket says 172.21.15.112:55338) 2024-09-13T06:28:54.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.208+0000 7fb7e659c640 1 -- 172.21.15.112:0/553813915 learned_addr learned my addr 172.21.15.112:0/553813915 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e559a640 1 -- 172.21.15.112:0/553813915 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341135951 0 0) 0x7fb7e8098790 con 0x7fb7e80952d0 2024-09-13T06:28:54.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e559a640 1 -- 172.21.15.112:0/553813915 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7d0003530 con 0x7fb7e80952d0 2024-09-13T06:28:54.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e5d9b640 1 -- 172.21.15.112:0/553813915 >> v1:172.21.15.112:6789/0 conn(0x7fb7e80952d0 legacy=0x7fb7e80956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e5d9b640 1 -- 172.21.15.112:0/553813915 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8097940 con 0x7fb7e80974f0 2024-09-13T06:28:54.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e5d9b640 1 --2- 172.21.15.112:0/553813915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80974f0 0x7fb7e8131880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009740 tx=0x7fb7dc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e69544c50963685 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e559a640 1 -- 172.21.15.112:0/553813915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7dc0b0070 con 0x7fb7e80974f0 2024-09-13T06:28:54.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e559a640 1 -- 172.21.15.112:0/553813915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0ab530 con 0x7fb7e80974f0 2024-09-13T06:28:54.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7e559a640 1 -- 172.21.15.112:0/553813915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7dc0ab830 con 0x7fb7e80974f0 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/553813915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80974f0 msgr2=0x7fb7e8131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 --2- 172.21.15.112:0/553813915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80974f0 0x7fb7e8131880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009740 tx=0x7fb7dc01c310 comp rx=0 tx=0).stop 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/553813915 shutdown_connections 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 --2- 172.21.15.112:0/553813915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80974f0 0x7fb7e8131880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/553813915 >> 172.21.15.112:0/553813915 conn(0x7fb7e809cd50 msgr2=0x7fb7e809d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/553813915 shutdown_connections 2024-09-13T06:28:54.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.212+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/553813915 wait complete. 2024-09-13T06:28:54.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7ecdd0640 1 Processor -- start 2024-09-13T06:28:54.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7ecdd0640 1 -- start start 2024-09-13T06:28:54.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7ecdd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 0x7fb7e80948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7ecdd0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8134760 con 0x7fb7e80952d0 2024-09-13T06:28:54.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7e659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 0x7fb7e80948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7e659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 0x7fb7e80948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34442/0 (socket says 172.21.15.112:34442) 2024-09-13T06:28:54.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7e659c640 1 -- 172.21.15.112:0/2592647423 learned_addr learned my addr 172.21.15.112:0/2592647423 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7e659c640 1 -- 172.21.15.112:0/2592647423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8070e50 con 0x7fb7e80952d0 2024-09-13T06:28:54.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7e659c640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 0x7fb7e80948a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8001ec0 tx=0x7fb7d800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d8017070 con 0x7fb7e80952d0 2024-09-13T06:28:54.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d80058c0 con 0x7fb7e80952d0 2024-09-13T06:28:54.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/2592647423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e8071630 con 0x7fb7e80952d0 2024-09-13T06:28:54.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d8005be0 con 0x7fb7e80952d0 2024-09-13T06:28:54.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7ecdd0640 1 -- 172.21.15.112:0/2592647423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e8071d10 con 0x7fb7e80952d0 2024-09-13T06:28:54.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c0005090 con 0x7fb7e80952d0 2024-09-13T06:28:54.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7d801a070 con 0x7fb7e80952d0 2024-09-13T06:28:54.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d6ffd640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb7c8035db0 0x7fb7c8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fb7d80479e0 con 0x7fb7e80952d0 2024-09-13T06:28:54.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.216+0000 7fb7e5d9b640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb7c8035db0 0x7fb7c8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.220+0000 7fb7e5d9b640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb7c8035db0 0x7fb7c8038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0ad000 tx=0x7fb7dc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.228+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7d8007070 con 0x7fb7e80952d0 2024-09-13T06:28:54.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6ed0a640 1 Processor -- start 2024-09-13T06:28:54.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7aca858640 1 Processor -- start 2024-09-13T06:28:54.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6ed0a640 1 -- start start 2024-09-13T06:28:54.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7aca858640 1 -- start start 2024-09-13T06:28:54.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6ed0a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8e6806e180 0x7f8e68133de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6ed0a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6806f8a0 con 0x7f8e6812ed70 2024-09-13T06:28:54.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6ed0a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6806eac0 con 0x7f8e6806e180 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7aca858640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ac40714d0 0x7f7ac40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7aca858640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac4070f60 con 0x7f7ac4071df0 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7aca858640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac4073920 con 0x7f7ac40714d0 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7ac4071df0 0x7f7ac406e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55346/0 (socket says 172.21.15.112:55346) 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac37fe640 1 -- 172.21.15.112:0/847003927 learned_addr learned my addr 172.21.15.112:0/847003927 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e67fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8e6806e180 0x7f8e68133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6caa6640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8e6812ed70 0x7f8e6812f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55340/0 (socket says 172.21.15.112:55340) 2024-09-13T06:28:54.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e6caa6640 1 -- 172.21.15.112:0/410300551 learned_addr learned my addr 172.21.15.112:0/410300551 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac3fff640 1 --2- 172.21.15.112:0/847003927 >> v2:172.21.15.112:3300/0 conn(0x7f7ac40714d0 0x7f7ac40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797237018 0 0) 0x7f7ac4070f60 con 0x7f7ac4071df0 2024-09-13T06:28:54.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aac005740 con 0x7f7ac4071df0 2024-09-13T06:28:54.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e67fff640 1 -- 172.21.15.112:0/410300551 >> v1:172.21.15.112:6789/0 conn(0x7f8e6812ed70 legacy=0x7f8e6812f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f8e67fff640 1 -- 172.21.15.112:0/410300551 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6806fbb0 con 0x7f8e6806e180 2024-09-13T06:28:54.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4219590177 0 0) 0x7f7aac005740 con 0x7f7ac4071df0 2024-09-13T06:28:54.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 >> v2:172.21.15.112:3300/0 conn(0x7f7ac40714d0 msgr2=0x7f7ac40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T06:28:54.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 --2- 172.21.15.112:0/847003927 >> v2:172.21.15.112:3300/0 conn(0x7f7ac40714d0 0x7f7ac40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac4072200 con 0x7f7ac4071df0 2024-09-13T06:28:54.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1533444724 0 0) 0x7f7ab80015b0 con 0x7f7ac4071df0 2024-09-13T06:28:54.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 >> v1:172.21.15.112:6789/0 conn(0x7f7ac4071df0 legacy=0x7f7ac406e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 --2- 172.21.15.112:0/847003927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7aac005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbf5ee640 1 Processor -- start 2024-09-13T06:28:54.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac006690 con 0x7f7aac005bd0 2024-09-13T06:28:54.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac3fff640 1 --2- 172.21.15.112:0/847003927 >> v2:172.21.15.112:3300/0 conn(0x7f7ac40714d0 0x7f7ac40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T06:28:54.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac3fff640 1 --2- 172.21.15.112:0/847003927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7aac005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7f7ac3fff640 1 -- 172.21.15.112:0/847003927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac4072200 con 0x7f7aac005bd0 2024-09-13T06:28:54.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbf5ee640 1 -- start start 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbf5ee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcbb80953f0 0x7fcbb80957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbf5ee640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb809c780 con 0x7fcbb8095d10 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbf5ee640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb8097030 con 0x7fcbb80953f0 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbcb89640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcbb8095d10 0x7fcbb812f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55362/0 (socket says 172.21.15.112:55362) 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbcb89640 1 -- 172.21.15.112:0/2176832065 learned_addr learned my addr 172.21.15.112:0/2176832065 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.272+0000 7fcbbd38a640 1 --2- 172.21.15.112:0/2176832065 >> v2:172.21.15.112:3300/0 conn(0x7fcbb80953f0 0x7fcbb80957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbd38a640 1 -- 172.21.15.112:0/2176832065 >> v1:172.21.15.112:6789/0 conn(0x7fcbb8095d10 legacy=0x7fcbb812f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbd38a640 1 -- 172.21.15.112:0/2176832065 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb80966c0 con 0x7fcbb80953f0 2024-09-13T06:28:54.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbaffff640 1 -- 172.21.15.112:0/2176832065 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360626047 0 0) 0x7fcbb809c780 con 0x7fcbb8095d10 2024-09-13T06:28:54.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e67fff640 1 --2- 172.21.15.112:0/410300551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e68133de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009740 tx=0x7f8e5401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1c93993fcca28c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e677fe640 1 -- 172.21.15.112:0/410300551 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e540ab550 con 0x7f8e6806e180 2024-09-13T06:28:54.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e677fe640 1 -- 172.21.15.112:0/410300551 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e540b0070 con 0x7f8e6806e180 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e677fe640 1 -- 172.21.15.112:0/410300551 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e540ab840 con 0x7f8e6806e180 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/410300551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 msgr2=0x7f8e68133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 --2- 172.21.15.112:0/410300551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e68133de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009740 tx=0x7f8e5401c400 comp rx=0 tx=0).stop 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/410300551 shutdown_connections 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 --2- 172.21.15.112:0/410300551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e68133de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/410300551 >> 172.21.15.112:0/410300551 conn(0x7f8e6809cd30 msgr2=0x7f8e6809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/410300551 shutdown_connections 2024-09-13T06:28:54.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/410300551 wait complete. 2024-09-13T06:28:54.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbd38a640 1 --2- 172.21.15.112:0/2176832065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb80957d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009fd0 tx=0x7fcbb401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63ba43a324b371f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbaffff640 1 -- 172.21.15.112:0/2176832065 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb40b0070 con 0x7fcbb80953f0 2024-09-13T06:28:54.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbaffff640 1 -- 172.21.15.112:0/2176832065 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb40ab530 con 0x7fcbb80953f0 2024-09-13T06:28:54.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbaffff640 1 -- 172.21.15.112:0/2176832065 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb40ab830 con 0x7fcbb80953f0 2024-09-13T06:28:54.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f7ac3fff640 1 --2- 172.21.15.112:0/847003927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7aac005fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009c10 tx=0x7f7ab401cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0593eef4527bab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab4009860 con 0x7f7aac005bd0 2024-09-13T06:28:54.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab40a5b60 con 0x7f7aac005bd0 2024-09-13T06:28:54.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f7ac2ffd640 1 -- 172.21.15.112:0/847003927 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab40a5e40 con 0x7f7aac005bd0 2024-09-13T06:28:54.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/2176832065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 msgr2=0x7fcbb80957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 --2- 172.21.15.112:0/2176832065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb80957d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009fd0 tx=0x7fcbb401c370 comp rx=0 tx=0).stop 2024-09-13T06:28:54.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 Processor -- start 2024-09-13T06:28:54.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 -- start start 2024-09-13T06:28:54.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/2176832065 shutdown_connections 2024-09-13T06:28:54.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 --2- 172.21.15.112:0/2176832065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb80957d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/2176832065 >> 172.21.15.112:0/2176832065 conn(0x7fcbb809b450 msgr2=0x7fcbb809b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/2176832065 shutdown_connections 2024-09-13T06:28:54.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/2176832065 wait complete. 2024-09-13T06:28:54.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6ed0a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e681c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f7aca858640 1 -- 172.21.15.112:0/847003927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 msgr2=0x7f7aac005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f7aca858640 1 --2- 172.21.15.112:0/847003927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7aac005fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009c10 tx=0x7f7ab401cd10 comp rx=0 tx=0).stop 2024-09-13T06:28:54.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- 172.21.15.112:0/847003927 shutdown_connections 2024-09-13T06:28:54.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.276+0000 7f8e6caa6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e681c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6caa6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e681c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34494/0 (socket says 172.21.15.112:34494) 2024-09-13T06:28:54.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6caa6640 1 -- 172.21.15.112:0/3272644864 learned_addr learned my addr 172.21.15.112:0/3272644864 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 --2- 172.21.15.112:0/847003927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7aac005fd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 --2- 172.21.15.112:0/847003927 >> v2:172.21.15.112:3300/0 conn(0x7f7ac40714d0 0x7f7ac40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- 172.21.15.112:0/847003927 >> 172.21.15.112:0/847003927 conn(0x7f7ac409a6f0 msgr2=0x7f7ac409ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68136ed0 con 0x7f8e6806e180 2024-09-13T06:28:54.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- 172.21.15.112:0/847003927 shutdown_connections 2024-09-13T06:28:54.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- 172.21.15.112:0/847003927 wait complete. 2024-09-13T06:28:54.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 Processor -- start 2024-09-13T06:28:54.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6caa6640 1 -- 172.21.15.112:0/3272644864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68093f70 con 0x7f8e6806e180 2024-09-13T06:28:54.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6caa6640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e681c61e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c480 tx=0x7f8e5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 -- start start 2024-09-13T06:28:54.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb81c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8133390 con 0x7fcbb80953f0 2024-09-13T06:28:54.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c017070 con 0x7f8e6806e180 2024-09-13T06:28:54.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5c005c20 con 0x7f8e6806e180 2024-09-13T06:28:54.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c007070 con 0x7f8e6806e180 2024-09-13T06:28:54.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbd38a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb81c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbd38a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb81c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34504/0 (socket says 172.21.15.112:34504) 2024-09-13T06:28:54.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbd38a640 1 -- 172.21.15.112:0/3279521010 learned_addr learned my addr 172.21.15.112:0/3279521010 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e68094740 con 0x7f8e6806e180 2024-09-13T06:28:54.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 Processor -- start 2024-09-13T06:28:54.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- start start 2024-09-13T06:28:54.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e681c6720 con 0x7f8e6806e180 2024-09-13T06:28:54.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbd38a640 1 -- 172.21.15.112:0/3279521010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb812dc80 con 0x7fcbb80953f0 2024-09-13T06:28:54.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbd38a640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb81c7500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4019fa0 tx=0x7fcbb4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb40b8070 con 0x7fcbb80953f0 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb40b4540 con 0x7fcbb80953f0 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb812c750 con 0x7fcbb80953f0 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb40b0040 con 0x7fcbb80953f0 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb81c7a40 con 0x7fcbb80953f0 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7ac41c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac406f3f0 con 0x7f7aac005bd0 2024-09-13T06:28:54.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7ac41c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7ac41c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34516/0 (socket says 172.21.15.112:34516) 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac3fff640 1 -- 172.21.15.112:0/2294468659 learned_addr learned my addr 172.21.15.112:0/2294468659 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac3fff640 1 -- 172.21.15.112:0/2294468659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac40959b0 con 0x7f7aac005bd0 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac3fff640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7ac41c5c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009c10 tx=0x7f7ab4019ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8e5c01a070 con 0x7f8e6806e180 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e48005090 con 0x7f8e6806e180 2024-09-13T06:28:54.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e657fa640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8e4c035e50 0x7f8e4c038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f8e5c0479f0 con 0x7f8e6806e180 2024-09-13T06:28:54.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e67fff640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8e4c035e50 0x7f8e4c038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab4006e20 con 0x7f7aac005bd0 2024-09-13T06:28:54.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab4004230 con 0x7f7aac005bd0 2024-09-13T06:28:54.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f8e67fff640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8e4c035e50 0x7f8e4c038310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009740 tx=0x7f8e540a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab40059a0 con 0x7f7aac005bd0 2024-09-13T06:28:54.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac41c6140 con 0x7f7aac005bd0 2024-09-13T06:28:54.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac41c6600 con 0x7f7aac005bd0 2024-09-13T06:28:54.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.280+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb80940d0 con 0x7fcbb80953f0 2024-09-13T06:28:54.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.284+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac4096180 con 0x7f7aac005bd0 2024-09-13T06:28:54.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.284+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e5c007210 con 0x7f8e6806e180 2024-09-13T06:28:54.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.284+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcbb40bb070 con 0x7fcbb80953f0 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7fcbadffb640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcb9c035db0 0x7fcb9c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fcbb40e2a90 con 0x7fcbb80953f0 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7fcbbcb89640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcb9c035db0 0x7fcb9c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ab40c8030 con 0x7f7aac005bd0 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7f7ac0ff9640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ab0035d40 0x7f7ab0038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f7ab40c6070 con 0x7f7aac005bd0 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7f7ac37fe640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ab0035d40 0x7f7ab0038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:54.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7fcbbcb89640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcb9c035db0 0x7fcb9c038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcba8007fd0 tx=0x7fcba8007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.288+0000 7f7ac37fe640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ab0035d40 0x7f7ab0038200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007930 tx=0x7f7ab80014e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:54.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.292+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcbb4015ff0 con 0x7fcbb80953f0 2024-09-13T06:28:54.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.300+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ab40cf060 con 0x7f7aac005bd0 2024-09-13T06:28:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.388+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb7c0005380 con 0x7fb7e80952d0 2024-09-13T06:28:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d6ffd640 1 -- 172.21.15.112:0/2592647423 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7d801a360 con 0x7fb7e80952d0 2024-09-13T06:28:54.388 INFO:teuthology.orchestra.run.smithi112.stdout:42949672964 2024-09-13T06:28:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb7c8035db0 msgr2=0x7fb7c8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb7c8035db0 0x7fb7c8038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0ad000 tx=0x7fb7dc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:28:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 msgr2=0x7fb7e80948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 0x7fb7e80948a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8001ec0 tx=0x7fb7d800cb60 comp rx=0 tx=0).stop 2024-09-13T06:28:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 shutdown_connections 2024-09-13T06:28:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb7c8035db0 0x7fb7c8038270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 --2- 172.21.15.112:0/2592647423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7e80952d0 0x7fb7e80948a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 >> 172.21.15.112:0/2592647423 conn(0x7fb7e809cd50 msgr2=0x7fb7e8099680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 shutdown_connections 2024-09-13T06:28:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.392+0000 7fb7d4ff9640 1 -- 172.21.15.112:0/2592647423 wait complete. 2024-09-13T06:28:54.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-13T06:28:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.444+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8e48005380 con 0x7f8e6806e180 2024-09-13T06:28:54.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.444+0000 7f8e657fa640 1 -- 172.21.15.112:0/3272644864 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e5c01b3b0 con 0x7f8e6806e180 2024-09-13T06:28:54.442 INFO:teuthology.orchestra.run.smithi112.stdout:42949672963 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8e4c035e50 msgr2=0x7f8e4c038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8e4c035e50 0x7f8e4c038310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009740 tx=0x7f8e540a7000 comp rx=0 tx=0).stop 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 msgr2=0x7f8e681c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e681c61e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c480 tx=0x7f8e5c00c940 comp rx=0 tx=0).stop 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 shutdown_connections 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8e4c035e50 0x7f8e4c038310 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 --2- 172.21.15.112:0/3272644864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6806e180 0x7f8e681c61e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 >> 172.21.15.112:0/3272644864 conn(0x7f8e6809cd30 msgr2=0x7f8e6812fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 shutdown_connections 2024-09-13T06:28:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.448+0000 7f8e6ed0a640 1 -- 172.21.15.112:0/3272644864 wait complete. 2024-09-13T06:28:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcbb809c780 con 0x7fcbb80953f0 2024-09-13T06:28:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbadffb640 1 -- 172.21.15.112:0/3279521010 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcbb40b4d40 con 0x7fcbb80953f0 2024-09-13T06:28:54.453 INFO:teuthology.orchestra.run.smithi112.stdout:38654705667 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcb9c035db0 msgr2=0x7fcb9c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcb9c035db0 0x7fcb9c038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcba8007fd0 tx=0x7fcba8007920 comp rx=0 tx=0).stop 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 msgr2=0x7fcbb81c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb81c7500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4019fa0 tx=0x7fcbb4019110 comp rx=0 tx=0).stop 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 shutdown_connections 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcb9c035db0 0x7fcb9c038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.456+0000 7fcbbf5ee640 1 --2- 172.21.15.112:0/3279521010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbb80953f0 0x7fcbb81c7500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 >> 172.21.15.112:0/3279521010 conn(0x7fcbb809b450 msgr2=0x7fcbb806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 shutdown_connections 2024-09-13T06:28:54.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7fcbbf5ee640 1 -- 172.21.15.112:0/3279521010 wait complete. 2024-09-13T06:28:54.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7ac40008e0 con 0x7f7aac005bd0 2024-09-13T06:28:54.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7ac0ff9640 1 -- 172.21.15.112:0/2294468659 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ab4016900 con 0x7f7aac005bd0 2024-09-13T06:28:54.457 INFO:teuthology.orchestra.run.smithi112.stdout:42949672964 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ab0035d40 msgr2=0x7f7ab0038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ab0035d40 0x7f7ab0038200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007930 tx=0x7f7ab80014e0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 msgr2=0x7f7ac41c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7ac41c5c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009c10 tx=0x7f7ab4019ab0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 shutdown_connections 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ab0035d40 0x7f7ab0038200 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 --2- 172.21.15.112:0/2294468659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7aac005bd0 0x7f7ac41c5c00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 >> 172.21.15.112:0/2294468659 conn(0x7f7ac409a6f0 msgr2=0x7f7ac4098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 shutdown_connections 2024-09-13T06:28:54.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:54.460+0000 7f7aca858640 1 -- 172.21.15.112:0/2294468659 wait complete. 2024-09-13T06:28:54.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-13T06:28:54.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-09-13T06:28:54.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-13T06:28:55.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:28:55.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:28:55.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:28:55.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.536+0000 7f16c8be9640 1 Processor -- start 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c8be9640 1 -- start start 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c8be9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16c4070870 0x7f16c4131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c8be9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c409e860 con 0x7f16c412cd50 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c8be9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f16c412d840 con 0x7f16c4070870 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c1d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16c4070870 0x7f16c4131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c259c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16c412cd50 0x7f16c412d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55376/0 (socket says 172.21.15.112:55376) 2024-09-13T06:28:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c259c640 1 -- 172.21.15.112:0/4096505313 learned_addr learned my addr 172.21.15.112:0/4096505313 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:55.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c159a640 1 -- 172.21.15.112:0/4096505313 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750043947 0 0) 0x7f16c409e860 con 0x7f16c412cd50 2024-09-13T06:28:55.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c159a640 1 -- 172.21.15.112:0/4096505313 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16ac003530 con 0x7f16c412cd50 2024-09-13T06:28:55.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c1d9b640 1 -- 172.21.15.112:0/4096505313 >> v1:172.21.15.112:6789/0 conn(0x7f16c412cd50 legacy=0x7f16c412d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.540+0000 7f16c1d9b640 1 -- 172.21.15.112:0/4096505313 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c4071c60 con 0x7f16c4070870 2024-09-13T06:28:55.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c1d9b640 1 --2- 172.21.15.112:0/4096505313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c4131dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009740 tx=0x7f16b801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44b5b61ad8e14cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c159a640 1 -- 172.21.15.112:0/4096505313 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b80ab550 con 0x7f16c4070870 2024-09-13T06:28:55.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c159a640 1 -- 172.21.15.112:0/4096505313 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b80b0070 con 0x7f16c4070870 2024-09-13T06:28:55.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c159a640 1 -- 172.21.15.112:0/4096505313 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b80ab840 con 0x7f16c4070870 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- 172.21.15.112:0/4096505313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 msgr2=0x7f16c4131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 --2- 172.21.15.112:0/4096505313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c4131dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009740 tx=0x7f16b801c400 comp rx=0 tx=0).stop 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- 172.21.15.112:0/4096505313 shutdown_connections 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 --2- 172.21.15.112:0/4096505313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c4131dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- 172.21.15.112:0/4096505313 >> 172.21.15.112:0/4096505313 conn(0x7f16c409cd30 msgr2=0x7f16c409d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- 172.21.15.112:0/4096505313 shutdown_connections 2024-09-13T06:28:55.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- 172.21.15.112:0/4096505313 wait complete. 2024-09-13T06:28:55.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 Processor -- start 2024-09-13T06:28:55.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- start start 2024-09-13T06:28:55.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c40986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f16c4134d30 con 0x7f16c4070870 2024-09-13T06:28:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c40986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c40986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34532/0 (socket says 172.21.15.112:34532) 2024-09-13T06:28:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c259c640 1 -- 172.21.15.112:0/1269961472 learned_addr learned my addr 172.21.15.112:0/1269961472 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c259c640 1 -- 172.21.15.112:0/1269961472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c412a170 con 0x7f16c4070870 2024-09-13T06:28:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c259c640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c40986d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16b400c450 tx=0x7f16b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4017070 con 0x7f16c4070870 2024-09-13T06:28:55.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b4005c20 con 0x7f16c4070870 2024-09-13T06:28:55.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c412ad20 con 0x7f16c4070870 2024-09-13T06:28:55.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.544+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4007070 con 0x7f16c4070870 2024-09-13T06:28:55.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c4098de0 con 0x7f16c4070870 2024-09-13T06:28:55.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c4129cb0 con 0x7f16c4070870 2024-09-13T06:28:55.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16b401a070 con 0x7f16c4070870 2024-09-13T06:28:55.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16b2ffd640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16a4035db0 0x7f16a4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f16b4047a20 con 0x7f16c4070870 2024-09-13T06:28:55.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16c1d9b640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16a4035db0 0x7f16a4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.548+0000 7f16c1d9b640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16a4035db0 0x7f16a4038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16b80af000 tx=0x7f16b80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.552+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f16b4012400 con 0x7f16c4070870 2024-09-13T06:28:55.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.584+0000 7f525e738640 1 Processor -- start 2024-09-13T06:28:55.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.584+0000 7f525e738640 1 -- start start 2024-09-13T06:28:55.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f525e738640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5258097350 0x7f5258097730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f525e738640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52580709e0 con 0x7f5258097c70 2024-09-13T06:28:55.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f525e738640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f525809b480 con 0x7f5258097350 2024-09-13T06:28:55.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f5257fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5258097350 0x7f5258097730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f52577fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5258097c70 0x7f525806e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55386/0 (socket says 172.21.15.112:55386) 2024-09-13T06:28:55.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f52577fe640 1 -- 172.21.15.112:0/2496869452 learned_addr learned my addr 172.21.15.112:0/2496869452 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:55.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f5257fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5258097350 0x7f5258097730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34536/0 (socket says 172.21.15.112:34536) 2024-09-13T06:28:55.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f5257fff640 1 -- 172.21.15.112:0/2496869452 >> v1:172.21.15.112:6789/0 conn(0x7f5258097c70 legacy=0x7f525806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.588+0000 7f5257fff640 1 -- 172.21.15.112:0/2496869452 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5258070c80 con 0x7f5258097350 2024-09-13T06:28:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5257fff640 1 --2- 172.21.15.112:0/2496869452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258097730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5248009740 tx=0x7f524801e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91be19a7681681f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5256ffd640 1 -- 172.21.15.112:0/2496869452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52480ac530 con 0x7f5258097350 2024-09-13T06:28:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5256ffd640 1 -- 172.21.15.112:0/2496869452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52480b1070 con 0x7f5258097350 2024-09-13T06:28:55.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5256ffd640 1 -- 172.21.15.112:0/2496869452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52480ac820 con 0x7f5258097350 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/2496869452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 msgr2=0x7f5258097730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 --2- 172.21.15.112:0/2496869452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258097730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5248009740 tx=0x7f524801e580 comp rx=0 tx=0).stop 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/2496869452 shutdown_connections 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 --2- 172.21.15.112:0/2496869452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258097730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/2496869452 >> 172.21.15.112:0/2496869452 conn(0x7f525809ab20 msgr2=0x7f525806d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/2496869452 shutdown_connections 2024-09-13T06:28:55.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/2496869452 wait complete. 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 Processor -- start 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- start start 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258129170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f525806fab0 con 0x7f5258097350 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5257fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258129170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5257fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258129170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34546/0 (socket says 172.21.15.112:34546) 2024-09-13T06:28:55.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5257fff640 1 -- 172.21.15.112:0/909064662 learned_addr learned my addr 172.21.15.112:0/909064662 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5257fff640 1 -- 172.21.15.112:0/909064662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5258130590 con 0x7f5258097350 2024-09-13T06:28:55.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5257fff640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258129170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52480ae040 tx=0x7f524801cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52480b6610 con 0x7f5258097350 2024-09-13T06:28:55.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52480b67b0 con 0x7f5258097350 2024-09-13T06:28:55.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/909064662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525812a9f0 con 0x7f5258097350 2024-09-13T06:28:55.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52480b6ad0 con 0x7f5258097350 2024-09-13T06:28:55.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.592+0000 7f525e738640 1 -- 172.21.15.112:0/909064662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525812b610 con 0x7f5258097350 2024-09-13T06:28:55.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.596+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5230005090 con 0x7f5258097350 2024-09-13T06:28:55.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.596+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52480be020 con 0x7f5258097350 2024-09-13T06:28:55.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.596+0000 7f5254ff9640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5244035db0 0x7f5244038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.596+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f52480e50d0 con 0x7f5258097350 2024-09-13T06:28:55.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.596+0000 7f52577fe640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5244035db0 0x7f5244038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.596+0000 7f52577fe640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5244035db0 0x7f5244038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5258098070 tx=0x7f524c007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.604+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5258130590 con 0x7f5258097350 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.624+0000 7f0ef054a640 1 Processor -- start 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.624+0000 7f0ef054a640 1 -- start start 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.624+0000 7f0ef054a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee812e760 0x7f0ee812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.624+0000 7f0ef054a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee80984f0 con 0x7f0ee812f1c0 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.624+0000 7f0ef054a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee8098dc0 con 0x7f0ee812e760 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eee2e6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee812e760 0x7f0ee812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eedae5640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0ee812f1c0 0x7f0ee812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55398/0 (socket says 172.21.15.112:55398) 2024-09-13T06:28:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eedae5640 1 -- 172.21.15.112:0/2770672768 learned_addr learned my addr 172.21.15.112:0/2770672768 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eed2e4640 1 -- 172.21.15.112:0/2770672768 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144005048 0 0) 0x7f0ee80984f0 con 0x7f0ee812f1c0 2024-09-13T06:28:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eed2e4640 1 -- 172.21.15.112:0/2770672768 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ed4003530 con 0x7f0ee812f1c0 2024-09-13T06:28:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eee2e6640 1 -- 172.21.15.112:0/2770672768 >> v1:172.21.15.112:6789/0 conn(0x7f0ee812f1c0 legacy=0x7f0ee812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eee2e6640 1 -- 172.21.15.112:0/2770672768 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee812f5a0 con 0x7f0ee812e760 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b95da640 1 Processor -- start 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b95da640 1 -- start start 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b95da640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83b406e850 0x7f83b406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b95da640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b406beb0 con 0x7f83b406f170 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b95da640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f83b4070050 con 0x7f83b406e850 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b2ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83b406e850 0x7f83b406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b2ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83b406e850 0x7f83b406ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34556/0 (socket says 172.21.15.112:34556) 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b27fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f83b406f170 0x7f83b412ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55412/0 (socket says 172.21.15.112:55412) 2024-09-13T06:28:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b2ffd640 1 -- 172.21.15.112:0/870669261 learned_addr learned my addr 172.21.15.112:0/870669261 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b1ffb640 1 -- 172.21.15.112:0/870669261 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166781442 0 0) 0x7f83b406beb0 con 0x7f83b406f170 2024-09-13T06:28:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b2ffd640 1 -- 172.21.15.112:0/870669261 >> v1:172.21.15.112:6789/0 conn(0x7f83b406f170 legacy=0x7f83b412ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f83b2ffd640 1 -- 172.21.15.112:0/870669261 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b406fd40 con 0x7f83b406e850 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eee2e6640 1 --2- 172.21.15.112:0/2770672768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee812ec80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009740 tx=0x7f0ee401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccea6cf531884080 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eed2e4640 1 -- 172.21.15.112:0/2770672768 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40b0070 con 0x7f0ee812e760 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eed2e4640 1 -- 172.21.15.112:0/2770672768 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40ab530 con 0x7f0ee812e760 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0eed2e4640 1 -- 172.21.15.112:0/2770672768 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40ab830 con 0x7f0ee812e760 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0ef054a640 1 -- 172.21.15.112:0/2770672768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 msgr2=0x7f0ee812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.628+0000 7f0ef054a640 1 --2- 172.21.15.112:0/2770672768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee812ec80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009740 tx=0x7f0ee401c400 comp rx=0 tx=0).stop 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/2770672768 shutdown_connections 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 --2- 172.21.15.112:0/2770672768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee812ec80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/2770672768 >> 172.21.15.112:0/2770672768 conn(0x7f0ee80a10a0 msgr2=0x7f0ee80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/2770672768 shutdown_connections 2024-09-13T06:28:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/2770672768 wait complete. 2024-09-13T06:28:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b2ffd640 1 --2- 172.21.15.112:0/870669261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b406ec30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83a40097f0 tx=0x7f83a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8e40e12c54a23a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b1ffb640 1 -- 172.21.15.112:0/870669261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a40b0070 con 0x7f83b406e850 2024-09-13T06:28:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b1ffb640 1 -- 172.21.15.112:0/870669261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a40ab530 con 0x7f83b406e850 2024-09-13T06:28:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b1ffb640 1 -- 172.21.15.112:0/870669261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a40ab830 con 0x7f83b406e850 2024-09-13T06:28:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 Processor -- start 2024-09-13T06:28:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- start start 2024-09-13T06:28:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee80704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8136e30 con 0x7f0ee812e760 2024-09-13T06:28:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0eee2e6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee80704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- 172.21.15.112:0/870669261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 msgr2=0x7f83b406ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 --2- 172.21.15.112:0/870669261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b406ec30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83a40097f0 tx=0x7f83a401c430 comp rx=0 tx=0).stop 2024-09-13T06:28:55.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0eee2e6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee80704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34570/0 (socket says 172.21.15.112:34570) 2024-09-13T06:28:55.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0eee2e6640 1 -- 172.21.15.112:0/108305996 learned_addr learned my addr 172.21.15.112:0/108305996 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- 172.21.15.112:0/870669261 shutdown_connections 2024-09-13T06:28:55.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 --2- 172.21.15.112:0/870669261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b406ec30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- 172.21.15.112:0/870669261 >> 172.21.15.112:0/870669261 conn(0x7f83b409ac70 msgr2=0x7f83b406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- 172.21.15.112:0/870669261 shutdown_connections 2024-09-13T06:28:55.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- 172.21.15.112:0/870669261 wait complete. 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0eee2e6640 1 -- 172.21.15.112:0/108305996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee8071310 con 0x7f0ee812e760 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0eee2e6640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee80704c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ee401a030 tx=0x7f0ee401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40b0050 con 0x7f0ee812e760 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40b1040 con 0x7f0ee812e760 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee8128f50 con 0x7f0ee812e760 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40b7580 con 0x7f0ee812e760 2024-09-13T06:28:55.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee8072e70 con 0x7f0ee812e760 2024-09-13T06:28:55.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 Processor -- start 2024-09-13T06:28:55.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- start start 2024-09-13T06:28:55.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b41cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee812ec80 con 0x7f0ee812e760 2024-09-13T06:28:55.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.632+0000 7f83b95da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4137970 con 0x7f83b406e850 2024-09-13T06:28:55.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f83b2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b41cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f83b2ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b41cabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34572/0 (socket says 172.21.15.112:34572) 2024-09-13T06:28:55.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f83b2ffd640 1 -- 172.21.15.112:0/2467752164 learned_addr learned my addr 172.21.15.112:0/2467752164 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f83b2ffd640 1 -- 172.21.15.112:0/2467752164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b408c4c0 con 0x7f83b406e850 2024-09-13T06:28:55.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f83b2ffd640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b41cabd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83a4019040 tx=0x7f83a401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ee40be030 con 0x7f0ee812e760 2024-09-13T06:28:55.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f0edeffd640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ecc035db0 0x7f0ecc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f0ee40bc070 con 0x7f0ee812e760 2024-09-13T06:28:55.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f0eedae5640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ecc035db0 0x7f0ecc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.636+0000 7f0eedae5640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ecc035db0 0x7f0ecc038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8007fd0 tx=0x7f0ed8007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a40b0040 con 0x7f83b406e850 2024-09-13T06:28:55.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4004020 con 0x7f83b406e850 2024-09-13T06:28:55.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f83b95da640 1 -- 172.21.15.112:0/2467752164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b4097680 con 0x7f83b406e850 2024-09-13T06:28:55.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a40abe60 con 0x7f83b406e850 2024-09-13T06:28:55.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f83b95da640 1 -- 172.21.15.112:0/2467752164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b408d5a0 con 0x7f83b406e850 2024-09-13T06:28:55.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ee40c5020 con 0x7f0ee812e760 2024-09-13T06:28:55.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.640+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c005090 con 0x7f83b406e850 2024-09-13T06:28:55.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.644+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f83a40b3070 con 0x7f83b406e850 2024-09-13T06:28:55.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.644+0000 7f839b7fe640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f83a0035db0 0x7f83a0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.644+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f83a40e30b0 con 0x7f83b406e850 2024-09-13T06:28:55.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.644+0000 7f83b27fc640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f83a0035db0 0x7f83a0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.644+0000 7f83b27fc640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f83a0035db0 0x7f83a0038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83a8007fd0 tx=0x7f83a8007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.652+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83a40c3030 con 0x7f83b406e850 2024-09-13T06:28:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.732+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f16c4070e10 con 0x7f16c4070870 2024-09-13T06:28:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.732+0000 7f16b2ffd640 1 -- 172.21.15.112:0/1269961472 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f16b401ac10 con 0x7f16c4070870 2024-09-13T06:28:55.730 INFO:teuthology.orchestra.run.smithi112.stdout:42949672965 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16a4035db0 msgr2=0x7f16a4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16a4035db0 0x7f16a4038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16b80af000 tx=0x7f16b80a7000 comp rx=0 tx=0).stop 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 msgr2=0x7f16c40986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c40986d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16b400c450 tx=0x7f16b400c910 comp rx=0 tx=0).stop 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 shutdown_connections 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16a4035db0 0x7f16a4038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 --2- 172.21.15.112:0/1269961472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c4070870 0x7f16c40986d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 >> 172.21.15.112:0/1269961472 conn(0x7f16c409cd30 msgr2=0x7f16c41308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 shutdown_connections 2024-09-13T06:28:55.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.736+0000 7f16c8be9640 1 -- 172.21.15.112:0/1269961472 wait complete. 2024-09-13T06:28:55.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.1 2024-09-13T06:28:55.747 DEBUG:teuthology.parallel:result is None 2024-09-13T06:28:55.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.764+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5230005380 con 0x7f5258097350 2024-09-13T06:28:55.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.764+0000 7f5254ff9640 1 -- 172.21.15.112:0/909064662 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5248018200 con 0x7f5258097350 2024-09-13T06:28:55.763 INFO:teuthology.orchestra.run.smithi112.stdout:42949672964 2024-09-13T06:28:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5244035db0 msgr2=0x7f5244038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5244035db0 0x7f5244038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5258098070 tx=0x7f524c007ad0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 msgr2=0x7f5258129170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258129170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52480ae040 tx=0x7f524801cdc0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 shutdown_connections 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5244035db0 0x7f5244038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 --2- 172.21.15.112:0/909064662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5258097350 0x7f5258129170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 >> 172.21.15.112:0/909064662 conn(0x7f525809ab20 msgr2=0x7f5258127f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 shutdown_connections 2024-09-13T06:28:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.768+0000 7f523e7fc640 1 -- 172.21.15.112:0/909064662 wait complete. 2024-09-13T06:28:55.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.3 2024-09-13T06:28:55.780 DEBUG:teuthology.parallel:result is None 2024-09-13T06:28:55.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.808+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0ee806e930 con 0x7f0ee812e760 2024-09-13T06:28:55.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.808+0000 7f0edeffd640 1 -- 172.21.15.112:0/108305996 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ee4015ff0 con 0x7f0ee812e760 2024-09-13T06:28:55.806 INFO:teuthology.orchestra.run.smithi112.stdout:38654705668 2024-09-13T06:28:55.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ecc035db0 msgr2=0x7f0ecc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ecc035db0 0x7f0ecc038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8007fd0 tx=0x7f0ed8007980 comp rx=0 tx=0).stop 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 msgr2=0x7f0ee80704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee80704c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ee401a030 tx=0x7f0ee401ac40 comp rx=0 tx=0).stop 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 shutdown_connections 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ecc035db0 0x7f0ecc038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 --2- 172.21.15.112:0/108305996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee812e760 0x7f0ee80704c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 >> 172.21.15.112:0/108305996 conn(0x7f0ee80a10a0 msgr2=0x7f0ee8125d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 shutdown_connections 2024-09-13T06:28:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.812+0000 7f0ef054a640 1 -- 172.21.15.112:0/108305996 wait complete. 2024-09-13T06:28:55.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.820+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f838c005650 con 0x7f83b406e850 2024-09-13T06:28:55.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.820+0000 7f839b7fe640 1 -- 172.21.15.112:0/2467752164 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83b4097680 con 0x7f83b406e850 2024-09-13T06:28:55.817 INFO:teuthology.orchestra.run.smithi112.stdout:42949672965 2024-09-13T06:28:55.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f83a0035db0 msgr2=0x7f83a0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f83a0035db0 0x7f83a0038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83a8007fd0 tx=0x7f83a8007920 comp rx=0 tx=0).stop 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 msgr2=0x7f83b41cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b41cabd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83a4019040 tx=0x7f83a401ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 shutdown_connections 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f83a0035db0 0x7f83a0038270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 --2- 172.21.15.112:0/2467752164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b406e850 0x7f83b41cabd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 >> 172.21.15.112:0/2467752164 conn(0x7f83b409ac70 msgr2=0x7f83b4071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 shutdown_connections 2024-09-13T06:28:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.824+0000 7f83997fa640 1 -- 172.21.15.112:0/2467752164 wait complete. 2024-09-13T06:28:55.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-13T06:28:55.823 DEBUG:teuthology.parallel:result is None 2024-09-13T06:28:55.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-09-13T06:28:55.835 DEBUG:teuthology.parallel:result is None 2024-09-13T06:28:55.835 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:28:55.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:28:55.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfc5f9640 1 Processor -- start 2024-09-13T06:28:55.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfc5f9640 1 -- start start 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfc5f9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3df4072760 0x7f3df4072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfc5f9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df406fa30 con 0x7f3df406f190 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfc5f9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3df406e800 con 0x7f3df4072760 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfa395640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3df4072760 0x7f3df4072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfa395640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3df4072760 0x7f3df4072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34588/0 (socket says 172.21.15.112:34588) 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.980+0000 7f3dfa395640 1 -- 172.21.15.112:0/2022764613 learned_addr learned my addr 172.21.15.112:0/2022764613 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfa395640 1 -- 172.21.15.112:0/2022764613 >> v1:172.21.15.112:6789/0 conn(0x7f3df406f190 legacy=0x7f3df406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T06:28:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfa395640 1 -- 172.21.15.112:0/2022764613 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df406fd40 con 0x7f3df4072760 2024-09-13T06:28:55.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfa395640 1 --2- 172.21.15.112:0/2022764613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df4072760 0x7f3df4072b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3df00097f0 tx=0x7f3df001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d32a300ba37408 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3df9393640 1 -- 172.21.15.112:0/2022764613 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df00b0070 con 0x7f3df4072760 2024-09-13T06:28:55.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3df9393640 1 -- 172.21.15.112:0/2022764613 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df00ab530 con 0x7f3df4072760 2024-09-13T06:28:55.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3df9393640 1 -- 172.21.15.112:0/2022764613 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df00ab830 con 0x7f3df4072760 2024-09-13T06:28:55.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2022764613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df4072760 msgr2=0x7f3df4072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:55.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 --2- 172.21.15.112:0/2022764613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df4072760 0x7f3df4072b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3df00097f0 tx=0x7f3df001c430 comp rx=0 tx=0).stop 2024-09-13T06:28:55.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2022764613 shutdown_connections 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 --2- 172.21.15.112:0/2022764613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df4072760 0x7f3df4072b40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2022764613 >> 172.21.15.112:0/2022764613 conn(0x7f3df4099a50 msgr2=0x7f3df40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2022764613 shutdown_connections 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2022764613 wait complete. 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 Processor -- start 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.984+0000 7f3dfc5f9640 1 -- start start 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfc5f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 0x7f3df4121e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfc5f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4137620 con 0x7f3df406f190 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfa395640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 0x7f3df4121e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfa395640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 0x7f3df4121e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34596/0 (socket says 172.21.15.112:34596) 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfa395640 1 -- 172.21.15.112:0/2130572879 learned_addr learned my addr 172.21.15.112:0/2130572879 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfa395640 1 -- 172.21.15.112:0/2130572879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df40967a0 con 0x7f3df406f190 2024-09-13T06:28:55.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfa395640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 0x7f3df4121e80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3df00097f0 tx=0x7f3df001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df00ba020 con 0x7f3df406f190 2024-09-13T06:28:55.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df00b6420 con 0x7f3df406f190 2024-09-13T06:28:55.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df4124fb0 con 0x7f3df406f190 2024-09-13T06:28:55.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df00b0040 con 0x7f3df406f190 2024-09-13T06:28:55.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41253f0 con 0x7f3df406f190 2024-09-13T06:28:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4072b40 con 0x7f3df406f190 2024-09-13T06:28:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3df00bd020 con 0x7f3df406f190 2024-09-13T06:28:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3deaffd640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3dd8035db0 0x7f3dd8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f3df00e2a80 con 0x7f3df406f190 2024-09-13T06:28:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3df9b94640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3dd8035db0 0x7f3dd8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.988+0000 7f3df9b94640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3dd8035db0 0x7f3dd8038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000f70 tx=0x7f3de4007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:55.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:55.992+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3df00c4030 con 0x7f3df406f190 2024-09-13T06:28:56.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.136+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3df4122ff0 con 0x7f3dd8035db0 2024-09-13T06:28:56.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.140+0000 7f3deaffd640 1 -- 172.21.15.112:0/2130572879 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32241 (secure 0 0 0) 0x7f3df4122ff0 con 0x7f3dd8035db0 2024-09-13T06:28:56.139 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:28:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3dd8035db0 msgr2=0x7f3dd8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3dd8035db0 0x7f3dd8038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000f70 tx=0x7f3de4007a40 comp rx=0 tx=0).stop 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 msgr2=0x7f3df4121e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 0x7f3df4121e80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3df00097f0 tx=0x7f3df001ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 shutdown_connections 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3dd8035db0 0x7f3dd8038270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 --2- 172.21.15.112:0/2130572879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df406f190 0x7f3df4121e80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 >> 172.21.15.112:0/2130572879 conn(0x7f3df4099a50 msgr2=0x7f3df4133300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 shutdown_connections 2024-09-13T06:28:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.144+0000 7f3dfc5f9640 1 -- 172.21.15.112:0/2130572879 wait complete. 2024-09-13T06:28:56.155 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T06:28:54.395371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109892,"kb_used_data":1768,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377468,"statfs":{"total":386547056640,"available":386434527232,"internally_reserved":0,"allocated":1810432,"data_stored":1380318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.463909"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.961183+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:28:52.961183+0000","last_peered":"2024-09-13T06:28:52.961183+0000","last_clean":"2024-09-13T06:28:52.961183+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:28:52.961183+0000","last_undegraded":"2024-09-13T06:28:52.961183+0000","last_fullsized":"2024-09-13T06:28:52.961183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:00.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.951324+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:28:52.951324+0000","last_peered":"2024-09-13T06:28:52.951324+0000","last_clean":"2024-09-13T06:28:52.951324+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:28:52.951324+0000","last_undegraded":"2024-09-13T06:28:52.951324+0000","last_fullsized":"2024-09-13T06:28:52.951324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:58.129743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.960647+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:28:52.960647+0000","last_peered":"2024-09-13T06:28:52.960647+0000","last_clean":"2024-09-13T06:28:52.960647+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:28:52.960647+0000","last_undegraded":"2024-09-13T06:28:52.960647+0000","last_fullsized":"2024-09-13T06:28:52.960647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:39:32.946230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.951405+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:28:52.951405+0000","last_peered":"2024-09-13T06:28:52.951405+0000","last_clean":"2024-09-13T06:28:52.951405+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:28:52.951405+0000","last_undegraded":"2024-09-13T06:28:52.951405+0000","last_fullsized":"2024-09-13T06:28:52.951405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:03.965231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.964873+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:28:52.964873+0000","last_peered":"2024-09-13T06:28:52.964873+0000","last_clean":"2024-09-13T06:28:52.964873+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:28:52.964873+0000","last_undegraded":"2024-09-13T06:28:52.964873+0000","last_fullsized":"2024-09-13T06:28:52.964873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:57.119174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:53.498291+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:28:53.498291+0000","last_peered":"2024-09-13T06:28:53.498291+0000","last_clean":"2024-09-13T06:28:53.498291+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:28:53.498291+0000","last_undegraded":"2024-09-13T06:28:53.498291+0000","last_fullsized":"2024-09-13T06:28:53.498291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:05.399184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.959276+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:28:52.959276+0000","last_peered":"2024-09-13T06:28:52.959276+0000","last_clean":"2024-09-13T06:28:52.959276+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:28:52.959276+0000","last_undegraded":"2024-09-13T06:28:52.959276+0000","last_fullsized":"2024-09-13T06:28:52.959276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:55.462615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.961108+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:28:52.961108+0000","last_peered":"2024-09-13T06:28:52.961108+0000","last_clean":"2024-09-13T06:28:52.961108+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:28:52.961108+0000","last_undegraded":"2024-09-13T06:28:52.961108+0000","last_fullsized":"2024-09-13T06:28:52.961108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.927955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.950668+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:28:52.950668+0000","last_peered":"2024-09-13T06:28:52.950668+0000","last_clean":"2024-09-13T06:28:52.950668+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:28:52.950668+0000","last_undegraded":"2024-09-13T06:28:52.950668+0000","last_fullsized":"2024-09-13T06:28:52.950668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:19.132984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":50912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":741376,"data_stored":637176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":641299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:28:56.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:28:56.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.268+0000 7fd67e5e3640 1 Processor -- start 2024-09-13T06:28:56.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.268+0000 7fd67e5e3640 1 -- start start 2024-09-13T06:28:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd67812f390 0x7fd678133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6780984f0 con 0x7fd67812e760 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd678098dc0 con 0x7fd67812f390 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd6777fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd67812f390 0x7fd678133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd677fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd67812e760 0x7fd67812ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55424/0 (socket says 172.21.15.112:55424) 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd6777fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd67812f390 0x7fd678133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34612/0 (socket says 172.21.15.112:34612) 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd677fff640 1 -- 172.21.15.112:0/1190865255 learned_addr learned my addr 172.21.15.112:0/1190865255 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd6777fe640 1 -- 172.21.15.112:0/1190865255 >> v1:172.21.15.112:6789/0 conn(0x7fd67812e760 legacy=0x7fd67812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd6777fe640 1 -- 172.21.15.112:0/1190865255 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6780981a0 con 0x7fd67812f390 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd6777fe640 1 --2- 172.21.15.112:0/1190865255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812f390 0x7fd678133a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd668009740 tx=0x7fd66801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c9c3f8939e2ece server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd676ffd640 1 -- 172.21.15.112:0/1190865255 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6680b1070 con 0x7fd67812f390 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd676ffd640 1 -- 172.21.15.112:0/1190865255 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6680ac570 con 0x7fd67812f390 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd676ffd640 1 -- 172.21.15.112:0/1190865255 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6680ac870 con 0x7fd67812f390 2024-09-13T06:28:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- 172.21.15.112:0/1190865255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812f390 msgr2=0x7fd678133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 --2- 172.21.15.112:0/1190865255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812f390 0x7fd678133a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd668009740 tx=0x7fd66801c400 comp rx=0 tx=0).stop 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- 172.21.15.112:0/1190865255 shutdown_connections 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 --2- 172.21.15.112:0/1190865255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812f390 0x7fd678133a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- 172.21.15.112:0/1190865255 >> 172.21.15.112:0/1190865255 conn(0x7fd6780a10a0 msgr2=0x7fd6780a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- 172.21.15.112:0/1190865255 shutdown_connections 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.272+0000 7fd67e5e3640 1 -- 172.21.15.112:0/1190865255 wait complete. 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 Processor -- start 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 -- start start 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 0x7fd6780963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd678136b70 con 0x7fd67812e760 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd677fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 0x7fd6780963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd677fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 0x7fd6780963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34622/0 (socket says 172.21.15.112:34622) 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd677fff640 1 -- 172.21.15.112:0/3067314119 learned_addr learned my addr 172.21.15.112:0/3067314119 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:56.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd677fff640 1 -- 172.21.15.112:0/3067314119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd678131730 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd677fff640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 0x7fd6780963d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00c480 tx=0x7fd66c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c017070 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c005c20 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd678128f50 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c007070 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd678131da0 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd66c01a070 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67812de00 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd674ff9640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd664035db0 0x7fd664038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fd66c047990 con 0x7fd67812e760 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd6777fe640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd664035db0 0x7fd664038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.276+0000 7fd6777fe640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd664035db0 0x7fd664038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6680ae000 tx=0x7fd668008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.280+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd678131730 con 0x7fd67812e760 2024-09-13T06:28:56.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.428+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd67812ec80 con 0x7fd664035db0 2024-09-13T06:28:56.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd674ff9640 1 -- 172.21.15.112:0/3067314119 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32181 (secure 0 0 0) 0x7fd67812ec80 con 0x7fd664035db0 2024-09-13T06:28:56.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:56.429 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:28:56.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd664035db0 msgr2=0x7fd664038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd664035db0 0x7fd664038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6680ae000 tx=0x7fd668008040 comp rx=0 tx=0).stop 2024-09-13T06:28:56.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 msgr2=0x7fd6780963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 0x7fd6780963d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00c480 tx=0x7fd66c00c940 comp rx=0 tx=0).stop 2024-09-13T06:28:56.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 shutdown_connections 2024-09-13T06:28:56.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd664035db0 0x7fd664038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 --2- 172.21.15.112:0/3067314119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd67812e760 0x7fd6780963d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 >> 172.21.15.112:0/3067314119 conn(0x7fd6780a10a0 msgr2=0x7fd6780972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:56.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 shutdown_connections 2024-09-13T06:28:56.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.432+0000 7fd67e5e3640 1 -- 172.21.15.112:0/3067314119 wait complete. 2024-09-13T06:28:56.445 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T06:28:56.395943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109888,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377472,"statfs":{"total":386547056640,"available":386434531328,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464482"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.961183+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:28:52.961183+0000","last_peered":"2024-09-13T06:28:52.961183+0000","last_clean":"2024-09-13T06:28:52.961183+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:28:52.961183+0000","last_undegraded":"2024-09-13T06:28:52.961183+0000","last_fullsized":"2024-09-13T06:28:52.961183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:00.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.951324+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:28:52.951324+0000","last_peered":"2024-09-13T06:28:52.951324+0000","last_clean":"2024-09-13T06:28:52.951324+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:28:52.951324+0000","last_undegraded":"2024-09-13T06:28:52.951324+0000","last_fullsized":"2024-09-13T06:28:52.951324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:58.129743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.960647+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:28:52.960647+0000","last_peered":"2024-09-13T06:28:52.960647+0000","last_clean":"2024-09-13T06:28:52.960647+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:28:52.960647+0000","last_undegraded":"2024-09-13T06:28:52.960647+0000","last_fullsized":"2024-09-13T06:28:52.960647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:39:32.946230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.951405+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:28:52.951405+0000","last_peered":"2024-09-13T06:28:52.951405+0000","last_clean":"2024-09-13T06:28:52.951405+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:28:52.951405+0000","last_undegraded":"2024-09-13T06:28:52.951405+0000","last_fullsized":"2024-09-13T06:28:52.951405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:03.965231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.964873+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:28:52.964873+0000","last_peered":"2024-09-13T06:28:52.964873+0000","last_clean":"2024-09-13T06:28:52.964873+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:28:52.964873+0000","last_undegraded":"2024-09-13T06:28:52.964873+0000","last_fullsized":"2024-09-13T06:28:52.964873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:57.119174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:53.498291+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:28:53.498291+0000","last_peered":"2024-09-13T06:28:53.498291+0000","last_clean":"2024-09-13T06:28:53.498291+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:28:53.498291+0000","last_undegraded":"2024-09-13T06:28:53.498291+0000","last_fullsized":"2024-09-13T06:28:53.498291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:05.399184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.959276+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:28:52.959276+0000","last_peered":"2024-09-13T06:28:52.959276+0000","last_clean":"2024-09-13T06:28:52.959276+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:28:52.959276+0000","last_undegraded":"2024-09-13T06:28:52.959276+0000","last_fullsized":"2024-09-13T06:28:52.959276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:55.462615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.961108+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:28:52.961108+0000","last_peered":"2024-09-13T06:28:52.961108+0000","last_clean":"2024-09-13T06:28:52.961108+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:28:52.961108+0000","last_undegraded":"2024-09-13T06:28:52.961108+0000","last_fullsized":"2024-09-13T06:28:52.961108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.927955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:28:52.950668+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:28:52.950668+0000","last_peered":"2024-09-13T06:28:52.950668+0000","last_clean":"2024-09-13T06:28:52.950668+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:28:52.950668+0000","last_undegraded":"2024-09-13T06:28:52.950668+0000","last_fullsized":"2024-09-13T06:28:52.950668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:19.132984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":50912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":641299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:28:56.446 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:28:56.446 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T06:28:56.446 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T06:28:56.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T06:28:56.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc301ca5640 1 Processor -- start 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc301ca5640 1 -- start start 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc301ca5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc2fc098080 0x7fc2fc1318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc301ca5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2fc09ac60 con 0x7fc2fc095450 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc301ca5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc2fc0987f0 con 0x7fc2fc098080 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc2faffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc2fc098080 0x7fc2fc1318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc2fb7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc2fc095450 0x7fc2fc095830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55434/0 (socket says 172.21.15.112:55434) 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc2fb7fe640 1 -- 172.21.15.112:0/1509709564 learned_addr learned my addr 172.21.15.112:0/1509709564 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc2faffd640 1 -- 172.21.15.112:0/1509709564 >> v1:172.21.15.112:6789/0 conn(0x7fc2fc095450 legacy=0x7fc2fc095830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.552+0000 7fc2faffd640 1 -- 172.21.15.112:0/1509709564 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc0976f0 con 0x7fc2fc098080 2024-09-13T06:28:56.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2faffd640 1 --2- 172.21.15.112:0/1509709564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc098080 0x7fc2fc1318d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009740 tx=0x7fc2f001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f556dcba5fa10a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fa7fc640 1 -- 172.21.15.112:0/1509709564 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00b0070 con 0x7fc2fc098080 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fa7fc640 1 -- 172.21.15.112:0/1509709564 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00ab530 con 0x7fc2fc098080 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fa7fc640 1 -- 172.21.15.112:0/1509709564 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00ab830 con 0x7fc2fc098080 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/1509709564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc098080 msgr2=0x7fc2fc1318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 --2- 172.21.15.112:0/1509709564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc098080 0x7fc2fc1318d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009740 tx=0x7fc2f001c370 comp rx=0 tx=0).stop 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/1509709564 shutdown_connections 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 --2- 172.21.15.112:0/1509709564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc098080 0x7fc2fc1318d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/1509709564 >> 172.21.15.112:0/1509709564 conn(0x7fc2fc09bbc0 msgr2=0x7fc2fc09bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/1509709564 shutdown_connections 2024-09-13T06:28:56.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/1509709564 wait complete. 2024-09-13T06:28:56.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 Processor -- start 2024-09-13T06:28:56.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- start start 2024-09-13T06:28:56.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 0x7fc2fc1c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1349c0 con 0x7fc2fc095450 2024-09-13T06:28:56.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 0x7fc2fc1c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 0x7fc2fc1c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34640/0 (socket says 172.21.15.112:34640) 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fb7fe640 1 -- 172.21.15.112:0/462749647 learned_addr learned my addr 172.21.15.112:0/462749647 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fb7fe640 1 -- 172.21.15.112:0/462749647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc1c3d40 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2fb7fe640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 0x7fc2fc1c4190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c480 tx=0x7fc2ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec017070 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec005c20 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc12c9f0 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc12d180 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec007070 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc005090 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.556+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2ec01a070 con 0x7fc2fc095450 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.560+0000 7fc2e3fff640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc2e8035db0 0x7fc2e8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.560+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc2ec047950 con 0x7fc2fc095450 2024-09-13T06:28:56.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.560+0000 7fc2faffd640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc2e8035db0 0x7fc2e8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.560+0000 7fc2faffd640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc2e8035db0 0x7fc2e8038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00ad000 tx=0x7fc2f00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.564+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2ec007210 con 0x7fc2fc095450 2024-09-13T06:28:56.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc2dc005380 con 0x7fc2fc095450 2024-09-13T06:28:56.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc2e3fff640 1 -- 172.21.15.112:0/462749647 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc2ec012400 con 0x7fc2fc095450 2024-09-13T06:28:56.741 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:28:56.741 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc2e8035db0 msgr2=0x7fc2e8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc2e8035db0 0x7fc2e8038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00ad000 tx=0x7fc2f00a6000 comp rx=0 tx=0).stop 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 msgr2=0x7fc2fc1c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 0x7fc2fc1c4190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c480 tx=0x7fc2ec00c940 comp rx=0 tx=0).stop 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 shutdown_connections 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc2e8035db0 0x7fc2e8038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 --2- 172.21.15.112:0/462749647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2fc095450 0x7fc2fc1c4190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 >> 172.21.15.112:0/462749647 conn(0x7fc2fc09bbc0 msgr2=0x7fc2fc09d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:56.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 shutdown_connections 2024-09-13T06:28:56.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:28:56.744+0000 7fc301ca5640 1 -- 172.21.15.112:0/462749647 wait complete. 2024-09-13T06:28:56.758 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T06:28:56.758 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T06:28:56.778 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T06:28:56.778 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T06:28:56.778 INFO:tasks.rgw:Creating data pools 2024-09-13T06:28:56.778 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T06:28:56.779 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcadfdeb640 1 Processor -- start 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcadfdeb640 1 -- start start 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcadfdeb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcad810ed90 0x7fcad810f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcadfdeb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad810fb60 con 0x7fcad810f6b0 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcadfdeb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcad811c840 con 0x7fcad810ed90 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcaddb87640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcad810ed90 0x7fcad810f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcaddb87640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcad810ed90 0x7fcad810f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48606/0 (socket says 172.21.15.169:48606) 2024-09-13T06:28:56.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcadd386640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcad810f6b0 0x7fcad811a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57476/0 (socket says 172.21.15.169:57476) 2024-09-13T06:28:56.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcaddb87640 1 -- 172.21.15.169:0/726382796 learned_addr learned my addr 172.21.15.169:0/726382796 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:56.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcaddb87640 1 -- 172.21.15.169:0/726382796 >> v1:172.21.15.112:6789/0 conn(0x7fcad810f6b0 legacy=0x7fcad811a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.909+0000 7fcaddb87640 1 -- 172.21.15.169:0/726382796 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad811c9c0 con 0x7fcad810ed90 2024-09-13T06:28:56.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaddb87640 1 --2- 172.21.15.169:0/726382796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad810f170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097f0 tx=0x7fcad401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c490f685001aed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadcb85640 1 -- 172.21.15.169:0/726382796 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40ab580 con 0x7fcad810ed90 2024-09-13T06:28:56.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadcb85640 1 -- 172.21.15.169:0/726382796 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad40b0070 con 0x7fcad810ed90 2024-09-13T06:28:56.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadcb85640 1 -- 172.21.15.169:0/726382796 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40ab870 con 0x7fcad810ed90 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- 172.21.15.169:0/726382796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 msgr2=0x7fcad810f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 --2- 172.21.15.169:0/726382796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad810f170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097f0 tx=0x7fcad401c430 comp rx=0 tx=0).stop 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- 172.21.15.169:0/726382796 shutdown_connections 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 --2- 172.21.15.169:0/726382796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad810f170 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- 172.21.15.169:0/726382796 >> 172.21.15.169:0/726382796 conn(0x7fcad806f390 msgr2=0x7fcad80717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- 172.21.15.169:0/726382796 shutdown_connections 2024-09-13T06:28:56.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- 172.21.15.169:0/726382796 wait complete. 2024-09-13T06:28:56.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 Processor -- start 2024-09-13T06:28:56.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- start start 2024-09-13T06:28:56.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad81accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcad811c3d0 con 0x7fcad810ed90 2024-09-13T06:28:56.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaddb87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad81accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaddb87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad81accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48610/0 (socket says 172.21.15.169:48610) 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaddb87640 1 -- 172.21.15.169:0/2356430489 learned_addr learned my addr 172.21.15.169:0/2356430489 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaddb87640 1 -- 172.21.15.169:0/2356430489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad81ad2a0 con 0x7fcad810ed90 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaddb87640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad81accd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcad401a060 tx=0x7fcad401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40aa7d0 con 0x7fcad810ed90 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad40aa970 con 0x7fcad810ed90 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.913+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad81ad4d0 con 0x7fcad810ed90 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40aac70 con 0x7fcad810ed90 2024-09-13T06:28:56.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad81a6d70 con 0x7fcad810ed90 2024-09-13T06:28:56.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad810f170 con 0x7fcad810ed90 2024-09-13T06:28:56.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcad40059a0 con 0x7fcad810ed90 2024-09-13T06:28:56.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcaca7fc640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcabc035e50 0x7fcabc038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:56.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fcad40e3a40 con 0x7fcad810ed90 2024-09-13T06:28:56.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcadd386640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcabc035e50 0x7fcabc038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:56.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.917+0000 7fcadd386640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcabc035e50 0x7fcabc038310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcacc001cd0 tx=0x7fcacc007db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:56.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:56.929+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcad40160b0 con 0x7fcad810ed90 2024-09-13T06:28:57.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.085+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fcad810f6b0 con 0x7fcad810ed90 2024-09-13T06:28:57.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.961+0000 7fcaca7fc640 1 -- 172.21.15.169:0/2356430489 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v19) ==== 167+0+0 (secure 0 0 0) 0x7fcad40cd0c0 con 0x7fcad810ed90 2024-09-13T06:28:57.965 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T06:28:57.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcabc035e50 msgr2=0x7fcabc038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:57.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcabc035e50 0x7fcabc038310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcacc001cd0 tx=0x7fcacc007db0 comp rx=0 tx=0).stop 2024-09-13T06:28:57.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 msgr2=0x7fcad81accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad81accd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcad401a060 tx=0x7fcad401ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 shutdown_connections 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcabc035e50 0x7fcabc038310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 --2- 172.21.15.169:0/2356430489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcad810ed90 0x7fcad81accd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 >> 172.21.15.169:0/2356430489 conn(0x7fcad806f390 msgr2=0x7fcad8117820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 shutdown_connections 2024-09-13T06:28:57.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:57.965+0000 7fcadfdeb640 1 -- 172.21.15.169:0/2356430489 wait complete. 2024-09-13T06:28:57.995 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T06:28:58.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6d0206c640 1 Processor -- start 2024-09-13T06:28:58.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6d0206c640 1 -- start start 2024-09-13T06:28:58.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6d0206c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cfc111bf0 0x7f6cfc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6d0206c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc073cc0 con 0x7f6cfc0737e0 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6d0206c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc073e90 con 0x7f6cfc111bf0 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6cfb7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cfc111bf0 0x7f6cfc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6cfb7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cfc111bf0 0x7f6cfc0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48856/0 (socket says 172.21.15.169:48856) 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6cfb7fe640 1 -- 172.21.15.169:0/2727924707 learned_addr learned my addr 172.21.15.169:0/2727924707 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6cfaffd640 1 --1- 172.21.15.169:0/2727924707 >> v1:172.21.15.112:6789/0 conn(0x7f6cfc0737e0 0x7f6cfc11c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57950/0 (socket says 172.21.15.169:57950) 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6cfb7fe640 1 -- 172.21.15.169:0/2727924707 >> v1:172.21.15.112:6789/0 conn(0x7f6cfc0737e0 legacy=0x7f6cfc11c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:58.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.105+0000 7f6cfb7fe640 1 -- 172.21.15.169:0/2727924707 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc074040 con 0x7f6cfc111bf0 2024-09-13T06:28:58.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfb7fe640 1 --2- 172.21.15.169:0/2727924707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc111bf0 0x7f6cfc0732a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097f0 tx=0x7f6cec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2538e1ae5dedefc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:58.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfa7fc640 1 -- 172.21.15.169:0/2727924707 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cec0ab580 con 0x7f6cfc111bf0 2024-09-13T06:28:58.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfa7fc640 1 -- 172.21.15.169:0/2727924707 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec0b0070 con 0x7f6cfc111bf0 2024-09-13T06:28:58.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfa7fc640 1 -- 172.21.15.169:0/2727924707 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cec0ab870 con 0x7f6cfc111bf0 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- 172.21.15.169:0/2727924707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc111bf0 msgr2=0x7f6cfc0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 --2- 172.21.15.169:0/2727924707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc111bf0 0x7f6cfc0732a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097f0 tx=0x7f6cec01c430 comp rx=0 tx=0).stop 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- 172.21.15.169:0/2727924707 shutdown_connections 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 --2- 172.21.15.169:0/2727924707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc111bf0 0x7f6cfc0732a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- 172.21.15.169:0/2727924707 >> 172.21.15.169:0/2727924707 conn(0x7f6cfc06f390 msgr2=0x7f6cfc0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- 172.21.15.169:0/2727924707 shutdown_connections 2024-09-13T06:28:58.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- 172.21.15.169:0/2727924707 wait complete. 2024-09-13T06:28:58.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 Processor -- start 2024-09-13T06:28:58.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- start start 2024-09-13T06:28:58.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 0x7f6cfc1af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:58.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6d0206c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc11e910 con 0x7f6cfc0737e0 2024-09-13T06:28:58.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 0x7f6cfc1af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:58.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 0x7f6cfc1af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48872/0 (socket says 172.21.15.169:48872) 2024-09-13T06:28:58.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfb7fe640 1 -- 172.21.15.169:0/1241357444 learned_addr learned my addr 172.21.15.169:0/1241357444 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:58.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfb7fe640 1 -- 172.21.15.169:0/1241357444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc1af640 con 0x7f6cfc0737e0 2024-09-13T06:28:58.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6cfb7fe640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 0x7f6cfc1af070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6cec01a060 tx=0x7f6cec01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:58.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cec0abe10 con 0x7f6cfc0737e0 2024-09-13T06:28:58.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.113+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec0aa8f0 con 0x7f6cfc0737e0 2024-09-13T06:28:58.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cec0aac10 con 0x7f6cfc0737e0 2024-09-13T06:28:58.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc1af870 con 0x7f6cfc0737e0 2024-09-13T06:28:58.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1a9110 con 0x7f6cfc0737e0 2024-09-13T06:28:58.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc0732a0 con 0x7f6cfc0737e0 2024-09-13T06:28:58.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6cec0c73f0 con 0x7f6cfc0737e0 2024-09-13T06:28:58.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6ce3fff640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6ce8035d60 0x7f6ce8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:58.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3873+0+0 (secure 0 0 0) 0x7f6cec0e3870 con 0x7f6cfc0737e0 2024-09-13T06:28:58.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6cfaffd640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6ce8035d60 0x7f6ce8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:58.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.117+0000 7f6cfaffd640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6ce8035d60 0x7f6ce8038220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0001620 tx=0x7f6cf0007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:58.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.129+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cec0160b0 con 0x7f6cfc0737e0 2024-09-13T06:28:58.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.281+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f6cfc1a9b50 con 0x7f6cfc0737e0 2024-09-13T06:28:58.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.677+0000 7f6ce3fff640 1 -- 172.21.15.169:0/1241357444 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) ==== 185+0+0 (secure 0 0 0) 0x7f6cec0b3540 con 0x7f6cfc0737e0 2024-09-13T06:28:58.680 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6ce8035d60 msgr2=0x7f6ce8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6ce8035d60 0x7f6ce8038220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0001620 tx=0x7f6cf0007a10 comp rx=0 tx=0).stop 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 msgr2=0x7f6cfc1af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 0x7f6cfc1af070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6cec01a060 tx=0x7f6cec01ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 shutdown_connections 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6ce8035d60 0x7f6ce8038220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 --2- 172.21.15.169:0/1241357444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cfc0737e0 0x7f6cfc1af070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 >> 172.21.15.169:0/1241357444 conn(0x7f6cfc06f390 msgr2=0x7f6cfc070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:58.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 shutdown_connections 2024-09-13T06:28:58.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.681+0000 7f6d0206c640 1 -- 172.21.15.169:0/1241357444 wait complete. 2024-09-13T06:28:58.727 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe30d3cd640 1 Processor -- start 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe30d3cd640 1 -- start start 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe30d3cd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe30806d460 0x7fe30806d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe30d3cd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30806e230 con 0x7fe30806dd80 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe30d3cd640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe30811e940 con 0x7fe30806d460 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe306ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe30806d460 0x7fe30806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe306ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe30806d460 0x7fe30806d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48874/0 (socket says 172.21.15.169:48874) 2024-09-13T06:28:58.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe306ffd640 1 -- 172.21.15.169:0/4098150453 learned_addr learned my addr 172.21.15.169:0/4098150453 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:58.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe306ffd640 1 -- 172.21.15.169:0/4098150453 >> v1:172.21.15.112:6789/0 conn(0x7fe30806dd80 legacy=0x7fe30811c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:58.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.845+0000 7fe306ffd640 1 -- 172.21.15.169:0/4098150453 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30811eac0 con 0x7fe30806d460 2024-09-13T06:28:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe306ffd640 1 --2- 172.21.15.169:0/4098150453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe30806d840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80097f0 tx=0x7fe2f801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d560c49634da19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe3067fc640 1 -- 172.21.15.169:0/4098150453 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f80ab580 con 0x7fe30806d460 2024-09-13T06:28:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe3067fc640 1 -- 172.21.15.169:0/4098150453 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f80b0070 con 0x7fe30806d460 2024-09-13T06:28:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe3067fc640 1 -- 172.21.15.169:0/4098150453 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f80ab870 con 0x7fe30806d460 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- 172.21.15.169:0/4098150453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 msgr2=0x7fe30806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 --2- 172.21.15.169:0/4098150453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe30806d840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80097f0 tx=0x7fe2f801c430 comp rx=0 tx=0).stop 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- 172.21.15.169:0/4098150453 shutdown_connections 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 --2- 172.21.15.169:0/4098150453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe30806d840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- 172.21.15.169:0/4098150453 >> 172.21.15.169:0/4098150453 conn(0x7fe308071360 msgr2=0x7fe308073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- 172.21.15.169:0/4098150453 shutdown_connections 2024-09-13T06:28:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- 172.21.15.169:0/4098150453 wait complete. 2024-09-13T06:28:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 Processor -- start 2024-09-13T06:28:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- start start 2024-09-13T06:28:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe3081aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe30d3cd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe30811e590 con 0x7fe30806d460 2024-09-13T06:28:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.849+0000 7fe306ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe3081aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe306ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe3081aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48876/0 (socket says 172.21.15.169:48876) 2024-09-13T06:28:58.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe306ffd640 1 -- 172.21.15.169:0/1069218384 learned_addr learned my addr 172.21.15.169:0/1069218384 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:58.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe306ffd640 1 -- 172.21.15.169:0/1069218384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3081af550 con 0x7fe30806d460 2024-09-13T06:28:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe306ffd640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe3081aef80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2f801a060 tx=0x7fe2f801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f80aa7d0 con 0x7fe30806d460 2024-09-13T06:28:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f80aa970 con 0x7fe30806d460 2024-09-13T06:28:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3081af780 con 0x7fe30806d460 2024-09-13T06:28:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f80aac70 con 0x7fe30806d460 2024-09-13T06:28:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3081a9020 con 0x7fe30806d460 2024-09-13T06:28:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30806d840 con 0x7fe30806d460 2024-09-13T06:28:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2f80c7440 con 0x7fe30806d460 2024-09-13T06:28:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2ff7fe640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2e8035db0 0x7fe2e8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3884+0+0 (secure 0 0 0) 0x7fe2f80e3690 con 0x7fe30806d460 2024-09-13T06:28:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2fffff640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2e8035db0 0x7fe2e8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.853+0000 7fe2fffff640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2e8035db0 0x7fe2e8038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001610 tx=0x7fe2f00079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:58.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:58.869+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe2f80160b0 con 0x7fe30806d460 2024-09-13T06:28:59.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.029+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fe30806dd80 con 0x7fe30806d460 2024-09-13T06:28:59.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe2ff7fe640 1 -- 172.21.15.169:0/1069218384 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) ==== 169+0+0 (secure 0 0 0) 0x7fe2f80e3430 con 0x7fe30806d460 2024-09-13T06:28:59.683 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2e8035db0 msgr2=0x7fe2e8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2e8035db0 0x7fe2e8038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001610 tx=0x7fe2f00079e0 comp rx=0 tx=0).stop 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 msgr2=0x7fe3081aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe3081aef80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2f801a060 tx=0x7fe2f801ac70 comp rx=0 tx=0).stop 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 shutdown_connections 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2e8035db0 0x7fe2e8038270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 --2- 172.21.15.169:0/1069218384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe30806d460 0x7fe3081aef80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 >> 172.21.15.169:0/1069218384 conn(0x7fe308071360 msgr2=0x7fe3081199d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 shutdown_connections 2024-09-13T06:28:59.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.681+0000 7fe30d3cd640 1 -- 172.21.15.169:0/1069218384 wait complete. 2024-09-13T06:28:59.716 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T06:28:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c7b81b640 1 Processor -- start 2024-09-13T06:28:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c7b81b640 1 -- start start 2024-09-13T06:28:59.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c7b81b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c741171c0 0x7f4c741195b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:59.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c7b81b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c74119af0 con 0x7f4c74114450 2024-09-13T06:28:59.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c7b81b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7411acd0 con 0x7f4c741171c0 2024-09-13T06:28:59.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c78db6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c741171c0 0x7f4c741195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:59.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c78db6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c741171c0 0x7f4c741195b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48890/0 (socket says 172.21.15.169:48890) 2024-09-13T06:28:59.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c78db6640 1 -- 172.21.15.169:0/2246415504 learned_addr learned my addr 172.21.15.169:0/2246415504 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:59.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c78db6640 1 -- 172.21.15.169:0/2246415504 >> v1:172.21.15.112:6789/0 conn(0x7f4c74114450 legacy=0x7f4c74114830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:59.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.837+0000 7f4c78db6640 1 -- 172.21.15.169:0/2246415504 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7411ae80 con 0x7f4c741171c0 2024-09-13T06:28:59.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c78db6640 1 --2- 172.21.15.169:0/2246415504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c741171c0 0x7f4c741195b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400a990 tx=0x7f4c6401d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b131eaf2c3ab0631 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:59.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c6bfff640 1 -- 172.21.15.169:0/2246415504 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c640b3070 con 0x7f4c741171c0 2024-09-13T06:28:59.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c6bfff640 1 -- 172.21.15.169:0/2246415504 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c640a67a0 con 0x7f4c741171c0 2024-09-13T06:28:59.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c6bfff640 1 -- 172.21.15.169:0/2246415504 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6400b040 con 0x7f4c741171c0 2024-09-13T06:28:59.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2246415504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c741171c0 msgr2=0x7f4c741195b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:28:59.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 --2- 172.21.15.169:0/2246415504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c741171c0 0x7f4c741195b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400a990 tx=0x7f4c6401d800 comp rx=0 tx=0).stop 2024-09-13T06:28:59.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2246415504 shutdown_connections 2024-09-13T06:28:59.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 --2- 172.21.15.169:0/2246415504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c741171c0 0x7f4c741195b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:28:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2246415504 >> 172.21.15.169:0/2246415504 conn(0x7f4c7406f390 msgr2=0x7f4c740717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:28:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2246415504 shutdown_connections 2024-09-13T06:28:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.841+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2246415504 wait complete. 2024-09-13T06:28:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 Processor -- start 2024-09-13T06:28:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 -- start start 2024-09-13T06:28:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 0x7f4c7411d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7411a9f0 con 0x7f4c74114450 2024-09-13T06:28:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c795b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 0x7f4c7411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c795b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 0x7f4c7411d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:48896/0 (socket says 172.21.15.169:48896) 2024-09-13T06:28:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c795b7640 1 -- 172.21.15.169:0/2373749928 learned_addr learned my addr 172.21.15.169:0/2373749928 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:28:59.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c795b7640 1 -- 172.21.15.169:0/2373749928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7411d730 con 0x7f4c74114450 2024-09-13T06:28:59.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c795b7640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 0x7f4c7411d1f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c3a0 tx=0x7f4c7000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c70005150 con 0x7f4c74114450 2024-09-13T06:28:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c700052f0 con 0x7f4c74114450 2024-09-13T06:28:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7411d9c0 con 0x7f4c74114450 2024-09-13T06:28:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c700067e0 con 0x7f4c74114450 2024-09-13T06:28:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7411df00 con 0x7f4c74114450 2024-09-13T06:28:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c74114830 con 0x7f4c74114450 2024-09-13T06:28:59.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c70019020 con 0x7f4c74114450 2024-09-13T06:28:59.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.845+0000 7f4c69ffb640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c58035db0 0x7f4c58038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:28:59.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.849+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4220+0+0 (secure 0 0 0) 0x7f4c70047ee0 con 0x7f4c74114450 2024-09-13T06:28:59.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.849+0000 7f4c78db6640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c58035db0 0x7f4c58038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:28:59.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.849+0000 7f4c78db6640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c58035db0 0x7f4c58038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c640b0000 tx=0x7f4c6400c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:28:59.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:28:59.861+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c7001a7a0 con 0x7f4c74114450 2024-09-13T06:29:00.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.025+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f4c741115f0 con 0x7f4c74114450 2024-09-13T06:29:00.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c69ffb640 1 -- 172.21.15.169:0/2373749928 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) ==== 187+0+0 (secure 0 0 0) 0x7f4c70045be0 con 0x7f4c74114450 2024-09-13T06:29:00.685 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T06:29:00.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c58035db0 msgr2=0x7f4c58038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:00.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c58035db0 0x7f4c58038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c640b0000 tx=0x7f4c6400c040 comp rx=0 tx=0).stop 2024-09-13T06:29:00.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 msgr2=0x7f4c7411d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:00.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 0x7f4c7411d1f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c3a0 tx=0x7f4c7000c860 comp rx=0 tx=0).stop 2024-09-13T06:29:00.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 shutdown_connections 2024-09-13T06:29:00.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c58035db0 0x7f4c58038270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 --2- 172.21.15.169:0/2373749928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c74114450 0x7f4c7411d1f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 >> 172.21.15.169:0/2373749928 conn(0x7f4c7406f390 msgr2=0x7f4c741179a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 shutdown_connections 2024-09-13T06:29:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:00.685+0000 7f4c7b81b640 1 -- 172.21.15.169:0/2373749928 wait complete. 2024-09-13T06:29:00.730 DEBUG:tasks.rgw:Pools created 2024-09-13T06:29:00.730 INFO:tasks.rgw:Starting rgw... 2024-09-13T06:29:00.730 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T06:29:00.730 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T06:29:00.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo echo -n http://smithi169.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T06:29:00.743 INFO:teuthology.orchestra.run.smithi169.stdout:http://smithi169.front.sepia.ceph.com:80 2024-09-13T06:29:00.743 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T06:29:00.797 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T06:29:00.797 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T06:29:00.839 INFO:tasks.rgw.client.0:Started 2024-09-13T06:29:00.839 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi169.front.sepia.ceph.com:80/ 2024-09-13T06:29:00.840 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-09-13T06:29:00.960 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:29:00.960 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:29:00.962 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:29:00.962 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:29:00.962 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:29:01.963 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-09-13T06:29:01.975 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:29:01.975 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:29:01.975 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:29:01.976 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:29:01.976 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:29:03.977 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-09-13T06:29:03.989 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:29:03.989 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:29:03.989 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:29:03.989 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:29:03.990 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:29:07.991 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-09-13T06:29:08.003 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:29:08.003 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:29:08.003 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:29:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:29:08.004 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:29:09.880 INFO:tasks.rgw.client.0.smithi169.stdout:2024-09-13T06:29:09.877+0000 7f3c79ef3a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T06:29:16.005 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-09-13T06:29:16.016 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:29:16.016 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:29:16.020 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 52234 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-13T06:29:16.021 INFO:teuthology.orchestra.run.smithi169.stdout:anonymous 2024-09-13T06:29:16.021 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T06:29:16.113 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T06:29:16.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T06:29:16.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T06:29:16.114 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T06:29:16.151 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:16.214 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d8c3c980 1 Processor -- start 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d8c3c980 1 -- start start 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d8c3c980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564ee3bbba80 0x564ee3bbde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d8c3c980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ee3a3fae0 con 0x564ee3b2bab0 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d8c3c980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x564ee3a63e30 con 0x564ee3bbba80 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d5f4b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564ee3bbba80 0x564ee3bbde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d5f4b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564ee3bbba80 0x564ee3bbde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46056/0 (socket says 172.21.15.169:46056) 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d674c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x564ee3b2bab0 0x564ee3bba360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60368/0 (socket says 172.21.15.169:60368) 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d5f4b640 1 -- 172.21.15.169:0/612301393 learned_addr learned my addr 172.21.15.169:0/612301393 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d5f4b640 1 -- 172.21.15.169:0/612301393 >> v1:172.21.15.112:6789/0 conn(0x564ee3b2bab0 legacy=0x564ee3bba360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.149+0000 7f86d5f4b640 1 -- 172.21.15.169:0/612301393 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee3bbf3c0 con 0x564ee3bbba80 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/612301393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3bbde70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00a5c0 tx=0x7f86cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5887f9c92da29d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d574a640 1 -- 172.21.15.169:0/612301393 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86cc0a6070 con 0x564ee3bbba80 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d574a640 1 -- 172.21.15.169:0/612301393 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc0af070 con 0x564ee3bbba80 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d574a640 1 -- 172.21.15.169:0/612301393 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86cc0aa5c0 con 0x564ee3bbba80 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 -- 172.21.15.169:0/612301393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 msgr2=0x564ee3bbde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/612301393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3bbde70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00a5c0 tx=0x7f86cc01b340 comp rx=0 tx=0).stop 2024-09-13T06:29:16.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 -- 172.21.15.169:0/612301393 shutdown_connections 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/612301393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3bbde70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 -- 172.21.15.169:0/612301393 >> 172.21.15.169:0/612301393 conn(0x564ee3bb2050 msgr2=0x564ee3bb4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 -- 172.21.15.169:0/612301393 shutdown_connections 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.153+0000 7f86d8c3c980 1 -- 172.21.15.169:0/612301393 wait complete. 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d8c3c980 1 Processor -- start 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d8c3c980 1 -- start start 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d8c3c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 0x564ee3ca0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d8c3c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564ee3a65200 con 0x564ee3b2bab0 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 0x564ee3ca0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 0x564ee3ca0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46062/0 (socket says 172.21.15.169:46062) 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.169+0000 7f86d674c640 1 -- 172.21.15.169:0/105216845 learned_addr learned my addr 172.21.15.169:0/105216845 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d674c640 1 -- 172.21.15.169:0/105216845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee3ca0e10 con 0x564ee3b2bab0 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d674c640 1 --2- 172.21.15.169:0/105216845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 0x564ee3ca0840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001690 tx=0x7f86c8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acdce359005664c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f85c4608640 1 -- 172.21.15.169:0/105216845 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8003460 con 0x564ee3b2bab0 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f85c4608640 1 -- 172.21.15.169:0/105216845 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8003600 con 0x564ee3b2bab0 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f85c4608640 1 -- 172.21.15.169:0/105216845 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8003920 con 0x564ee3b2bab0 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- 172.21.15.169:0/105216845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 msgr2=0x564ee3ca0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/105216845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 0x564ee3ca0840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001690 tx=0x7f86c8001b50 comp rx=0 tx=0).stop 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- 172.21.15.169:0/105216845 shutdown_connections 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/105216845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3b2bab0 0x564ee3ca0840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- 172.21.15.169:0/105216845 >> 172.21.15.169:0/105216845 conn(0x564ee3bb2050 msgr2=0x564ee3c9c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- 172.21.15.169:0/105216845 shutdown_connections 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- 172.21.15.169:0/105216845 wait complete. 2024-09-13T06:29:16.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 Processor -- start 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- start start 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3ca7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d8c3c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564ee3bbee00 con 0x564ee3bbba80 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3ca7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3ca7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46068/0 (socket says 172.21.15.169:46068) 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d674c640 1 -- 172.21.15.169:0/2244054432 learned_addr learned my addr 172.21.15.169:0/2244054432 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.173+0000 7f86d674c640 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee3ca82f0 con 0x564ee3bbba80 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d674c640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3ca7db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001360 tx=0x7f86c8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f85c2e05640 1 -- 172.21.15.169:0/2244054432 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8021020 con 0x564ee3bbba80 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f85c2e05640 1 -- 172.21.15.169:0/2244054432 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c801d680 con 0x564ee3bbba80 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ee3ca8580 con 0x564ee3bbba80 2024-09-13T06:29:16.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f85c2e05640 1 -- 172.21.15.169:0/2244054432 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c801da20 con 0x564ee3bbba80 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee3cab260 con 0x564ee3bbba80 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f85c2e05640 1 -- 172.21.15.169:0/2244054432 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86c8024020 con 0x564ee3bbba80 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f85c2e05640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85bc0346a0 0x7f85bc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f85c2e05640 1 -- 172.21.15.169:0/2244054432 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f86c8018040 con 0x564ee3bbba80 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85bc0346a0 0x7f85bc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3cacea0 0x564ee3caf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3caf7d0 con 0x564ee3cacea0 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d6f4d640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3cacea0 0x564ee3caf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85bc0346a0 0x7f85bc036b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0ae000 tx=0x7f86cc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d6f4d640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3cacea0 0x564ee3caf290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d6f4d640 1 -- 172.21.15.169:0/2244054432 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3cacea0 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3cb0560 0x564ee3cb2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cb2f90 con 0x564ee3cb0560 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.177+0000 7f86d674c640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3cb0560 0x564ee3cb2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d674c640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3cb0560 0x564ee3cb2950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d674c640 1 -- 172.21.15.169:0/2244054432 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86c800f070 con 0x564ee3cb0560 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cb4840 con 0x564ee3cb0560 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d674c640 1 -- 172.21.15.169:0/2244054432 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f86c800f070 con 0x564ee3cb0560 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cb39b0 con 0x564ee3cb0560 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d674c640 1 -- 172.21.15.169:0/2244054432 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86c800f070 con 0x564ee3cb0560 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cb5bf0 0x564ee3cb7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cb8520 con 0x564ee3cb5bf0 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cb5bf0 0x564ee3cb7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cb5bf0 0x564ee3cb7fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d5f4b640 1 -- 172.21.15.169:0/2244054432 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cb5bf0 2024-09-13T06:29:16.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 Processor -- start 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 -- start start 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 0x564ee3cc6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.181+0000 7f86d8c3c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564ee3abe800 con 0x564ee3cc5f00 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 0x564ee3cc6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 0x564ee3cc6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46082/0 (socket says 172.21.15.169:46082) 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d674c640 1 -- 172.21.15.169:0/1247516955 learned_addr learned my addr 172.21.15.169:0/1247516955 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d674c640 1 -- 172.21.15.169:0/1247516955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee3cc6860 con 0x564ee3cc5f00 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d674c640 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 0x564ee3cc6320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86c8006cd0 tx=0x7f86c801df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f85bbfff640 1 -- 172.21.15.169:0/1247516955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8042a20 con 0x564ee3cc5f00 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ee3cc6af0 con 0x564ee3cc5f00 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f85bbfff640 1 -- 172.21.15.169:0/1247516955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8042bc0 con 0x564ee3cc5f00 2024-09-13T06:29:16.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f85bbfff640 1 -- 172.21.15.169:0/1247516955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8005910 con 0x564ee3cc5f00 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee3cc9770 con 0x564ee3cc5f00 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f85bbfff640 1 -- 172.21.15.169:0/1247516955 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86c801b040 con 0x564ee3cc5f00 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f85bbfff640 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85b0034650 0x7f85b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f85bbfff640 1 -- 172.21.15.169:0/1247516955 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f86c803baf0 con 0x564ee3cc5f00 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85b0034650 0x7f85b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d8c3c980 1 Processor -- start 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d8c3c980 1 -- start start 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d8c3c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85b0034650 0x7f85b0036b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x564ee3cac3a0 tx=0x7f86cc005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d8c3c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564ee3ca1130 con 0x564ee3cd2810 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.185+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46094/0 (socket says 172.21.15.169:46094) 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 -- 172.21.15.169:0/2333824386 learned_addr learned my addr 172.21.15.169:0/2333824386 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 -- 172.21.15.169:0/2333824386 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee3cd31c0 con 0x564ee3cd2810 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 --2- 172.21.15.169:0/2333824386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd2bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f86c8013ef0 tx=0x7f86c801b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a280e7526fa48794 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f85b9ffb640 1 -- 172.21.15.169:0/2333824386 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8058070 con 0x564ee3cd2810 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f85b9ffb640 1 -- 172.21.15.169:0/2333824386 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8027dc0 con 0x564ee3cd2810 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f85b9ffb640 1 -- 172.21.15.169:0/2333824386 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c80413e0 con 0x564ee3cd2810 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2333824386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 msgr2=0x564ee3cd2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2333824386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd2bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f86c8013ef0 tx=0x7f86c801b650 comp rx=0 tx=0).stop 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2333824386 shutdown_connections 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2333824386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd2bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2333824386 >> 172.21.15.169:0/2333824386 conn(0x564ee3ccebf0 msgr2=0x564ee3ccccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2333824386 shutdown_connections 2024-09-13T06:29:16.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2333824386 wait complete. 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 Processor -- start 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- start start 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564ee3cd3660 con 0x564ee3cd2810 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46096/0 (socket says 172.21.15.169:46096) 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 learned_addr learned my addr 172.21.15.169:0/3857043332 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee3cd9ee0 con 0x564ee3cd2810 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d674c640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd99a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f86c8000f90 tx=0x7f86c804a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f85a7fff640 1 -- 172.21.15.169:0/3857043332 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c80460c0 con 0x564ee3cd2810 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f85a7fff640 1 -- 172.21.15.169:0/3857043332 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c806c070 con 0x564ee3cd2810 2024-09-13T06:29:16.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ee3cd9ee0 con 0x564ee3cd2810 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f85a7fff640 1 -- 172.21.15.169:0/3857043332 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86c8046630 con 0x564ee3cd2810 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.189+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee3cd9ee0 con 0x564ee3cd2810 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f85a7fff640 1 -- 172.21.15.169:0/3857043332 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86c805b070 con 0x564ee3cd2810 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f85a7fff640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85a0034650 0x7f85a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f85a7fff640 1 -- 172.21.15.169:0/3857043332 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f86c8035150 con 0x564ee3cd2810 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85a0034650 0x7f85a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3ce4a80 0x564ee3ce6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3ce7670 con 0x564ee3ce4a80 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d6f4d640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3ce4a80 0x564ee3ce6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85a0034650 0x7f85a0036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f86cc01b380 tx=0x7f86cc0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d6f4d640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3ce4a80 0x564ee3ce6f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 realm 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3ce3f70 con 0x564ee3ce4a80 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3ce8140 con 0x564ee3ce4a80 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3ce8cf0 0x564ee3ceb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3ceb920 con 0x564ee3ce8cf0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.193+0000 7f86d674c640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3ce8cf0 0x564ee3ceb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d674c640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3ce8cf0 0x564ee3ceb1b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cec1c0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 20 searching for the correct realm 2024-09-13T06:29:16.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cedf30 0x564ee3cf0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cedf30 0x564ee3cf0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d5f4b640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cedf30 0x564ee3cf0320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d674c640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86c805d070 0x7f86c803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x7f86c805d070 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d6f4d640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86c805d070 0x7f86c803b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d6f4d640 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86c805d070 0x7f86c803b050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.197+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x7f86c805d070 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x7f86c805d070 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.201+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x7f86c805d070 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce4a80 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.205+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x7f86c805d070 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x7f86c805d070 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3cedf30 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf09a0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:16.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cecb70 con 0x564ee3ce4a80 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.209+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cecfc0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3ced420 con 0x564ee3cedf30 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 zone default found 2024-09-13T06:29:16.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 4 Realm: () 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 zonegroup default 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf1300 con 0x7f86c805d070 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf3110 con 0x564ee3cedf30 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf3530 con 0x564ee3cedf30 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 started sync module instance, tier type = 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.213+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf2520 con 0x564ee3ce8cf0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94896829442592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf2520 con 0x564ee3ce8cf0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94896829446912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf48d0 con 0x564ee3ce4a80 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf5310 con 0x564ee3ce8cf0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94896829442592] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.217+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94896829446912] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94896829451744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4420 con 0x564ee3ce8cf0 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf5bb0 con 0x7f86c805d070 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94896829454080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4420 con 0x7f86c805d070 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf6650 con 0x564ee3ce8cf0 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.221+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94896829451744] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.225+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94896829454080] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.225+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.225+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94896829455136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf6610 con 0x564ee3ce8cf0 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.225+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf6a70 con 0x564ee3cedf30 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.225+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94896829440112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3cedf30 2024-09-13T06:29:16.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7d30 con 0x564ee3cedf30 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94896829455136] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94896829440112] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94896829460064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf6140 con 0x564ee3cedf30 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf85d0 con 0x7f86c805d070 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94896829464864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf8540 con 0x7f86c805d070 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 20 add_watcher() i=0 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 20 add_watcher() i=1 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 20 add_watcher() i=2 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 20 add_watcher() i=3 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 20 add_watcher() i=4 2024-09-13T06:29:16.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.229+0000 7f86d8c3c980 20 add_watcher() i=5 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94896829460064] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 20 add_watcher() i=6 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94896829464864] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 20 add_watcher() i=7 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7820 con 0x564ee3ce4a80 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94896829462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf8fd0 con 0x564ee3ce4a80 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94896829462560] v31'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f858cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:16.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.233+0000 7f86d8c3c980 5 note: GC not initialized 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f85077fe640 20 reqs_thread_entry: start 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d8c3c980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d8c3c980 20 Filter name: none 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f85057fa640 20 reqs_thread_entry: start 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3d1e800 con 0x564ee3cedf30 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3ce8cf0 2024-09-13T06:29:16.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cecfc0 con 0x564ee3ce4a80 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.237+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.241+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce4a80 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.245+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x564ee3cedf30 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf4030 con 0x7f86c805d070 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f858cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.249+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94896829462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3ce4a80 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94896829462560] v31'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94896829442592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cecfc0 con 0x564ee3ce8cf0 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94896829442592] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d8c3c980 20 remove_watcher() i=0 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d8c3c980 2 removed watcher, disabling cache 2024-09-13T06:29:16.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94896829446912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3ce4a80 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94896829446912] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x564ee3ce4a80 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d8c3c980 20 remove_watcher() i=1 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.253+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94896829451744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3ce8cf0 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.257+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94896829451744] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.257+0000 7f86d8c3c980 20 remove_watcher() i=2 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.257+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94896829454080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x7f86c805d070 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.257+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94896829454080] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.257+0000 7f86d8c3c980 20 remove_watcher() i=3 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.257+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94896829455136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3ce8cf0 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d674c640 1 -- 172.21.15.169:0/3857043332 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94896829455136] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86c805a030 con 0x564ee3ce8cf0 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d8c3c980 20 remove_watcher() i=4 2024-09-13T06:29:16.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94896829440112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf7310 con 0x564ee3cedf30 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94896829440112] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d8c3c980 20 remove_watcher() i=5 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94896829460064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf2a20 con 0x564ee3cedf30 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d5f4b640 1 -- 172.21.15.169:0/3857043332 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94896829460064] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86cc0aab50 con 0x564ee3cedf30 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d8c3c980 20 remove_watcher() i=6 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.261+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94896829464864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ee3cf2a20 con 0x7f86c805d070 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94896829464864] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86d00083f0 con 0x7f86c805d070 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 20 remove_watcher() i=7 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3ce8cf0 msgr2=0x564ee3ceb1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3ce8cf0 0x564ee3ceb1b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3ce4a80 msgr2=0x564ee3ce6f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3ce4a80 0x564ee3ce6f20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86c805d070 msgr2=0x7f86c803b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86c805d070 0x7f86c803b050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cedf30 msgr2=0x564ee3cf0320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cedf30 0x564ee3cf0320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85a0034650 msgr2=0x7f85a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85a0034650 0x7f85a0036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f86cc01b380 tx=0x7f86cc0c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 msgr2=0x564ee3cd99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd99a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f86c8000f90 tx=0x7f86c804a710 comp rx=0 tx=0).stop 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d6f4d640 1 -- 172.21.15.169:0/3857043332 reap_dead start 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 shutdown_connections 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/3857043332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cd2810 0x564ee3cd99a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 >> 172.21.15.169:0/3857043332 conn(0x564ee3ccebf0 msgr2=0x564ee3ccccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 shutdown_connections 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/3857043332 wait complete. 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85b0034650 msgr2=0x7f85b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85b0034650 0x7f85b0036b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x564ee3cac3a0 tx=0x7f86cc005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 msgr2=0x564ee3cc6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 0x564ee3cc6320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86c8006cd0 tx=0x7f86c801df30 comp rx=0 tx=0).stop 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 shutdown_connections 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85b0034650 0x7f85b0036b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/1247516955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3cc5f00 0x564ee3cc6320 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 >> 172.21.15.169:0/1247516955 conn(0x564ee3cbb050 msgr2=0x564ee3cbdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 shutdown_connections 2024-09-13T06:29:16.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/1247516955 wait complete. 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3cb0560 msgr2=0x564ee3cb2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564ee3cb0560 0x564ee3cb2950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3cacea0 msgr2=0x564ee3caf290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564ee3cacea0 0x564ee3caf290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cb5bf0 msgr2=0x564ee3cb7fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564ee3cb5bf0 0x564ee3cb7fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85bc0346a0 msgr2=0x7f85bc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f85bc0346a0 0x7f85bc036b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0ae000 tx=0x7f86cc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 msgr2=0x564ee3ca7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 --2- 172.21.15.169:0/2244054432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564ee3bbba80 0x564ee3ca7db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001360 tx=0x7f86c8001260 comp rx=0 tx=0).stop 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d6f4d640 1 -- 172.21.15.169:0/2244054432 reap_dead start 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 shutdown_connections 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 >> 172.21.15.169:0/2244054432 conn(0x564ee3bb2050 msgr2=0x564ee3c9aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 shutdown_connections 2024-09-13T06:29:16.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.265+0000 7f86d8c3c980 1 -- 172.21.15.169:0/2244054432 wait complete. 2024-09-13T06:29:16.288 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-09-13T06:29:16.289 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:29:16.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T06:29:16.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T06:29:16.289 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T06:29:16.366 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:16.367 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:16.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa44336980 1 Processor -- start 2024-09-13T06:29:16.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa44336980 1 -- start start 2024-09-13T06:29:16.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa44336980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b6ff5428e0 0x55b6ff542cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa44336980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b6ff3c8ae0 con 0x55b6ff543230 2024-09-13T06:29:16.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa44336980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55b6ff3ece30 con 0x55b6ff5428e0 2024-09-13T06:29:16.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa41e46640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b6ff5428e0 0x55b6ff542cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa41645640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55b6ff543230 0x55b6ff547c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60380/0 (socket says 172.21.15.169:60380) 2024-09-13T06:29:16.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa41e46640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b6ff5428e0 0x55b6ff542cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46102/0 (socket says 172.21.15.169:46102) 2024-09-13T06:29:16.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa41645640 1 -- 172.21.15.169:0/45552179 learned_addr learned my addr 172.21.15.169:0/45552179 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:16.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa41e46640 1 -- 172.21.15.169:0/45552179 >> v1:172.21.15.112:6789/0 conn(0x55b6ff543230 legacy=0x55b6ff547c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.365+0000 7ffa41e46640 1 -- 172.21.15.169:0/45552179 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ff54a4b0 con 0x55b6ff5428e0 2024-09-13T06:29:16.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa41e46640 1 --2- 172.21.15.169:0/45552179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff542cc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400a480 tx=0x7ffa3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfeddefdf3e1e59b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa40e44640 1 -- 172.21.15.169:0/45552179 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340b0070 con 0x55b6ff5428e0 2024-09-13T06:29:16.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa40e44640 1 -- 172.21.15.169:0/45552179 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340ab540 con 0x55b6ff5428e0 2024-09-13T06:29:16.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa40e44640 1 -- 172.21.15.169:0/45552179 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340ab840 con 0x55b6ff5428e0 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 -- 172.21.15.169:0/45552179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 msgr2=0x55b6ff542cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 --2- 172.21.15.169:0/45552179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff542cc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400a480 tx=0x7ffa3401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 -- 172.21.15.169:0/45552179 shutdown_connections 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 --2- 172.21.15.169:0/45552179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff542cc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 -- 172.21.15.169:0/45552179 >> 172.21.15.169:0/45552179 conn(0x55b6ff4b6230 msgr2=0x55b6ff4b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 -- 172.21.15.169:0/45552179 shutdown_connections 2024-09-13T06:29:16.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.369+0000 7ffa44336980 1 -- 172.21.15.169:0/45552179 wait complete. 2024-09-13T06:29:16.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.385+0000 7ffa44336980 1 Processor -- start 2024-09-13T06:29:16.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.385+0000 7ffa44336980 1 -- start start 2024-09-13T06:29:16.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff62dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b6ff3ee200 con 0x55b6ff5428e0 2024-09-13T06:29:16.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff62dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff62dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46104/0 (socket says 172.21.15.169:46104) 2024-09-13T06:29:16.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 -- 172.21.15.169:0/2291604799 learned_addr learned my addr 172.21.15.169:0/2291604799 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 -- 172.21.15.169:0/2291604799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ff62e220 con 0x55b6ff5428e0 2024-09-13T06:29:16.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 --2- 172.21.15.169:0/2291604799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff62dc50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa340ae040 tx=0x7ffa34003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28de2d8181ace5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ff92fe07640 1 -- 172.21.15.169:0/2291604799 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340b0040 con 0x55b6ff5428e0 2024-09-13T06:29:16.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ff92fe07640 1 -- 172.21.15.169:0/2291604799 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340ab9d0 con 0x55b6ff5428e0 2024-09-13T06:29:16.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ff92fe07640 1 -- 172.21.15.169:0/2291604799 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340abcf0 con 0x55b6ff5428e0 2024-09-13T06:29:16.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- 172.21.15.169:0/2291604799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 msgr2=0x55b6ff62dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 --2- 172.21.15.169:0/2291604799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff62dc50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa340ae040 tx=0x7ffa34003030 comp rx=0 tx=0).stop 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- 172.21.15.169:0/2291604799 shutdown_connections 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 --2- 172.21.15.169:0/2291604799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff62dc50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- 172.21.15.169:0/2291604799 >> 172.21.15.169:0/2291604799 conn(0x55b6ff4b6230 msgr2=0x55b6ff629880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- 172.21.15.169:0/2291604799 shutdown_connections 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- 172.21.15.169:0/2291604799 wait complete. 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 Processor -- start 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- start start 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff634e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa44336980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b6ff549ef0 con 0x55b6ff5428e0 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff634e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff634e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46114/0 (socket says 172.21.15.169:46114) 2024-09-13T06:29:16.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.389+0000 7ffa41e46640 1 -- 172.21.15.169:0/2583083750 learned_addr learned my addr 172.21.15.169:0/2583083750 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa41e46640 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ff6353c0 con 0x55b6ff5428e0 2024-09-13T06:29:16.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa41e46640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff634e80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa34019930 tx=0x7ffa34018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ff92e604640 1 -- 172.21.15.169:0/2583083750 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340b0070 con 0x55b6ff5428e0 2024-09-13T06:29:16.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ff92e604640 1 -- 172.21.15.169:0/2583083750 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340b68b0 con 0x55b6ff5428e0 2024-09-13T06:29:16.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ff92e604640 1 -- 172.21.15.169:0/2583083750 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340b6b90 con 0x55b6ff5428e0 2024-09-13T06:29:16.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6ff635650 con 0x55b6ff5428e0 2024-09-13T06:29:16.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ff638330 con 0x55b6ff5428e0 2024-09-13T06:29:16.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ff92e604640 1 -- 172.21.15.169:0/2583083750 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa340bf3f0 con 0x55b6ff5428e0 2024-09-13T06:29:16.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ff92e604640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff928034650 0x7ff928036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ff92e604640 1 -- 172.21.15.169:0/2583083750 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ffa340bc070 con 0x55b6ff5428e0 2024-09-13T06:29:16.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa41645640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff928034650 0x7ff928036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff543230 0x55b6ff63be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff63c460 con 0x55b6ff543230 2024-09-13T06:29:16.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa42647640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff543230 0x55b6ff63be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa41645640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff928034650 0x7ff928036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffa38001da0 tx=0x7ffa38001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.393+0000 7ffa42647640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff543230 0x55b6ff63be10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa42647640 1 -- 172.21.15.169:0/2583083750 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff543230 2024-09-13T06:29:16.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff63d210 0x55b6ff63f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff63fc60 con 0x55b6ff63d210 2024-09-13T06:29:16.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa41e46640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff63d210 0x55b6ff63f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa41e46640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff63d210 0x55b6ff63f600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa41e46640 1 -- 172.21.15.169:0/2583083750 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa340b3040 con 0x55b6ff63d210 2024-09-13T06:29:16.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff641510 con 0x55b6ff63d210 2024-09-13T06:29:16.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa41e46640 1 -- 172.21.15.169:0/2583083750 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa340b3040 con 0x55b6ff63d210 2024-09-13T06:29:16.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff640650 con 0x55b6ff63d210 2024-09-13T06:29:16.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa41e46640 1 -- 172.21.15.169:0/2583083750 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa340b3040 con 0x55b6ff63d210 2024-09-13T06:29:16.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff641110 0x55b6ff644980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff645110 con 0x55b6ff641110 2024-09-13T06:29:16.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.397+0000 7ffa41645640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff641110 0x55b6ff644980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41645640 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff641110 0x55b6ff644980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41645640 1 -- 172.21.15.169:0/2583083750 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff641110 2024-09-13T06:29:16.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa44336980 1 Processor -- start 2024-09-13T06:29:16.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa44336980 1 -- start start 2024-09-13T06:29:16.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa44336980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 0x55b6ff652fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa44336980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b6ff447800 con 0x55b6ff652ba0 2024-09-13T06:29:16.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 0x55b6ff652fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 0x55b6ff652fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46124/0 (socket says 172.21.15.169:46124) 2024-09-13T06:29:16.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41e46640 1 -- 172.21.15.169:0/1378411199 learned_addr learned my addr 172.21.15.169:0/1378411199 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41e46640 1 -- 172.21.15.169:0/1378411199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ff653500 con 0x55b6ff652ba0 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa41e46640 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 0x55b6ff652fc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa340e47e0 tx=0x7ffa340b56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ff9277fe640 1 -- 172.21.15.169:0/1378411199 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340e41e0 con 0x55b6ff652ba0 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6ff653790 con 0x55b6ff652ba0 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ff9277fe640 1 -- 172.21.15.169:0/1378411199 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340e4380 con 0x55b6ff652ba0 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ff9277fe640 1 -- 172.21.15.169:0/1378411199 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340bf860 con 0x55b6ff652ba0 2024-09-13T06:29:16.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ff653790 con 0x55b6ff652ba0 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ff9277fe640 1 -- 172.21.15.169:0/1378411199 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa340de070 con 0x55b6ff652ba0 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.401+0000 7ff9277fe640 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff91c034650 0x7ff91c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ff9277fe640 1 -- 172.21.15.169:0/1378411199 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ffa340a8070 con 0x55b6ff652ba0 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41645640 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff91c034650 0x7ff91c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 Processor -- start 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- start start 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41645640 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff91c034650 0x7ff91c036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55b6ff645510 tx=0x7ffa3800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff65f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b6ff62e4e0 con 0x55b6ff65f2d0 2024-09-13T06:29:16.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff65f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff65f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46134/0 (socket says 172.21.15.169:46134) 2024-09-13T06:29:16.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 -- 172.21.15.169:0/1725626015 learned_addr learned my addr 172.21.15.169:0/1725626015 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 -- 172.21.15.169:0/1725626015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ff65fc80 con 0x55b6ff65f2d0 2024-09-13T06:29:16.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 --2- 172.21.15.169:0/1725626015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff65f6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa340c0f80 tx=0x7ffa340d4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a946d2132bfb2d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ff9257fa640 1 -- 172.21.15.169:0/1725626015 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340df400 con 0x55b6ff65f2d0 2024-09-13T06:29:16.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ff9257fa640 1 -- 172.21.15.169:0/1725626015 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340d4e00 con 0x55b6ff65f2d0 2024-09-13T06:29:16.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ff9257fa640 1 -- 172.21.15.169:0/1725626015 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340aab10 con 0x55b6ff65f2d0 2024-09-13T06:29:16.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- 172.21.15.169:0/1725626015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 msgr2=0x55b6ff65f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 --2- 172.21.15.169:0/1725626015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff65f6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa340c0f80 tx=0x7ffa340d4cc0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- 172.21.15.169:0/1725626015 shutdown_connections 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 --2- 172.21.15.169:0/1725626015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff65f6b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- 172.21.15.169:0/1725626015 >> 172.21.15.169:0/1725626015 conn(0x55b6ff65b6b0 msgr2=0x55b6ff6597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- 172.21.15.169:0/1725626015 shutdown_connections 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- 172.21.15.169:0/1725626015 wait complete. 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 Processor -- start 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- start start 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff666450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa44336980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b6ff660120 con 0x55b6ff65f2d0 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff666450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff666450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46146/0 (socket says 172.21.15.169:46146) 2024-09-13T06:29:16.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.405+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 learned_addr learned my addr 172.21.15.169:0/588796273 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ff666990 con 0x55b6ff65f2d0 2024-09-13T06:29:16.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa41e46640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff666450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffa340e1ad0 tx=0x7ffa340b1f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ff9137fe640 1 -- 172.21.15.169:0/588796273 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340c0070 con 0x55b6ff65f2d0 2024-09-13T06:29:16.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ff9137fe640 1 -- 172.21.15.169:0/588796273 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340d4570 con 0x55b6ff65f2d0 2024-09-13T06:29:16.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6ff666990 con 0x55b6ff65f2d0 2024-09-13T06:29:16.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ff9137fe640 1 -- 172.21.15.169:0/588796273 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa340c0210 con 0x55b6ff65f2d0 2024-09-13T06:29:16.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ff666990 con 0x55b6ff65f2d0 2024-09-13T06:29:16.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ff9137fe640 1 -- 172.21.15.169:0/588796273 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa34109020 con 0x55b6ff65f2d0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ff9137fe640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff90c034600 0x7ff90c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ff9137fe640 1 -- 172.21.15.169:0/588796273 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ffa34107020 con 0x55b6ff65f2d0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa41645640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff90c034600 0x7ff90c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff671440 0x55b6ff673900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff674050 con 0x55b6ff671440 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa42647640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff671440 0x55b6ff673900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa41645640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff90c034600 0x7ff90c036ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800bb60 tx=0x7ffa38010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa42647640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff671440 0x55b6ff673900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 20 realm 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6708f0 con 0x55b6ff671440 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.409+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff674b20 con 0x55b6ff671440 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff6758d0 0x55b6ff677cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678340 con 0x55b6ff6758d0 2024-09-13T06:29:16.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41e46640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff6758d0 0x55b6ff677cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41e46640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff6758d0 0x55b6ff677cc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 20 searching for the correct realm 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff67a900 0x55b6ff67ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67d370 con 0x55b6ff67a900 2024-09-13T06:29:16.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41645640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff67a900 0x55b6ff67ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41645640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff67a900 0x55b6ff67ccf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67d370 con 0x55b6ff6758d0 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.413+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41e46640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffa340ab030 0x7ffa340df690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x7ffa340ab030 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffa340ab030 0x7ffa340df690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffa340ab030 0x7ffa340df690 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff67a900 2024-09-13T06:29:16.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.417+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x7ffa340ab030 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x7ffa340ab030 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff67a900 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff67a900 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff67a900 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.421+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x7ffa340ab030 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff671440 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x7ffa340ab030 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff67a900 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x7ffa340ab030 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff67a900 2024-09-13T06:29:16.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.425+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff678b90 con 0x55b6ff6758d0 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6793e0 con 0x55b6ff671440 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6797d0 con 0x55b6ff6758d0 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6797d0 con 0x55b6ff67a900 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 zone default found 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 4 Realm: () 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:16.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 zonegroup default 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67d7f0 con 0x7ffa340ab030 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff679d70 con 0x55b6ff67a900 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67fb30 con 0x55b6ff67a900 2024-09-13T06:29:16.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 started sync module instance, tier type = 2024-09-13T06:29:16.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:16.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.429+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67eeb0 con 0x55b6ff6758d0 2024-09-13T06:29:16.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94244457411504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67eeb0 con 0x55b6ff6758d0 2024-09-13T06:29:16.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6805f0 con 0x55b6ff671440 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94244457414912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff680ec0 con 0x55b6ff671440 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff681900 con 0x55b6ff6758d0 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94244457411504] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.433+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94244457414912] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94244457419728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff680a10 con 0x55b6ff6758d0 2024-09-13T06:29:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6821a0 con 0x7ffa340ab030 2024-09-13T06:29:16.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94244457422064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff680a10 con 0x7ffa340ab030 2024-09-13T06:29:16.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff682c20 con 0x55b6ff6758d0 2024-09-13T06:29:16.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94244457422064] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94244457419728] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94244457409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff682730 con 0x55b6ff6758d0 2024-09-13T06:29:16.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.437+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6834c0 con 0x55b6ff67a900 2024-09-13T06:29:16.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94244457426960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff682730 con 0x55b6ff67a900 2024-09-13T06:29:16.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff684330 con 0x55b6ff67a900 2024-09-13T06:29:16.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94244457409024] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94244457426960] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94244457423120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff684330 con 0x55b6ff67a900 2024-09-13T06:29:16.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.441+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff684bc0 con 0x7ffa340ab030 2024-09-13T06:29:16.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94244457431856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff684790 con 0x7ffa340ab030 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=0 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=1 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=2 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=3 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=4 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=5 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94244457423120] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=6 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94244457431856] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 20 add_watcher() i=7 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff683e80 con 0x55b6ff671440 2024-09-13T06:29:16.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.445+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94244457430656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6855e0 con 0x55b6ff671440 2024-09-13T06:29:16.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94244457430656] v31'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ff8f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:16.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ffa44336980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:16.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ffa44336980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:16.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff690a10 con 0x55b6ff6758d0 2024-09-13T06:29:16.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.449+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff690ac0 con 0x7ffa340ab030 2024-09-13T06:29:16.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.453+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.453+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff691160 con 0x55b6ff67a900 2024-09-13T06:29:16.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.453+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.453+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff6915c0 con 0x55b6ff671440 2024-09-13T06:29:16.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.457+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.457+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff691b30 con 0x55b6ff6758d0 2024-09-13T06:29:16.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.457+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.457+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff691b30 con 0x55b6ff67a900 2024-09-13T06:29:16.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.461+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.461+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff691ef0 con 0x55b6ff6758d0 2024-09-13T06:29:16.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.461+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.461+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff691f80 con 0x55b6ff671440 2024-09-13T06:29:16.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.465+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.465+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692510 con 0x55b6ff6758d0 2024-09-13T06:29:16.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.465+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.465+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692510 con 0x55b6ff6758d0 2024-09-13T06:29:16.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.469+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.469+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692510 con 0x55b6ff6758d0 2024-09-13T06:29:16.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.473+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.473+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692510 con 0x55b6ff67a900 2024-09-13T06:29:16.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.473+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.473+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692ae0 con 0x55b6ff6758d0 2024-09-13T06:29:16.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.473+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.473+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692ae0 con 0x55b6ff671440 2024-09-13T06:29:16.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.477+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.477+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff671440 2024-09-13T06:29:16.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.477+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.477+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff6758d0 2024-09-13T06:29:16.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.481+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.481+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff6758d0 2024-09-13T06:29:16.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.481+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.481+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff67a900 2024-09-13T06:29:16.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.485+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.485+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff6758d0 2024-09-13T06:29:16.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.489+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.489+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff671440 2024-09-13T06:29:16.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.489+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.489+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff6758d0 2024-09-13T06:29:16.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.493+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.493+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff6758d0 2024-09-13T06:29:16.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.493+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.493+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff67a900 2024-09-13T06:29:16.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.497+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.497+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff6758d0 2024-09-13T06:29:16.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.497+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.497+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff692f90 con 0x55b6ff67a900 2024-09-13T06:29:16.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.501+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.501+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693050 con 0x55b6ff67a900 2024-09-13T06:29:16.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.505+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.505+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693050 con 0x55b6ff67a900 2024-09-13T06:29:16.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.505+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.505+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693020 con 0x55b6ff6758d0 2024-09-13T06:29:16.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.509+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.509+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693020 con 0x55b6ff671440 2024-09-13T06:29:16.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.513+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.513+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693020 con 0x55b6ff6758d0 2024-09-13T06:29:16.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.513+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.513+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693020 con 0x55b6ff671440 2024-09-13T06:29:16.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.517+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.517+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff693020 con 0x7ffa340ab030 2024-09-13T06:29:16.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ff8f27fc640 20 reqs_thread_entry: start 2024-09-13T06:29:16.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:16.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 20 Filter name: none 2024-09-13T06:29:16.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ff863fff640 20 reqs_thread_entry: start 2024-09-13T06:29:16.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T06:29:16.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff68fc90 con 0x7ffa340ab030 2024-09-13T06:29:16.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T06:29:16.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.521+0000 7ffa44336980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:29:16.528 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:29:16.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.525+0000 7ff8f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:16.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.525+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94244457430656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff68e6d0 con 0x55b6ff671440 2024-09-13T06:29:16.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.525+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94244457430656] v31'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.525+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94244457411504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff683e80 con 0x55b6ff6758d0 2024-09-13T06:29:16.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94244457411504] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa44336980 20 remove_watcher() i=0 2024-09-13T06:29:16.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa44336980 2 removed watcher, disabling cache 2024-09-13T06:29:16.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94244457414912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67f3b0 con 0x55b6ff671440 2024-09-13T06:29:16.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94244457414912] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x55b6ff671440 2024-09-13T06:29:16.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa44336980 20 remove_watcher() i=1 2024-09-13T06:29:16.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.529+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94244457419728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67f3b0 con 0x55b6ff6758d0 2024-09-13T06:29:16.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.533+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94244457419728] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.533+0000 7ffa44336980 20 remove_watcher() i=2 2024-09-13T06:29:16.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.533+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94244457422064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67f3b0 con 0x7ffa340ab030 2024-09-13T06:29:16.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.533+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94244457422064] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.533+0000 7ffa44336980 20 remove_watcher() i=3 2024-09-13T06:29:16.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.533+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94244457409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff681cf0 con 0x55b6ff6758d0 2024-09-13T06:29:16.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.537+0000 7ffa41e46640 1 -- 172.21.15.169:0/588796273 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94244457409024] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa340fe030 con 0x55b6ff6758d0 2024-09-13T06:29:16.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.537+0000 7ffa44336980 20 remove_watcher() i=4 2024-09-13T06:29:16.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.537+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94244457426960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67f3b0 con 0x55b6ff67a900 2024-09-13T06:29:16.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.537+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94244457426960] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.537+0000 7ffa44336980 20 remove_watcher() i=5 2024-09-13T06:29:16.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.537+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94244457423120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff683010 con 0x55b6ff67a900 2024-09-13T06:29:16.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa41645640 1 -- 172.21.15.169:0/588796273 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94244457423120] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3800e6c0 con 0x55b6ff67a900 2024-09-13T06:29:16.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 20 remove_watcher() i=6 2024-09-13T06:29:16.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94244457431856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b6ff67f3b0 con 0x7ffa340ab030 2024-09-13T06:29:16.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94244457431856] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa3c00a4d0 con 0x7ffa340ab030 2024-09-13T06:29:16.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 20 remove_watcher() i=7 2024-09-13T06:29:16.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff6758d0 msgr2=0x55b6ff677cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff6758d0 0x55b6ff677cc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff671440 msgr2=0x55b6ff673900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff671440 0x55b6ff673900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffa340ab030 msgr2=0x7ffa340df690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffa340ab030 0x7ffa340df690 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff67a900 msgr2=0x55b6ff67ccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff67a900 0x55b6ff67ccf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff90c034600 msgr2=0x7ff90c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff90c034600 0x7ff90c036ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800bb60 tx=0x7ffa38010000 comp rx=0 tx=0).stop 2024-09-13T06:29:16.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa42647640 1 -- 172.21.15.169:0/588796273 reap_dead start 2024-09-13T06:29:16.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 msgr2=0x55b6ff666450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff666450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffa340e1ad0 tx=0x7ffa340b1f70 comp rx=0 tx=0).stop 2024-09-13T06:29:16.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 shutdown_connections 2024-09-13T06:29:16.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 --2- 172.21.15.169:0/588796273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff65f2d0 0x55b6ff666450 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 >> 172.21.15.169:0/588796273 conn(0x55b6ff65b6b0 msgr2=0x55b6ff659780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.541+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 shutdown_connections 2024-09-13T06:29:16.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/588796273 wait complete. 2024-09-13T06:29:16.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff91c034650 msgr2=0x7ff91c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff91c034650 0x7ff91c036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55b6ff645510 tx=0x7ffa3800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:16.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 msgr2=0x55b6ff652fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 0x55b6ff652fc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa340e47e0 tx=0x7ffa340b56d0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 shutdown_connections 2024-09-13T06:29:16.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff91c034650 0x7ff91c036b10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/1378411199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff652ba0 0x55b6ff652fc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 >> 172.21.15.169:0/1378411199 conn(0x55b6ff647cf0 msgr2=0x55b6ff64a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 shutdown_connections 2024-09-13T06:29:16.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/1378411199 wait complete. 2024-09-13T06:29:16.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff63d210 msgr2=0x55b6ff63f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b6ff63d210 0x55b6ff63f600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff543230 msgr2=0x55b6ff63be10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b6ff543230 0x55b6ff63be10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff641110 msgr2=0x55b6ff644980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b6ff641110 0x55b6ff644980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff928034650 msgr2=0x7ff928036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff928034650 0x7ff928036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffa38001da0 tx=0x7ffa38001300 comp rx=0 tx=0).stop 2024-09-13T06:29:16.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 msgr2=0x55b6ff634e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 --2- 172.21.15.169:0/2583083750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b6ff5428e0 0x55b6ff634e80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa34019930 tx=0x7ffa34018020 comp rx=0 tx=0).stop 2024-09-13T06:29:16.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa42647640 1 -- 172.21.15.169:0/2583083750 reap_dead start 2024-09-13T06:29:16.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 shutdown_connections 2024-09-13T06:29:16.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 >> 172.21.15.169:0/2583083750 conn(0x55b6ff4b6230 msgr2=0x55b6ff628400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 shutdown_connections 2024-09-13T06:29:16.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.545+0000 7ffa44336980 1 -- 172.21.15.169:0/2583083750 wait complete. 2024-09-13T06:29:16.559 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:29:16.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T06:29:16.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T06:29:16.561 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T06:29:16.640 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:16.640 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:16.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9dfb2980 1 Processor -- start 2024-09-13T06:29:16.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9dfb2980 1 -- start start 2024-09-13T06:29:16.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9dfb2980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564fd7f1ab90 0x564fd7f1cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9dfb2980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564fd7d9eae0 con 0x564fd7f14ac0 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9dfb2980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x564fd7dc2e30 con 0x564fd7f1ab90 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9b2c1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564fd7f1ab90 0x564fd7f1cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9b2c1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564fd7f1ab90 0x564fd7f1cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46156/0 (socket says 172.21.15.169:46156) 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.637+0000 7fda9b2c1640 1 -- 172.21.15.169:0/453780643 learned_addr learned my addr 172.21.15.169:0/453780643 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.641+0000 7fda9b2c1640 1 -- 172.21.15.169:0/453780643 >> v1:172.21.15.112:6789/0 conn(0x564fd7f14ac0 legacy=0x564fd7f14ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.641+0000 7fda9b2c1640 1 -- 172.21.15.169:0/453780643 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd7f155b0 con 0x564fd7f1ab90 2024-09-13T06:29:16.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.641+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/453780643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f1ab90 0x564fd7f1cf80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a5c0 tx=0x7fda8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496e30801cacd6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.641+0000 7fda9aac0640 1 -- 172.21.15.169:0/453780643 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda840a6070 con 0x564fd7f1ab90 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.641+0000 7fda9aac0640 1 -- 172.21.15.169:0/453780643 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda840af070 con 0x564fd7f1ab90 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.641+0000 7fda9aac0640 1 -- 172.21.15.169:0/453780643 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda840aa5c0 con 0x564fd7f1ab90 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 -- 172.21.15.169:0/453780643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f1ab90 msgr2=0x564fd7f1cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/453780643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f1ab90 0x564fd7f1cf80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a5c0 tx=0x7fda8401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 -- 172.21.15.169:0/453780643 shutdown_connections 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/453780643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f1ab90 0x564fd7f1cf80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 -- 172.21.15.169:0/453780643 >> 172.21.15.169:0/453780643 conn(0x564fd7f107a0 msgr2=0x564fd7f12bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 -- 172.21.15.169:0/453780643 shutdown_connections 2024-09-13T06:29:16.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.645+0000 7fda9dfb2980 1 -- 172.21.15.169:0/453780643 wait complete. 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 Processor -- start 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- start start 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8001a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564fd7dc4200 con 0x564fd7f14ac0 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8001a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8001a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46158/0 (socket says 172.21.15.169:46158) 2024-09-13T06:29:16.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 -- 172.21.15.169:0/3539537974 learned_addr learned my addr 172.21.15.169:0/3539537974 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 -- 172.21.15.169:0/3539537974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd8001fe0 con 0x564fd7f14ac0 2024-09-13T06:29:16.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 --2- 172.21.15.169:0/3539537974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8001a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b1f0 tx=0x7fda8c00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09e10bef0455691 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fd989e0b640 1 -- 172.21.15.169:0/3539537974 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c00a040 con 0x564fd7f14ac0 2024-09-13T06:29:16.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fd989e0b640 1 -- 172.21.15.169:0/3539537974 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c00f750 con 0x564fd7f14ac0 2024-09-13T06:29:16.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fd989e0b640 1 -- 172.21.15.169:0/3539537974 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c00fa70 con 0x564fd7f14ac0 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- 172.21.15.169:0/3539537974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 msgr2=0x564fd8001a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/3539537974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8001a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b1f0 tx=0x7fda8c00b6b0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- 172.21.15.169:0/3539537974 shutdown_connections 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/3539537974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8001a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- 172.21.15.169:0/3539537974 >> 172.21.15.169:0/3539537974 conn(0x564fd7f107a0 msgr2=0x564fd7ffd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- 172.21.15.169:0/3539537974 shutdown_connections 2024-09-13T06:29:16.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- 172.21.15.169:0/3539537974 wait complete. 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 Processor -- start 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- start start 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8008da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9dfb2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564fd7f1ffe0 con 0x564fd7f14ac0 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8008da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8008da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46166/0 (socket says 172.21.15.169:46166) 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.661+0000 7fda9bac2640 1 -- 172.21.15.169:0/4196540827 learned_addr learned my addr 172.21.15.169:0/4196540827 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9bac2640 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd80092e0 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9bac2640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8008da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b6f0 tx=0x7fda8c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fd983fff640 1 -- 172.21.15.169:0/4196540827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c001300 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fd8009570 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fd983fff640 1 -- 172.21.15.169:0/4196540827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c01c9c0 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fd983fff640 1 -- 172.21.15.169:0/4196540827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c01cca0 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd800c250 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fd983fff640 1 -- 172.21.15.169:0/4196540827 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda8c017050 con 0x564fd7f14ac0 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fd983fff640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd984034650 0x7fd984036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fd983fff640 1 -- 172.21.15.169:0/4196540827 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fda8c015020 con 0x564fd7f14ac0 2024-09-13T06:29:16.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd984034650 0x7fd984036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd7f1ab90 0x564fd800fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8010420 con 0x564fd7f1ab90 2024-09-13T06:29:16.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9c2c3640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd7f1ab90 0x564fd800fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd984034650 0x7fd984036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a5c0 tx=0x7fda840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9c2c3640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd7f1ab90 0x564fd800fea0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9c2c3640 1 -- 172.21.15.169:0/4196540827 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd7f1ab90 2024-09-13T06:29:16.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd80111f0 0x564fd80135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.665+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8013c10 con 0x564fd80111f0 2024-09-13T06:29:16.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9bac2640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd80111f0 0x564fd80135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9bac2640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd80111f0 0x564fd80135e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9bac2640 1 -- 172.21.15.169:0/4196540827 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd80111f0 2024-09-13T06:29:16.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd80154c0 con 0x564fd80111f0 2024-09-13T06:29:16.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9bac2640 1 -- 172.21.15.169:0/4196540827 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd80111f0 2024-09-13T06:29:16.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8014630 con 0x564fd80111f0 2024-09-13T06:29:16.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9bac2640 1 -- 172.21.15.169:0/4196540827 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd80111f0 2024-09-13T06:29:16.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd8016870 0x564fd8018c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd80191a0 con 0x564fd8016870 2024-09-13T06:29:16.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd8016870 0x564fd8018c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd8016870 0x564fd8018c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.669+0000 7fda9b2c1640 1 -- 172.21.15.169:0/4196540827 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd8016870 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 Processor -- start 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 -- start start 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 0x564fd8026fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564fd7e1d800 con 0x564fd8026b80 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 0x564fd8026fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 0x564fd8026fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46172/0 (socket says 172.21.15.169:46172) 2024-09-13T06:29:16.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9bac2640 1 -- 172.21.15.169:0/2355062429 learned_addr learned my addr 172.21.15.169:0/2355062429 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9bac2640 1 -- 172.21.15.169:0/2355062429 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd80274e0 con 0x564fd8026b80 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9bac2640 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 0x564fd8026fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda8c01ced0 tx=0x7fda8c00e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fd9817fa640 1 -- 172.21.15.169:0/2355062429 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c01bfc0 con 0x564fd8026b80 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fd8027770 con 0x564fd8026b80 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fd9817fa640 1 -- 172.21.15.169:0/2355062429 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c01c160 con 0x564fd8026b80 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fd9817fa640 1 -- 172.21.15.169:0/2355062429 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c02fa90 con 0x564fd8026b80 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd802a3f0 con 0x564fd8026b80 2024-09-13T06:29:16.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fd9817fa640 1 -- 172.21.15.169:0/2355062429 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda8c02fc30 con 0x564fd8026b80 2024-09-13T06:29:16.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fd9817fa640 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd974034650 0x7fd974036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fd9817fa640 1 -- 172.21.15.169:0/2355062429 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fda8c04f080 con 0x564fd8026b80 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd974034650 0x7fd974036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 Processor -- start 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.673+0000 7fda9dfb2980 1 -- start start 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd974034650 0x7fd974036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x564fd800d390 tx=0x7fda84005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd80336c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564fd8002360 con 0x564fd80332c0 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd80336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd80336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46184/0 (socket says 172.21.15.169:46184) 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 -- 172.21.15.169:0/353744915 learned_addr learned my addr 172.21.15.169:0/353744915 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 -- 172.21.15.169:0/353744915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd8033c90 con 0x564fd80332c0 2024-09-13T06:29:16.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 --2- 172.21.15.169:0/353744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd80336c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda8c021040 tx=0x7fda8c03ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8840c26c0637ce86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fd97affd640 1 -- 172.21.15.169:0/353744915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c052040 con 0x564fd80332c0 2024-09-13T06:29:16.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fd97affd640 1 -- 172.21.15.169:0/353744915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c027c00 con 0x564fd80332c0 2024-09-13T06:29:16.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fd97affd640 1 -- 172.21.15.169:0/353744915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c041e90 con 0x564fd80332c0 2024-09-13T06:29:16.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- 172.21.15.169:0/353744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 msgr2=0x564fd80336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/353744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd80336c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda8c021040 tx=0x7fda8c03ed60 comp rx=0 tx=0).stop 2024-09-13T06:29:16.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- 172.21.15.169:0/353744915 shutdown_connections 2024-09-13T06:29:16.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/353744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd80336c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- 172.21.15.169:0/353744915 >> 172.21.15.169:0/353744915 conn(0x564fd802f6f0 msgr2=0x564fd802d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- 172.21.15.169:0/353744915 shutdown_connections 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- 172.21.15.169:0/353744915 wait complete. 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 Processor -- start 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- start start 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9dfb2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564fd8034160 con 0x564fd80332c0 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd803a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46196/0 (socket says 172.21.15.169:46196) 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 learned_addr learned my addr 172.21.15.169:0/683431281 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.677+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd803aa60 con 0x564fd80332c0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9bac2640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd803a520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda8c047530 tx=0x7fda8c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fd9797fa640 1 -- 172.21.15.169:0/683431281 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c052040 con 0x564fd80332c0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fd9797fa640 1 -- 172.21.15.169:0/683431281 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c01b570 con 0x564fd80332c0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fd9797fa640 1 -- 172.21.15.169:0/683431281 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c01b720 con 0x564fd80332c0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fd803aa60 con 0x564fd80332c0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd803aed0 con 0x564fd80332c0 2024-09-13T06:29:16.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fd9797fa640 1 -- 172.21.15.169:0/683431281 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda8c072020 con 0x564fd80332c0 2024-09-13T06:29:16.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fd9797fa640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd964034650 0x7fd964036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fd9797fa640 1 -- 172.21.15.169:0/683431281 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fda8c070020 con 0x564fd80332c0 2024-09-13T06:29:16.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd964034650 0x7fd964036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd8045600 0x564fd8047ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8048210 con 0x564fd8045600 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9c2c3640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd8045600 0x564fd8047ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd964034650 0x7fd964036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda84000c10 tx=0x7fda840c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9c2c3640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd8045600 0x564fd8047ac0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 realm 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8044a30 con 0x564fd8045600 2024-09-13T06:29:16.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8048ca0 con 0x564fd8045600 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd8049a80 0x564fd804be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.681+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9bac2640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd8049a80 0x564fd804be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9bac2640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd8049a80 0x564fd804be70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd804cd50 con 0x564fd8049a80 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 20 searching for the correct realm 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd804e5c0 0x564fd8050a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd8051150 con 0x564fd804e5c0 2024-09-13T06:29:16.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd804e5c0 0x564fd8050a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9b2c1640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd804e5c0 0x564fd8050a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd8051150 con 0x564fd8049a80 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.685+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9bac2640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fda8c06b420 0x7fda8c014930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x7fda8c06b420 2024-09-13T06:29:16.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fda8c06b420 0x7fda8c014930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fda8c06b420 0x7fda8c014930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd804e5c0 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.689+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x7fda8c06b420 2024-09-13T06:29:16.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x7fda8c06b420 2024-09-13T06:29:16.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd804e5c0 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd804e5c0 2024-09-13T06:29:16.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.693+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd804e5c0 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x7fda8c06b420 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8045600 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x7fda8c06b420 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd804e5c0 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x7fda8c06b420 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd804e5c0 2024-09-13T06:29:16.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.697+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c500 con 0x564fd8049a80 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:16.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd804c9f0 con 0x564fd8045600 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd804cde0 con 0x564fd8049a80 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd804cde0 con 0x564fd804e5c0 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:16.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 zone default found 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 4 Realm: () 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 zonegroup default 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd80515d0 con 0x7fda8c06b420 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8053800 con 0x564fd804e5c0 2024-09-13T06:29:16.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8053ba0 con 0x564fd804e5c0 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 started sync module instance, tier type = 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.701+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8052c40 con 0x564fd8049a80 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.705+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.705+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94900926623792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8053450 con 0x564fd8049a80 2024-09-13T06:29:16.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.705+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80543f0 con 0x564fd8045600 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.705+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.705+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94900926629776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055060 con 0x564fd8045600 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.705+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055a20 con 0x564fd8049a80 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.709+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94900926629776] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.709+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94900926623792] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.709+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.709+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94900926633328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055060 con 0x564fd8049a80 2024-09-13T06:29:16.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.709+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055990 con 0x7fda8c06b420 2024-09-13T06:29:16.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.713+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.713+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94900926635536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055990 con 0x7fda8c06b420 2024-09-13T06:29:16.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.713+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8056d60 con 0x564fd8049a80 2024-09-13T06:29:16.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.713+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94900926633328] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.717+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94900926635536] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.717+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.717+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94900926636592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8056d20 con 0x564fd8049a80 2024-09-13T06:29:16.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.717+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8057150 con 0x564fd804e5c0 2024-09-13T06:29:16.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94900926630832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80579f0 con 0x564fd804e5c0 2024-09-13T06:29:16.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80583b0 con 0x564fd804e5c0 2024-09-13T06:29:16.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94900926636592] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94900926643968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8058320 con 0x564fd804e5c0 2024-09-13T06:29:16.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.721+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8059270 con 0x7fda8c06b420 2024-09-13T06:29:16.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.725+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94900926630832] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94900926643968] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94900926646176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8058dc0 con 0x7fda8c06b420 2024-09-13T06:29:16.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=0 2024-09-13T06:29:16.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=1 2024-09-13T06:29:16.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=2 2024-09-13T06:29:16.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=3 2024-09-13T06:29:16.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=4 2024-09-13T06:29:16.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=5 2024-09-13T06:29:16.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.729+0000 7fda9dfb2980 20 add_watcher() i=6 2024-09-13T06:29:16.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94900926646176] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 20 add_watcher() i=7 2024-09-13T06:29:16.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:16.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8058dc0 con 0x564fd8045600 2024-09-13T06:29:16.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94900926641472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8059970 con 0x564fd8045600 2024-09-13T06:29:16.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94900926641472] v31'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:16.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:16.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:16.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.733+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8064b20 con 0x564fd8049a80 2024-09-13T06:29:16.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.737+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.737+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8064c30 con 0x7fda8c06b420 2024-09-13T06:29:16.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.737+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.737+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8065340 con 0x564fd804e5c0 2024-09-13T06:29:16.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.741+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.741+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80657f0 con 0x564fd8045600 2024-09-13T06:29:16.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.741+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.741+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8062920 con 0x564fd8049a80 2024-09-13T06:29:16.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.745+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.745+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8062920 con 0x564fd804e5c0 2024-09-13T06:29:16.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.745+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.745+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8062920 con 0x564fd8049a80 2024-09-13T06:29:16.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.749+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.749+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066350 con 0x564fd8045600 2024-09-13T06:29:16.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.749+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.749+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066800 con 0x564fd8049a80 2024-09-13T06:29:16.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.753+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.753+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066800 con 0x564fd8049a80 2024-09-13T06:29:16.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.757+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.757+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066800 con 0x564fd8049a80 2024-09-13T06:29:16.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.757+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.757+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066800 con 0x564fd804e5c0 2024-09-13T06:29:16.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.761+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.761+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066a60 con 0x564fd8049a80 2024-09-13T06:29:16.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.761+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.761+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066a60 con 0x564fd8045600 2024-09-13T06:29:16.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.765+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.765+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8067030 con 0x564fd8045600 2024-09-13T06:29:16.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.765+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.765+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066fd0 con 0x564fd8049a80 2024-09-13T06:29:16.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.769+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.769+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066fa0 con 0x564fd8049a80 2024-09-13T06:29:16.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.769+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.769+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066f10 con 0x564fd804e5c0 2024-09-13T06:29:16.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.773+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.773+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066f10 con 0x564fd8049a80 2024-09-13T06:29:16.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.773+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.773+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066f10 con 0x564fd8045600 2024-09-13T06:29:16.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.777+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.777+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066f10 con 0x564fd8049a80 2024-09-13T06:29:16.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.777+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.777+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066f10 con 0x564fd8049a80 2024-09-13T06:29:16.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.781+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.781+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066f10 con 0x564fd804e5c0 2024-09-13T06:29:16.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.781+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.781+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066fa0 con 0x564fd8049a80 2024-09-13T06:29:16.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.785+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.785+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8066fa0 con 0x564fd804e5c0 2024-09-13T06:29:16.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.789+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.789+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x564fd804e5c0 2024-09-13T06:29:16.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.789+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.789+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x564fd804e5c0 2024-09-13T06:29:16.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.793+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.793+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x564fd8049a80 2024-09-13T06:29:16.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.793+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.793+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x564fd8045600 2024-09-13T06:29:16.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.797+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.797+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x564fd8049a80 2024-09-13T06:29:16.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.801+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.801+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x564fd8045600 2024-09-13T06:29:16.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.801+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.801+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd80674e0 con 0x7fda8c06b420 2024-09-13T06:29:16.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fd950fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 20 Filter name: none 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fd8ca7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564fd8082510 con 0x7fda8c06b420 2024-09-13T06:29:16.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T06:29:16.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.805+0000 7fda9dfb2980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:29:16.809 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:29:16.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.809+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:16.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.809+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94900926641472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8042d80 con 0x564fd8045600 2024-09-13T06:29:16.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.809+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94900926641472] v31'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.809+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94900926623792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8057540 con 0x564fd8049a80 2024-09-13T06:29:16.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94900926623792] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9dfb2980 20 remove_watcher() i=0 2024-09-13T06:29:16.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9dfb2980 2 removed watcher, disabling cache 2024-09-13T06:29:16.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94900926629776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8057540 con 0x564fd8045600 2024-09-13T06:29:16.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94900926629776] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x564fd8045600 2024-09-13T06:29:16.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9dfb2980 20 remove_watcher() i=1 2024-09-13T06:29:16.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.813+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94900926633328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8054790 con 0x564fd8049a80 2024-09-13T06:29:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.817+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94900926633328] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.817+0000 7fda9dfb2980 20 remove_watcher() i=2 2024-09-13T06:29:16.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.817+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94900926635536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8057540 con 0x7fda8c06b420 2024-09-13T06:29:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.817+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94900926635536] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.817+0000 7fda9dfb2980 20 remove_watcher() i=3 2024-09-13T06:29:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.817+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94900926636592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055570 con 0x564fd8049a80 2024-09-13T06:29:16.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9bac2640 1 -- 172.21.15.169:0/683431281 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94900926636592] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x564fd8049a80 2024-09-13T06:29:16.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9dfb2980 20 remove_watcher() i=4 2024-09-13T06:29:16.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94900926630832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8054790 con 0x564fd804e5c0 2024-09-13T06:29:16.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94900926630832] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9dfb2980 20 remove_watcher() i=5 2024-09-13T06:29:16.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94900926643968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8057540 con 0x564fd804e5c0 2024-09-13T06:29:16.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9b2c1640 1 -- 172.21.15.169:0/683431281 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94900926643968] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda840aaaf0 con 0x564fd804e5c0 2024-09-13T06:29:16.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9dfb2980 20 remove_watcher() i=6 2024-09-13T06:29:16.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.821+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94900926646176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564fd8055570 con 0x7fda8c06b420 2024-09-13T06:29:16.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94900926646176] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9400a4d0 con 0x7fda8c06b420 2024-09-13T06:29:16.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 20 remove_watcher() i=7 2024-09-13T06:29:16.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd8049a80 msgr2=0x564fd804be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd8049a80 0x564fd804be70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd8045600 msgr2=0x564fd8047ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd8045600 0x564fd8047ac0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fda8c06b420 msgr2=0x7fda8c014930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fda8c06b420 0x7fda8c014930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd804e5c0 msgr2=0x564fd8050a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd804e5c0 0x564fd8050a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd964034650 msgr2=0x7fd964036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd964034650 0x7fd964036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda84000c10 tx=0x7fda840c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 msgr2=0x564fd803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/683431281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd80332c0 0x564fd803a520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda8c047530 tx=0x7fda8c00cf20 comp rx=0 tx=0).stop 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9c2c3640 1 -- 172.21.15.169:0/683431281 reap_dead start 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 shutdown_connections 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 >> 172.21.15.169:0/683431281 conn(0x564fd802f6f0 msgr2=0x564fd802d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 shutdown_connections 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/683431281 wait complete. 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd974034650 msgr2=0x7fd974036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd974034650 0x7fd974036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x564fd800d390 tx=0x7fda84005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 msgr2=0x564fd8026fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 0x564fd8026fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda8c01ced0 tx=0x7fda8c00e900 comp rx=0 tx=0).stop 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 shutdown_connections 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd974034650 0x7fd974036b10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/2355062429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd8026b80 0x564fd8026fa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 >> 172.21.15.169:0/2355062429 conn(0x564fd801bcd0 msgr2=0x564fd801e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 shutdown_connections 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/2355062429 wait complete. 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd80111f0 msgr2=0x564fd80135e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564fd80111f0 0x564fd80135e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd7f1ab90 msgr2=0x564fd800fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564fd7f1ab90 0x564fd800fea0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd8016870 msgr2=0x564fd8018c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564fd8016870 0x564fd8018c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd984034650 msgr2=0x7fd984036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd984034650 0x7fd984036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a5c0 tx=0x7fda840a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 msgr2=0x564fd8008da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 --2- 172.21.15.169:0/4196540827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fd7f14ac0 0x564fd8008da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b6f0 tx=0x7fda8c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9c2c3640 1 -- 172.21.15.169:0/4196540827 reap_dead start 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 shutdown_connections 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 >> 172.21.15.169:0/4196540827 conn(0x564fd7f107a0 msgr2=0x564fd7ffc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 shutdown_connections 2024-09-13T06:29:16.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.825+0000 7fda9dfb2980 1 -- 172.21.15.169:0/4196540827 wait complete. 2024-09-13T06:29:16.840 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:29:16.841 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T06:29:16.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T06:29:16.841 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T06:29:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa47a281980 1 Processor -- start 2024-09-13T06:29:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa47a281980 1 -- start start 2024-09-13T06:29:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa47a281980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561cf86c8c60 0x561cf86cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa47a281980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cf854aae0 con 0x561cf86c48e0 2024-09-13T06:29:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa47a281980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x561cf856ee30 con 0x561cf86c8c60 2024-09-13T06:29:16.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa477590640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561cf86c8c60 0x561cf86cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa477d91640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x561cf86c48e0 0x561cf86c4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60404/0 (socket says 172.21.15.169:60404) 2024-09-13T06:29:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa477d91640 1 -- 172.21.15.169:0/2597386326 learned_addr learned my addr 172.21.15.169:0/2597386326 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa477590640 1 -- 172.21.15.169:0/2597386326 >> v1:172.21.15.112:6789/0 conn(0x561cf86c48e0 legacy=0x561cf86c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.917+0000 7fa477590640 1 -- 172.21.15.169:0/2597386326 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf86cc5a0 con 0x561cf86c8c60 2024-09-13T06:29:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa477590640 1 --2- 172.21.15.169:0/2597386326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c8c60 0x561cf86cb050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa46800a480 tx=0x7fa46801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3a70f086b07712 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa476d8f640 1 -- 172.21.15.169:0/2597386326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4680b0070 con 0x561cf86c8c60 2024-09-13T06:29:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa476d8f640 1 -- 172.21.15.169:0/2597386326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4680ab540 con 0x561cf86c8c60 2024-09-13T06:29:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa476d8f640 1 -- 172.21.15.169:0/2597386326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4680ab840 con 0x561cf86c8c60 2024-09-13T06:29:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 -- 172.21.15.169:0/2597386326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c8c60 msgr2=0x561cf86cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 --2- 172.21.15.169:0/2597386326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c8c60 0x561cf86cb050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa46800a480 tx=0x7fa46801b280 comp rx=0 tx=0).stop 2024-09-13T06:29:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 -- 172.21.15.169:0/2597386326 shutdown_connections 2024-09-13T06:29:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 --2- 172.21.15.169:0/2597386326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c8c60 0x561cf86cb050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 -- 172.21.15.169:0/2597386326 >> 172.21.15.169:0/2597386326 conn(0x561cf8638230 msgr2=0x561cf8638640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 -- 172.21.15.169:0/2597386326 shutdown_connections 2024-09-13T06:29:16.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.921+0000 7fa47a281980 1 -- 172.21.15.169:0/2597386326 wait complete. 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa47a281980 1 Processor -- start 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa47a281980 1 -- start start 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa47a281980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa47a281980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561cf8570200 con 0x561cf86c48e0 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46216/0 (socket says 172.21.15.169:46216) 2024-09-13T06:29:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa477d91640 1 -- 172.21.15.169:0/2980973120 learned_addr learned my addr 172.21.15.169:0/2980973120 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa477d91640 1 -- 172.21.15.169:0/2980973120 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf87b0210 con 0x561cf86c48e0 2024-09-13T06:29:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.937+0000 7fa477d91640 1 --2- 172.21.15.169:0/2980973120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87afc40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa4600017b0 tx=0x7fa460001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d2f54c9681ca2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa365e0b640 1 -- 172.21.15.169:0/2980973120 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460016070 con 0x561cf86c48e0 2024-09-13T06:29:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa365e0b640 1 -- 172.21.15.169:0/2980973120 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa460004530 con 0x561cf86c48e0 2024-09-13T06:29:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa365e0b640 1 -- 172.21.15.169:0/2980973120 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460004870 con 0x561cf86c48e0 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/2980973120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 msgr2=0x561cf87afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 --2- 172.21.15.169:0/2980973120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87afc40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa4600017b0 tx=0x7fa460001c70 comp rx=0 tx=0).stop 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/2980973120 shutdown_connections 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 --2- 172.21.15.169:0/2980973120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87afc40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/2980973120 >> 172.21.15.169:0/2980973120 conn(0x561cf8638230 msgr2=0x561cf87ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/2980973120 shutdown_connections 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/2980973120 wait complete. 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 Processor -- start 2024-09-13T06:29:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- start start 2024-09-13T06:29:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561cf86cc0a0 con 0x561cf86c48e0 2024-09-13T06:29:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46220/0 (socket says 172.21.15.169:46220) 2024-09-13T06:29:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa477d91640 1 -- 172.21.15.169:0/507407931 learned_addr learned my addr 172.21.15.169:0/507407931 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa477d91640 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf87b7530 con 0x561cf86c48e0 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa477d91640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87b6ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa460000f90 tx=0x7fa460001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa35ffff640 1 -- 172.21.15.169:0/507407931 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460020070 con 0x561cf86c48e0 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa35ffff640 1 -- 172.21.15.169:0/507407931 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa460011400 con 0x561cf86c48e0 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf87b77c0 con 0x561cf86c48e0 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa35ffff640 1 -- 172.21.15.169:0/507407931 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460016040 con 0x561cf86c48e0 2024-09-13T06:29:16.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.941+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf87ba4a0 con 0x561cf86c48e0 2024-09-13T06:29:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa35ffff640 1 -- 172.21.15.169:0/507407931 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa460023070 con 0x561cf86c48e0 2024-09-13T06:29:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa35ffff640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa360034650 0x7fa360036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa35ffff640 1 -- 172.21.15.169:0/507407931 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fa460048fc0 con 0x561cf86c48e0 2024-09-13T06:29:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa477590640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa360034650 0x7fa360036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf86c8c60 0x561cf87be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87be630 con 0x561cf86c8c60 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa478592640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf86c8c60 0x561cf87be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa477590640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa360034650 0x7fa360036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ad000 tx=0x7fa4680a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa478592640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf86c8c60 0x561cf87be0f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa478592640 1 -- 172.21.15.169:0/507407931 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf86c8c60 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87bf410 0x561cf87c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87c1e30 con 0x561cf87bf410 2024-09-13T06:29:16.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa477d91640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87bf410 0x561cf87c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa477d91640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87bf410 0x561cf87c1800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa477d91640 1 -- 172.21.15.169:0/507407931 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa46002c070 con 0x561cf87bf410 2024-09-13T06:29:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.945+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87c36e0 con 0x561cf87bf410 2024-09-13T06:29:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 -- 172.21.15.169:0/507407931 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa46002c070 con 0x561cf87bf410 2024-09-13T06:29:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87c2910 con 0x561cf87bf410 2024-09-13T06:29:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 -- 172.21.15.169:0/507407931 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa46002c070 con 0x561cf87bf410 2024-09-13T06:29:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87c4a90 0x561cf87c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87c73c0 con 0x561cf87c4a90 2024-09-13T06:29:16.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477590640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87c4a90 0x561cf87c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477590640 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87c4a90 0x561cf87c6e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477590640 1 -- 172.21.15.169:0/507407931 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4680b3040 con 0x561cf87c4a90 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 Processor -- start 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 -- start start 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 0x561cf87d5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa47a281980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561cf85c9800 con 0x561cf87d4df0 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 0x561cf87d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 0x561cf87d5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46224/0 (socket says 172.21.15.169:46224) 2024-09-13T06:29:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 -- 172.21.15.169:0/1356172363 learned_addr learned my addr 172.21.15.169:0/1356172363 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 -- 172.21.15.169:0/1356172363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf87d5750 con 0x561cf87d4df0 2024-09-13T06:29:16.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.949+0000 7fa477d91640 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 0x561cf87d5210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa460024700 tx=0x7fa460023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa35d7fa640 1 -- 172.21.15.169:0/1356172363 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa46003e020 con 0x561cf87d4df0 2024-09-13T06:29:16.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa35d7fa640 1 -- 172.21.15.169:0/1356172363 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4600118f0 con 0x561cf87d4df0 2024-09-13T06:29:16.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf87d59e0 con 0x561cf87d4df0 2024-09-13T06:29:16.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa35d7fa640 1 -- 172.21.15.169:0/1356172363 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa46002a040 con 0x561cf87d4df0 2024-09-13T06:29:16.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf87d8660 con 0x561cf87d4df0 2024-09-13T06:29:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa35d7fa640 1 -- 172.21.15.169:0/1356172363 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa460026970 con 0x561cf87d4df0 2024-09-13T06:29:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa35d7fa640 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa350034650 0x7fa350036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa35d7fa640 1 -- 172.21.15.169:0/1356172363 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fa46003ca90 con 0x561cf87d4df0 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477590640 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa350034650 0x7fa350036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 Processor -- start 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 -- start start 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561cf87b0590 con 0x561cf87e1720 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477590640 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa350034650 0x7fa350036b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa468000c10 tx=0x7fa468005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46226/0 (socket says 172.21.15.169:46226) 2024-09-13T06:29:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477d91640 1 -- 172.21.15.169:0/3261142792 learned_addr learned my addr 172.21.15.169:0/3261142792 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477d91640 1 -- 172.21.15.169:0/3261142792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf87e20d0 con 0x561cf87e1720 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa477d91640 1 --2- 172.21.15.169:0/3261142792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e1b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa460023c10 tx=0x7fa460025450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41291de6e068040 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa356ffd640 1 -- 172.21.15.169:0/3261142792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa46003cdb0 con 0x561cf87e1720 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa356ffd640 1 -- 172.21.15.169:0/3261142792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46005e070 con 0x561cf87e1720 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa356ffd640 1 -- 172.21.15.169:0/3261142792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460040d20 con 0x561cf87e1720 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 -- 172.21.15.169:0/3261142792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 msgr2=0x561cf87e1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.953+0000 7fa47a281980 1 --2- 172.21.15.169:0/3261142792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e1b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa460023c10 tx=0x7fa460025450 comp rx=0 tx=0).stop 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/3261142792 shutdown_connections 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 --2- 172.21.15.169:0/3261142792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e1b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/3261142792 >> 172.21.15.169:0/3261142792 conn(0x561cf87ddb00 msgr2=0x561cf87dbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/3261142792 shutdown_connections 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/3261142792 wait complete. 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 Processor -- start 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- start start 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561cf87e2570 con 0x561cf87e1720 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa477d91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46240/0 (socket says 172.21.15.169:46240) 2024-09-13T06:29:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 learned_addr learned my addr 172.21.15.169:0/60833166 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf87e8ec0 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa477d91640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e8980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa460011d70 tx=0x7fa46003c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa3557fa640 1 -- 172.21.15.169:0/60833166 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa46006c070 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf87e8ec0 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa3557fa640 1 -- 172.21.15.169:0/60833166 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa460029aa0 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa3557fa640 1 -- 172.21.15.169:0/60833166 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460029d80 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf87e8ec0 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa3557fa640 1 -- 172.21.15.169:0/60833166 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa460044440 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa3557fa640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa340034650 0x7fa340036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa3557fa640 1 -- 172.21.15.169:0/60833166 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fa46003e1c0 con 0x561cf87e1720 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa477590640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa340034650 0x7fa340036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf87f3820 0x561cf87f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.957+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87f6430 con 0x561cf87f3820 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa478592640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf87f3820 0x561cf87f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa477590640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa340034650 0x7fa340036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ab510 tx=0x7fa4680b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa478592640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf87f3820 0x561cf87f5ce0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 realm 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87f2c50 con 0x561cf87f3820 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87f6ec0 con 0x561cf87f3820 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87f7ca0 0x561cf87fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87fa720 con 0x561cf87f7ca0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa477d91640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87f7ca0 0x561cf87fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa477d91640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87f7ca0 0x561cf87fa090 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87faf70 con 0x561cf87f7ca0 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 20 searching for the correct realm 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87fcce0 0x561cf87ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.961+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477590640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87fcce0 0x561cf87ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477590640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87fcce0 0x561cf87ff0d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477d91640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fa460071070 0x7fa46003fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x7fa460071070 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fa460071070 0x7fa46003fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fa460071070 0x7fa46003fa10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.965+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x7fa460071070 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x7fa460071070 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.969+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x7fa460071070 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f3820 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x7fa460071070 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x7fa460071070 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.973+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87fcce0 2024-09-13T06:29:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561cf87ff750 con 0x561cf87f7ca0 2024-09-13T06:29:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87fb8f0 con 0x561cf87f3820 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87fb530 con 0x561cf87f7ca0 2024-09-13T06:29:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87fc210 con 0x561cf87fcce0 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 zone default found 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 4 Realm: () 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 zonegroup default 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf87fbdf0 con 0x7fa460071070 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.977+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf8801f70 con 0x561cf87fcce0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf8802310 con 0x561cf87fcce0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 20 started sync module instance, tier type = 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88013b0 con 0x561cf87f7ca0 2024-09-13T06:29:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94682428215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8801a20 con 0x561cf87f7ca0 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.981+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8802cd0 con 0x561cf87f3820 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94682428221472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8803520 con 0x561cf87f3820 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8803f40 con 0x561cf87f7ca0 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94682428221472] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94682428215312] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94682428226096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8803070 con 0x561cf87f7ca0 2024-09-13T06:29:16.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88047e0 con 0x7fa460071070 2024-09-13T06:29:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94682428228400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8803070 con 0x7fa460071070 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.985+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8805260 con 0x561cf87f7ca0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94682428226096] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94682428228400] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94682428229456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8804d70 con 0x561cf87f7ca0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8805b00 con 0x561cf87fcce0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94682428233296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8804d70 con 0x561cf87fcce0 2024-09-13T06:29:16.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.989+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806970 con 0x561cf87fcce0 2024-09-13T06:29:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94682428229456] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94682428233296] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94682428216432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806970 con 0x561cf87fcce0 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88071c0 con 0x7fa460071070 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94682428216432] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94682428237472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806ff0 con 0x7fa460071070 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=0 2024-09-13T06:29:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=1 2024-09-13T06:29:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=2 2024-09-13T06:29:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=3 2024-09-13T06:29:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=4 2024-09-13T06:29:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=5 2024-09-13T06:29:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.993+0000 7fa47a281980 20 add_watcher() i=6 2024-09-13T06:29:16.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94682428237472] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:16.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 20 add_watcher() i=7 2024-09-13T06:29:16.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:16.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf880a560 con 0x561cf87f3820 2024-09-13T06:29:16.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:16.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94682428238528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8807ab0 con 0x561cf87f3820 2024-09-13T06:29:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94682428238528] v31'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa32dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:16.997+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf880a270 con 0x561cf87f7ca0 2024-09-13T06:29:17.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.001+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.001+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf880a320 con 0x7fa460071070 2024-09-13T06:29:17.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.001+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:17.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.001+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8813650 con 0x561cf87fcce0 2024-09-13T06:29:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.005+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.005+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88135f0 con 0x561cf87f3820 2024-09-13T06:29:17.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.005+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.005+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8813d00 con 0x561cf87f7ca0 2024-09-13T06:29:17.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.009+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.009+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8813e30 con 0x561cf87fcce0 2024-09-13T06:29:17.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.009+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.009+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88144a0 con 0x561cf87f7ca0 2024-09-13T06:29:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.009+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.009+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88144a0 con 0x561cf87f3820 2024-09-13T06:29:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.013+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.013+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8814a10 con 0x561cf87f7ca0 2024-09-13T06:29:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.017+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.017+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8814a10 con 0x561cf87f7ca0 2024-09-13T06:29:17.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.017+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.017+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8814ec0 con 0x561cf87f7ca0 2024-09-13T06:29:17.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.017+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.017+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8814ec0 con 0x561cf87fcce0 2024-09-13T06:29:17.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.021+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.021+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8811c50 con 0x561cf87f7ca0 2024-09-13T06:29:17.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.021+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.021+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8811c50 con 0x561cf87f3820 2024-09-13T06:29:17.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.025+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.025+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8811c50 con 0x561cf87f3820 2024-09-13T06:29:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.025+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.025+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8811d10 con 0x561cf87f7ca0 2024-09-13T06:29:17.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.029+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.029+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.033+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.033+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87fcce0 2024-09-13T06:29:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.033+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.033+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.037+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.037+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f3820 2024-09-13T06:29:17.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.041+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.041+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.041+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.041+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.045+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.045+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87fcce0 2024-09-13T06:29:17.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.049+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.049+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.049+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.049+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87fcce0 2024-09-13T06:29:17.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.053+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.053+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87fcce0 2024-09-13T06:29:17.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.053+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.053+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87fcce0 2024-09-13T06:29:17.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.057+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.057+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.057+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.057+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f3820 2024-09-13T06:29:17.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.061+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.061+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f7ca0 2024-09-13T06:29:17.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.061+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.061+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x561cf87f3820 2024-09-13T06:29:17.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8815a20 con 0x7fa460071070 2024-09-13T06:29:17.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa32cfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 20 Filter name: none 2024-09-13T06:29:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa2a67fc640 20 reqs_thread_entry: start 2024-09-13T06:29:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cf8830a50 con 0x7fa460071070 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.065+0000 7fa47a281980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:29:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.069+0000 7fa32dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.069+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94682428238528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf87a7100 con 0x561cf87f3820 2024-09-13T06:29:17.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.069+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94682428238528] v31'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.069+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94682428215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806ac0 con 0x561cf87f7ca0 2024-09-13T06:29:17.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94682428215312] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa47a281980 20 remove_watcher() i=0 2024-09-13T06:29:17.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa47a281980 2 removed watcher, disabling cache 2024-09-13T06:29:17.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94682428221472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806ac0 con 0x561cf87f3820 2024-09-13T06:29:17.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94682428221472] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x561cf87f3820 2024-09-13T06:29:17.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa47a281980 20 remove_watcher() i=1 2024-09-13T06:29:17.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.073+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94682428226096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806ac0 con 0x561cf87f7ca0 2024-09-13T06:29:17.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.077+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94682428226096] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.077+0000 7fa47a281980 20 remove_watcher() i=2 2024-09-13T06:29:17.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.077+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94682428228400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8803a30 con 0x7fa460071070 2024-09-13T06:29:17.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.077+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94682428228400] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:17.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.077+0000 7fa47a281980 20 remove_watcher() i=3 2024-09-13T06:29:17.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.077+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94682428229456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806ac0 con 0x561cf87f7ca0 2024-09-13T06:29:17.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.081+0000 7fa477d91640 1 -- 172.21.15.169:0/60833166 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94682428229456] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46006e070 con 0x561cf87f7ca0 2024-09-13T06:29:17.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.081+0000 7fa47a281980 20 remove_watcher() i=4 2024-09-13T06:29:17.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.081+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94682428233296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8803a30 con 0x561cf87fcce0 2024-09-13T06:29:17.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.081+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94682428233296] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.081+0000 7fa47a281980 20 remove_watcher() i=5 2024-09-13T06:29:17.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.081+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94682428216432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf8806ac0 con 0x561cf87fcce0 2024-09-13T06:29:17.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa477590640 1 -- 172.21.15.169:0/60833166 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94682428216432] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4680c9030 con 0x561cf87fcce0 2024-09-13T06:29:17.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 20 remove_watcher() i=6 2024-09-13T06:29:17.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94682428237472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561cf88047e0 con 0x7fa460071070 2024-09-13T06:29:17.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94682428237472] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4700083f0 con 0x7fa460071070 2024-09-13T06:29:17.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 20 remove_watcher() i=7 2024-09-13T06:29:17.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87f7ca0 msgr2=0x561cf87fa090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87f7ca0 0x561cf87fa090 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf87f3820 msgr2=0x561cf87f5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf87f3820 0x561cf87f5ce0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fa460071070 msgr2=0x7fa46003fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fa460071070 0x7fa46003fa10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87fcce0 msgr2=0x561cf87ff0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87fcce0 0x561cf87ff0d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa340034650 msgr2=0x7fa340036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa340034650 0x7fa340036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ab510 tx=0x7fa4680b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 msgr2=0x561cf87e8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e8980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa460011d70 tx=0x7fa46003c730 comp rx=0 tx=0).stop 2024-09-13T06:29:17.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa478592640 1 -- 172.21.15.169:0/60833166 reap_dead start 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 shutdown_connections 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/60833166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87e1720 0x561cf87e8980 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 >> 172.21.15.169:0/60833166 conn(0x561cf87ddb00 msgr2=0x561cf87dbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 shutdown_connections 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/60833166 wait complete. 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa350034650 msgr2=0x7fa350036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa350034650 0x7fa350036b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa468000c10 tx=0x7fa468005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 msgr2=0x561cf87d5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 0x561cf87d5210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa460024700 tx=0x7fa460023ac0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 shutdown_connections 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa350034650 0x7fa350036b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 --2- 172.21.15.169:0/1356172363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf87d4df0 0x561cf87d5210 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 >> 172.21.15.169:0/1356172363 conn(0x561cf87c9f40 msgr2=0x561cf87cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 shutdown_connections 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.085+0000 7fa47a281980 1 -- 172.21.15.169:0/1356172363 wait complete. 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87bf410 msgr2=0x561cf87c1800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561cf87bf410 0x561cf87c1800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf86c8c60 msgr2=0x561cf87be0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561cf86c8c60 0x561cf87be0f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87c4a90 msgr2=0x561cf87c6e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561cf87c4a90 0x561cf87c6e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa360034650 msgr2=0x7fa360036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa360034650 0x7fa360036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ad000 tx=0x7fa4680a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 msgr2=0x561cf87b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 --2- 172.21.15.169:0/507407931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561cf86c48e0 0x561cf87b6ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa460000f90 tx=0x7fa460001260 comp rx=0 tx=0).stop 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa478592640 1 -- 172.21.15.169:0/507407931 reap_dead start 2024-09-13T06:29:17.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 shutdown_connections 2024-09-13T06:29:17.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 >> 172.21.15.169:0/507407931 conn(0x561cf8638230 msgr2=0x561cf87aa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 shutdown_connections 2024-09-13T06:29:17.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.089+0000 7fa47a281980 1 -- 172.21.15.169:0/507407931 wait complete. 2024-09-13T06:29:17.101 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:29:17.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T06:29:17.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T06:29:17.102 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T06:29:17.178 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:17.179 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:17.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9fb9f980 1 Processor -- start 2024-09-13T06:29:17.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9fb9f980 1 -- start start 2024-09-13T06:29:17.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9fb9f980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55be836468e0 0x55be83646cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9fb9f980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be834ccae0 con 0x55be83647230 2024-09-13T06:29:17.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9fb9f980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55be834f0e30 con 0x55be836468e0 2024-09-13T06:29:17.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9d6af640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55be836468e0 0x55be83646cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9ceae640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55be83647230 0x55be8364bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60418/0 (socket says 172.21.15.169:60418) 2024-09-13T06:29:17.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9d6af640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55be836468e0 0x55be83646cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46248/0 (socket says 172.21.15.169:46248) 2024-09-13T06:29:17.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9ceae640 1 -- 172.21.15.169:0/3661091338 learned_addr learned my addr 172.21.15.169:0/3661091338 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:17.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9d6af640 1 -- 172.21.15.169:0/3661091338 >> v1:172.21.15.112:6789/0 conn(0x55be83647230 legacy=0x55be8364bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.177+0000 7fee9d6af640 1 -- 172.21.15.169:0/3661091338 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8364e4b0 con 0x55be836468e0 2024-09-13T06:29:17.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3661091338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be836468e0 0x55be83646cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee9000a480 tx=0x7fee9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc17eeab1e36058 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee97fff640 1 -- 172.21.15.169:0/3661091338 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900b0070 con 0x55be836468e0 2024-09-13T06:29:17.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee97fff640 1 -- 172.21.15.169:0/3661091338 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee900ab540 con 0x55be836468e0 2024-09-13T06:29:17.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee97fff640 1 -- 172.21.15.169:0/3661091338 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900ab840 con 0x55be836468e0 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3661091338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be836468e0 msgr2=0x55be83646cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3661091338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be836468e0 0x55be83646cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee9000a480 tx=0x7fee9001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3661091338 shutdown_connections 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3661091338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be836468e0 0x55be83646cc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3661091338 >> 172.21.15.169:0/3661091338 conn(0x55be835ba230 msgr2=0x55be835ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3661091338 shutdown_connections 2024-09-13T06:29:17.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.181+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3661091338 wait complete. 2024-09-13T06:29:17.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9fb9f980 1 Processor -- start 2024-09-13T06:29:17.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9fb9f980 1 -- start start 2024-09-13T06:29:17.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9fb9f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83731db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9fb9f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55be834f2200 con 0x55be83647230 2024-09-13T06:29:17.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83731db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83731db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46254/0 (socket says 172.21.15.169:46254) 2024-09-13T06:29:17.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9d6af640 1 -- 172.21.15.169:0/26873628 learned_addr learned my addr 172.21.15.169:0/26873628 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.197+0000 7fee9d6af640 1 -- 172.21.15.169:0/26873628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be83732380 con 0x55be83647230 2024-09-13T06:29:17.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9d6af640 1 --2- 172.21.15.169:0/26873628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83731db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee90018eb0 tx=0x7fee90003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d42533525f3734 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fed8b606640 1 -- 172.21.15.169:0/26873628 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900b0040 con 0x55be83647230 2024-09-13T06:29:17.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fed8b606640 1 -- 172.21.15.169:0/26873628 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee900ab9b0 con 0x55be83647230 2024-09-13T06:29:17.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fed8b606640 1 -- 172.21.15.169:0/26873628 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900abcd0 con 0x55be83647230 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/26873628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 msgr2=0x55be83731db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/26873628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83731db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee90018eb0 tx=0x7fee90003030 comp rx=0 tx=0).stop 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/26873628 shutdown_connections 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/26873628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83731db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/26873628 >> 172.21.15.169:0/26873628 conn(0x55be835ba230 msgr2=0x55be8372d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/26873628 shutdown_connections 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/26873628 wait complete. 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 Processor -- start 2024-09-13T06:29:17.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- start start 2024-09-13T06:29:17.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83739130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55be8364def0 con 0x55be83647230 2024-09-13T06:29:17.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83739130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83739130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46260/0 (socket says 172.21.15.169:46260) 2024-09-13T06:29:17.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9d6af640 1 -- 172.21.15.169:0/3361805894 learned_addr learned my addr 172.21.15.169:0/3361805894 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9d6af640 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be83739670 con 0x55be83647230 2024-09-13T06:29:17.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83739130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee900b9040 tx=0x7fee90018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fed89e03640 1 -- 172.21.15.169:0/3361805894 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900b0070 con 0x55be83647230 2024-09-13T06:29:17.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fed89e03640 1 -- 172.21.15.169:0/3361805894 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee900c5070 con 0x55be83647230 2024-09-13T06:29:17.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be83739900 con 0x55be83647230 2024-09-13T06:29:17.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fed89e03640 1 -- 172.21.15.169:0/3361805894 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900b69a0 con 0x55be83647230 2024-09-13T06:29:17.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.201+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8373c5e0 con 0x55be83647230 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fed89e03640 1 -- 172.21.15.169:0/3361805894 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fee900b6b40 con 0x55be83647230 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fed89e03640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed84034650 0x7fed84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fed89e03640 1 -- 172.21.15.169:0/3361805894 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fee900bc070 con 0x55be83647230 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed84034650 0x7fed84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be8373e0b0 0x55be837404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83740ac0 con 0x55be8373e0b0 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9deb0640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be8373e0b0 0x55be837404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed84034650 0x7fed84036b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee88000f70 tx=0x7fee880012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9deb0640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be8373e0b0 0x55be837404a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9deb0640 1 -- 172.21.15.169:0/3361805894 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be8373e0b0 2024-09-13T06:29:17.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be83741890 0x55be83743c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be837442b0 con 0x55be83741890 2024-09-13T06:29:17.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be83741890 0x55be83743c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.205+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be83741890 0x55be83743c80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9d6af640 1 -- 172.21.15.169:0/3361805894 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee900b3040 con 0x55be83741890 2024-09-13T06:29:17.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83745b60 con 0x55be83741890 2024-09-13T06:29:17.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9d6af640 1 -- 172.21.15.169:0/3361805894 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee900b3040 con 0x55be83741890 2024-09-13T06:29:17.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83744d90 con 0x55be83741890 2024-09-13T06:29:17.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9d6af640 1 -- 172.21.15.169:0/3361805894 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee900b3040 con 0x55be83741890 2024-09-13T06:29:17.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be83746f10 0x55be83749300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83749840 con 0x55be83746f10 2024-09-13T06:29:17.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be83746f10 0x55be83749300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be83746f10 0x55be83749300 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9ceae640 1 -- 172.21.15.169:0/3361805894 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee8800e620 con 0x55be83746f10 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 Processor -- start 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 -- start start 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 0x55be83757660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9fb9f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55be8354b800 con 0x55be83757240 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 0x55be83757660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 0x55be83757660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46264/0 (socket says 172.21.15.169:46264) 2024-09-13T06:29:17.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.209+0000 7fee9d6af640 1 -- 172.21.15.169:0/1343826237 learned_addr learned my addr 172.21.15.169:0/1343826237 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9d6af640 1 -- 172.21.15.169:0/1343826237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be83757ba0 con 0x55be83757240 2024-09-13T06:29:17.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9d6af640 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 0x55be83757660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fee900e2e00 tx=0x7fee900b4d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fed82ffd640 1 -- 172.21.15.169:0/1343826237 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900e49a0 con 0x55be83757240 2024-09-13T06:29:17.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be83757e30 con 0x55be83757240 2024-09-13T06:29:17.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fed82ffd640 1 -- 172.21.15.169:0/1343826237 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee90000e50 con 0x55be83757240 2024-09-13T06:29:17.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fed82ffd640 1 -- 172.21.15.169:0/1343826237 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900e4b40 con 0x55be83757240 2024-09-13T06:29:17.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8375aab0 con 0x55be83757240 2024-09-13T06:29:17.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fed82ffd640 1 -- 172.21.15.169:0/1343826237 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fee900e4ce0 con 0x55be83757240 2024-09-13T06:29:17.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fed82ffd640 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed74034650 0x7fed74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fed82ffd640 1 -- 172.21.15.169:0/1343826237 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fee900a8070 con 0x55be83757240 2024-09-13T06:29:17.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9ceae640 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed74034650 0x7fed74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9fb9f980 1 Processor -- start 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9fb9f980 1 -- start start 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9ceae640 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed74034650 0x7fed74036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee8800bf60 tx=0x7fee8800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9fb9f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be83763f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9fb9f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55be83732640 con 0x55be83763b90 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be83763f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be83763f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46274/0 (socket says 172.21.15.169:46274) 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.213+0000 7fee9d6af640 1 -- 172.21.15.169:0/3254958399 learned_addr learned my addr 172.21.15.169:0/3254958399 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 -- 172.21.15.169:0/3254958399 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be83764540 con 0x55be83763b90 2024-09-13T06:29:17.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3254958399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be83763f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee900b6ea0 tx=0x7fee900bc5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7114d27a57bb4326 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fed80ff9640 1 -- 172.21.15.169:0/3254958399 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900f1030 con 0x55be83763b90 2024-09-13T06:29:17.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fed80ff9640 1 -- 172.21.15.169:0/3254958399 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee900d6d70 con 0x55be83763b90 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fed80ff9640 1 -- 172.21.15.169:0/3254958399 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900c9940 con 0x55be83763b90 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3254958399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 msgr2=0x55be83763f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3254958399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be83763f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee900b6ea0 tx=0x7fee900bc5f0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3254958399 shutdown_connections 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3254958399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be83763f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3254958399 >> 172.21.15.169:0/3254958399 conn(0x55be8375ff70 msgr2=0x55be8375e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3254958399 shutdown_connections 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3254958399 wait complete. 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 Processor -- start 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- start start 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be8376ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55be837649e0 con 0x55be83763b90 2024-09-13T06:29:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be8376ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be8376ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46276/0 (socket says 172.21.15.169:46276) 2024-09-13T06:29:17.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 learned_addr learned my addr 172.21.15.169:0/3785974900 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8376b2d0 con 0x55be83763b90 2024-09-13T06:29:17.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be8376ad90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee900c9fd0 tx=0x7fee900f1f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fed72ffd640 1 -- 172.21.15.169:0/3785974900 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee90110070 con 0x55be83763b90 2024-09-13T06:29:17.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be8376b2d0 con 0x55be83763b90 2024-09-13T06:29:17.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fed72ffd640 1 -- 172.21.15.169:0/3785974900 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee900c97f0 con 0x55be83763b90 2024-09-13T06:29:17.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fed72ffd640 1 -- 172.21.15.169:0/3785974900 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee900f1040 con 0x55be83763b90 2024-09-13T06:29:17.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.217+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8376b740 con 0x55be83763b90 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fed72ffd640 1 -- 172.21.15.169:0/3785974900 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fee90113070 con 0x55be83763b90 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fed72ffd640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed68034650 0x7fed68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fed72ffd640 1 -- 172.21.15.169:0/3785974900 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fee90108070 con 0x55be83763b90 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed68034650 0x7fed68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be83775d20 0x55be837781e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83778930 con 0x55be83775d20 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9deb0640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be83775d20 0x55be837781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed68034650 0x7fed68036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55be8373d720 tx=0x7fee88010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9deb0640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be83775d20 0x55be837781e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 realm 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83775150 con 0x55be83775d20 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be837793c0 con 0x55be83775d20 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be8377a1a0 0x55be8377c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be8377a1a0 0x55be8377c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.221+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be8377a1a0 0x55be8377c590 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be8377d470 con 0x55be8377a1a0 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 20 searching for the correct realm 2024-09-13T06:29:17.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be8377ecf0 0x55be837811b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be83781880 con 0x55be8377ecf0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be8377ecf0 0x55be837811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9ceae640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be8377ecf0 0x55be837811b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be83781880 con 0x55be8377a1a0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9d6af640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fee90115060 0x7fee901226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x7fee90115060 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fee90115060 0x7fee901226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fee90115060 0x7fee901226d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.225+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377ecf0 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x7fee90115060 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x7fee90115060 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377ecf0 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.229+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377ecf0 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377ecf0 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x7fee90115060 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be83775d20 2024-09-13T06:29:17.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x7fee90115060 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377ecf0 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x7fee90115060 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.233+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377ecf0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55be8377cc20 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:17.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be8377d140 con 0x55be83775d20 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.237+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be8377d530 con 0x55be8377a1a0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be8377d530 con 0x55be8377ecf0 2024-09-13T06:29:17.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 zone default found 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 4 Realm: () 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 zonegroup default 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83781d00 con 0x7fee90115060 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be83783f30 con 0x55be8377ecf0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be837842d0 con 0x55be8377ecf0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 started sync module instance, tier type = 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783370 con 0x55be8377a1a0 2024-09-13T06:29:17.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94276737841264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783370 con 0x55be8377a1a0 2024-09-13T06:29:17.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.241+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83784b20 con 0x55be83775d20 2024-09-13T06:29:17.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.245+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.245+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94276737844848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83785370 con 0x55be83775d20 2024-09-13T06:29:17.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.245+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83785d90 con 0x55be8377a1a0 2024-09-13T06:29:17.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.245+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94276737841264] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.245+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94276737844848] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.249+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.249+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94276737849472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83784ec0 con 0x55be8377a1a0 2024-09-13T06:29:17.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.249+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83786200 con 0x7fee90115060 2024-09-13T06:29:17.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.249+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.249+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94276737850704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83786620 con 0x7fee90115060 2024-09-13T06:29:17.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.249+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837870c0 con 0x55be8377a1a0 2024-09-13T06:29:17.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.253+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94276737849472] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94276737850704] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94276737851760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83782ec0 con 0x55be8377a1a0 2024-09-13T06:29:17.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83787530 con 0x55be8377ecf0 2024-09-13T06:29:17.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94276737855616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83787dd0 con 0x55be8377ecf0 2024-09-13T06:29:17.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.257+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837887d0 con 0x55be8377ecf0 2024-09-13T06:29:17.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.261+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.261+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94276737855616] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.261+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94276737860320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83789070 con 0x55be8377ecf0 2024-09-13T06:29:17.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.261+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83787980 con 0x7fee90115060 2024-09-13T06:29:17.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.261+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94276737851760] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94276737860320] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94276737854352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83789070 con 0x7fee90115060 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=0 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=1 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=2 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=3 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=4 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=5 2024-09-13T06:29:17.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=6 2024-09-13T06:29:17.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94276737854352] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 20 add_watcher() i=7 2024-09-13T06:29:17.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:17.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be8378c630 con 0x55be83775d20 2024-09-13T06:29:17.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.265+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94276737863136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83789ab0 con 0x55be83775d20 2024-09-13T06:29:17.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94276737863136] v31'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fed537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fee9fb9f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:17.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fee9fb9f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:17.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83794e50 con 0x55be8377a1a0 2024-09-13T06:29:17.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.269+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83794f60 con 0x7fee90115060 2024-09-13T06:29:17.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.273+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.273+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83795670 con 0x55be8377ecf0 2024-09-13T06:29:17.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.273+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.273+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83795b20 con 0x55be83775d20 2024-09-13T06:29:17.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.277+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.277+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83792c50 con 0x55be8377a1a0 2024-09-13T06:29:17.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.277+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.277+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83792c50 con 0x55be8377ecf0 2024-09-13T06:29:17.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.277+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.277+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83792c50 con 0x55be8377a1a0 2024-09-13T06:29:17.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.281+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.281+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796680 con 0x55be83775d20 2024-09-13T06:29:17.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.285+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.285+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796b30 con 0x55be8377a1a0 2024-09-13T06:29:17.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.285+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.285+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796b30 con 0x55be8377a1a0 2024-09-13T06:29:17.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.289+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.289+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796b30 con 0x55be8377a1a0 2024-09-13T06:29:17.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.289+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.289+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796b30 con 0x55be8377ecf0 2024-09-13T06:29:17.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.293+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.293+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796f30 con 0x55be8377a1a0 2024-09-13T06:29:17.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.293+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.293+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83796f30 con 0x55be83775d20 2024-09-13T06:29:17.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.293+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.297+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be83775d20 2024-09-13T06:29:17.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.297+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.297+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377a1a0 2024-09-13T06:29:17.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.301+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.301+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377a1a0 2024-09-13T06:29:17.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.301+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.301+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377ecf0 2024-09-13T06:29:17.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.305+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.305+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377a1a0 2024-09-13T06:29:17.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.305+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.305+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be83775d20 2024-09-13T06:29:17.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.309+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.309+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377a1a0 2024-09-13T06:29:17.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.313+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.313+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377a1a0 2024-09-13T06:29:17.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.313+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.313+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377ecf0 2024-09-13T06:29:17.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.317+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.317+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377a1a0 2024-09-13T06:29:17.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.317+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.317+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837973e0 con 0x55be8377ecf0 2024-09-13T06:29:17.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.321+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.321+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837974b0 con 0x55be8377ecf0 2024-09-13T06:29:17.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.321+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.321+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83797470 con 0x55be8377ecf0 2024-09-13T06:29:17.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.325+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.325+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83797470 con 0x55be8377a1a0 2024-09-13T06:29:17.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.329+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.329+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83797470 con 0x55be83775d20 2024-09-13T06:29:17.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.333+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.333+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83797470 con 0x55be8377a1a0 2024-09-13T06:29:17.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.333+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.333+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83797470 con 0x55be83775d20 2024-09-13T06:29:17.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.337+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.337+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83797470 con 0x7fee90115060 2024-09-13T06:29:17.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fed527e4640 20 reqs_thread_entry: start 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 20 Filter name: none 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fecc3fff640 20 reqs_thread_entry: start 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55be837b2a20 con 0x55be83775d20 2024-09-13T06:29:17.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T06:29:17.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.341+0000 7fee9fb9f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:17.346 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:29:17.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.345+0000 7fed537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.345+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94276737863136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be837732a0 con 0x55be83775d20 2024-09-13T06:29:17.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.345+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94276737863136] v31'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.345+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94276737841264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83788de0 con 0x55be8377a1a0 2024-09-13T06:29:17.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94276737841264] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9fb9f980 20 remove_watcher() i=0 2024-09-13T06:29:17.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9fb9f980 2 removed watcher, disabling cache 2024-09-13T06:29:17.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94276737844848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783870 con 0x55be83775d20 2024-09-13T06:29:17.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94276737844848] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x55be83775d20 2024-09-13T06:29:17.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9fb9f980 20 remove_watcher() i=1 2024-09-13T06:29:17.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.349+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94276737849472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783870 con 0x55be8377a1a0 2024-09-13T06:29:17.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.353+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94276737849472] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.353+0000 7fee9fb9f980 20 remove_watcher() i=2 2024-09-13T06:29:17.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.353+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94276737850704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83785880 con 0x7fee90115060 2024-09-13T06:29:17.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.353+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94276737850704] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.353+0000 7fee9fb9f980 20 remove_watcher() i=3 2024-09-13T06:29:17.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.353+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94276737851760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783870 con 0x55be8377a1a0 2024-09-13T06:29:17.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.357+0000 7fee9d6af640 1 -- 172.21.15.169:0/3785974900 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94276737851760] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90112030 con 0x55be8377a1a0 2024-09-13T06:29:17.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.357+0000 7fee9fb9f980 20 remove_watcher() i=4 2024-09-13T06:29:17.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.357+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94276737855616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783870 con 0x55be8377ecf0 2024-09-13T06:29:17.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.357+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94276737855616] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.357+0000 7fee9fb9f980 20 remove_watcher() i=5 2024-09-13T06:29:17.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.357+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94276737860320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783870 con 0x55be8377ecf0 2024-09-13T06:29:17.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9ceae640 1 -- 172.21.15.169:0/3785974900 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94276737860320] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8800e620 con 0x55be8377ecf0 2024-09-13T06:29:17.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 20 remove_watcher() i=6 2024-09-13T06:29:17.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94276737854352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55be83783870 con 0x7fee90115060 2024-09-13T06:29:17.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94276737854352] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9800a4d0 con 0x7fee90115060 2024-09-13T06:29:17.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 20 remove_watcher() i=7 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be8377a1a0 msgr2=0x55be8377c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be8377a1a0 0x55be8377c590 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be83775d20 msgr2=0x55be837781e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be83775d20 0x55be837781e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fee90115060 msgr2=0x7fee901226d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fee90115060 0x7fee901226d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be8377ecf0 msgr2=0x55be837811b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be8377ecf0 0x55be837811b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed68034650 msgr2=0x7fed68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed68034650 0x7fed68036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55be8373d720 tx=0x7fee88010000 comp rx=0 tx=0).stop 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 msgr2=0x55be8376ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9deb0640 1 -- 172.21.15.169:0/3785974900 reap_dead start 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be8376ad90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee900c9fd0 tx=0x7fee900f1f50 comp rx=0 tx=0).stop 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 shutdown_connections 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3785974900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83763b90 0x55be8376ad90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 >> 172.21.15.169:0/3785974900 conn(0x55be8375ff70 msgr2=0x55be8375e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 shutdown_connections 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3785974900 wait complete. 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed74034650 msgr2=0x7fed74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed74034650 0x7fed74036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee8800bf60 tx=0x7fee8800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 msgr2=0x55be83757660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 0x55be83757660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fee900e2e00 tx=0x7fee900b4d60 comp rx=0 tx=0).stop 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 shutdown_connections 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed74034650 0x7fed74036b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/1343826237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83757240 0x55be83757660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 >> 172.21.15.169:0/1343826237 conn(0x55be8374c390 msgr2=0x55be8374ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 shutdown_connections 2024-09-13T06:29:17.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.361+0000 7fee9fb9f980 1 -- 172.21.15.169:0/1343826237 wait complete. 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be83741890 msgr2=0x55be83743c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55be83741890 0x55be83743c80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be8373e0b0 msgr2=0x55be837404a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55be8373e0b0 0x55be837404a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be83746f10 msgr2=0x55be83749300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55be83746f10 0x55be83749300 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed84034650 msgr2=0x7fed84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fed84034650 0x7fed84036b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee88000f70 tx=0x7fee880012c0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 msgr2=0x55be83739130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 --2- 172.21.15.169:0/3361805894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55be83647230 0x55be83739130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee900b9040 tx=0x7fee90018020 comp rx=0 tx=0).stop 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9deb0640 1 -- 172.21.15.169:0/3361805894 reap_dead start 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 shutdown_connections 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 >> 172.21.15.169:0/3361805894 conn(0x55be835ba230 msgr2=0x55be8372c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 shutdown_connections 2024-09-13T06:29:17.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.365+0000 7fee9fb9f980 1 -- 172.21.15.169:0/3361805894 wait complete. 2024-09-13T06:29:17.377 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:29:17.378 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:29:17.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:29:17.378 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T06:29:17.465 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:17.465 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.461+0000 7f805d1bc980 1 Processor -- start 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.461+0000 7f805d1bc980 1 -- start start 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805d1bc980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558665922e70 0x558665925260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805d1bc980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586657a4ae0 con 0x558665890bb0 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805d1bc980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5586657c8e30 con 0x558665922e70 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805a4cb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558665922e70 0x558665925260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805accc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x558665890bb0 0x558665921750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60428/0 (socket says 172.21.15.169:60428) 2024-09-13T06:29:17.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805accc640 1 -- 172.21.15.169:0/2291899456 learned_addr learned my addr 172.21.15.169:0/2291899456 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:17.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805a4cb640 1 -- 172.21.15.169:0/2291899456 >> v1:172.21.15.112:6789/0 conn(0x558665890bb0 legacy=0x558665921750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805a4cb640 1 -- 172.21.15.169:0/2291899456 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558665890f90 con 0x558665922e70 2024-09-13T06:29:17.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f805a4cb640 1 --2- 172.21.15.169:0/2291899456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665922e70 0x558665925260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f805000a480 tx=0x7f805001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e252fc17e33a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f8059cca640 1 -- 172.21.15.169:0/2291899456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80500b0070 con 0x558665922e70 2024-09-13T06:29:17.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f8059cca640 1 -- 172.21.15.169:0/2291899456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500ab540 con 0x558665922e70 2024-09-13T06:29:17.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.465+0000 7f8059cca640 1 -- 172.21.15.169:0/2291899456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80500ab840 con 0x558665922e70 2024-09-13T06:29:17.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 -- 172.21.15.169:0/2291899456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665922e70 msgr2=0x558665925260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2291899456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665922e70 0x558665925260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f805000a480 tx=0x7f805001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:17.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 -- 172.21.15.169:0/2291899456 shutdown_connections 2024-09-13T06:29:17.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2291899456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665922e70 0x558665925260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 -- 172.21.15.169:0/2291899456 >> 172.21.15.169:0/2291899456 conn(0x558665917040 msgr2=0x558665919460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 -- 172.21.15.169:0/2291899456 shutdown_connections 2024-09-13T06:29:17.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.469+0000 7f805d1bc980 1 -- 172.21.15.169:0/2291899456 wait complete. 2024-09-13T06:29:17.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 Processor -- start 2024-09-13T06:29:17.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- start start 2024-09-13T06:29:17.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a09cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5586657ca200 con 0x558665890bb0 2024-09-13T06:29:17.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805accc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a09cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805accc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a09cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46298/0 (socket says 172.21.15.169:46298) 2024-09-13T06:29:17.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805accc640 1 -- 172.21.15.169:0/2911707478 learned_addr learned my addr 172.21.15.169:0/2911707478 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805accc640 1 -- 172.21.15.169:0/2911707478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558665a0a2c0 con 0x558665890bb0 2024-09-13T06:29:17.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805accc640 1 --2- 172.21.15.169:0/2911707478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a09cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f804c001e20 tx=0x7f804c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90b287f92f5adf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f7f48e09640 1 -- 172.21.15.169:0/2911707478 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f804c012020 con 0x558665890bb0 2024-09-13T06:29:17.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f7f48e09640 1 -- 172.21.15.169:0/2911707478 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c00e7c0 con 0x558665890bb0 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f7f48e09640 1 -- 172.21.15.169:0/2911707478 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f804c00eb00 con 0x558665890bb0 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- 172.21.15.169:0/2911707478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 msgr2=0x558665a09cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2911707478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a09cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f804c001e20 tx=0x7f804c00b790 comp rx=0 tx=0).stop 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- 172.21.15.169:0/2911707478 shutdown_connections 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2911707478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a09cf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- 172.21.15.169:0/2911707478 >> 172.21.15.169:0/2911707478 conn(0x558665917040 msgr2=0x558665a05920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- 172.21.15.169:0/2911707478 shutdown_connections 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- 172.21.15.169:0/2911707478 wait complete. 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 Processor -- start 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- start start 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a11100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805d1bc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558665928230 con 0x558665890bb0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.485+0000 7f805accc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a11100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805accc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a11100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46310/0 (socket says 172.21.15.169:46310) 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805accc640 1 -- 172.21.15.169:0/1541459016 learned_addr learned my addr 172.21.15.169:0/1541459016 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805accc640 1 -- 172.21.15.169:0/1541459016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558665a11640 con 0x558665890bb0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805accc640 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a11100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f804c001e20 tx=0x7f804c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f47606640 1 -- 172.21.15.169:0/1541459016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f804c012030 con 0x558665890bb0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f47606640 1 -- 172.21.15.169:0/1541459016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c001480 con 0x558665890bb0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f47606640 1 -- 172.21.15.169:0/1541459016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f804c01a940 con 0x558665890bb0 2024-09-13T06:29:17.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558665a118d0 con 0x558665890bb0 2024-09-13T06:29:17.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558665a145b0 con 0x558665890bb0 2024-09-13T06:29:17.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805d1bc980 1 Processor -- start 2024-09-13T06:29:17.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805d1bc980 1 -- start start 2024-09-13T06:29:17.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805d1bc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a1e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805d1bc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558665823800 con 0x558665a1dec0 2024-09-13T06:29:17.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805b4cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a1e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805b4cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a1e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46314/0 (socket says 172.21.15.169:46314) 2024-09-13T06:29:17.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805b4cd640 1 -- 172.21.15.169:0/1984077834 learned_addr learned my addr 172.21.15.169:0/1984077834 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f47606640 1 -- 172.21.15.169:0/1541459016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f804c015020 con 0x558665890bb0 2024-09-13T06:29:17.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f47606640 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f40034650 0x7f7f40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f47606640 1 -- 172.21.15.169:0/1541459016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f804c020030 con 0x558665890bb0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805b4cd640 1 -- 172.21.15.169:0/1984077834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558665a1e800 con 0x558665a1dec0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805accc640 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f40034650 0x7f7f40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805b4cd640 1 --2- 172.21.15.169:0/1984077834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a1e2c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f805400a430 tx=0x7f805400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bcf7ae835f362d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f805accc640 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f40034650 0x7f7f40036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f804c018ac0 tx=0x7f804c0189f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f45602640 1 -- 172.21.15.169:0/1984077834 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805400f6e0 con 0x558665a1dec0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f45602640 1 -- 172.21.15.169:0/1984077834 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8054015070 con 0x558665a1dec0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.489+0000 7f7f45602640 1 -- 172.21.15.169:0/1984077834 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805400fa10 con 0x558665a1dec0 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/1984077834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 msgr2=0x558665a1e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1984077834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a1e2c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f805400a430 tx=0x7f805400a8f0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/1984077834 shutdown_connections 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1984077834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a1e2c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/1984077834 >> 172.21.15.169:0/1984077834 conn(0x558665922e70 msgr2=0x558665a197d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/1984077834 shutdown_connections 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/1984077834 wait complete. 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 Processor -- start 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- start start 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a252a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558665a1f1e0 con 0x558665a1dec0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805b4cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805b4cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a252a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46320/0 (socket says 172.21.15.169:46320) 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805b4cd640 1 -- 172.21.15.169:0/995445496 learned_addr learned my addr 172.21.15.169:0/995445496 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805b4cd640 1 -- 172.21.15.169:0/995445496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558665a257e0 con 0x558665a1dec0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805b4cd640 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a252a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x558665a1ec70 tx=0x7f8054003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f7f3f7fe640 1 -- 172.21.15.169:0/995445496 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805400fe00 con 0x558665a1dec0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558665a25a70 con 0x558665a1dec0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f7f3f7fe640 1 -- 172.21.15.169:0/995445496 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8054010a20 con 0x558665a1dec0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f7f3f7fe640 1 -- 172.21.15.169:0/995445496 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8054010dc0 con 0x558665a1dec0 2024-09-13T06:29:17.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558665a28750 con 0x558665a1dec0 2024-09-13T06:29:17.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:17.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f805d1bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:17.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.493+0000 7f7f3f7fe640 1 -- 172.21.15.169:0/995445496 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f805401a480 con 0x558665a1dec0 2024-09-13T06:29:17.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 Processor -- start 2024-09-13T06:29:17.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f3f7fe640 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f34034650 0x7f7f34036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f3f7fe640 1 -- 172.21.15.169:0/995445496 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f805404a2c0 con 0x558665a1dec0 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 -- start start 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805b4cd640 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f34034650 0x7f7f34036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 0x558665a3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558665a0a640 con 0x558665a3eb20 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805b4cd640 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f34034650 0x7f7f34036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f805402e920 tx=0x7f805402e830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805accc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 0x558665a3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805accc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 0x558665a3ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46322/0 (socket says 172.21.15.169:46322) 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805accc640 1 -- 172.21.15.169:0/2050091083 learned_addr learned my addr 172.21.15.169:0/2050091083 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805accc640 1 -- 172.21.15.169:0/2050091083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558665a3f510 con 0x558665a3eb20 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805accc640 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 0x558665a3ef40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f804c0485a0 tx=0x7f804c02d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f1affd640 1 -- 172.21.15.169:0/2050091083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f804c035040 con 0x558665a3eb20 2024-09-13T06:29:17.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558665a42070 con 0x558665a3eb20 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f1affd640 1 -- 172.21.15.169:0/2050091083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c02da90 con 0x558665a3eb20 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f1affd640 1 -- 172.21.15.169:0/2050091083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f804c01adf0 con 0x558665a3eb20 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558665a42470 con 0x558665a3eb20 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f1affd640 1 -- 172.21.15.169:0/2050091083 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f804c009070 con 0x558665a3eb20 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f1affd640 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7e940347a0 0x7f7e94036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f1affd640 1 -- 172.21.15.169:0/2050091083 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f804c005050 con 0x558665a3eb20 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805a4cb640 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7e940347a0 0x7f7e94036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f7f18ff9640 20 reqs_thread_entry: start 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558665a44630 0x558665a46a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558665a47130 con 0x558665a44630 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.497+0000 7f805a4cb640 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7e940347a0 0x7f7e94036c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80500ad000 tx=0x7f80500a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.501+0000 7f805b4cd640 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558665a44630 0x558665a46a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.501+0000 7f805b4cd640 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558665a44630 0x558665a46a80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.501+0000 7f805b4cd640 1 -- 172.21.15.169:0/1541459016 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f805400e070 con 0x558665a44630 2024-09-13T06:29:17.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.501+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558665a489f0 con 0x558665a44630 2024-09-13T06:29:17.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.501+0000 7f805b4cd640 1 -- 172.21.15.169:0/1541459016 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(2 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f805400e070 con 0x558665a44630 2024-09-13T06:29:17.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.501+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558665a4d4b0 con 0x558665a44630 2024-09-13T06:29:17.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805b4cd640 1 -- 172.21.15.169:0/1541459016 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [stat,call,call,writefull 0~993] v31'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f805400e070 con 0x558665a44630 2024-09-13T06:29:17.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f34034650 msgr2=0x7f7f34036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f34034650 0x7f7f34036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f805402e920 tx=0x7f805402e830 comp rx=0 tx=0).stop 2024-09-13T06:29:17.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 msgr2=0x558665a252a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a252a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x558665a1ec70 tx=0x7f8054003380 comp rx=0 tx=0).stop 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 shutdown_connections 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f34034650 0x7f7f34036b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/995445496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a1dec0 0x558665a252a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 >> 172.21.15.169:0/995445496 conn(0x558665922e70 msgr2=0x558665a193a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 shutdown_connections 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/995445496 wait complete. 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7e940347a0 msgr2=0x7f7e94036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7e940347a0 0x7f7e94036c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80500ad000 tx=0x7f80500a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 msgr2=0x558665a3ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 0x558665a3ef40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f804c0485a0 tx=0x7f804c02d520 comp rx=0 tx=0).stop 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 shutdown_connections 2024-09-13T06:29:17.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7e940347a0 0x7f7e94036c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/2050091083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665a3eb20 0x558665a3ef40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 >> 172.21.15.169:0/2050091083 conn(0x558665a33af0 msgr2=0x558665a363e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 shutdown_connections 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/2050091083 wait complete. 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558665a44630 msgr2=0x558665a46a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558665a44630 0x558665a46a80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f40034650 msgr2=0x7f7f40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f40034650 0x7f7f40036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f804c018ac0 tx=0x7f804c0189f0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 msgr2=0x558665a11100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a11100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f804c001e20 tx=0x7f804c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 shutdown_connections 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558665a44630 0x558665a46a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7f40034650 0x7f7f40036b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 --2- 172.21.15.169:0/1541459016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558665890bb0 0x558665a11100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 >> 172.21.15.169:0/1541459016 conn(0x558665917040 msgr2=0x558665a044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 shutdown_connections 2024-09-13T06:29:17.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.505+0000 7f805d1bc980 1 -- 172.21.15.169:0/1541459016 wait complete. 2024-09-13T06:29:17.518 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"8744f35f-8918-4410-a77e-3a3ac7b40446","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T06:29:17.519 DEBUG:tasks.util.rgw: json result: {'id': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T06:29:17.521 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T06:29:17.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T06:29:17.521 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T06:29:17.589 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:17.589 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:17.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.585+0000 7fbc2b319980 1 Processor -- start 2024-09-13T06:29:17.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.585+0000 7fbc2b319980 1 -- start start 2024-09-13T06:29:17.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.585+0000 7fbc2b319980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55c148ab5e80 0x55c148ab8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.585+0000 7fbc2b319980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c148937ae0 con 0x55c148a23ab0 2024-09-13T06:29:17.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.585+0000 7fbc2b319980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55c14895be30 con 0x55c148ab5e80 2024-09-13T06:29:17.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc28628640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55c148ab5e80 0x55c148ab8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc28e29640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55c148a23ab0 0x55c148ab4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60440/0 (socket says 172.21.15.169:60440) 2024-09-13T06:29:17.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc28e29640 1 -- 172.21.15.169:0/2634767117 learned_addr learned my addr 172.21.15.169:0/2634767117 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:17.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc27e27640 1 -- 172.21.15.169:0/2634767117 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108012212 0 0) 0x55c148937ae0 con 0x55c148a23ab0 2024-09-13T06:29:17.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc27e27640 1 -- 172.21.15.169:0/2634767117 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc10001e20 con 0x55c148a23ab0 2024-09-13T06:29:17.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc28628640 1 -- 172.21.15.169:0/2634767117 >> v1:172.21.15.112:6789/0 conn(0x55c148a23ab0 legacy=0x55c148ab4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc28628640 1 -- 172.21.15.169:0/2634767117 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c148a23e90 con 0x55c148ab5e80 2024-09-13T06:29:17.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc28628640 1 --2- 172.21.15.169:0/2634767117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148ab5e80 0x55c148ab8270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00a480 tx=0x7fbc1c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c120098238239c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc27e27640 1 -- 172.21.15.169:0/2634767117 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1c0b0070 con 0x55c148ab5e80 2024-09-13T06:29:17.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc27e27640 1 -- 172.21.15.169:0/2634767117 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0ab540 con 0x55c148ab5e80 2024-09-13T06:29:17.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.589+0000 7fbc27e27640 1 -- 172.21.15.169:0/2634767117 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1c0ab840 con 0x55c148ab5e80 2024-09-13T06:29:17.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 -- 172.21.15.169:0/2634767117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148ab5e80 msgr2=0x55c148ab8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 --2- 172.21.15.169:0/2634767117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148ab5e80 0x55c148ab8270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00a480 tx=0x7fbc1c01b280 comp rx=0 tx=0).stop 2024-09-13T06:29:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 -- 172.21.15.169:0/2634767117 shutdown_connections 2024-09-13T06:29:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 --2- 172.21.15.169:0/2634767117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148ab5e80 0x55c148ab8270 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 -- 172.21.15.169:0/2634767117 >> 172.21.15.169:0/2634767117 conn(0x55c148aaa050 msgr2=0x55c148aac470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 -- 172.21.15.169:0/2634767117 shutdown_connections 2024-09-13T06:29:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.593+0000 7fbc2b319980 1 -- 172.21.15.169:0/2634767117 wait complete. 2024-09-13T06:29:17.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc2b319980 1 Processor -- start 2024-09-13T06:29:17.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc2b319980 1 -- start start 2024-09-13T06:29:17.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc2b319980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148b9ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc2b319980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c14895d200 con 0x55c148a23ab0 2024-09-13T06:29:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148b9ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148b9ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46354/0 (socket says 172.21.15.169:46354) 2024-09-13T06:29:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc28e29640 1 -- 172.21.15.169:0/1656116410 learned_addr learned my addr 172.21.15.169:0/1656116410 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc28e29640 1 -- 172.21.15.169:0/1656116410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c148b9d060 con 0x55c148a23ab0 2024-09-13T06:29:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc28e29640 1 --2- 172.21.15.169:0/1656116410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148b9ca90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbc18001740 tx=0x7fbc18001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a13a12e1528844a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbb16e0d640 1 -- 172.21.15.169:0/1656116410 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc18016070 con 0x55c148a23ab0 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbb16e0d640 1 -- 172.21.15.169:0/1656116410 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc18004530 con 0x55c148a23ab0 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbb16e0d640 1 -- 172.21.15.169:0/1656116410 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc18004850 con 0x55c148a23ab0 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc2b319980 1 -- 172.21.15.169:0/1656116410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 msgr2=0x55c148b9ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.605+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1656116410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148b9ca90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbc18001740 tx=0x7fbc18001c00 comp rx=0 tx=0).stop 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1656116410 shutdown_connections 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1656116410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148b9ca90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1656116410 >> 172.21.15.169:0/1656116410 conn(0x55c148aaa050 msgr2=0x55c148b986c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1656116410 shutdown_connections 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1656116410 wait complete. 2024-09-13T06:29:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 Processor -- start 2024-09-13T06:29:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- start start 2024-09-13T06:29:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148ba3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c148abb240 con 0x55c148a23ab0 2024-09-13T06:29:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148ba3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148ba3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46364/0 (socket says 172.21.15.169:46364) 2024-09-13T06:29:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc28e29640 1 -- 172.21.15.169:0/1358701858 learned_addr learned my addr 172.21.15.169:0/1358701858 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc28e29640 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c148ba43a0 con 0x55c148a23ab0 2024-09-13T06:29:17.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc28e29640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148ba3e60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc18014040 tx=0x7fbc18001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbb1560a640 1 -- 172.21.15.169:0/1358701858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc18016040 con 0x55c148a23ab0 2024-09-13T06:29:17.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c148ba4630 con 0x55c148a23ab0 2024-09-13T06:29:17.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbb1560a640 1 -- 172.21.15.169:0/1358701858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc18011400 con 0x55c148a23ab0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c148ba7310 con 0x55c148a23ab0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbb1560a640 1 -- 172.21.15.169:0/1358701858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1802a060 con 0x55c148a23ab0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbb1560a640 1 -- 172.21.15.169:0/1358701858 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc180116e0 con 0x55c148a23ab0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbb1560a640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb10034650 0x7fbb10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbb1560a640 1 -- 172.21.15.169:0/1358701858 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fbc180497f0 con 0x55c148a23ab0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc28628640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb10034650 0x7fbb10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148ab5e80 0x55c148baaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bab4a0 con 0x55c148ab5e80 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.609+0000 7fbc2962a640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148ab5e80 0x55c148baaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28628640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb10034650 0x7fbb10036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0ad000 tx=0x7fbc1c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2962a640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148ab5e80 0x55c148baaf60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2962a640 1 -- 172.21.15.169:0/1358701858 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148ab5e80 2024-09-13T06:29:17.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148bac2e0 0x55c148bae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148baed00 con 0x55c148bac2e0 2024-09-13T06:29:17.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28e29640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148bac2e0 0x55c148bae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28e29640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148bac2e0 0x55c148bae6d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28e29640 1 -- 172.21.15.169:0/1358701858 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc18023070 con 0x55c148bac2e0 2024-09-13T06:29:17.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bb05b0 con 0x55c148bac2e0 2024-09-13T06:29:17.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28e29640 1 -- 172.21.15.169:0/1358701858 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc18023070 con 0x55c148bac2e0 2024-09-13T06:29:17.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148baf720 con 0x55c148bac2e0 2024-09-13T06:29:17.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28e29640 1 -- 172.21.15.169:0/1358701858 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc18023070 con 0x55c148bac2e0 2024-09-13T06:29:17.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148bb1960 0x55c148bb3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bb4290 con 0x55c148bb1960 2024-09-13T06:29:17.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.613+0000 7fbc28628640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148bb1960 0x55c148bb3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28628640 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148bb1960 0x55c148bb3d50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28628640 1 -- 172.21.15.169:0/1358701858 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc1c0b3040 con 0x55c148bb1960 2024-09-13T06:29:17.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc2b319980 1 Processor -- start 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc2b319980 1 -- start start 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc2b319980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 0x55c148bc2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc2b319980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c1489b6800 con 0x55c148bc1bf0 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 0x55c148bc2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 0x55c148bc2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46372/0 (socket says 172.21.15.169:46372) 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28e29640 1 -- 172.21.15.169:0/3586017751 learned_addr learned my addr 172.21.15.169:0/3586017751 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28e29640 1 -- 172.21.15.169:0/3586017751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c148bc2550 con 0x55c148bc1bf0 2024-09-13T06:29:17.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28e29640 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 0x55c148bc2010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc18047dc0 tx=0x7fbc1801cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbb0e7fc640 1 -- 172.21.15.169:0/3586017751 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1802d8e0 con 0x55c148bc1bf0 2024-09-13T06:29:17.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c148bc27e0 con 0x55c148bc1bf0 2024-09-13T06:29:17.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbb0e7fc640 1 -- 172.21.15.169:0/3586017751 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1802e3a0 con 0x55c148bc1bf0 2024-09-13T06:29:17.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbb0e7fc640 1 -- 172.21.15.169:0/3586017751 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1802e680 con 0x55c148bc1bf0 2024-09-13T06:29:17.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c148bc5460 con 0x55c148bc1bf0 2024-09-13T06:29:17.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbb0e7fc640 1 -- 172.21.15.169:0/3586017751 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc18041420 con 0x55c148bc1bf0 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbb0e7fc640 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb00034650 0x7fbb00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbb0e7fc640 1 -- 172.21.15.169:0/3586017751 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fbc18030330 con 0x55c148bc1bf0 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.617+0000 7fbc28628640 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb00034650 0x7fbb00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 Processor -- start 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- start start 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28628640 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb00034650 0x7fbb00036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c148ba8450 tx=0x7fbc1c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bcea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c148b9d3e0 con 0x55c148bce680 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bcea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bcea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46376/0 (socket says 172.21.15.169:46376) 2024-09-13T06:29:17.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 -- 172.21.15.169:0/1830141803 learned_addr learned my addr 172.21.15.169:0/1830141803 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 -- 172.21.15.169:0/1830141803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c148bcf050 con 0x55c148bce680 2024-09-13T06:29:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 --2- 172.21.15.169:0/1830141803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bcea80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc1802db70 tx=0x7fbc1803ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6455518329614807 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbafffff640 1 -- 172.21.15.169:0/1830141803 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc18049570 con 0x55c148bce680 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbafffff640 1 -- 172.21.15.169:0/1830141803 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc18023b30 con 0x55c148bce680 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbafffff640 1 -- 172.21.15.169:0/1830141803 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc18049180 con 0x55c148bce680 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- 172.21.15.169:0/1830141803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 msgr2=0x55c148bcea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1830141803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bcea80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc1802db70 tx=0x7fbc1803ad60 comp rx=0 tx=0).stop 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- 172.21.15.169:0/1830141803 shutdown_connections 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1830141803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bcea80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- 172.21.15.169:0/1830141803 >> 172.21.15.169:0/1830141803 conn(0x55c148bca9b0 msgr2=0x55c148bc8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- 172.21.15.169:0/1830141803 shutdown_connections 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- 172.21.15.169:0/1830141803 wait complete. 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 Processor -- start 2024-09-13T06:29:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- start start 2024-09-13T06:29:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bd5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc2b319980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c148bcf3c0 con 0x55c148bce680 2024-09-13T06:29:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bd5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bd5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46388/0 (socket says 172.21.15.169:46388) 2024-09-13T06:29:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 learned_addr learned my addr 172.21.15.169:0/825351404 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.621+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c148bd5c90 con 0x55c148bce680 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc28e29640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bd5750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc18046c10 tx=0x7fbc18030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbafe7fc640 1 -- 172.21.15.169:0/825351404 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1806c020 con 0x55c148bce680 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c148bd5c90 con 0x55c148bce680 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbafe7fc640 1 -- 172.21.15.169:0/825351404 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1802fb40 con 0x55c148bce680 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbafe7fc640 1 -- 172.21.15.169:0/825351404 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc18062040 con 0x55c148bce680 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c148bd5c90 con 0x55c148bce680 2024-09-13T06:29:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbafe7fc640 1 -- 172.21.15.169:0/825351404 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc1806f020 con 0x55c148bce680 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbafe7fc640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf4034650 0x7fbaf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbafe7fc640 1 -- 172.21.15.169:0/825351404 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fbc18072ab0 con 0x55c148bce680 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc28628640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf4034650 0x7fbaf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148be0650 0x55c148be2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be3260 con 0x55c148be0650 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2962a640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148be0650 0x55c148be2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2962a640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148be0650 0x55c148be2b10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc28628640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf4034650 0x7fbaf4036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0ab510 tx=0x7fbc1c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 realm 2024-09-13T06:29:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bdfb00 con 0x55c148be0650 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be3d30 con 0x55c148be0650 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148be48e0 0x55c148be6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7510 con 0x55c148be48e0 2024-09-13T06:29:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.625+0000 7fbc28e29640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148be48e0 0x55c148be6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28e29640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148be48e0 0x55c148be6da0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:17.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 20 searching for the correct realm 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148be9b20 0x55c148bebf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148bec520 con 0x55c148be9b20 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28628640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148be9b20 0x55c148bebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28628640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148be9b20 0x55c148bebf10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148bec520 con 0x55c148be48e0 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28e29640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc18071020 0x7fbc1802a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x7fbc18071020 2024-09-13T06:29:17.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2962a640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc18071020 0x7fbc1802a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2962a640 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc18071020 0x7fbc1802a200 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.629+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be9b20 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x7fbc18071020 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x7fbc18071020 2024-09-13T06:29:17.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be9b20 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.633+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be9b20 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be9b20 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x7fbc18071020 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be0650 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x7fbc18071020 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be9b20 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x7fbc18071020 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.637+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be9b20 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c148be7db0 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:17.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be8600 con 0x55c148be0650 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be89f0 con 0x55c148be48e0 2024-09-13T06:29:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148be89f0 con 0x55c148be9b20 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 zone default found 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 4 Realm: () 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 zonegroup default 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bec9a0 con 0x7fbc18071020 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bee720 con 0x55c148be9b20 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148beeac0 con 0x55c148be9b20 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.641+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 20 started sync module instance, tier type = 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bedbc0 con 0x55c148be48e0 2024-09-13T06:29:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288637518064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bedbc0 con 0x55c148be48e0 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bef370 con 0x55c148be0650 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288637521504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148befc10 con 0x55c148be0650 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf0610 con 0x55c148be48e0 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.645+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288637518064] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288637521504] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288637515536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bef760 con 0x55c148be48e0 2024-09-13T06:29:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf0ee0 con 0x7fbc18071020 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288637528624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bef760 con 0x7fbc18071020 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf1980 con 0x55c148be48e0 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288637515536] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.649+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288637528624] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288637529680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf1940 con 0x55c148be48e0 2024-09-13T06:29:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf1db0 con 0x55c148be9b20 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288637526304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf2600 con 0x55c148be9b20 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf3020 con 0x55c148be9b20 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288637529680] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288637526304] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288637537040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf3410 con 0x55c148be9b20 2024-09-13T06:29:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.653+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf3c60 con 0x7fbc18071020 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288637539824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf40d0 con 0x7fbc18071020 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=0 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=1 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=2 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=3 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=4 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=5 2024-09-13T06:29:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288637537040] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=6 2024-09-13T06:29:17.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288637539824] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 20 add_watcher() i=7 2024-09-13T06:29:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf1470 con 0x55c148be0650 2024-09-13T06:29:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.657+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288637531248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148bf4650 con 0x55c148be0650 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288637531248] v31'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbadefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 5 note: GC not initialized 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbaddfe3640 20 reqs_thread_entry: start 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 20 Filter name: none 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fba4f7fe640 20 reqs_thread_entry: start 2024-09-13T06:29:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ada0 con 0x55c148be48e0 2024-09-13T06:29:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ada0 con 0x55c148be48e0 2024-09-13T06:29:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.661+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x7fbc18071020 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x7fbc18071020 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.665+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.669+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbadefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288637531248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94288637531248] v31'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.673+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288637518064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94288637518064] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 20 remove_watcher() i=0 2024-09-13T06:29:17.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 2 removed watcher, disabling cache 2024-09-13T06:29:17.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288637521504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be0650 2024-09-13T06:29:17.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94288637521504] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x55c148be0650 2024-09-13T06:29:17.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 20 remove_watcher() i=1 2024-09-13T06:29:17.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288637515536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94288637515536] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 20 remove_watcher() i=2 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.677+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288637528624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x7fbc18071020 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94288637528624] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2b319980 20 remove_watcher() i=3 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288637529680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be48e0 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc28e29640 1 -- 172.21.15.169:0/825351404 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94288637529680] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18065040 con 0x55c148be48e0 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2b319980 20 remove_watcher() i=4 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288637526304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94288637526304] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2b319980 20 remove_watcher() i=5 2024-09-13T06:29:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.681+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288637537040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x55c148be9b20 2024-09-13T06:29:17.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc28628640 1 -- 172.21.15.169:0/825351404 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94288637537040] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc1c0d8070 con 0x55c148be9b20 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 20 remove_watcher() i=6 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288637539824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c148c1ad60 con 0x7fbc18071020 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94288637539824] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc200083f0 con 0x7fbc18071020 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 20 remove_watcher() i=7 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148be48e0 msgr2=0x55c148be6da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148be48e0 0x55c148be6da0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148be0650 msgr2=0x55c148be2b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148be0650 0x55c148be2b10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc18071020 msgr2=0x7fbc1802a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc18071020 0x7fbc1802a200 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148be9b20 msgr2=0x55c148bebf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148be9b20 0x55c148bebf10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf4034650 msgr2=0x7fbaf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf4034650 0x7fbaf4036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0ab510 tx=0x7fbc1c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 msgr2=0x55c148bd5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bd5750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc18046c10 tx=0x7fbc18030040 comp rx=0 tx=0).stop 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2962a640 1 -- 172.21.15.169:0/825351404 reap_dead start 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 shutdown_connections 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/825351404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bce680 0x55c148bd5750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 >> 172.21.15.169:0/825351404 conn(0x55c148bca9b0 msgr2=0x55c148bc8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 shutdown_connections 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/825351404 wait complete. 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb00034650 msgr2=0x7fbb00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb00034650 0x7fbb00036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c148ba8450 tx=0x7fbc1c005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:17.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 msgr2=0x55c148bc2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 0x55c148bc2010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc18047dc0 tx=0x7fbc1801cd20 comp rx=0 tx=0).stop 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 shutdown_connections 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb00034650 0x7fbb00036b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/3586017751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148bc1bf0 0x55c148bc2010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 >> 172.21.15.169:0/3586017751 conn(0x55c148bb6d40 msgr2=0x55c148bb97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 shutdown_connections 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/3586017751 wait complete. 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148bac2e0 msgr2=0x55c148bae6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c148bac2e0 0x55c148bae6d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148ab5e80 msgr2=0x55c148baaf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c148ab5e80 0x55c148baaf60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148bb1960 msgr2=0x55c148bb3d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c148bb1960 0x55c148bb3d50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb10034650 msgr2=0x7fbb10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb10034650 0x7fbb10036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0ad000 tx=0x7fbc1c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 msgr2=0x55c148ba3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 --2- 172.21.15.169:0/1358701858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c148a23ab0 0x55c148ba3e60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc18014040 tx=0x7fbc18001260 comp rx=0 tx=0).stop 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2962a640 1 -- 172.21.15.169:0/1358701858 reap_dead start 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 shutdown_connections 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 >> 172.21.15.169:0/1358701858 conn(0x55c148aaa050 msgr2=0x55c148b97240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 shutdown_connections 2024-09-13T06:29:17.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.685+0000 7fbc2b319980 1 -- 172.21.15.169:0/1358701858 wait complete. 2024-09-13T06:29:17.697 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[],"summary":[]} 2024-09-13T06:29:17.697 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T06:29:17.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:17.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:17.698 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:17.774 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:17.774 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f48804c2980 1 Processor -- start 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f48804c2980 1 -- start start 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f48804c2980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f2d327aec0 0x55f2d327d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f48804c2980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f2d30fcae0 con 0x55f2d31e9290 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f48804c2980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55f2d3120e30 con 0x55f2d327aec0 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f487d7d1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f2d327aec0 0x55f2d327d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f487dfd2640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55f2d31e9290 0x55f2d32797a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60444/0 (socket says 172.21.15.169:60444) 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.769+0000 7f487dfd2640 1 -- 172.21.15.169:0/2719866396 learned_addr learned my addr 172.21.15.169:0/2719866396 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.773+0000 7f487d7d1640 1 -- 172.21.15.169:0/2719866396 >> v1:172.21.15.112:6789/0 conn(0x55f2d31e9290 legacy=0x55f2d32797a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.773+0000 7f487d7d1640 1 -- 172.21.15.169:0/2719866396 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d31e9670 con 0x55f2d327aec0 2024-09-13T06:29:17.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.773+0000 7f487d7d1640 1 --2- 172.21.15.169:0/2719866396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d327aec0 0x55f2d327d2b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f486800a480 tx=0x7f486801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8fdd9bb400ba59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.773+0000 7f487cfd0640 1 -- 172.21.15.169:0/2719866396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48680b0070 con 0x55f2d327aec0 2024-09-13T06:29:17.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.773+0000 7f487cfd0640 1 -- 172.21.15.169:0/2719866396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48680ab540 con 0x55f2d327aec0 2024-09-13T06:29:17.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.773+0000 7f487cfd0640 1 -- 172.21.15.169:0/2719866396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48680ab840 con 0x55f2d327aec0 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 -- 172.21.15.169:0/2719866396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d327aec0 msgr2=0x55f2d327d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 --2- 172.21.15.169:0/2719866396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d327aec0 0x55f2d327d2b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f486800a480 tx=0x7f486801b280 comp rx=0 tx=0).stop 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 -- 172.21.15.169:0/2719866396 shutdown_connections 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 --2- 172.21.15.169:0/2719866396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d327aec0 0x55f2d327d2b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 -- 172.21.15.169:0/2719866396 >> 172.21.15.169:0/2719866396 conn(0x55f2d326f090 msgr2=0x55f2d32714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 -- 172.21.15.169:0/2719866396 shutdown_connections 2024-09-13T06:29:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.777+0000 7f48804c2980 1 -- 172.21.15.169:0/2719866396 wait complete. 2024-09-13T06:29:17.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f48804c2980 1 Processor -- start 2024-09-13T06:29:17.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f48804c2980 1 -- start start 2024-09-13T06:29:17.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f48804c2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3361cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f48804c2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d3122200 con 0x55f2d31e9290 2024-09-13T06:29:17.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3361cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3361cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46408/0 (socket says 172.21.15.169:46408) 2024-09-13T06:29:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f487dfd2640 1 -- 172.21.15.169:0/403268614 learned_addr learned my addr 172.21.15.169:0/403268614 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f487dfd2640 1 -- 172.21.15.169:0/403268614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d33622a0 con 0x55f2d31e9290 2024-09-13T06:29:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f487dfd2640 1 --2- 172.21.15.169:0/403268614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3361cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48780017b0 tx=0x7f4878001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b298d3b9d48e4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f476be07640 1 -- 172.21.15.169:0/403268614 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878016070 con 0x55f2d31e9290 2024-09-13T06:29:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f476be07640 1 -- 172.21.15.169:0/403268614 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878004530 con 0x55f2d31e9290 2024-09-13T06:29:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.789+0000 7f476be07640 1 -- 172.21.15.169:0/403268614 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878004870 con 0x55f2d31e9290 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/403268614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 msgr2=0x55f2d3361cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 --2- 172.21.15.169:0/403268614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3361cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48780017b0 tx=0x7f4878001c70 comp rx=0 tx=0).stop 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/403268614 shutdown_connections 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 --2- 172.21.15.169:0/403268614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3361cd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/403268614 >> 172.21.15.169:0/403268614 conn(0x55f2d326f090 msgr2=0x55f2d335d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/403268614 shutdown_connections 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/403268614 wait complete. 2024-09-13T06:29:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 Processor -- start 2024-09-13T06:29:17.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- start start 2024-09-13T06:29:17.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3368fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d3280220 con 0x55f2d31e9290 2024-09-13T06:29:17.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3368fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3368fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46422/0 (socket says 172.21.15.169:46422) 2024-09-13T06:29:17.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f487dfd2640 1 -- 172.21.15.169:0/980457857 learned_addr learned my addr 172.21.15.169:0/980457857 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f487dfd2640 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d3369520 con 0x55f2d31e9290 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f487dfd2640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3368fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4878000f90 tx=0x7f4878001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f476a604640 1 -- 172.21.15.169:0/980457857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878020070 con 0x55f2d31e9290 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2d33697b0 con 0x55f2d31e9290 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f476a604640 1 -- 172.21.15.169:0/980457857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878011400 con 0x55f2d31e9290 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f476a604640 1 -- 172.21.15.169:0/980457857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878016040 con 0x55f2d31e9290 2024-09-13T06:29:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d336c490 con 0x55f2d31e9290 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f476a604640 1 -- 172.21.15.169:0/980457857 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4878023070 con 0x55f2d31e9290 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f476a604640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4764034650 0x7f4764036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.793+0000 7f476a604640 1 -- 172.21.15.169:0/980457857 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4878048fc0 con 0x55f2d31e9290 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487d7d1640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4764034650 0x7f4764036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d327aec0 0x55f2d33700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d3370620 con 0x55f2d327aec0 2024-09-13T06:29:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487e7d3640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d327aec0 0x55f2d33700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487d7d1640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4764034650 0x7f4764036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48680ad000 tx=0x7f48680a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487e7d3640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d327aec0 0x55f2d33700e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487e7d3640 1 -- 172.21.15.169:0/980457857 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d327aec0 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d3371400 0x55f2d33737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d3373e20 con 0x55f2d3371400 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487dfd2640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d3371400 0x55f2d33737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487dfd2640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d3371400 0x55f2d33737f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487dfd2640 1 -- 172.21.15.169:0/980457857 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f487802c070 con 0x55f2d3371400 2024-09-13T06:29:17.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33756d0 con 0x55f2d3371400 2024-09-13T06:29:17.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f487dfd2640 1 -- 172.21.15.169:0/980457857 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f487802c070 con 0x55f2d3371400 2024-09-13T06:29:17.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.797+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d3374900 con 0x55f2d3371400 2024-09-13T06:29:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487dfd2640 1 -- 172.21.15.169:0/980457857 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f487802c070 con 0x55f2d3371400 2024-09-13T06:29:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d3376a80 0x55f2d3378e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33793b0 con 0x55f2d3376a80 2024-09-13T06:29:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487d7d1640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d3376a80 0x55f2d3378e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487d7d1640 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d3376a80 0x55f2d3378e70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487d7d1640 1 -- 172.21.15.169:0/980457857 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48680ab8a0 con 0x55f2d3376a80 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 Processor -- start 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 -- start start 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 0x55f2d3387180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d317b800 con 0x55f2d3386d60 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 0x55f2d3387180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 0x55f2d3387180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46428/0 (socket says 172.21.15.169:46428) 2024-09-13T06:29:17.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487dfd2640 1 -- 172.21.15.169:0/3014003788 learned_addr learned my addr 172.21.15.169:0/3014003788 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487dfd2640 1 -- 172.21.15.169:0/3014003788 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d33876c0 con 0x55f2d3386d60 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f487dfd2640 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 0x55f2d3387180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48780475c0 tx=0x7f4878023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f47637fe640 1 -- 172.21.15.169:0/3014003788 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487803f070 con 0x55f2d3386d60 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2d3387950 con 0x55f2d3386d60 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f47637fe640 1 -- 172.21.15.169:0/3014003788 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878011ae0 con 0x55f2d3386d60 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f47637fe640 1 -- 172.21.15.169:0/3014003788 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878040d20 con 0x55f2d3386d60 2024-09-13T06:29:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.801+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d338a5d0 con 0x55f2d3386d60 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f47637fe640 1 -- 172.21.15.169:0/3014003788 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4878040ec0 con 0x55f2d3386d60 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f47637fe640 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4758034650 0x7f4758036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f47637fe640 1 -- 172.21.15.169:0/3014003788 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f487804f850 con 0x55f2d3386d60 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487d7d1640 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4758034650 0x7f4758036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 Processor -- start 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- start start 2024-09-13T06:29:17.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487d7d1640 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4758034650 0x7f4758036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55f2d336d5d0 tx=0x7f4868005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d3393ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d3362620 con 0x55f2d33936d0 2024-09-13T06:29:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d3393ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d3393ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46438/0 (socket says 172.21.15.169:46438) 2024-09-13T06:29:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487dfd2640 1 -- 172.21.15.169:0/3050361908 learned_addr learned my addr 172.21.15.169:0/3050361908 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487dfd2640 1 -- 172.21.15.169:0/3050361908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d3394080 con 0x55f2d33936d0 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487dfd2640 1 --2- 172.21.15.169:0/3050361908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d3393ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f487801bf70 tx=0x7f487804a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524fdcf5a928da7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f47617fa640 1 -- 172.21.15.169:0/3050361908 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487805e020 con 0x55f2d33936d0 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f47617fa640 1 -- 172.21.15.169:0/3050361908 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487802f450 con 0x55f2d33936d0 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f47617fa640 1 -- 172.21.15.169:0/3050361908 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48780476a0 con 0x55f2d33936d0 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- 172.21.15.169:0/3050361908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 msgr2=0x55f2d3393ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 --2- 172.21.15.169:0/3050361908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d3393ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f487801bf70 tx=0x7f487804a6c0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- 172.21.15.169:0/3050361908 shutdown_connections 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 --2- 172.21.15.169:0/3050361908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d3393ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- 172.21.15.169:0/3050361908 >> 172.21.15.169:0/3050361908 conn(0x55f2d338fab0 msgr2=0x55f2d338dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- 172.21.15.169:0/3050361908 shutdown_connections 2024-09-13T06:29:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- 172.21.15.169:0/3050361908 wait complete. 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 Processor -- start 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- start start 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d339a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f48804c2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d3394520 con 0x55f2d33936d0 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.805+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d339a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487dfd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d339a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46452/0 (socket says 172.21.15.169:46452) 2024-09-13T06:29:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 learned_addr learned my addr 172.21.15.169:0/1610061016 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d339ae10 con 0x55f2d33936d0 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487dfd2640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d339a8d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f487802f600 tx=0x7f487800aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f474f7fe640 1 -- 172.21.15.169:0/1610061016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878073070 con 0x55f2d33936d0 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f474f7fe640 1 -- 172.21.15.169:0/1610061016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878040440 con 0x55f2d33936d0 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2d339ae10 con 0x55f2d33936d0 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f474f7fe640 1 -- 172.21.15.169:0/1610061016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487804f050 con 0x55f2d33936d0 2024-09-13T06:29:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d339ae10 con 0x55f2d33936d0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f474f7fe640 1 -- 172.21.15.169:0/1610061016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4878076070 con 0x55f2d33936d0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f474f7fe640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4748034650 0x7f4748036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f474f7fe640 1 -- 172.21.15.169:0/1610061016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f487806a030 con 0x55f2d33936d0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487d7d1640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4748034650 0x7f4748036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d33a57c0 0x55f2d33a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33a83b0 con 0x55f2d33a57c0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487e7d3640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d33a57c0 0x55f2d33a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487d7d1640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4748034650 0x7f4748036b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f486801b2c0 tx=0x7f48680a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487e7d3640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d33a57c0 0x55f2d33a7c60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 20 realm 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33a4cb0 con 0x55f2d33a57c0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.809+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33a8e80 con 0x55f2d33a57c0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d33a9a30 0x55f2d33abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33ac660 con 0x55f2d33a9a30 2024-09-13T06:29:17.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d33a9a30 0x55f2d33abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d33a9a30 0x55f2d33abef0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 20 searching for the correct realm 2024-09-13T06:29:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d33aec70 0x55f2d33b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b1690 con 0x55f2d33aec70 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487d7d1640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d33aec70 0x55f2d33b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487d7d1640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d33aec70 0x55f2d33b1060 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b1690 con 0x55f2d33a9a30 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4878078060 0x7f487806e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x7f4878078060 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.813+0000 7f487e7d3640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4878078060 0x7f487806e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4878078060 0x7f487806e470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33aec70 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x7f4878078060 2024-09-13T06:29:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x7f4878078060 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.817+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33aec70 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33aec70 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33aec70 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x7f4878078060 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a57c0 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x7f4878078060 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33aec70 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x7f4878078060 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.821+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33aec70 2024-09-13T06:29:17.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33acf00 con 0x55f2d33a9a30 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33ad750 con 0x55f2d33a57c0 2024-09-13T06:29:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33adb40 con 0x55f2d33a9a30 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33adb40 con 0x55f2d33aec70 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 zone default found 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 4 Realm: () 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 zonegroup default 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b1b10 con 0x7f4878078060 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.825+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b3890 con 0x55f2d33aec70 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b3c30 con 0x55f2d33aec70 2024-09-13T06:29:17.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 20 started sync module instance, tier type = 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b2d30 con 0x55f2d33a9a30 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501414318672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b2d30 con 0x55f2d33a9a30 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b45f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501414322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b4e90 con 0x55f2d33a57c0 2024-09-13T06:29:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.829+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b5890 con 0x55f2d33a9a30 2024-09-13T06:29:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501414318672] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501414322496] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501414316160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b49e0 con 0x55f2d33a9a30 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b6130 con 0x7f4878078060 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501414329472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b49e0 con 0x7f4878078060 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b6bb0 con 0x55f2d33a9a30 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501414329472] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.833+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501414316160] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501414327200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b66c0 con 0x55f2d33a9a30 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b7450 con 0x55f2d33aec70 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501414334368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b66c0 con 0x55f2d33aec70 2024-09-13T06:29:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b81d0 con 0x55f2d33aec70 2024-09-13T06:29:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501414327200] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501414330528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b8a70 con 0x55f2d33aec70 2024-09-13T06:29:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b9430 con 0x7f4878078060 2024-09-13T06:29:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.837+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501414334368] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501414336496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b9430 con 0x7f4878078060 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 20 add_watcher() i=0 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 20 add_watcher() i=1 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 20 add_watcher() i=2 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 20 add_watcher() i=3 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 20 add_watcher() i=4 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f48804c2980 20 add_watcher() i=5 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.841+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501414330528] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f48804c2980 20 add_watcher() i=6 2024-09-13T06:29:17.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501414336496] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f48804c2980 20 add_watcher() i=7 2024-09-13T06:29:17.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f48804c2980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:17.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33bc460 con 0x55f2d33a57c0 2024-09-13T06:29:17.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.845+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501414342528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33b98c0 con 0x55f2d33a57c0 2024-09-13T06:29:17.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501414342528] v31'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f4733fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 5 note: GC not initialized 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f4732fe5640 20 reqs_thread_entry: start 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 20 Filter name: none 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f4730fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df500 con 0x55f2d33a57c0 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:could not fetch user info: no user info saved 2024-09-13T06:29:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f4733fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.849+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501414342528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33a57c0 2024-09-13T06:29:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94501414342528] v31'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501414318672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33a9a30 2024-09-13T06:29:17.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94501414318672] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f48804c2980 20 remove_watcher() i=0 2024-09-13T06:29:17.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f48804c2980 2 removed watcher, disabling cache 2024-09-13T06:29:17.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501414322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33a57c0 2024-09-13T06:29:17.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94501414322496] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x55f2d33a57c0 2024-09-13T06:29:17.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f48804c2980 20 remove_watcher() i=1 2024-09-13T06:29:17.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.853+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501414316160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33a9a30 2024-09-13T06:29:17.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.857+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94501414316160] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.857+0000 7f48804c2980 20 remove_watcher() i=2 2024-09-13T06:29:17.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.857+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501414329472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x7f4878078060 2024-09-13T06:29:17.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.857+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94501414329472] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.857+0000 7f48804c2980 20 remove_watcher() i=3 2024-09-13T06:29:17.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.857+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501414327200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33a9a30 2024-09-13T06:29:17.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f487dfd2640 1 -- 172.21.15.169:0/1610061016 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94501414327200] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4878075030 con 0x55f2d33a9a30 2024-09-13T06:29:17.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 20 remove_watcher() i=4 2024-09-13T06:29:17.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501414334368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33aec70 2024-09-13T06:29:17.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94501414334368] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 20 remove_watcher() i=5 2024-09-13T06:29:17.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501414330528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x55f2d33aec70 2024-09-13T06:29:17.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f487d7d1640 1 -- 172.21.15.169:0/1610061016 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94501414330528] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48680da070 con 0x55f2d33aec70 2024-09-13T06:29:17.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 20 remove_watcher() i=6 2024-09-13T06:29:17.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501414336496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f2d33df4c0 con 0x7f4878078060 2024-09-13T06:29:17.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94501414336496] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48700083f0 con 0x7f4878078060 2024-09-13T06:29:17.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 20 remove_watcher() i=7 2024-09-13T06:29:17.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d33a9a30 msgr2=0x55f2d33abef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d33a9a30 0x55f2d33abef0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d33a57c0 msgr2=0x55f2d33a7c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d33a57c0 0x55f2d33a7c60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4878078060 msgr2=0x7f487806e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4878078060 0x7f487806e470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d33aec70 msgr2=0x55f2d33b1060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d33aec70 0x55f2d33b1060 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4748034650 msgr2=0x7f4748036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4748034650 0x7f4748036b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f486801b2c0 tx=0x7f48680a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 msgr2=0x55f2d339a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d339a8d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f487802f600 tx=0x7f487800aee0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f487e7d3640 1 -- 172.21.15.169:0/1610061016 reap_dead start 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 shutdown_connections 2024-09-13T06:29:17.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/1610061016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d33936d0 0x55f2d339a8d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 >> 172.21.15.169:0/1610061016 conn(0x55f2d338fab0 msgr2=0x55f2d338db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 shutdown_connections 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/1610061016 wait complete. 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4758034650 msgr2=0x7f4758036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4758034650 0x7f4758036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55f2d336d5d0 tx=0x7f4868005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 msgr2=0x55f2d3387180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.861+0000 7f48804c2980 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 0x55f2d3387180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48780475c0 tx=0x7f4878023ac0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 shutdown_connections 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4758034650 0x7f4758036b10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/3014003788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d3386d60 0x55f2d3387180 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 >> 172.21.15.169:0/3014003788 conn(0x55f2d337be60 msgr2=0x55f2d337e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 shutdown_connections 2024-09-13T06:29:17.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/3014003788 wait complete. 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d3371400 msgr2=0x55f2d33737f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f2d3371400 0x55f2d33737f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d327aec0 msgr2=0x55f2d33700e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f2d327aec0 0x55f2d33700e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d3376a80 msgr2=0x55f2d3378e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f2d3376a80 0x55f2d3378e70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4764034650 msgr2=0x7f4764036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4764034650 0x7f4764036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48680ad000 tx=0x7f48680a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 msgr2=0x55f2d3368fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 --2- 172.21.15.169:0/980457857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d31e9290 0x55f2d3368fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4878000f90 tx=0x7f4878001260 comp rx=0 tx=0).stop 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f487e7d3640 1 -- 172.21.15.169:0/980457857 reap_dead start 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 shutdown_connections 2024-09-13T06:29:17.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 >> 172.21.15.169:0/980457857 conn(0x55f2d326f090 msgr2=0x55f2d335c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 shutdown_connections 2024-09-13T06:29:17.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.865+0000 7f48804c2980 1 -- 172.21.15.169:0/980457857 wait complete. 2024-09-13T06:29:17.875 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:29:17.875 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T06:29:17.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T06:29:17.876 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T06:29:17.956 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:17.956 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:17.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea207ed980 1 Processor -- start 2024-09-13T06:29:17.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea207ed980 1 -- start start 2024-09-13T06:29:17.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea207ed980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5588ae473880 0x5588ae473c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea207ed980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588ae2f9ae0 con 0x5588ae4741d0 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea207ed980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5588ae31de30 con 0x5588ae473880 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea1e2fd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5588ae473880 0x5588ae473c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea1dafc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5588ae4741d0 0x5588ae478c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:60456/0 (socket says 172.21.15.169:60456) 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.953+0000 7fea1dafc640 1 -- 172.21.15.169:0/1341452638 learned_addr learned my addr 172.21.15.169:0/1341452638 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1341452638 >> v1:172.21.15.112:6789/0 conn(0x5588ae4741d0 legacy=0x5588ae478c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1341452638 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae47b450 con 0x5588ae473880 2024-09-13T06:29:17.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/1341452638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae473c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea1000a480 tx=0x7fea1001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b97382c1badaa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea1d2fb640 1 -- 172.21.15.169:0/1341452638 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100b0070 con 0x5588ae473880 2024-09-13T06:29:17.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea1d2fb640 1 -- 172.21.15.169:0/1341452638 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea100ab540 con 0x5588ae473880 2024-09-13T06:29:17.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea1d2fb640 1 -- 172.21.15.169:0/1341452638 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100ab840 con 0x5588ae473880 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 -- 172.21.15.169:0/1341452638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 msgr2=0x5588ae473c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 --2- 172.21.15.169:0/1341452638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae473c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea1000a480 tx=0x7fea1001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 -- 172.21.15.169:0/1341452638 shutdown_connections 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 --2- 172.21.15.169:0/1341452638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae473c60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 -- 172.21.15.169:0/1341452638 >> 172.21.15.169:0/1341452638 conn(0x5588ae3e71d0 msgr2=0x5588ae3e75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 -- 172.21.15.169:0/1341452638 shutdown_connections 2024-09-13T06:29:17.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.957+0000 7fea207ed980 1 -- 172.21.15.169:0/1341452638 wait complete. 2024-09-13T06:29:17.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 Processor -- start 2024-09-13T06:29:17.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- start start 2024-09-13T06:29:17.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae55ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5588ae31f200 con 0x5588ae473880 2024-09-13T06:29:17.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae55ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae55ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46460/0 (socket says 172.21.15.169:46460) 2024-09-13T06:29:17.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea1e2fd640 1 -- 172.21.15.169:0/406548843 learned_addr learned my addr 172.21.15.169:0/406548843 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea1e2fd640 1 -- 172.21.15.169:0/406548843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae55f230 con 0x5588ae473880 2024-09-13T06:29:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/406548843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae55ec60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea10017e90 tx=0x7fea10003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b030ecd5f93093 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fe90c608640 1 -- 172.21.15.169:0/406548843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100b0070 con 0x5588ae473880 2024-09-13T06:29:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fe90c608640 1 -- 172.21.15.169:0/406548843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea100b1040 con 0x5588ae473880 2024-09-13T06:29:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fe90c608640 1 -- 172.21.15.169:0/406548843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100abc30 con 0x5588ae473880 2024-09-13T06:29:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- 172.21.15.169:0/406548843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 msgr2=0x5588ae55ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 --2- 172.21.15.169:0/406548843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae55ec60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea10017e90 tx=0x7fea10003030 comp rx=0 tx=0).stop 2024-09-13T06:29:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- 172.21.15.169:0/406548843 shutdown_connections 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 --2- 172.21.15.169:0/406548843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae55ec60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- 172.21.15.169:0/406548843 >> 172.21.15.169:0/406548843 conn(0x5588ae3e71d0 msgr2=0x5588ae55a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- 172.21.15.169:0/406548843 shutdown_connections 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- 172.21.15.169:0/406548843 wait complete. 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 Processor -- start 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- start start 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae565e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.973+0000 7fea207ed980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5588ae47ae90 con 0x5588ae473880 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae565e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae565e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46462/0 (socket says 172.21.15.169:46462) 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1985474202 learned_addr learned my addr 172.21.15.169:0/1985474202 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae5663d0 con 0x5588ae473880 2024-09-13T06:29:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae565e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea10017e90 tx=0x7fea10018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fe90ae05640 1 -- 172.21.15.169:0/1985474202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100c6070 con 0x5588ae473880 2024-09-13T06:29:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588ae566660 con 0x5588ae473880 2024-09-13T06:29:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fe90ae05640 1 -- 172.21.15.169:0/1985474202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea100b78c0 con 0x5588ae473880 2024-09-13T06:29:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fe90ae05640 1 -- 172.21.15.169:0/1985474202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100b7ba0 con 0x5588ae473880 2024-09-13T06:29:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ae569340 con 0x5588ae473880 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fe90ae05640 1 -- 172.21.15.169:0/1985474202 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fea100c9070 con 0x5588ae473880 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fe90ae05640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe904034650 0x7fe904036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fe90ae05640 1 -- 172.21.15.169:0/1985474202 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fea100bc070 con 0x5588ae473880 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1dafc640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe904034650 0x7fe904036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae4741d0 0x5588ae56ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae56d490 con 0x5588ae4741d0 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1eafe640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae4741d0 0x5588ae56ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1dafc640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe904034650 0x7fe904036b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea14001da0 tx=0x7fea14001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1eafe640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae4741d0 0x5588ae56ce20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea1eafe640 1 -- 172.21.15.169:0/1985474202 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae4741d0 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae56e290 0x5588ae570680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.977+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae570ce0 con 0x5588ae56e290 2024-09-13T06:29:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae56e290 0x5588ae570680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae56e290 0x5588ae570680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1985474202 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea100d2070 con 0x5588ae56e290 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae572590 con 0x5588ae56e290 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1985474202 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea100d2070 con 0x5588ae56e290 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5717c0 con 0x5588ae56e290 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1e2fd640 1 -- 172.21.15.169:0/1985474202 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea100d2070 con 0x5588ae56e290 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae573940 0x5588ae575d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae576270 con 0x5588ae573940 2024-09-13T06:29:17.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1dafc640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae573940 0x5588ae575d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1dafc640 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae573940 0x5588ae575d30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea1dafc640 1 -- 172.21.15.169:0/1985474202 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae573940 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea207ed980 1 Processor -- start 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.981+0000 7fea207ed980 1 -- start start 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 0x5588ae584140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5588ae378800 con 0x5588ae583d20 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 0x5588ae584140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 0x5588ae584140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46466/0 (socket says 172.21.15.169:46466) 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3866496949 learned_addr learned my addr 172.21.15.169:0/3866496949 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3866496949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae584680 con 0x5588ae583d20 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 0x5588ae584140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea100c1fd0 tx=0x7fea100b5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fe903fff640 1 -- 172.21.15.169:0/3866496949 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100bfd60 con 0x5588ae583d20 2024-09-13T06:29:17.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588ae584910 con 0x5588ae583d20 2024-09-13T06:29:17.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fe903fff640 1 -- 172.21.15.169:0/3866496949 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea100e8070 con 0x5588ae583d20 2024-09-13T06:29:17.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ae584910 con 0x5588ae583d20 2024-09-13T06:29:17.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fe903fff640 1 -- 172.21.15.169:0/3866496949 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100f2060 con 0x5588ae583d20 2024-09-13T06:29:17.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fe903fff640 1 -- 172.21.15.169:0/3866496949 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fea100e3670 con 0x5588ae583d20 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fe903fff640 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8f8034600 0x7fe8f8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fe903fff640 1 -- 172.21.15.169:0/3866496949 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fea100a8070 con 0x5588ae583d20 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1dafc640 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8f8034600 0x7fe8f8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 Processor -- start 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 -- start start 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1dafc640 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8f8034600 0x7fe8f8036ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea100ad000 tx=0x7fea1400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae590950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea207ed980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5588ae55f4f0 con 0x5588ae590550 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae590950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.985+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae590950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46472/0 (socket says 172.21.15.169:46472) 2024-09-13T06:29:17.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 -- 172.21.15.169:0/723236951 learned_addr learned my addr 172.21.15.169:0/723236951 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 -- 172.21.15.169:0/723236951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae590f20 con 0x5588ae590550 2024-09-13T06:29:17.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/723236951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae590950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea100d4fc0 tx=0x7fea100aa470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd1e01dc45cf292 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fe901ffb640 1 -- 172.21.15.169:0/723236951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea10107070 con 0x5588ae590550 2024-09-13T06:29:17.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fe901ffb640 1 -- 172.21.15.169:0/723236951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea100a6070 con 0x5588ae590550 2024-09-13T06:29:17.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fe901ffb640 1 -- 172.21.15.169:0/723236951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100d4760 con 0x5588ae590550 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/723236951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 msgr2=0x5588ae590950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 --2- 172.21.15.169:0/723236951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae590950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea100d4fc0 tx=0x7fea100aa470 comp rx=0 tx=0).stop 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/723236951 shutdown_connections 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 --2- 172.21.15.169:0/723236951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae590950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/723236951 >> 172.21.15.169:0/723236951 conn(0x5588ae58c8c0 msgr2=0x5588ae58a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/723236951 shutdown_connections 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/723236951 wait complete. 2024-09-13T06:29:17.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 Processor -- start 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- start start 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae597670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5588ae591450 con 0x5588ae590550 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae597670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae597670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46478/0 (socket says 172.21.15.169:46478) 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 learned_addr learned my addr 172.21.15.169:0/3924859737 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae597bb0 con 0x5588ae590550 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae597670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea100d4fc0 tx=0x7fea100ebf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fe8effff640 1 -- 172.21.15.169:0/3924859737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea10112070 con 0x5588ae590550 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fe8effff640 1 -- 172.21.15.169:0/3924859737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea100d6e00 con 0x5588ae590550 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588ae597bb0 con 0x5588ae590550 2024-09-13T06:29:17.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fe8effff640 1 -- 172.21.15.169:0/3924859737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea1011c060 con 0x5588ae590550 2024-09-13T06:29:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.989+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ae597bb0 con 0x5588ae590550 2024-09-13T06:29:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fe8effff640 1 -- 172.21.15.169:0/3924859737 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fea10115070 con 0x5588ae590550 2024-09-13T06:29:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fe8effff640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8e8034650 0x7fe8e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fe8effff640 1 -- 172.21.15.169:0/3924859737 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fea10118b00 con 0x5588ae590550 2024-09-13T06:29:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1dafc640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8e8034650 0x7fe8e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae5a25a0 0x5588ae5a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a51b0 con 0x5588ae5a25a0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1eafe640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae5a25a0 0x5588ae5a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1dafc640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8e8034650 0x7fe8e8036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5588ae576650 tx=0x7fea14010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1eafe640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae5a25a0 0x5588ae5a4a60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 realm 2024-09-13T06:29:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a19d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a5c40 con 0x5588ae5a25a0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae5a6a20 0x5588ae5a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a94a0 con 0x5588ae5a6a20 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae5a6a20 0x5588ae5a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae5a6a20 0x5588ae5a8e10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.993+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea207ed980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea207ed980 20 searching for the correct realm 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae5aba60 0x5588ae5ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5ae4d0 con 0x5588ae5aba60 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1dafc640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae5aba60 0x5588ae5ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1dafc640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae5aba60 0x5588ae5ade50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5ae4d0 con 0x5588ae5a6a20 2024-09-13T06:29:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1e2fd640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fea10117070 0x7fea100cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x7fea10117070 2024-09-13T06:29:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fea10117070 0x7fea100cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fea10117070 0x7fea100cb8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5aba60 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:17.997+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x7fea10117070 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x7fea10117070 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5aba60 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5aba60 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.001+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5aba60 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x7fea10117070 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a25a0 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x7fea10117070 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5aba60 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x7fea10117070 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5aba60 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5a9cf0 con 0x5588ae5a6a20 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.005+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5aa540 con 0x5588ae5a25a0 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5aa930 con 0x5588ae5a6a20 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5aa930 con 0x5588ae5aba60 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 zone default found 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 4 Realm: () 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 zonegroup default 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5ae930 con 0x7fea10117070 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b0b60 con 0x5588ae5aba60 2024-09-13T06:29:18.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b0f00 con 0x5588ae5aba60 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 started sync module instance, tier type = 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:18.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5affa0 con 0x5588ae5a6a20 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94045529113488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5affa0 con 0x5588ae5a6a20 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.009+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b1750 con 0x5588ae5a25a0 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94045529117344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b1ff0 con 0x5588ae5a25a0 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b2a30 con 0x5588ae5a6a20 2024-09-13T06:29:18.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94045529113488] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94045529117344] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94045529122048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b1b40 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b32d0 con 0x7fea10117070 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94045529124384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b1b40 con 0x7fea10117070 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.013+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b3da0 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94045529122048] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94045529124384] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94045529125440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b3d60 con 0x5588ae5a6a20 2024-09-13T06:29:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b4190 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94045529111280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b4a30 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b5430 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94045529125440] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.017+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94045529111280] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94045529130368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b4f40 con 0x5588ae5aba60 2024-09-13T06:29:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b5cd0 con 0x7fea10117070 2024-09-13T06:29:18.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94045529130368] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94045529127056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b5cd0 con 0x7fea10117070 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=0 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=1 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=2 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=3 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=4 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=5 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=6 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94045529127056] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 20 add_watcher() i=7 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b9140 con 0x5588ae5a25a0 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.021+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94045529148080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b5ec0 con 0x5588ae5a25a0 2024-09-13T06:29:18.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94045529148080] v31'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fe8d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 5 note: GC not initialized 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fe84f7fe640 20 reqs_thread_entry: start 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 Filter name: none 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fe84d7fa640 20 reqs_thread_entry: start 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5dc840 con 0x5588ae5a25a0 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5dafe0 con 0x5588ae5a25a0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5dafe0 con 0x5588ae5a25a0 2024-09-13T06:29:18.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5db990 con 0x5588ae5a25a0 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.025+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v31'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94045529289840 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5e0310 con 0x5588ae5a6a20 2024-09-13T06:29:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94045529125440 notify 133143986176 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5588ae584680 con 0x5588ae5a6a20 2024-09-13T06:29:18.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fe901ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94045529125440 notifier 4288 bl.length()=567 2024-09-13T06:29:18.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.4 [notify cookie 94045529289840 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fe901ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:18.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fe901ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fe901ffb640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe8e4003eb0 con 0x5588ae5a6a20 2024-09-13T06:29:18.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94045529289840 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fea100dd030 con 0x5588ae5a6a20 2024-09-13T06:29:18.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5db470 con 0x5588ae5a25a0 2024-09-13T06:29:18.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.029+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94045529300416 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5e0740 con 0x7fea10117070 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== watch-notify(notify (1) cookie 94045529124384 notify 133143986176 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5588ae5dbd30 con 0x7fea10117070 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe901ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94045529124384 notifier 4288 bl.length()=169 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe901ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe901ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe901ffb640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe8e4003eb0 con 0x7fea10117070 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(69 notify.3 [notify cookie 94045529300416 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== watch-notify(notify_complete (2) cookie 94045529300416 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5588ae5dc410 con 0x7fea10117070 2024-09-13T06:29:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5de3d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea207ed980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea207ed980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea207ed980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94045529289664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5e0740 con 0x7fea10117070 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== watch-notify(notify (1) cookie 94045529124384 notify 133143986177 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5588ae5dc410 con 0x7fea10117070 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe9017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94045529124384 notifier 4288 bl.length()=177 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe9017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe9017fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(72 notify.3 [notify cookie 94045529289664 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe9017fa640 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe854003410 con 0x7fea10117070 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== watch-notify(notify_complete (2) cookie 94045529289664 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fea18016c40 con 0x7fea10117070 2024-09-13T06:29:18.039 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:18.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fe8d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.033+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94045529148080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5da5e0 con 0x5588ae5a25a0 2024-09-13T06:29:18.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94045529148080] v31'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94045529113488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5da5e0 con 0x5588ae5a6a20 2024-09-13T06:29:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94045529113488] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea207ed980 20 remove_watcher() i=0 2024-09-13T06:29:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea207ed980 2 removed watcher, disabling cache 2024-09-13T06:29:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94045529117344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5da5e0 con 0x5588ae5a25a0 2024-09-13T06:29:18.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94045529117344] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x5588ae5a25a0 2024-09-13T06:29:18.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea207ed980 20 remove_watcher() i=1 2024-09-13T06:29:18.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.037+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94045529122048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5da5e0 con 0x5588ae5a6a20 2024-09-13T06:29:18.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.041+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94045529122048] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.041+0000 7fea207ed980 20 remove_watcher() i=2 2024-09-13T06:29:18.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.041+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94045529124384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b2500 con 0x7fea10117070 2024-09-13T06:29:18.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.041+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94045529124384] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.041+0000 7fea207ed980 20 remove_watcher() i=3 2024-09-13T06:29:18.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.041+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94045529125440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5da5e0 con 0x5588ae5a6a20 2024-09-13T06:29:18.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea1e2fd640 1 -- 172.21.15.169:0/3924859737 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94045529125440] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea10114030 con 0x5588ae5a6a20 2024-09-13T06:29:18.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 20 remove_watcher() i=4 2024-09-13T06:29:18.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94045529111280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b2500 con 0x5588ae5aba60 2024-09-13T06:29:18.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94045529111280] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 20 remove_watcher() i=5 2024-09-13T06:29:18.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94045529130368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5da5e0 con 0x5588ae5aba60 2024-09-13T06:29:18.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea1dafc640 1 -- 172.21.15.169:0/3924859737 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94045529130368] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1400e6c0 con 0x5588ae5aba60 2024-09-13T06:29:18.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 20 remove_watcher() i=6 2024-09-13T06:29:18.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94045529127056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588ae5b3280 con 0x7fea10117070 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94045529127056] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea1800a4d0 con 0x7fea10117070 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 20 remove_watcher() i=7 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae5a6a20 msgr2=0x5588ae5a8e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae5a6a20 0x5588ae5a8e10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae5a25a0 msgr2=0x5588ae5a4a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae5a25a0 0x5588ae5a4a60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fea10117070 msgr2=0x7fea100cb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fea10117070 0x7fea100cb8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae5aba60 msgr2=0x5588ae5ade50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae5aba60 0x5588ae5ade50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8e8034650 msgr2=0x7fe8e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8e8034650 0x7fe8e8036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5588ae576650 tx=0x7fea14010000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 msgr2=0x5588ae597670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea1eafe640 1 -- 172.21.15.169:0/3924859737 reap_dead start 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae597670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea100d4fc0 tx=0x7fea100ebf00 comp rx=0 tx=0).stop 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 shutdown_connections 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 --2- 172.21.15.169:0/3924859737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae590550 0x5588ae597670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.045+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 >> 172.21.15.169:0/3924859737 conn(0x5588ae58c8c0 msgr2=0x5588ae58a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 shutdown_connections 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3924859737 wait complete. 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8f8034600 msgr2=0x7fe8f8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8f8034600 0x7fe8f8036ac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea100ad000 tx=0x7fea1400f000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 msgr2=0x5588ae584140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 0x5588ae584140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea100c1fd0 tx=0x7fea100b5a40 comp rx=0 tx=0).stop 2024-09-13T06:29:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 shutdown_connections 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe8f8034600 0x7fe8f8036ac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/3866496949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae583d20 0x5588ae584140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 >> 172.21.15.169:0/3866496949 conn(0x5588ae578e70 msgr2=0x5588ae57b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 shutdown_connections 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/3866496949 wait complete. 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae56e290 msgr2=0x5588ae570680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5588ae56e290 0x5588ae570680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae4741d0 msgr2=0x5588ae56ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5588ae4741d0 0x5588ae56ce20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae573940 msgr2=0x5588ae575d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5588ae573940 0x5588ae575d30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe904034650 msgr2=0x7fe904036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe904034650 0x7fe904036b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea14001da0 tx=0x7fea14001300 comp rx=0 tx=0).stop 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 msgr2=0x5588ae565e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 --2- 172.21.15.169:0/1985474202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5588ae473880 0x5588ae565e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea10017e90 tx=0x7fea10018020 comp rx=0 tx=0).stop 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea1eafe640 1 -- 172.21.15.169:0/1985474202 reap_dead start 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 shutdown_connections 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 >> 172.21.15.169:0/1985474202 conn(0x5588ae3e71d0 msgr2=0x5588ae559410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 shutdown_connections 2024-09-13T06:29:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.049+0000 7fea207ed980 1 -- 172.21.15.169:0/1985474202 wait complete. 2024-09-13T06:29:18.060 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:18.060 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T06:29:18.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T06:29:18.060 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T06:29:18.138 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:18.138 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1ea4bf980 1 Processor -- start 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1ea4bf980 1 -- start start 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1ea4bf980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x56266958e880 0x56266958ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1ea4bf980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562669414ae0 con 0x56266958f1d0 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1ea4bf980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x562669438e30 con 0x56266958e880 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1e7fcf640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x56266958e880 0x56266958ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1e77ce640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x56266958f1d0 0x562669593c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45014/0 (socket says 172.21.15.169:45014) 2024-09-13T06:29:18.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2864745732 learned_addr learned my addr 172.21.15.169:0/2864745732 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:18.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2864745732 >> v1:172.21.15.112:6789/0 conn(0x56266958f1d0 legacy=0x562669593c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.137+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2864745732 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562669596450 con 0x56266958e880 2024-09-13T06:29:18.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/2864745732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x56266958ec60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00a480 tx=0x7ff1dc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daf2b72d7df1a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1e6fcd640 1 -- 172.21.15.169:0/2864745732 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0b0070 con 0x56266958e880 2024-09-13T06:29:18.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1e6fcd640 1 -- 172.21.15.169:0/2864745732 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0ab540 con 0x56266958e880 2024-09-13T06:29:18.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1e6fcd640 1 -- 172.21.15.169:0/2864745732 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0ab840 con 0x56266958e880 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2864745732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 msgr2=0x56266958ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2864745732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x56266958ec60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00a480 tx=0x7ff1dc01b280 comp rx=0 tx=0).stop 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2864745732 shutdown_connections 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2864745732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x56266958ec60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2864745732 >> 172.21.15.169:0/2864745732 conn(0x5626695021d0 msgr2=0x5626695025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2864745732 shutdown_connections 2024-09-13T06:29:18.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.141+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2864745732 wait complete. 2024-09-13T06:29:18.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.153+0000 7ff1ea4bf980 1 Processor -- start 2024-09-13T06:29:18.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- start start 2024-09-13T06:29:18.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669679bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56266943a200 con 0x56266958e880 2024-09-13T06:29:18.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669679bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669679bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35332/0 (socket says 172.21.15.169:35332) 2024-09-13T06:29:18.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/566516074 learned_addr learned my addr 172.21.15.169:0/566516074 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/566516074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266967a1c0 con 0x56266958e880 2024-09-13T06:29:18.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/566516074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669679bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ae040 tx=0x7ff1dc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a937e6828546dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff0d5e0b640 1 -- 172.21.15.169:0/566516074 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0b0040 con 0x56266958e880 2024-09-13T06:29:18.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff0d5e0b640 1 -- 172.21.15.169:0/566516074 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0ab9d0 con 0x56266958e880 2024-09-13T06:29:18.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff0d5e0b640 1 -- 172.21.15.169:0/566516074 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0abcf0 con 0x56266958e880 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/566516074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 msgr2=0x562669679bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/566516074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669679bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ae040 tx=0x7ff1dc003030 comp rx=0 tx=0).stop 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/566516074 shutdown_connections 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/566516074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669679bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/566516074 >> 172.21.15.169:0/566516074 conn(0x5626695021d0 msgr2=0x562669675820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/566516074 shutdown_connections 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/566516074 wait complete. 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 Processor -- start 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- start start 2024-09-13T06:29:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669680ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1ea4bf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562669595e90 con 0x56266958e880 2024-09-13T06:29:18.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669680ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669680ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35348/0 (socket says 172.21.15.169:35348) 2024-09-13T06:29:18.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.157+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3914835604 learned_addr learned my addr 172.21.15.169:0/3914835604 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562669681420 con 0x56266958e880 2024-09-13T06:29:18.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669680ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc019930 tx=0x7ff1dc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff0cffff640 1 -- 172.21.15.169:0/3914835604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0b0070 con 0x56266958e880 2024-09-13T06:29:18.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff0cffff640 1 -- 172.21.15.169:0/3914835604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0b68b0 con 0x56266958e880 2024-09-13T06:29:18.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626696816b0 con 0x56266958e880 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff0cffff640 1 -- 172.21.15.169:0/3914835604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0b6b90 con 0x56266958e880 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562669684390 con 0x56266958e880 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff0cffff640 1 -- 172.21.15.169:0/3914835604 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1dc0bf3f0 con 0x56266958e880 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff0cffff640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0d00346a0 0x7ff0d0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff0cffff640 1 -- 172.21.15.169:0/3914835604 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff1dc0bc070 con 0x56266958e880 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0d00346a0 0x7ff0d0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56266958f1d0 0x562669687e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562669688490 con 0x56266958f1d0 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e87d0640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56266958f1d0 0x562669687e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0d00346a0 0x7ff0d0036b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80012f0 tx=0x7ff1d8006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e87d0640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56266958f1d0 0x562669687e70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e87d0640 1 -- 172.21.15.169:0/3914835604 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x56266958f1d0 2024-09-13T06:29:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562669689280 0x56266968b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56266968bcb0 con 0x562669689280 2024-09-13T06:29:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.161+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562669689280 0x56266968b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562669689280 0x56266968b670 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3914835604 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1dc0b3040 con 0x562669689280 2024-09-13T06:29:18.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56266968d560 con 0x562669689280 2024-09-13T06:29:18.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3914835604 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1dc0b3040 con 0x562669689280 2024-09-13T06:29:18.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56266968c6a0 con 0x562669689280 2024-09-13T06:29:18.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3914835604 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1dc0b3040 con 0x562669689280 2024-09-13T06:29:18.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56266968d160 0x5626696909d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562669691160 con 0x56266968d160 2024-09-13T06:29:18.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56266968d160 0x5626696909d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56266968d160 0x5626696909d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1e77ce640 1 -- 172.21.15.169:0/3914835604 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1d800f070 con 0x56266968d160 2024-09-13T06:29:18.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 Processor -- start 2024-09-13T06:29:18.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 -- start start 2024-09-13T06:29:18.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 0x56266969f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.165+0000 7ff1ea4bf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562669493800 con 0x56266969ebf0 2024-09-13T06:29:18.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 0x56266969f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 0x56266969f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35354/0 (socket says 172.21.15.169:35354) 2024-09-13T06:29:18.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3509399622 learned_addr learned my addr 172.21.15.169:0/3509399622 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/3509399622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266969f550 con 0x56266969ebf0 2024-09-13T06:29:18.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 0x56266969f010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0e4010 tx=0x7ff1dc0b56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff0cd7fa640 1 -- 172.21.15.169:0/3509399622 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0e41e0 con 0x56266969ebf0 2024-09-13T06:29:18.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56266969f7e0 con 0x56266969ebf0 2024-09-13T06:29:18.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff0cd7fa640 1 -- 172.21.15.169:0/3509399622 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0e4380 con 0x56266969ebf0 2024-09-13T06:29:18.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff0cd7fa640 1 -- 172.21.15.169:0/3509399622 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0bf730 con 0x56266969ebf0 2024-09-13T06:29:18.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266969f7e0 con 0x56266969ebf0 2024-09-13T06:29:18.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff0cd7fa640 1 -- 172.21.15.169:0/3509399622 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1dc0de070 con 0x56266969ebf0 2024-09-13T06:29:18.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff0cd7fa640 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0c00346a0 0x7ff0c0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff0cd7fa640 1 -- 172.21.15.169:0/3509399622 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff1dc0a8070 con 0x56266969ebf0 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0c00346a0 0x7ff0c0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1ea4bf980 1 Processor -- start 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1ea4bf980 1 -- start start 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0c00346a0 0x7ff0c0036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80062e0 tx=0x7ff1d800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1ea4bf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1ea4bf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56266967a480 con 0x5626696ab3e0 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696ab7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35356/0 (socket says 172.21.15.169:35356) 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/1844431326 learned_addr learned my addr 172.21.15.169:0/1844431326 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.169+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/1844431326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626696abd90 con 0x5626696ab3e0 2024-09-13T06:29:18.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/1844431326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696ab7c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0bf700 tx=0x7ff1dc0aa7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89345ec5f5a50f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c6ffd640 1 -- 172.21.15.169:0/1844431326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0d4e00 con 0x5626696ab3e0 2024-09-13T06:29:18.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c6ffd640 1 -- 172.21.15.169:0/1844431326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0aadd0 con 0x5626696ab3e0 2024-09-13T06:29:18.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c6ffd640 1 -- 172.21.15.169:0/1844431326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0e1790 con 0x5626696ab3e0 2024-09-13T06:29:18.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/1844431326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 msgr2=0x5626696ab7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/1844431326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696ab7c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0bf700 tx=0x7ff1dc0aa7b0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/1844431326 shutdown_connections 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/1844431326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696ab7c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/1844431326 >> 172.21.15.169:0/1844431326 conn(0x5626696a77c0 msgr2=0x5626696a58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/1844431326 shutdown_connections 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/1844431326 wait complete. 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 Processor -- start 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- start start 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626696ac230 con 0x5626696ab3e0 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1e7fcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35372/0 (socket says 172.21.15.169:35372) 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 learned_addr learned my addr 172.21.15.169:0/2486733514 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626696b2b00 con 0x5626696ab3e0 2024-09-13T06:29:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696b25c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0e1ad0 tx=0x7ff1dc0bcee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c57fa640 1 -- 172.21.15.169:0/2486733514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc105070 con 0x5626696ab3e0 2024-09-13T06:29:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c57fa640 1 -- 172.21.15.169:0/2486733514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0c0590 con 0x5626696ab3e0 2024-09-13T06:29:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626696b2b00 con 0x5626696ab3e0 2024-09-13T06:29:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c57fa640 1 -- 172.21.15.169:0/2486733514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0d4570 con 0x5626696ab3e0 2024-09-13T06:29:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626696b2b00 con 0x5626696ab3e0 2024-09-13T06:29:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.173+0000 7ff0c57fa640 1 -- 172.21.15.169:0/2486733514 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1dc0bf8d0 con 0x5626696ab3e0 2024-09-13T06:29:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff0c57fa640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0b0034650 0x7ff0b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff0c57fa640 1 -- 172.21.15.169:0/2486733514 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff1dc10aab0 con 0x5626696ab3e0 2024-09-13T06:29:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0b0034650 0x7ff0b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626696bd720 0x5626696bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c0330 con 0x5626696bd720 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e87d0640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626696bd720 0x5626696bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0b0034650 0x7ff0b0036b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x562669691560 tx=0x7ff1d8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e87d0640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626696bd720 0x5626696bfbe0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 realm 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696bcb50 con 0x5626696bd720 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c0df0 con 0x5626696bd720 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626696c1bd0 0x5626696c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c4670 con 0x5626696c1bd0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626696c1bd0 0x5626696c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626696c1bd0 0x5626696c3fc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c4ec0 con 0x5626696c1bd0 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 20 searching for the correct realm 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626696c6c30 0x5626696c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.177+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626696c6c30 0x5626696c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e77ce640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626696c6c30 0x5626696c9020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e7fcf640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff1dc115040 0x7ff1dc0c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x7ff1dc115040 2024-09-13T06:29:18.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff1dc115040 0x7ff1dc0c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff1dc115040 0x7ff1dc0c21b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.181+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x7ff1dc115040 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x7ff1dc115040 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.185+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x7ff1dc115040 2024-09-13T06:29:18.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696bd720 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x7ff1dc115040 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x7ff1dc115040 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c6c30 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.189+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626696c96a0 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:18.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c5870 con 0x5626696bd720 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c54b0 con 0x5626696c1bd0 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c6190 con 0x5626696c6c30 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 zone default found 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 4 Realm: () 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 zonegroup default 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696c9fb0 con 0x7ff1dc115040 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696cbd60 con 0x5626696c6c30 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696cc230 con 0x5626696c6c30 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 started sync module instance, tier type = 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.193+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cb1d0 con 0x5626696c1bd0 2024-09-13T06:29:18.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94722977478384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cb1d0 con 0x5626696c1bd0 2024-09-13T06:29:18.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cccf0 con 0x5626696bd720 2024-09-13T06:29:18.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94722977482752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cd540 con 0x5626696bd720 2024-09-13T06:29:18.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cdf80 con 0x5626696c1bd0 2024-09-13T06:29:18.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94722977478384] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94722977482752] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94722977487440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cd090 con 0x5626696c1bd0 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.197+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696ce850 con 0x7ff1dc115040 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94722977489824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cd090 con 0x7ff1dc115040 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cf290 con 0x5626696c1bd0 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94722977487440] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94722977489824] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94722977490880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cede0 con 0x5626696c1bd0 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cfb30 con 0x5626696c6c30 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94722977494656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696cede0 con 0x5626696c6c30 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696d09a0 con 0x5626696c6c30 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.201+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94722977490880] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94722977475872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696d11f0 con 0x5626696c6c30 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696d1ac0 con 0x7ff1dc115040 2024-09-13T06:29:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94722977494656] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94722977475872] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94722977496784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696d11f0 con 0x7ff1dc115040 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=0 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=1 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=2 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=3 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=4 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=5 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=6 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94722977496784] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 20 add_watcher() i=7 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696d11f0 con 0x5626696bd720 2024-09-13T06:29:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.205+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94722977500480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696d11d0 con 0x5626696bd720 2024-09-13T06:29:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94722977500480] v31'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 5 note: GC not initialized 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff09cfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 Filter name: none 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff0167fc640 20 reqs_thread_entry: start 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696f80f0 con 0x7ff1dc115040 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696f6890 con 0x5626696bd720 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626696f6c80 con 0x5626696bd720 2024-09-13T06:29:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 20 get_user_info_from_index found 0 xattrs 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.209+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94722977500480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696d7440 con 0x5626696bd720 2024-09-13T06:29:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.213+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94722977500480] v31'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.213+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94722977478384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696f5f20 con 0x5626696c1bd0 2024-09-13T06:29:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.213+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94722977478384] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.213+0000 7ff1ea4bf980 20 remove_watcher() i=0 2024-09-13T06:29:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.213+0000 7ff1ea4bf980 2 removed watcher, disabling cache 2024-09-13T06:29:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.213+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94722977482752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696f5f20 con 0x5626696bd720 2024-09-13T06:29:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94722977482752] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x5626696bd720 2024-09-13T06:29:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1ea4bf980 20 remove_watcher() i=1 2024-09-13T06:29:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94722977487440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696f5f20 con 0x5626696c1bd0 2024-09-13T06:29:18.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94722977487440] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1ea4bf980 20 remove_watcher() i=2 2024-09-13T06:29:18.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94722977489824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696f5f20 con 0x7ff1dc115040 2024-09-13T06:29:18.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94722977489824] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1ea4bf980 20 remove_watcher() i=3 2024-09-13T06:29:18.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.217+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94722977490880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696ce3a0 con 0x5626696c1bd0 2024-09-13T06:29:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1e7fcf640 1 -- 172.21.15.169:0/2486733514 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94722977490880] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc112020 con 0x5626696c1bd0 2024-09-13T06:29:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1ea4bf980 20 remove_watcher() i=4 2024-09-13T06:29:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94722977494656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696f5f20 con 0x5626696c6c30 2024-09-13T06:29:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94722977494656] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1ea4bf980 20 remove_watcher() i=5 2024-09-13T06:29:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94722977475872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696ce820 con 0x5626696c6c30 2024-09-13T06:29:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1e77ce640 1 -- 172.21.15.169:0/2486733514 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94722977475872] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d800f070 con 0x5626696c6c30 2024-09-13T06:29:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1ea4bf980 20 remove_watcher() i=6 2024-09-13T06:29:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.221+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94722977496784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626696ce800 con 0x7ff1dc115040 2024-09-13T06:29:18.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94722977496784] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e00083f0 con 0x7ff1dc115040 2024-09-13T06:29:18.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 20 remove_watcher() i=7 2024-09-13T06:29:18.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626696c1bd0 msgr2=0x5626696c3fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626696c1bd0 0x5626696c3fc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626696bd720 msgr2=0x5626696bfbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626696bd720 0x5626696bfbe0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff1dc115040 msgr2=0x7ff1dc0c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff1dc115040 0x7ff1dc0c21b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626696c6c30 msgr2=0x5626696c9020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626696c6c30 0x5626696c9020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0b0034650 msgr2=0x7ff0b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0b0034650 0x7ff0b0036b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x562669691560 tx=0x7ff1d8010000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 msgr2=0x5626696b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1e87d0640 1 -- 172.21.15.169:0/2486733514 reap_dead start 2024-09-13T06:29:18.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696b25c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0e1ad0 tx=0x7ff1dc0bcee0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 shutdown_connections 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/2486733514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626696ab3e0 0x5626696b25c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 >> 172.21.15.169:0/2486733514 conn(0x5626696a77c0 msgr2=0x5626696a5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 shutdown_connections 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/2486733514 wait complete. 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0c00346a0 msgr2=0x7ff0c0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0c00346a0 0x7ff0c0036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80062e0 tx=0x7ff1d800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 msgr2=0x56266969f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 0x56266969f010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0e4010 tx=0x7ff1dc0b56c0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 shutdown_connections 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0c00346a0 0x7ff0c0036b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3509399622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266969ebf0 0x56266969f010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 >> 172.21.15.169:0/3509399622 conn(0x562669693d40 msgr2=0x5626696967c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 shutdown_connections 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3509399622 wait complete. 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562669689280 msgr2=0x56266968b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562669689280 0x56266968b670 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56266958f1d0 msgr2=0x562669687e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56266958f1d0 0x562669687e70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56266968d160 msgr2=0x5626696909d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56266968d160 0x5626696909d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0d00346a0 msgr2=0x7ff0d0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff0d00346a0 0x7ff0d0036b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80012f0 tx=0x7ff1d8006700 comp rx=0 tx=0).stop 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 msgr2=0x562669680ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 --2- 172.21.15.169:0/3914835604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56266958e880 0x562669680ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc019930 tx=0x7ff1dc018020 comp rx=0 tx=0).stop 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1e87d0640 1 -- 172.21.15.169:0/3914835604 reap_dead start 2024-09-13T06:29:18.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 shutdown_connections 2024-09-13T06:29:18.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 >> 172.21.15.169:0/3914835604 conn(0x5626695021d0 msgr2=0x5626696743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 shutdown_connections 2024-09-13T06:29:18.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.225+0000 7ff1ea4bf980 1 -- 172.21.15.169:0/3914835604 wait complete. 2024-09-13T06:29:18.236 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T06:29:18.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:18.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:18.237 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:18.306 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:18.307 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:18.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd4bec980 1 Processor -- start 2024-09-13T06:29:18.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd4bec980 1 -- start start 2024-09-13T06:29:18.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd4bec980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55961df7cac0 0x55961e00b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd4bec980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55961de90ae0 con 0x55961e00b8b0 2024-09-13T06:29:18.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd4bec980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55961deb4e30 con 0x55961df7cac0 2024-09-13T06:29:18.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd26fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55961df7cac0 0x55961e00b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd26fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55961df7cac0 0x55961e00b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35374/0 (socket says 172.21.15.169:35374) 2024-09-13T06:29:18.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd1efb640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55961e00b8b0 0x55961e00dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45018/0 (socket says 172.21.15.169:45018) 2024-09-13T06:29:18.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd26fc640 1 -- 172.21.15.169:0/364082976 learned_addr learned my addr 172.21.15.169:0/364082976 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd26fc640 1 -- 172.21.15.169:0/364082976 >> v1:172.21.15.112:6789/0 conn(0x55961e00b8b0 legacy=0x55961e00dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.305+0000 7fbcd26fc640 1 -- 172.21.15.169:0/364082976 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961e0103d0 con 0x55961df7cac0 2024-09-13T06:29:18.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/364082976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e00b370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400a5c0 tx=0x7fbcc401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f64c038a1b3393 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd16fa640 1 -- 172.21.15.169:0/364082976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40a6070 con 0x55961df7cac0 2024-09-13T06:29:18.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd16fa640 1 -- 172.21.15.169:0/364082976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40af070 con 0x55961df7cac0 2024-09-13T06:29:18.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd16fa640 1 -- 172.21.15.169:0/364082976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40aa5c0 con 0x55961df7cac0 2024-09-13T06:29:18.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 -- 172.21.15.169:0/364082976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 msgr2=0x55961e00b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/364082976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e00b370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400a5c0 tx=0x7fbcc401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:18.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 -- 172.21.15.169:0/364082976 shutdown_connections 2024-09-13T06:29:18.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/364082976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e00b370 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 -- 172.21.15.169:0/364082976 >> 172.21.15.169:0/364082976 conn(0x55961e003060 msgr2=0x55961e005480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 -- 172.21.15.169:0/364082976 shutdown_connections 2024-09-13T06:29:18.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.309+0000 7fbcd4bec980 1 -- 172.21.15.169:0/364082976 wait complete. 2024-09-13T06:29:18.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd4bec980 1 Processor -- start 2024-09-13T06:29:18.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd4bec980 1 -- start start 2024-09-13T06:29:18.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd4bec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd4bec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55961deb6200 con 0x55961df7cac0 2024-09-13T06:29:18.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35388/0 (socket says 172.21.15.169:35388) 2024-09-13T06:29:18.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.321+0000 7fbcd26fc640 1 -- 172.21.15.169:0/1306056476 learned_addr learned my addr 172.21.15.169:0/1306056476 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 -- 172.21.15.169:0/1306056476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961e0f1dc0 con 0x55961df7cac0 2024-09-13T06:29:18.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/1306056476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f17f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40199f0 tx=0x7fbcc4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b17305cd273ffbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbbc0608640 1 -- 172.21.15.169:0/1306056476 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40aaa00 con 0x55961df7cac0 2024-09-13T06:29:18.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbbc0608640 1 -- 172.21.15.169:0/1306056476 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40aaba0 con 0x55961df7cac0 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbbc0608640 1 -- 172.21.15.169:0/1306056476 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40bd3f0 con 0x55961df7cac0 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/1306056476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 msgr2=0x55961e0f17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/1306056476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f17f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40199f0 tx=0x7fbcc4003030 comp rx=0 tx=0).stop 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/1306056476 shutdown_connections 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/1306056476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f17f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/1306056476 >> 172.21.15.169:0/1306056476 conn(0x55961e003060 msgr2=0x55961e0ed420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/1306056476 shutdown_connections 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/1306056476 wait complete. 2024-09-13T06:29:18.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 Processor -- start 2024-09-13T06:29:18.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- start start 2024-09-13T06:29:18.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55961e00fe10 con 0x55961df7cac0 2024-09-13T06:29:18.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35402/0 (socket says 172.21.15.169:35402) 2024-09-13T06:29:18.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 -- 172.21.15.169:0/2200078490 learned_addr learned my addr 172.21.15.169:0/2200078490 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961e0f8f80 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f8a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40199f0 tx=0x7fbcc40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbbbee05640 1 -- 172.21.15.169:0/2200078490 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40bd7c0 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbbbee05640 1 -- 172.21.15.169:0/2200078490 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40bd960 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55961e0f9210 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbbbee05640 1 -- 172.21.15.169:0/2200078490 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40bdc40 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.325+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961e0fbef0 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbbbee05640 1 -- 172.21.15.169:0/2200078490 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbcc40ce020 con 0x55961df7cac0 2024-09-13T06:29:18.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbbbee05640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbb80346a0 0x7fbbb8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbbbee05640 1 -- 172.21.15.169:0/2200078490 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fbcc40cc020 con 0x55961df7cac0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbb80346a0 0x7fbbb8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e00b8b0 0x55961e0ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e100030 con 0x55961e00b8b0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd2efd640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e00b8b0 0x55961e0ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbb80346a0 0x7fbbb8036b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001e50 tx=0x7fbcc80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd2efd640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e00b8b0 0x55961e0ff9f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd2efd640 1 -- 172.21.15.169:0/2200078490 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e00b8b0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e100e20 0x55961e103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e103870 con 0x55961e100e20 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e100e20 0x55961e103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.329+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e100e20 0x55961e103210 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 -- 172.21.15.169:0/2200078490 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e100e20 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e105120 con 0x55961e100e20 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 -- 172.21.15.169:0/2200078490 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e100e20 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e104350 con 0x55961e100e20 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 -- 172.21.15.169:0/2200078490 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e100e20 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e1064d0 0x55961e1088c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e108e00 con 0x55961e1064d0 2024-09-13T06:29:18.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e1064d0 0x55961e1088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e1064d0 0x55961e1088c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd1efb640 1 -- 172.21.15.169:0/2200078490 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcc800f700 con 0x55961e1064d0 2024-09-13T06:29:18.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 Processor -- start 2024-09-13T06:29:18.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 -- start start 2024-09-13T06:29:18.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 0x55961e116cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd4bec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55961df0f800 con 0x55961e116890 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 0x55961e116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 0x55961e116cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35418/0 (socket says 172.21.15.169:35418) 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 -- 172.21.15.169:0/22834942 learned_addr learned my addr 172.21.15.169:0/22834942 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.333+0000 7fbcd26fc640 1 -- 172.21.15.169:0/22834942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961e1171f0 con 0x55961e116890 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 0x55961e116cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4006fc0 tx=0x7fbcc40bcf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb7fff640 1 -- 172.21.15.169:0/22834942 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40ea070 con 0x55961e116890 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55961e117480 con 0x55961e116890 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb7fff640 1 -- 172.21.15.169:0/22834942 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40cfd00 con 0x55961e116890 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb7fff640 1 -- 172.21.15.169:0/22834942 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40e39a0 con 0x55961e116890 2024-09-13T06:29:18.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961e11a100 con 0x55961e116890 2024-09-13T06:29:18.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb7fff640 1 -- 172.21.15.169:0/22834942 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbcc40e3b40 con 0x55961e116890 2024-09-13T06:29:18.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb7fff640 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbac034650 0x7fbbac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb7fff640 1 -- 172.21.15.169:0/22834942 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fbcc40b50b0 con 0x55961e116890 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbac034650 0x7fbbac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd4bec980 1 Processor -- start 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd4bec980 1 -- start start 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbac034650 0x7fbbac036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55961e109200 tx=0x7fbcc800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd4bec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e123570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd4bec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55961e0f2080 con 0x55961e123170 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e123570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35426/0 (socket says 172.21.15.169:35426) 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd26fc640 1 -- 172.21.15.169:0/3236399147 learned_addr learned my addr 172.21.15.169:0/3236399147 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd26fc640 1 -- 172.21.15.169:0/3236399147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961e123b40 con 0x55961e123170 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/3236399147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e123570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40aab20 tx=0x7fbcc40dee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc80e1ecf10c3df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb5ffb640 1 -- 172.21.15.169:0/3236399147 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40bc8c0 con 0x55961e123170 2024-09-13T06:29:18.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb5ffb640 1 -- 172.21.15.169:0/3236399147 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4006710 con 0x55961e123170 2024-09-13T06:29:18.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.337+0000 7fbbb5ffb640 1 -- 172.21.15.169:0/3236399147 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40c0d00 con 0x55961e123170 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/3236399147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 msgr2=0x55961e123570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/3236399147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e123570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40aab20 tx=0x7fbcc40dee20 comp rx=0 tx=0).stop 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/3236399147 shutdown_connections 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/3236399147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e123570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/3236399147 >> 172.21.15.169:0/3236399147 conn(0x55961e11f5a0 msgr2=0x55961e11d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/3236399147 shutdown_connections 2024-09-13T06:29:18.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/3236399147 wait complete. 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 Processor -- start 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- start start 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e12a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55961e124010 con 0x55961e123170 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e12a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd26fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e12a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35428/0 (socket says 172.21.15.169:35428) 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 learned_addr learned my addr 172.21.15.169:0/4147711020 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961e12a8f0 con 0x55961e123170 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e12a3b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40bcf70 tx=0x7fbcc40f1ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbba3fff640 1 -- 172.21.15.169:0/4147711020 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc40bc8c0 con 0x55961e123170 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55961e12a8f0 con 0x55961e123170 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbba3fff640 1 -- 172.21.15.169:0/4147711020 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4115070 con 0x55961e123170 2024-09-13T06:29:18.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961e12a8f0 con 0x55961e123170 2024-09-13T06:29:18.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbba3fff640 1 -- 172.21.15.169:0/4147711020 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc4006b50 con 0x55961e123170 2024-09-13T06:29:18.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbba3fff640 1 -- 172.21.15.169:0/4147711020 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbcc40de420 con 0x55961e123170 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbba3fff640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb9c034650 0x7fbb9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbba3fff640 1 -- 172.21.15.169:0/4147711020 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fbcc40fd1a0 con 0x55961e123170 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb9c034650 0x7fbb9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e135480 0x55961e137940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.341+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e138090 con 0x55961e135480 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd2efd640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e135480 0x55961e137940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb9c034650 0x7fbb9c036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800baa0 tx=0x7fbcc8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd2efd640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e135480 0x55961e137940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 realm 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e134930 con 0x55961e135480 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e138b50 con 0x55961e135480 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e139930 0x55961e13bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e13c380 con 0x55961e139930 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e139930 0x55961e13bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e139930 0x55961e13bd20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e13cc20 con 0x55961e139930 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 20 searching for the correct realm 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e13e990 0x55961e140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e13e990 0x55961e140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd1efb640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e13e990 0x55961e140d80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.345+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbcc40ee020 0x7fbcc411a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x7fbcc40ee020 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbcc40ee020 0x7fbcc411a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbcc40ee020 0x7fbcc411a460 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x7fbcc40ee020 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.349+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x7fbcc40ee020 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x7fbcc40ee020 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e135480 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x7fbcc40ee020 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.353+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x7fbcc40ee020 2024-09-13T06:29:18.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e13e990 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55961e141400 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e13d5d0 con 0x55961e135480 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.357+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e13da20 con 0x55961e139930 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e13de40 con 0x55961e13e990 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 zone default found 2024-09-13T06:29:18.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 4 Realm: () 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 zonegroup default 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e1418b0 con 0x7fbcc40ee020 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e143ae0 con 0x55961e13e990 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e143e80 con 0x55961e13e990 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 started sync module instance, tier type = 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e142f20 con 0x55961e139930 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94103238095952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e142f20 con 0x55961e139930 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.361+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144750 con 0x55961e135480 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94103238099488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144ff0 con 0x55961e135480 2024-09-13T06:29:18.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e1459f0 con 0x55961e139930 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94103238095952] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94103238099488] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94103238093424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144b40 con 0x55961e139930 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e1462c0 con 0x7fbcc40ee020 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94103238106640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144b40 con 0x7fbcc40ee020 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.365+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e146d60 con 0x55961e139930 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94103238093424] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94103238106640] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94103238107696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e146d20 con 0x55961e139930 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e147190 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94103238104320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e147a30 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e148430 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.369+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94103238107696] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94103238104320] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94103238109264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e148820 con 0x55961e13e990 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e149070 con 0x7fbcc40ee020 2024-09-13T06:29:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94103238109264] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94103238117408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e1490f0 con 0x7fbcc40ee020 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=0 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=1 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=2 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=3 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=4 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=5 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=6 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94103238117408] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 20 add_watcher() i=7 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e14c3e0 con 0x55961e135480 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.373+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94103238118832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e149680 con 0x55961e135480 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94103238118832] v31'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbb88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 5 note: GC not initialized 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbb037fe640 20 reqs_thread_entry: start 2024-09-13T06:29:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 20 Filter name: none 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbb017fa640 20 reqs_thread_entry: start 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55961e16f5d0 con 0x55961e135480 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:18.381 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:18.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbb88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.377+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94103238118832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e16e520 con 0x55961e135480 2024-09-13T06:29:18.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94103238118832] v31'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94103238095952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e148db0 con 0x55961e139930 2024-09-13T06:29:18.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94103238095952] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd4bec980 20 remove_watcher() i=0 2024-09-13T06:29:18.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd4bec980 2 removed watcher, disabling cache 2024-09-13T06:29:18.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94103238099488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e148db0 con 0x55961e135480 2024-09-13T06:29:18.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94103238099488] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x55961e135480 2024-09-13T06:29:18.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd4bec980 20 remove_watcher() i=1 2024-09-13T06:29:18.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.381+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94103238093424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144220 con 0x55961e139930 2024-09-13T06:29:18.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.385+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94103238093424] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.385+0000 7fbcd4bec980 20 remove_watcher() i=2 2024-09-13T06:29:18.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.385+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94103238106640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e148db0 con 0x7fbcc40ee020 2024-09-13T06:29:18.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.385+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94103238106640] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.385+0000 7fbcd4bec980 20 remove_watcher() i=3 2024-09-13T06:29:18.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.385+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94103238107696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144220 con 0x55961e139930 2024-09-13T06:29:18.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd26fc640 1 -- 172.21.15.169:0/4147711020 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94103238107696] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc40c53e0 con 0x55961e139930 2024-09-13T06:29:18.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 20 remove_watcher() i=4 2024-09-13T06:29:18.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94103238104320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e148db0 con 0x55961e13e990 2024-09-13T06:29:18.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94103238104320] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 20 remove_watcher() i=5 2024-09-13T06:29:18.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94103238109264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e146290 con 0x55961e13e990 2024-09-13T06:29:18.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd1efb640 1 -- 172.21.15.169:0/4147711020 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94103238109264] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc8037040 con 0x55961e13e990 2024-09-13T06:29:18.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 20 remove_watcher() i=6 2024-09-13T06:29:18.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94103238117408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55961e144220 con 0x7fbcc40ee020 2024-09-13T06:29:18.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94103238117408] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc00a4d0 con 0x7fbcc40ee020 2024-09-13T06:29:18.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 20 remove_watcher() i=7 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e139930 msgr2=0x55961e13bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e139930 0x55961e13bd20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e135480 msgr2=0x55961e137940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e135480 0x55961e137940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbcc40ee020 msgr2=0x7fbcc411a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbcc40ee020 0x7fbcc411a460 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e13e990 msgr2=0x55961e140d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e13e990 0x55961e140d80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb9c034650 msgr2=0x7fbb9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbb9c034650 0x7fbb9c036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800baa0 tx=0x7fbcc8010000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd2efd640 1 -- 172.21.15.169:0/4147711020 reap_dead start 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 msgr2=0x55961e12a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e12a3b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40bcf70 tx=0x7fbcc40f1ea0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 shutdown_connections 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/4147711020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e123170 0x55961e12a3b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 >> 172.21.15.169:0/4147711020 conn(0x55961e11f5a0 msgr2=0x55961e11d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.389+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 shutdown_connections 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/4147711020 wait complete. 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbac034650 msgr2=0x7fbbac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbac034650 0x7fbbac036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55961e109200 tx=0x7fbcc800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 msgr2=0x55961e116cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 0x55961e116cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4006fc0 tx=0x7fbcc40bcf00 comp rx=0 tx=0).stop 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 shutdown_connections 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbac034650 0x7fbbac036b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/22834942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961e116890 0x55961e116cb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 >> 172.21.15.169:0/22834942 conn(0x55961e10b9e0 msgr2=0x55961e10e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 shutdown_connections 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/22834942 wait complete. 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e100e20 msgr2=0x55961e103210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55961e100e20 0x55961e103210 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e00b8b0 msgr2=0x55961e0ff9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55961e00b8b0 0x55961e0ff9f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e1064d0 msgr2=0x55961e1088c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55961e1064d0 0x55961e1088c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbb80346a0 msgr2=0x7fbbb8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbbb80346a0 0x7fbbb8036b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001e50 tx=0x7fbcc80013b0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 msgr2=0x55961e0f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 --2- 172.21.15.169:0/2200078490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55961df7cac0 0x55961e0f8a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40199f0 tx=0x7fbcc40180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd2efd640 1 -- 172.21.15.169:0/2200078490 reap_dead start 2024-09-13T06:29:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 shutdown_connections 2024-09-13T06:29:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 >> 172.21.15.169:0/2200078490 conn(0x55961e003060 msgr2=0x55961e0ebfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 shutdown_connections 2024-09-13T06:29:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.393+0000 7fbcd4bec980 1 -- 172.21.15.169:0/2200078490 wait complete. 2024-09-13T06:29:18.404 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:18.404 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T06:29:18.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T06:29:18.404 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T06:29:18.477 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:18.477 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:18.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f1130e23980 1 Processor -- start 2024-09-13T06:29:18.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f1130e23980 1 -- start start 2024-09-13T06:29:18.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f1130e23980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x559e75cf1c60 0x559e75cf4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f1130e23980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e75b73ae0 con 0x559e75ced8e0 2024-09-13T06:29:18.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f1130e23980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x559e75b97e30 con 0x559e75cf1c60 2024-09-13T06:29:18.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f112e132640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x559e75cf1c60 0x559e75cf4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f112e132640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x559e75cf1c60 0x559e75cf4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35430/0 (socket says 172.21.15.169:35430) 2024-09-13T06:29:18.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f112e933640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x559e75ced8e0 0x559e75cedcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45024/0 (socket says 172.21.15.169:45024) 2024-09-13T06:29:18.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f112e132640 1 -- 172.21.15.169:0/1897500014 learned_addr learned my addr 172.21.15.169:0/1897500014 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f112e132640 1 -- 172.21.15.169:0/1897500014 >> v1:172.21.15.112:6789/0 conn(0x559e75ced8e0 legacy=0x559e75cedcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.477+0000 7f112e132640 1 -- 172.21.15.169:0/1897500014 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e75cf55a0 con 0x559e75cf1c60 2024-09-13T06:29:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f112e132640 1 --2- 172.21.15.169:0/1897500014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75cf1c60 0x559e75cf4050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f112400a5c0 tx=0x7f112401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42d1c2b8a782343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f112d931640 1 -- 172.21.15.169:0/1897500014 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11240a6070 con 0x559e75cf1c60 2024-09-13T06:29:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f112d931640 1 -- 172.21.15.169:0/1897500014 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240af070 con 0x559e75cf1c60 2024-09-13T06:29:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f112d931640 1 -- 172.21.15.169:0/1897500014 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11240aa5c0 con 0x559e75cf1c60 2024-09-13T06:29:18.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 -- 172.21.15.169:0/1897500014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75cf1c60 msgr2=0x559e75cf4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 --2- 172.21.15.169:0/1897500014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75cf1c60 0x559e75cf4050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f112400a5c0 tx=0x7f112401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:18.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 -- 172.21.15.169:0/1897500014 shutdown_connections 2024-09-13T06:29:18.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 --2- 172.21.15.169:0/1897500014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75cf1c60 0x559e75cf4050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 -- 172.21.15.169:0/1897500014 >> 172.21.15.169:0/1897500014 conn(0x559e75c61230 msgr2=0x559e75c61640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 -- 172.21.15.169:0/1897500014 shutdown_connections 2024-09-13T06:29:18.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.481+0000 7f1130e23980 1 -- 172.21.15.169:0/1897500014 wait complete. 2024-09-13T06:29:18.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f1130e23980 1 Processor -- start 2024-09-13T06:29:18.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f1130e23980 1 -- start start 2024-09-13T06:29:18.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f1130e23980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75dd8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f1130e23980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559e75b99200 con 0x559e75ced8e0 2024-09-13T06:29:18.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75dd8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75dd8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35442/0 (socket says 172.21.15.169:35442) 2024-09-13T06:29:18.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f112e933640 1 -- 172.21.15.169:0/4149667298 learned_addr learned my addr 172.21.15.169:0/4149667298 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f112e933640 1 -- 172.21.15.169:0/4149667298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e75dd9200 con 0x559e75ced8e0 2024-09-13T06:29:18.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f112e933640 1 --2- 172.21.15.169:0/4149667298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75dd8c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f112000b240 tx=0x7f112000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73667c32cd2fbe5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f101ce09640 1 -- 172.21.15.169:0/4149667298 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112000e700 con 0x559e75ced8e0 2024-09-13T06:29:18.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f101ce09640 1 -- 172.21.15.169:0/4149667298 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112000e8a0 con 0x559e75ced8e0 2024-09-13T06:29:18.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.493+0000 7f101ce09640 1 -- 172.21.15.169:0/4149667298 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112000eb80 con 0x559e75ced8e0 2024-09-13T06:29:18.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/4149667298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 msgr2=0x559e75dd8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 --2- 172.21.15.169:0/4149667298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75dd8c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f112000b240 tx=0x7f112000b700 comp rx=0 tx=0).stop 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/4149667298 shutdown_connections 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 --2- 172.21.15.169:0/4149667298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75dd8c30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/4149667298 >> 172.21.15.169:0/4149667298 conn(0x559e75c61230 msgr2=0x559e75dd4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/4149667298 shutdown_connections 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/4149667298 wait complete. 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 Processor -- start 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- start start 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75ddffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559e75cf50a0 con 0x559e75ced8e0 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75ddffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75ddffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35448/0 (socket says 172.21.15.169:35448) 2024-09-13T06:29:18.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f112e933640 1 -- 172.21.15.169:0/1471158748 learned_addr learned my addr 172.21.15.169:0/1471158748 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f112e933640 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e75de04e0 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f112e933640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75ddffa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1120000c10 tx=0x7f1120000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f101b606640 1 -- 172.21.15.169:0/1471158748 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112000fa90 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e75de0770 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f101b606640 1 -- 172.21.15.169:0/1471158748 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112000fc50 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f101b606640 1 -- 172.21.15.169:0/1471158748 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112001a480 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e75de3450 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.497+0000 7f101b606640 1 -- 172.21.15.169:0/1471158748 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1120017070 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f101b606640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1014034650 0x7f1014036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f101b606640 1 -- 172.21.15.169:0/1471158748 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1120015020 con 0x559e75ced8e0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112e132640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1014034650 0x7f1014036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75cf1c60 0x559e75de6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75de75a0 con 0x559e75cf1c60 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112f134640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75cf1c60 0x559e75de6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112e132640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1014034650 0x7f1014036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11240ae000 tx=0x7f11240a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112f134640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75cf1c60 0x559e75de6f30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112f134640 1 -- 172.21.15.169:0/1471158748 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75cf1c60 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75de83e0 0x559e75dea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75deae00 con 0x559e75de83e0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112e933640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75de83e0 0x559e75dea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112e933640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75de83e0 0x559e75dea7d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112e933640 1 -- 172.21.15.169:0/1471158748 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f112002e070 con 0x559e75de83e0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75dec6b0 con 0x559e75de83e0 2024-09-13T06:29:18.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f112e933640 1 -- 172.21.15.169:0/1471158748 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f112002e070 con 0x559e75de83e0 2024-09-13T06:29:18.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.501+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75deb820 con 0x559e75de83e0 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e933640 1 -- 172.21.15.169:0/1471158748 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f112002e070 con 0x559e75de83e0 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75deda60 0x559e75defe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75df0390 con 0x559e75deda60 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e132640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75deda60 0x559e75defe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e132640 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75deda60 0x559e75defe50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e132640 1 -- 172.21.15.169:0/1471158748 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75deda60 2024-09-13T06:29:18.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 Processor -- start 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 -- start start 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 0x559e75dfe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559e75bf2800 con 0x559e75dfdd10 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 0x559e75dfe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 0x559e75dfe130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35464/0 (socket says 172.21.15.169:35464) 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e933640 1 -- 172.21.15.169:0/486466199 learned_addr learned my addr 172.21.15.169:0/486466199 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e933640 1 -- 172.21.15.169:0/486466199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e75dfe670 con 0x559e75dfdd10 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f112e933640 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 0x559e75dfe130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f112004a010 tx=0x7f1120019e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1018e01640 1 -- 172.21.15.169:0/486466199 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112003f020 con 0x559e75dfdd10 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e75dfe900 con 0x559e75dfdd10 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1018e01640 1 -- 172.21.15.169:0/486466199 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1120042720 con 0x559e75dfdd10 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1018e01640 1 -- 172.21.15.169:0/486466199 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1120042a00 con 0x559e75dfdd10 2024-09-13T06:29:18.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.505+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e75dfe900 con 0x559e75dfdd10 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1018e01640 1 -- 172.21.15.169:0/486466199 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f112003a070 con 0x559e75dfdd10 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1018e01640 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1008034650 0x7f1008036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1018e01640 1 -- 172.21.15.169:0/486466199 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f112004f850 con 0x559e75dfdd10 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e132640 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1008034650 0x7f1008036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 Processor -- start 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- start start 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e132640 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1008034650 0x7f1008036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x559e75de4590 tx=0x7f1124005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e0a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559e75dd9580 con 0x559e75e0a4a0 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e0a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e0a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35468/0 (socket says 172.21.15.169:35468) 2024-09-13T06:29:18.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 -- 172.21.15.169:0/498087911 learned_addr learned my addr 172.21.15.169:0/498087911 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 -- 172.21.15.169:0/498087911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e75e0ae50 con 0x559e75e0a4a0 2024-09-13T06:29:18.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 --2- 172.21.15.169:0/498087911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e0a880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f112004aa50 tx=0x7f1120031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa941a4c384892c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f10127fc640 1 -- 172.21.15.169:0/498087911 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112005e020 con 0x559e75e0a4a0 2024-09-13T06:29:18.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f10127fc640 1 -- 172.21.15.169:0/498087911 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112004a560 con 0x559e75e0a4a0 2024-09-13T06:29:18.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f10127fc640 1 -- 172.21.15.169:0/498087911 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112004ac30 con 0x559e75e0a4a0 2024-09-13T06:29:18.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- 172.21.15.169:0/498087911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 msgr2=0x559e75e0a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 --2- 172.21.15.169:0/498087911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e0a880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f112004aa50 tx=0x7f1120031f50 comp rx=0 tx=0).stop 2024-09-13T06:29:18.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- 172.21.15.169:0/498087911 shutdown_connections 2024-09-13T06:29:18.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 --2- 172.21.15.169:0/498087911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e0a880 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- 172.21.15.169:0/498087911 >> 172.21.15.169:0/498087911 conn(0x559e75e06880 msgr2=0x559e75e04980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- 172.21.15.169:0/498087911 shutdown_connections 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- 172.21.15.169:0/498087911 wait complete. 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 Processor -- start 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- start start 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f1130e23980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559e75e0b2f0 con 0x559e75e0a4a0 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35470/0 (socket says 172.21.15.169:35470) 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.509+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 learned_addr learned my addr 172.21.15.169:0/297482759 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e75e11c00 con 0x559e75e0a4a0 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112e933640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e116c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f112004aa50 tx=0x7f112004bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1010ff9640 1 -- 172.21.15.169:0/297482759 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1120007b40 con 0x559e75e0a4a0 2024-09-13T06:29:18.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1010ff9640 1 -- 172.21.15.169:0/297482759 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1120007ce0 con 0x559e75e0a4a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1010ff9640 1 -- 172.21.15.169:0/297482759 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200071a0 con 0x559e75e0a4a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e75e11c00 con 0x559e75e0a4a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e75e11c00 con 0x559e75e0a4a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1010ff9640 1 -- 172.21.15.169:0/297482759 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1120061020 con 0x559e75e0a4a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1010ff9640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ff80346a0 0x7f0ff8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1010ff9640 1 -- 172.21.15.169:0/297482759 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1120055040 con 0x559e75e0a4a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112e132640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ff80346a0 0x7f0ff8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75e1c7a0 0x559e75e1ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e1f3b0 con 0x559e75e1c7a0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112f134640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75e1c7a0 0x559e75e1ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112e132640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ff80346a0 0x7f0ff8036b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1124000c10 tx=0x7f11240c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112f134640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75e1c7a0 0x559e75e1ec60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 20 realm 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.513+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e1bce0 con 0x559e75e1c7a0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:18.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e1fed0 con 0x559e75e1c7a0 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75e20c80 0x559e75e23070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e236f0 con 0x559e75e20c80 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75e20c80 0x559e75e23070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75e20c80 0x559e75e23070 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e23f40 con 0x559e75e20c80 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 20 searching for the correct realm 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75e25cb0 0x559e75e280a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e132640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75e25cb0 0x559e75e280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e132640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75e25cb0 0x559e75e280a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1120063040 0x7f112003d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.517+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x7f1120063040 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1120063040 0x7f112003d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1120063040 0x7f112003d0d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x7f1120063040 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x7f1120063040 2024-09-13T06:29:18.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.521+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x7f1120063040 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e1c7a0 2024-09-13T06:29:18.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.525+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x7f1120063040 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x7f1120063040 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e25cb0 2024-09-13T06:29:18.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559e75e28720 con 0x559e75e20c80 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:18.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e248c0 con 0x559e75e1c7a0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.529+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e25160 con 0x559e75e20c80 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e24500 con 0x559e75e25cb0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:18.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 zone default found 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 4 Realm: () 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 zonegroup default 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e29030 con 0x7f1120063040 2024-09-13T06:29:18.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2b2d0 con 0x559e75e25cb0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2b670 con 0x559e75e25cb0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 started sync module instance, tier type = 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2a710 con 0x559e75e20c80 2024-09-13T06:29:18.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139070983216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2a710 con 0x559e75e20c80 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.533+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2c030 con 0x559e75e1c7a0 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94139070987136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2c8d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2d2f0 con 0x559e75e20c80 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94139070987136] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94139070983216] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94139070991840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2c420 con 0x559e75e20c80 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.537+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2db90 con 0x7f1120063040 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94139070994144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2c420 con 0x7f1120063040 2024-09-13T06:29:18.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2e610 con 0x559e75e20c80 2024-09-13T06:29:18.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94139070991840] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94139070994144] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94139070995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2e120 con 0x559e75e20c80 2024-09-13T06:29:18.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.541+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2eee0 con 0x559e75e25cb0 2024-09-13T06:29:18.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.545+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.545+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94139070999088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2e120 con 0x559e75e25cb0 2024-09-13T06:29:18.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.545+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2fd50 con 0x559e75e25cb0 2024-09-13T06:29:18.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.545+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94139070995200] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.545+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94139070999088] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.549+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.549+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94139070980704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2fd50 con 0x559e75e25cb0 2024-09-13T06:29:18.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.549+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e305a0 con 0x7f1120063040 2024-09-13T06:29:18.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94139070980704] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94139071003264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e303f0 con 0x7f1120063040 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=0 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=1 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=2 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=3 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=4 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=5 2024-09-13T06:29:18.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.553+0000 7f1130e23980 20 add_watcher() i=6 2024-09-13T06:29:18.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94139071003264] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 add_watcher() i=7 2024-09-13T06:29:18.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:18.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e339c0 con 0x559e75e1c7a0 2024-09-13T06:29:18.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94139071004320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e30e80 con 0x559e75e1c7a0 2024-09-13T06:29:18.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94139071004320] v31'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f0fe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:18.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 5 note: GC not initialized 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f0f5ffff640 20 reqs_thread_entry: start 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 Filter name: none 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f0f5dffb640 20 reqs_thread_entry: start 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e57040 con 0x559e75e1c7a0 2024-09-13T06:29:18.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.557+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e59ad0 con 0x7f1120063040 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5d250 con 0x559e75e1c7a0 2024-09-13T06:29:18.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f1130e23980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f1130e23980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f1130e23980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94139071188160 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x559e75e20c80 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94139070995200 notify 133143986177 ret 0) ==== 609+0+0 (crc 0 0 0) 0x559e75dfe670 con 0x559e75e20c80 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f10127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94139070995200 notifier 4309 bl.length()=567 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f10127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f10127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.4 [notify cookie 94139071188160 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f10127fc640 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0ff4003eb0 con 0x559e75e20c80 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94139071188160 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559e75de3450 con 0x559e75e20c80 2024-09-13T06:29:18.567 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:18.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f0fe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.561+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94139071004320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x559e75e1c7a0 2024-09-13T06:29:18.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.565+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94139071004320] v31'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.565+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94139070983216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x559e75e20c80 2024-09-13T06:29:18.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.565+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94139070983216] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.565+0000 7f1130e23980 20 remove_watcher() i=0 2024-09-13T06:29:18.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.565+0000 7f1130e23980 2 removed watcher, disabling cache 2024-09-13T06:29:18.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.565+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94139070987136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x559e75e1c7a0 2024-09-13T06:29:18.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94139070987136] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x559e75e1c7a0 2024-09-13T06:29:18.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f1130e23980 20 remove_watcher() i=1 2024-09-13T06:29:18.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94139070991840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x559e75e20c80 2024-09-13T06:29:18.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94139070991840] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f1130e23980 20 remove_watcher() i=2 2024-09-13T06:29:18.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94139070994144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x7f1120063040 2024-09-13T06:29:18.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94139070994144] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f1130e23980 20 remove_watcher() i=3 2024-09-13T06:29:18.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.569+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94139070995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x559e75e20c80 2024-09-13T06:29:18.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f112e933640 1 -- 172.21.15.169:0/297482759 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94139070995200] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1120041020 con 0x559e75e20c80 2024-09-13T06:29:18.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f1130e23980 20 remove_watcher() i=4 2024-09-13T06:29:18.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94139070999088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2fea0 con 0x559e75e25cb0 2024-09-13T06:29:18.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94139070999088] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f1130e23980 20 remove_watcher() i=5 2024-09-13T06:29:18.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94139070980704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e2cde0 con 0x559e75e25cb0 2024-09-13T06:29:18.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f112e132640 1 -- 172.21.15.169:0/297482759 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94139070980704] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11240aaad0 con 0x559e75e25cb0 2024-09-13T06:29:18.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f1130e23980 20 remove_watcher() i=6 2024-09-13T06:29:18.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.573+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94139071003264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559e75e5bda0 con 0x7f1120063040 2024-09-13T06:29:18.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94139071003264] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112800a4d0 con 0x7f1120063040 2024-09-13T06:29:18.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 20 remove_watcher() i=7 2024-09-13T06:29:18.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75e20c80 msgr2=0x559e75e23070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75e20c80 0x559e75e23070 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75e1c7a0 msgr2=0x559e75e1ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75e1c7a0 0x559e75e1ec60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1120063040 msgr2=0x7f112003d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1120063040 0x7f112003d0d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75e25cb0 msgr2=0x559e75e280a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75e25cb0 0x559e75e280a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ff80346a0 msgr2=0x7f0ff8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ff80346a0 0x7f0ff8036b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1124000c10 tx=0x7f11240c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 msgr2=0x559e75e116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e116c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f112004aa50 tx=0x7f112004bf70 comp rx=0 tx=0).stop 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f112f134640 1 -- 172.21.15.169:0/297482759 reap_dead start 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 shutdown_connections 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/297482759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75e0a4a0 0x559e75e116c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 >> 172.21.15.169:0/297482759 conn(0x559e75e06880 msgr2=0x559e75e04950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 shutdown_connections 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/297482759 wait complete. 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1008034650 msgr2=0x7f1008036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1008034650 0x7f1008036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x559e75de4590 tx=0x7f1124005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 msgr2=0x559e75dfe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 0x559e75dfe130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f112004a010 tx=0x7f1120019e70 comp rx=0 tx=0).stop 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 shutdown_connections 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1008034650 0x7f1008036b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/486466199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75dfdd10 0x559e75dfe130 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 >> 172.21.15.169:0/486466199 conn(0x559e75df2e60 msgr2=0x559e75df58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 shutdown_connections 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/486466199 wait complete. 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75de83e0 msgr2=0x559e75dea7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559e75de83e0 0x559e75dea7d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75cf1c60 msgr2=0x559e75de6f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559e75cf1c60 0x559e75de6f30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75deda60 msgr2=0x559e75defe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559e75deda60 0x559e75defe50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1014034650 msgr2=0x7f1014036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1014034650 0x7f1014036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11240ae000 tx=0x7f11240a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 msgr2=0x559e75ddffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 --2- 172.21.15.169:0/1471158748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559e75ced8e0 0x559e75ddffa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1120000c10 tx=0x7f1120000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f112f134640 1 -- 172.21.15.169:0/1471158748 reap_dead start 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 shutdown_connections 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 >> 172.21.15.169:0/1471158748 conn(0x559e75c61230 msgr2=0x559e75dd33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 shutdown_connections 2024-09-13T06:29:18.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.577+0000 7f1130e23980 1 -- 172.21.15.169:0/1471158748 wait complete. 2024-09-13T06:29:18.588 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:18.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:18.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:18.589 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:18.662 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:18.663 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:18.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e05648980 1 Processor -- start 2024-09-13T06:29:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e05648980 1 -- start start 2024-09-13T06:29:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e05648980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562e9702b8e0 0x562e9702bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e05648980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e96eb1ae0 con 0x562e9702c230 2024-09-13T06:29:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e05648980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x562e96ed5e30 con 0x562e9702b8e0 2024-09-13T06:29:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e03158640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562e9702b8e0 0x562e9702bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e02957640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x562e9702c230 0x562e97030c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45032/0 (socket says 172.21.15.169:45032) 2024-09-13T06:29:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e02957640 1 -- 172.21.15.169:0/548250021 learned_addr learned my addr 172.21.15.169:0/548250021 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e02156640 1 -- 172.21.15.169:0/548250021 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658323061 0 0) 0x562e96eb1ae0 con 0x562e9702c230 2024-09-13T06:29:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e02156640 1 -- 172.21.15.169:0/548250021 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dec001e20 con 0x562e9702c230 2024-09-13T06:29:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e03158640 1 -- 172.21.15.169:0/548250021 >> v1:172.21.15.112:6789/0 conn(0x562e9702c230 legacy=0x562e97030c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.661+0000 7f7e03158640 1 -- 172.21.15.169:0/548250021 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e970334b0 con 0x562e9702b8e0 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e03158640 1 --2- 172.21.15.169:0/548250021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9702bcc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7df400a480 tx=0x7f7df401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4744ea53ddd5c656 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e02156640 1 -- 172.21.15.169:0/548250021 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40b0070 con 0x562e9702b8e0 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e02156640 1 -- 172.21.15.169:0/548250021 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40ab540 con 0x562e9702b8e0 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e02156640 1 -- 172.21.15.169:0/548250021 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40ab840 con 0x562e9702b8e0 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 -- 172.21.15.169:0/548250021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 msgr2=0x562e9702bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 --2- 172.21.15.169:0/548250021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9702bcc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7df400a480 tx=0x7f7df401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 -- 172.21.15.169:0/548250021 shutdown_connections 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 --2- 172.21.15.169:0/548250021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9702bcc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 -- 172.21.15.169:0/548250021 >> 172.21.15.169:0/548250021 conn(0x562e96f9f230 msgr2=0x562e96f9f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 -- 172.21.15.169:0/548250021 shutdown_connections 2024-09-13T06:29:18.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.665+0000 7f7e05648980 1 -- 172.21.15.169:0/548250021 wait complete. 2024-09-13T06:29:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e05648980 1 Processor -- start 2024-09-13T06:29:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e05648980 1 -- start start 2024-09-13T06:29:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e05648980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e97116a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e05648980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e96ed7200 con 0x562e9702b8e0 2024-09-13T06:29:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e97116a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e97116a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35490/0 (socket says 172.21.15.169:35490) 2024-09-13T06:29:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e03158640 1 -- 172.21.15.169:0/2587901435 learned_addr learned my addr 172.21.15.169:0/2587901435 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e03158640 1 -- 172.21.15.169:0/2587901435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e97117020 con 0x562e9702b8e0 2024-09-13T06:29:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.677+0000 7f7e03158640 1 --2- 172.21.15.169:0/2587901435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e97116a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7df40ae040 tx=0x7f7df4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e347363da35ae18b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7cf160a640 1 -- 172.21.15.169:0/2587901435 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40b0040 con 0x562e9702b8e0 2024-09-13T06:29:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7cf160a640 1 -- 172.21.15.169:0/2587901435 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40ab9d0 con 0x562e9702b8e0 2024-09-13T06:29:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7cf160a640 1 -- 172.21.15.169:0/2587901435 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40abcd0 con 0x562e9702b8e0 2024-09-13T06:29:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2587901435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 msgr2=0x562e97116a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 --2- 172.21.15.169:0/2587901435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e97116a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7df40ae040 tx=0x7f7df4003030 comp rx=0 tx=0).stop 2024-09-13T06:29:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2587901435 shutdown_connections 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 --2- 172.21.15.169:0/2587901435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e97116a50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2587901435 >> 172.21.15.169:0/2587901435 conn(0x562e96f9f230 msgr2=0x562e97112680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2587901435 shutdown_connections 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2587901435 wait complete. 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 Processor -- start 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- start start 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9711dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e97032ef0 con 0x562e9702b8e0 2024-09-13T06:29:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9711dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9711dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35506/0 (socket says 172.21.15.169:35506) 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e03158640 1 -- 172.21.15.169:0/2819488379 learned_addr learned my addr 172.21.15.169:0/2819488379 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e03158640 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9711e2c0 con 0x562e9702b8e0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e03158640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9711dd80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7df4018eb0 tx=0x7f7df4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7cefe07640 1 -- 172.21.15.169:0/2819488379 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40c3070 con 0x562e9702b8e0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e9711e550 con 0x562e9702b8e0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7cefe07640 1 -- 172.21.15.169:0/2819488379 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40b6870 con 0x562e9702b8e0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7cefe07640 1 -- 172.21.15.169:0/2819488379 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40cd060 con 0x562e9702b8e0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.681+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e97121230 con 0x562e9702b8e0 2024-09-13T06:29:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7cefe07640 1 -- 172.21.15.169:0/2819488379 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7df40c6070 con 0x562e9702b8e0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7cefe07640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ce8034650 0x7f7ce8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7cefe07640 1 -- 172.21.15.169:0/2819488379 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7df40bc070 con 0x562e9702b8e0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e02957640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ce8034650 0x7f7ce8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9702c230 0x562e97124d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e971252e0 con 0x562e9702c230 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03959640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9702c230 0x562e97124d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e02957640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ce8034650 0x7f7ce8036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7df8000f70 tx=0x7f7df80010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03959640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9702c230 0x562e97124d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03959640 1 -- 172.21.15.169:0/2819488379 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9702c230 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e971260d0 0x562e971284c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97128af0 con 0x562e971260d0 2024-09-13T06:29:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03158640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e971260d0 0x562e971284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03158640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e971260d0 0x562e971284c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03158640 1 -- 172.21.15.169:0/2819488379 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7df40c5030 con 0x562e971260d0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9712a3a0 con 0x562e971260d0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e03158640 1 -- 172.21.15.169:0/2819488379 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7df40c5030 con 0x562e971260d0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.685+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97129510 con 0x562e971260d0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e03158640 1 -- 172.21.15.169:0/2819488379 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7df40c5030 con 0x562e971260d0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9712b750 0x562e9712db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9712e080 con 0x562e9712b750 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e02957640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9712b750 0x562e9712db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e02957640 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9712b750 0x562e9712db40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e02957640 1 -- 172.21.15.169:0/2819488379 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e9712b750 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 Processor -- start 2024-09-13T06:29:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 -- start start 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 0x562e9713be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e96f30800 con 0x562e9713ba30 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 0x562e9713be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 0x562e9713be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35518/0 (socket says 172.21.15.169:35518) 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e03158640 1 -- 172.21.15.169:0/2087747300 learned_addr learned my addr 172.21.15.169:0/2087747300 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e03158640 1 -- 172.21.15.169:0/2087747300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9713c390 con 0x562e9713ba30 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e03158640 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 0x562e9713be50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7df40030b0 tx=0x7f7df40076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7ced602640 1 -- 172.21.15.169:0/2087747300 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40e40b0 con 0x562e9713ba30 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e9713c620 con 0x562e9713ba30 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7ced602640 1 -- 172.21.15.169:0/2087747300 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40e4250 con 0x562e9713ba30 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7ced602640 1 -- 172.21.15.169:0/2087747300 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40e4530 con 0x562e9713ba30 2024-09-13T06:29:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.689+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9713f2a0 con 0x562e9713ba30 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7ced602640 1 -- 172.21.15.169:0/2087747300 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7df40e48d0 con 0x562e9713ba30 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7ced602640 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7cdc034650 0x7f7cdc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7ced602640 1 -- 172.21.15.169:0/2087747300 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7df40a8070 con 0x562e9713ba30 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e02957640 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7cdc034650 0x7f7cdc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 Processor -- start 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- start start 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e97148800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e971172e0 con 0x562e97148420 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e02957640 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7cdc034650 0x7f7cdc036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x562e97122370 tx=0x7f7df800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e97148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e97148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35528/0 (socket says 172.21.15.169:35528) 2024-09-13T06:29:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 -- 172.21.15.169:0/3650370420 learned_addr learned my addr 172.21.15.169:0/3650370420 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 -- 172.21.15.169:0/3650370420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e97148dd0 con 0x562e97148420 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 --2- 172.21.15.169:0/3650370420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e97148800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7df401b0b0 tx=0x7f7df40d27f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a731a2debac6e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7ce6ffd640 1 -- 172.21.15.169:0/3650370420 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40e1460 con 0x562e97148420 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7ce6ffd640 1 -- 172.21.15.169:0/3650370420 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40f1060 con 0x562e97148420 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7ce6ffd640 1 -- 172.21.15.169:0/3650370420 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40af170 con 0x562e97148420 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- 172.21.15.169:0/3650370420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 msgr2=0x562e97148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 --2- 172.21.15.169:0/3650370420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e97148800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7df401b0b0 tx=0x7f7df40d27f0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- 172.21.15.169:0/3650370420 shutdown_connections 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 --2- 172.21.15.169:0/3650370420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e97148800 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- 172.21.15.169:0/3650370420 >> 172.21.15.169:0/3650370420 conn(0x562e97144800 msgr2=0x562e97142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- 172.21.15.169:0/3650370420 shutdown_connections 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- 172.21.15.169:0/3650370420 wait complete. 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 Processor -- start 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- start start 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e9714f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e05648980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e97149270 con 0x562e97148420 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e9714f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e9714f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35540/0 (socket says 172.21.15.169:35540) 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 learned_addr learned my addr 172.21.15.169:0/2660596 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.693+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9714fae0 con 0x562e97148420 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03158640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e9714f5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7df40d1c50 tx=0x7f7df40aab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7ce57fa640 1 -- 172.21.15.169:0/2660596 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df4110070 con 0x562e97148420 2024-09-13T06:29:18.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e9714fae0 con 0x562e97148420 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7ce57fa640 1 -- 172.21.15.169:0/2660596 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40b4c60 con 0x562e97148420 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7ce57fa640 1 -- 172.21.15.169:0/2660596 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7df40e4bc0 con 0x562e97148420 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9714fae0 con 0x562e97148420 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7ce57fa640 1 -- 172.21.15.169:0/2660596 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7df4113070 con 0x562e97148420 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7ce57fa640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ccc0346a0 0x7f7ccc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7ce57fa640 1 -- 172.21.15.169:0/2660596 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7df4116af0 con 0x562e97148420 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e02957640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ccc0346a0 0x7f7ccc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9715a560 0x562e9715ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9715d150 con 0x562e9715a560 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03959640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9715a560 0x562e9715ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e02957640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ccc0346a0 0x7f7ccc036b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c010 tx=0x7f7df8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03959640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9715a560 0x562e9715ca00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 realm 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97159a50 con 0x562e9715a560 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9715dc10 con 0x562e9715a560 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9715e9f0 0x562e97160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97161440 con 0x562e9715e9f0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.697+0000 7f7e03158640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9715e9f0 0x562e97160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03158640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9715e9f0 0x562e97160de0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97161ce0 con 0x562e9715e9f0 2024-09-13T06:29:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 20 searching for the correct realm 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e97163a50 0x562e97165e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e02957640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e97163a50 0x562e97165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e02957640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e97163a50 0x562e97165e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03158640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7df4115060 0x7f7df40c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x7f7df4115060 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7df4115060 0x7f7df40c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7df4115060 0x7f7df40c4800 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.701+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x7f7df4115060 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x7f7df4115060 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.705+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x7f7df4115060 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715a560 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x7f7df4115060 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x7f7df4115060 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e97163a50 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.709+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e97166450 con 0x562e9715e9f0 2024-09-13T06:29:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97162690 con 0x562e9715a560 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97162b10 con 0x562e9715e9f0 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97162f30 con 0x562e97163a50 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 zone default found 2024-09-13T06:29:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 4 Realm: () 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 zonegroup default 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e971668d0 con 0x7f7df4115060 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97168b00 con 0x562e97163a50 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97168ea0 con 0x562e97163a50 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 started sync module instance, tier type = 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.713+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97167f40 con 0x562e9715e9f0 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94758103319584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97167f40 con 0x562e9715e9f0 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97169860 con 0x562e9715a560 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94758103323568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716a0b0 con 0x562e9715a560 2024-09-13T06:29:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716aab0 con 0x562e9715e9f0 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94758103319584] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94758103323568] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94758103317136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97169c00 con 0x562e9715e9f0 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.717+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716b350 con 0x7f7df4115060 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94758103330464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97169c00 con 0x7f7df4115060 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716be20 con 0x562e9715e9f0 2024-09-13T06:29:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94758103330464] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94758103317136] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94758103328192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716bde0 con 0x562e9715e9f0 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716c210 con 0x562e97163a50 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.721+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94758103331520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716cab0 con 0x562e97163a50 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716d4f0 con 0x562e97163a50 2024-09-13T06:29:18.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94758103331520] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94758103328192] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94758103333136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716c600 con 0x562e97163a50 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716dd90 con 0x7f7df4115060 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94758103341280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716e1b0 con 0x7f7df4115060 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=0 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=1 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=2 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=3 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=4 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=5 2024-09-13T06:29:18.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94758103333136] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=6 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94758103341280] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 20 add_watcher() i=7 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.725+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9716e1b0 con 0x562e9715a560 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94758103342336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716e120 con 0x562e9715a560 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94758103342336] v31'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7cba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 5 note: GC not initialized 2024-09-13T06:29:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7cb97e2640 20 reqs_thread_entry: start 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 20 Filter name: none 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7cb27fc640 20 reqs_thread_entry: start 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e97194410 con 0x562e9715a560 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.729+0000 7f7e05648980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:18.752 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.733+0000 7f7cba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.733+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94758103342336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97193360 con 0x562e9715a560 2024-09-13T06:29:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.733+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94758103342336] v31'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.733+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94758103319584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716dd00 con 0x562e9715e9f0 2024-09-13T06:29:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.733+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94758103319584] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 20 remove_watcher() i=0 2024-09-13T06:29:18.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 2 removed watcher, disabling cache 2024-09-13T06:29:18.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94758103323568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716dd00 con 0x562e9715a560 2024-09-13T06:29:18.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94758103323568] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x562e9715a560 2024-09-13T06:29:18.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 20 remove_watcher() i=1 2024-09-13T06:29:18.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94758103317136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716dd00 con 0x562e9715e9f0 2024-09-13T06:29:18.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94758103317136] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 20 remove_watcher() i=2 2024-09-13T06:29:18.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.737+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94758103330464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e97167a90 con 0x7f7df4115060 2024-09-13T06:29:18.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94758103330464] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 20 remove_watcher() i=3 2024-09-13T06:29:18.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94758103328192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716dd00 con 0x562e9715e9f0 2024-09-13T06:29:18.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e03158640 1 -- 172.21.15.169:0/2660596 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94758103328192] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df4112030 con 0x562e9715e9f0 2024-09-13T06:29:18.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 20 remove_watcher() i=4 2024-09-13T06:29:18.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94758103331520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716aea0 con 0x562e97163a50 2024-09-13T06:29:18.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94758103331520] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 20 remove_watcher() i=5 2024-09-13T06:29:18.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94758103333136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716b350 con 0x562e97163a50 2024-09-13T06:29:18.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e02957640 1 -- 172.21.15.169:0/2660596 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94758103333136] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7df800e6c0 con 0x562e97163a50 2024-09-13T06:29:18.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 20 remove_watcher() i=6 2024-09-13T06:29:18.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.741+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94758103341280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9716b350 con 0x7f7df4115060 2024-09-13T06:29:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94758103341280] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dfc00a4d0 con 0x7f7df4115060 2024-09-13T06:29:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 20 remove_watcher() i=7 2024-09-13T06:29:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9715e9f0 msgr2=0x562e97160de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9715e9f0 0x562e97160de0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9715a560 msgr2=0x562e9715ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9715a560 0x562e9715ca00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7df4115060 msgr2=0x7f7df40c4800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7df4115060 0x7f7df40c4800 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e97163a50 msgr2=0x562e97165e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e97163a50 0x562e97165e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ccc0346a0 msgr2=0x7f7ccc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ccc0346a0 0x7f7ccc036b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c010 tx=0x7f7df8010000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 msgr2=0x562e9714f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2660596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e97148420 0x562e9714f5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7df40d1c50 tx=0x7f7df40aab70 comp rx=0 tx=0).stop 2024-09-13T06:29:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 reap_dead start 2024-09-13T06:29:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e03959640 1 -- 172.21.15.169:0/2660596 reap_dead start 2024-09-13T06:29:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 shutdown_connections 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 >> 172.21.15.169:0/2660596 conn(0x562e97144800 msgr2=0x562e971428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 shutdown_connections 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2660596 wait complete. 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7cdc034650 msgr2=0x7f7cdc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7cdc034650 0x7f7cdc036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x562e97122370 tx=0x7f7df800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 msgr2=0x562e9713be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 0x562e9713be50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7df40030b0 tx=0x7f7df40076e0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 shutdown_connections 2024-09-13T06:29:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7cdc034650 0x7f7cdc036b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2087747300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9713ba30 0x562e9713be50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 >> 172.21.15.169:0/2087747300 conn(0x562e97130b80 msgr2=0x562e97133600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 shutdown_connections 2024-09-13T06:29:18.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2087747300 wait complete. 2024-09-13T06:29:18.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e971260d0 msgr2=0x562e971284c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e971260d0 0x562e971284c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9702c230 msgr2=0x562e97124d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9702c230 0x562e97124d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9712b750 msgr2=0x562e9712db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9712b750 0x562e9712db40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ce8034650 msgr2=0x7f7ce8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ce8034650 0x7f7ce8036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7df8000f70 tx=0x7f7df80010b0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 msgr2=0x562e9711dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 --2- 172.21.15.169:0/2819488379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9702b8e0 0x562e9711dd80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7df4018eb0 tx=0x7f7df4018020 comp rx=0 tx=0).stop 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e03959640 1 -- 172.21.15.169:0/2819488379 reap_dead start 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 shutdown_connections 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 >> 172.21.15.169:0/2819488379 conn(0x562e96f9f230 msgr2=0x562e97111200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 shutdown_connections 2024-09-13T06:29:18.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.745+0000 7f7e05648980 1 -- 172.21.15.169:0/2819488379 wait complete. 2024-09-13T06:29:18.774 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:18.774 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T06:29:18.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T06:29:18.774 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T06:29:18.833 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:18.833 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:18.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.829+0000 7fb44a7f8980 1 Processor -- start 2024-09-13T06:29:18.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb44a7f8980 1 -- start start 2024-09-13T06:29:18.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb44a7f8980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ac4781b90 0x560ac4780350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb44a7f8980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ac4693ae0 con 0x560ac4781fa0 2024-09-13T06:29:18.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb44a7f8980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x560ac46b7e30 con 0x560ac4781b90 2024-09-13T06:29:18.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb448308640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ac4781b90 0x560ac4780350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb447b07640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x560ac4781fa0 0x560ac4780890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45048/0 (socket says 172.21.15.169:45048) 2024-09-13T06:29:18.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb447b07640 1 -- 172.21.15.169:0/420211598 learned_addr learned my addr 172.21.15.169:0/420211598 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:18.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb448308640 1 -- 172.21.15.169:0/420211598 >> v1:172.21.15.112:6789/0 conn(0x560ac4781fa0 legacy=0x560ac4780890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb448308640 1 -- 172.21.15.169:0/420211598 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac47810c0 con 0x560ac4781b90 2024-09-13T06:29:18.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb448308640 1 --2- 172.21.15.169:0/420211598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac4780350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb43800a420 tx=0x7fb43801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb1a894d2a2d27c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb447306640 1 -- 172.21.15.169:0/420211598 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380af070 con 0x560ac4781b90 2024-09-13T06:29:18.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb447306640 1 -- 172.21.15.169:0/420211598 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4380aa530 con 0x560ac4781b90 2024-09-13T06:29:18.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.833+0000 7fb447306640 1 -- 172.21.15.169:0/420211598 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380aa850 con 0x560ac4781b90 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 -- 172.21.15.169:0/420211598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 msgr2=0x560ac4780350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/420211598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac4780350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb43800a420 tx=0x7fb43801afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 -- 172.21.15.169:0/420211598 shutdown_connections 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/420211598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac4780350 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 -- 172.21.15.169:0/420211598 >> 172.21.15.169:0/420211598 conn(0x560ac4807170 msgr2=0x560ac4809590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 -- 172.21.15.169:0/420211598 shutdown_connections 2024-09-13T06:29:18.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.837+0000 7fb44a7f8980 1 -- 172.21.15.169:0/420211598 wait complete. 2024-09-13T06:29:18.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 Processor -- start 2024-09-13T06:29:18.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- start start 2024-09-13T06:29:18.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ac46b9200 con 0x560ac4781b90 2024-09-13T06:29:18.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48f8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35558/0 (socket says 172.21.15.169:35558) 2024-09-13T06:29:18.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb448308640 1 -- 172.21.15.169:0/2306420188 learned_addr learned my addr 172.21.15.169:0/2306420188 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb448308640 1 -- 172.21.15.169:0/2306420188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac48f9220 con 0x560ac4781b90 2024-09-13T06:29:18.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb448308640 1 --2- 172.21.15.169:0/2306420188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48f8c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ad040 tx=0x7fb4380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfad7ed87046756 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb33660c640 1 -- 172.21.15.169:0/2306420188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380af040 con 0x560ac4781b90 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb33660c640 1 -- 172.21.15.169:0/2306420188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4380aab50 con 0x560ac4781b90 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb33660c640 1 -- 172.21.15.169:0/2306420188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380aae50 con 0x560ac4781b90 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2306420188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 msgr2=0x560ac48f8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2306420188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48f8c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ad040 tx=0x7fb4380033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2306420188 shutdown_connections 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2306420188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48f8c50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2306420188 >> 172.21.15.169:0/2306420188 conn(0x560ac4807170 msgr2=0x560ac48f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2306420188 shutdown_connections 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2306420188 wait complete. 2024-09-13T06:29:18.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 Processor -- start 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.849+0000 7fb44a7f8980 1 -- start start 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ac48171c0 con 0x560ac4781b90 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48ffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35572/0 (socket says 172.21.15.169:35572) 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448308640 1 -- 172.21.15.169:0/1451296385 learned_addr learned my addr 172.21.15.169:0/1451296385 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448308640 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4900400 con 0x560ac4781b90 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448308640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48ffec0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb438018c00 tx=0x7fb438017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb334e09640 1 -- 172.21.15.169:0/1451296385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380c5070 con 0x560ac4781b90 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb334e09640 1 -- 172.21.15.169:0/1451296385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4380b58f0 con 0x560ac4781b90 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ac4900690 con 0x560ac4781b90 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb334e09640 1 -- 172.21.15.169:0/1451296385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380b5bf0 con 0x560ac4781b90 2024-09-13T06:29:18.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac4903370 con 0x560ac4781b90 2024-09-13T06:29:18.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb334e09640 1 -- 172.21.15.169:0/1451296385 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb4380c8070 con 0x560ac4781b90 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb334e09640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb330034650 0x7fb330036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb334e09640 1 -- 172.21.15.169:0/1451296385 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fb4380bb070 con 0x560ac4781b90 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb447b07640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb330034650 0x7fb330036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac4781fa0 0x560ac4906fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4907500 con 0x560ac4781fa0 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448b09640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac4781fa0 0x560ac4906fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb447b07640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb330034650 0x7fb330036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb430000f70 tx=0x7fb4300012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448b09640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac4781fa0 0x560ac4906fc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb448b09640 1 -- 172.21.15.169:0/1451296385 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac4781fa0 2024-09-13T06:29:18.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4908260 0x560ac490a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.853+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac490ac80 con 0x560ac4908260 2024-09-13T06:29:18.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb448308640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4908260 0x560ac490a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb448308640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4908260 0x560ac490a650 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb448308640 1 -- 172.21.15.169:0/1451296385 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4908260 2024-09-13T06:29:18.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac490c530 con 0x560ac4908260 2024-09-13T06:29:18.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb448308640 1 -- 172.21.15.169:0/1451296385 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4908260 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac490b760 con 0x560ac4908260 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb448308640 1 -- 172.21.15.169:0/1451296385 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4908260 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac490d8e0 0x560ac490fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4910210 con 0x560ac490d8e0 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb447b07640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac490d8e0 0x560ac490fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb447b07640 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac490d8e0 0x560ac490fcd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.857+0000 7fb447b07640 1 -- 172.21.15.169:0/1451296385 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb43000e620 con 0x560ac490d8e0 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 Processor -- start 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 -- start start 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 0x560ac491dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ac4712800 con 0x560ac491dbd0 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 0x560ac491dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 0x560ac491dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35576/0 (socket says 172.21.15.169:35576) 2024-09-13T06:29:18.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb448308640 1 -- 172.21.15.169:0/2512450027 learned_addr learned my addr 172.21.15.169:0/2512450027 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb448308640 1 -- 172.21.15.169:0/2512450027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac491e530 con 0x560ac491dbd0 2024-09-13T06:29:18.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb448308640 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 0x560ac491dff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb4380bf520 tx=0x7fb4380c0d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb32dffb640 1 -- 172.21.15.169:0/2512450027 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380c03e0 con 0x560ac491dbd0 2024-09-13T06:29:18.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb32dffb640 1 -- 172.21.15.169:0/2512450027 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4380c0580 con 0x560ac491dbd0 2024-09-13T06:29:18.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ac491e760 con 0x560ac491dbd0 2024-09-13T06:29:18.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb32dffb640 1 -- 172.21.15.169:0/2512450027 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380c0880 con 0x560ac491dbd0 2024-09-13T06:29:18.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac491e760 con 0x560ac491dbd0 2024-09-13T06:29:18.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb32dffb640 1 -- 172.21.15.169:0/2512450027 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb4380e4520 con 0x560ac491dbd0 2024-09-13T06:29:18.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb32dffb640 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb320034600 0x7fb320036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb32dffb640 1 -- 172.21.15.169:0/2512450027 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fb4380e60b0 con 0x560ac491dbd0 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb447b07640 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb320034600 0x7fb320036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 Processor -- start 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb44a7f8980 1 -- start start 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.861+0000 7fb447b07640 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb320034600 0x7fb320036ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb43000bf60 tx=0x7fb43000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac492a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ac48f9540 con 0x560ac492a100 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac492a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac492a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35590/0 (socket says 172.21.15.169:35590) 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 -- 172.21.15.169:0/2210644166 learned_addr learned my addr 172.21.15.169:0/2210644166 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 -- 172.21.15.169:0/2210644166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac492aad0 con 0x560ac492a100 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 --2- 172.21.15.169:0/2210644166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac492a500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ccfd0 tx=0x7fb4380ca940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba29b74828dbe09b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb3277fe640 1 -- 172.21.15.169:0/2210644166 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380c3110 con 0x560ac492a100 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb3277fe640 1 -- 172.21.15.169:0/2210644166 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4380b9130 con 0x560ac492a100 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb3277fe640 1 -- 172.21.15.169:0/2210644166 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380c32b0 con 0x560ac492a100 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2210644166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 msgr2=0x560ac492a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2210644166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac492a500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ccfd0 tx=0x7fb4380ca940 comp rx=0 tx=0).stop 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2210644166 shutdown_connections 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2210644166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac492a500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2210644166 >> 172.21.15.169:0/2210644166 conn(0x560ac4926530 msgr2=0x560ac4924630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2210644166 shutdown_connections 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2210644166 wait complete. 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 Processor -- start 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- start start 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac4931370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ac492afa0 con 0x560ac492a100 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac4931370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac4931370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35598/0 (socket says 172.21.15.169:35598) 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 learned_addr learned my addr 172.21.15.169:0/1337554003 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac49318b0 con 0x560ac492a100 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb448308640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac4931370 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb4380dafd0 tx=0x7fb4380a8f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb325ffb640 1 -- 172.21.15.169:0/1337554003 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380d2810 con 0x560ac492a100 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ac49318b0 con 0x560ac492a100 2024-09-13T06:29:18.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb325ffb640 1 -- 172.21.15.169:0/1337554003 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4380d29b0 con 0x560ac492a100 2024-09-13T06:29:18.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb325ffb640 1 -- 172.21.15.169:0/1337554003 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380cada0 con 0x560ac492a100 2024-09-13T06:29:18.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.865+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac4931d20 con 0x560ac492a100 2024-09-13T06:29:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb325ffb640 1 -- 172.21.15.169:0/1337554003 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb438114020 con 0x560ac492a100 2024-09-13T06:29:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb325ffb640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb318034650 0x7fb318036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb325ffb640 1 -- 172.21.15.169:0/1337554003 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fb438112020 con 0x560ac492a100 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb447b07640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb318034650 0x7fb318036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac493c480 0x560ac493e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac493f070 con 0x560ac493c480 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448b09640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac493c480 0x560ac493e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb447b07640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb318034650 0x7fb318036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x560ac490c4c0 tx=0x7fb430010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448b09640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac493c480 0x560ac493e920 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 realm 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac493b970 con 0x560ac493c480 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac493fb40 con 0x560ac493c480 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4940920 0x560ac4942d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448308640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4940920 0x560ac4942d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.869+0000 7fb448308640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4940920 0x560ac4942d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943be0 con 0x560ac4940920 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 20 searching for the correct realm 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac4945490 0x560ac4947950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4948020 con 0x560ac4945490 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb447b07640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac4945490 0x560ac4947950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb447b07640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac4945490 0x560ac4947950 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4948020 con 0x560ac4940920 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448308640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb438103020 0x7fb4380c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x7fb438103020 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb438103020 0x7fb4380c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb438103020 0x7fb4380c4570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4945490 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.873+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x7fb438103020 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x7fb438103020 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4945490 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4945490 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.877+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4945490 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x7fb438103020 2024-09-13T06:29:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac493c480 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x7fb438103020 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4945490 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x7fb438103020 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4945490 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.881+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943390 con 0x560ac4940920 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943880 con 0x560ac493c480 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943c70 con 0x560ac4940920 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4943c70 con 0x560ac4945490 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 zone default found 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 4 Realm: () 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 zonegroup default 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac49484a0 con 0x7fb438103020 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac494a6d0 con 0x560ac4945490 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac494aa70 con 0x560ac4945490 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 started sync module instance, tier type = 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.885+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac4949b10 con 0x560ac4940920 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94604247736064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac4949b10 con 0x560ac4940920 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494b2c0 con 0x560ac493c480 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94604247739920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494bb10 con 0x560ac493c480 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494c530 con 0x560ac4940920 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94604247736064] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94604247739920] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94604247744544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494b660 con 0x560ac4940920 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.889+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494ce00 con 0x7fb438103020 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94604247746896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494b660 con 0x7fb438103020 2024-09-13T06:29:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494d880 con 0x560ac4940920 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94604247744544] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94604247746896] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94604247747952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494d390 con 0x560ac4940920 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.893+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494e120 con 0x560ac4945490 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94604247751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494d390 con 0x560ac4945490 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494ef90 con 0x560ac4945490 2024-09-13T06:29:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94604247747952] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94604247751792] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94604247733856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494ef90 con 0x560ac4945490 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494f7e0 con 0x7fb438103020 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94604247757168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494fc50 con 0x7fb438103020 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=0 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=1 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=2 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=3 2024-09-13T06:29:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=4 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=5 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94604247733856] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=6 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94604247757168] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 20 add_watcher() i=7 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac494eae0 con 0x560ac493c480 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.897+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94604247755488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49501d0 con 0x560ac493c480 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94604247755488] v31'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb2fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 5 note: GC not initialized 2024-09-13T06:29:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb2fd7e2640 20 reqs_thread_entry: start 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 20 Filter name: none 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb26effd640 20 reqs_thread_entry: start 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 20 rados->read ofs=0 len=0 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac49763b0 con 0x560ac493c480 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4975e90 con 0x7fb438103020 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.901+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac497c670 con 0x560ac493c480 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb44a7f8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb44a7f8980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb44a7f8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94604247941888 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ac4979390 con 0x560ac4940920 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94604247747952 notify 133143986178 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fb4380da040 con 0x560ac4940920 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb3277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94604247747952 notifier 4323 bl.length()=567 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb3277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.4 [notify cookie 94604247941888 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb3277fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb3277fe640 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb30c003eb0 con 0x560ac4940920 2024-09-13T06:29:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94604247941888 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb4380da420 con 0x560ac4940920 2024-09-13T06:29:18.914 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb2fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.905+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94604247755488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49741e0 con 0x560ac493c480 2024-09-13T06:29:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.909+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94604247755488] v31'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.909+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94604247736064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49741e0 con 0x560ac4940920 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.909+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94604247736064] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.909+0000 7fb44a7f8980 20 remove_watcher() i=0 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.909+0000 7fb44a7f8980 2 removed watcher, disabling cache 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.909+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94604247739920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49741e0 con 0x560ac493c480 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94604247739920] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x560ac493c480 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb44a7f8980 20 remove_watcher() i=1 2024-09-13T06:29:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94604247744544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49741e0 con 0x560ac4940920 2024-09-13T06:29:18.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94604247744544] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb44a7f8980 20 remove_watcher() i=2 2024-09-13T06:29:18.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94604247746896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494c020 con 0x7fb438103020 2024-09-13T06:29:18.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94604247746896] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb44a7f8980 20 remove_watcher() i=3 2024-09-13T06:29:18.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.913+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94604247747952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49741e0 con 0x560ac4940920 2024-09-13T06:29:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb448308640 1 -- 172.21.15.169:0/1337554003 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94604247747952] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4380d1070 con 0x560ac4940920 2024-09-13T06:29:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 20 remove_watcher() i=4 2024-09-13T06:29:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94604247751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494c020 con 0x560ac4945490 2024-09-13T06:29:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94604247751792] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 20 remove_watcher() i=5 2024-09-13T06:29:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94604247733856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac49741e0 con 0x560ac4945490 2024-09-13T06:29:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb447b07640 1 -- 172.21.15.169:0/1337554003 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94604247733856] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43000e620 con 0x560ac4945490 2024-09-13T06:29:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 20 remove_watcher() i=6 2024-09-13T06:29:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94604247757168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ac494c020 con 0x7fb438103020 2024-09-13T06:29:18.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94604247757168] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400083f0 con 0x7fb438103020 2024-09-13T06:29:18.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.917+0000 7fb44a7f8980 20 remove_watcher() i=7 2024-09-13T06:29:18.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4940920 msgr2=0x560ac4942d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4940920 0x560ac4942d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac493c480 msgr2=0x560ac493e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac493c480 0x560ac493e920 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb438103020 msgr2=0x7fb4380c4570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb438103020 0x7fb4380c4570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac4945490 msgr2=0x560ac4947950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac4945490 0x560ac4947950 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb318034650 msgr2=0x7fb318036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb318034650 0x7fb318036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x560ac490c4c0 tx=0x7fb430010000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 msgr2=0x560ac4931370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb448b09640 1 -- 172.21.15.169:0/1337554003 reap_dead start 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac4931370 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb4380dafd0 tx=0x7fb4380a8f70 comp rx=0 tx=0).stop 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 shutdown_connections 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1337554003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac492a100 0x560ac4931370 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 >> 172.21.15.169:0/1337554003 conn(0x560ac4926530 msgr2=0x560ac4924600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 shutdown_connections 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1337554003 wait complete. 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb320034600 msgr2=0x7fb320036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb320034600 0x7fb320036ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb43000bf60 tx=0x7fb43000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 msgr2=0x560ac491dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 0x560ac491dff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb4380bf520 tx=0x7fb4380c0d80 comp rx=0 tx=0).stop 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 shutdown_connections 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb320034600 0x7fb320036ac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/2512450027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac491dbd0 0x560ac491dff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 >> 172.21.15.169:0/2512450027 conn(0x560ac4912d20 msgr2=0x560ac49157a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 shutdown_connections 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/2512450027 wait complete. 2024-09-13T06:29:18.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4908260 msgr2=0x560ac490a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ac4908260 0x560ac490a650 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac4781fa0 msgr2=0x560ac4906fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ac4781fa0 0x560ac4906fc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac490d8e0 msgr2=0x560ac490fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ac490d8e0 0x560ac490fcd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb330034650 msgr2=0x7fb330036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb330034650 0x7fb330036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb430000f70 tx=0x7fb4300012c0 comp rx=0 tx=0).stop 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 msgr2=0x560ac48ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 --2- 172.21.15.169:0/1451296385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ac4781b90 0x560ac48ffec0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb438018c00 tx=0x7fb438017d70 comp rx=0 tx=0).stop 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb448b09640 1 -- 172.21.15.169:0/1451296385 reap_dead start 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 shutdown_connections 2024-09-13T06:29:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 >> 172.21.15.169:0/1451296385 conn(0x560ac4807170 msgr2=0x560ac48f3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:18.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 shutdown_connections 2024-09-13T06:29:18.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:18.921+0000 7fb44a7f8980 1 -- 172.21.15.169:0/1451296385 wait complete. 2024-09-13T06:29:18.932 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:18.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:18.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:18.933 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:19.006 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:19.006 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:19.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff629cba980 1 Processor -- start 2024-09-13T06:29:19.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff629cba980 1 -- start start 2024-09-13T06:29:19.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff629cba980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55aebd611ac0 0x55aebd613eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff629cba980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aebd495ae0 con 0x55aebd582290 2024-09-13T06:29:19.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff629cba980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55aebd4b9e30 con 0x55aebd611ac0 2024-09-13T06:29:19.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff626fc9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55aebd611ac0 0x55aebd613eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff6277ca640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55aebd582290 0x55aebd6103a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45064/0 (socket says 172.21.15.169:45064) 2024-09-13T06:29:19.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff6277ca640 1 -- 172.21.15.169:0/463726753 learned_addr learned my addr 172.21.15.169:0/463726753 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:19.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff6267c8640 1 -- 172.21.15.169:0/463726753 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824163013 0 0) 0x55aebd495ae0 con 0x55aebd582290 2024-09-13T06:29:19.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff6267c8640 1 -- 172.21.15.169:0/463726753 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff614001e20 con 0x55aebd582290 2024-09-13T06:29:19.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff626fc9640 1 -- 172.21.15.169:0/463726753 >> v1:172.21.15.112:6789/0 conn(0x55aebd582290 legacy=0x55aebd6103a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.005+0000 7ff626fc9640 1 -- 172.21.15.169:0/463726753 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd582820 con 0x55aebd611ac0 2024-09-13T06:29:19.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff626fc9640 1 --2- 172.21.15.169:0/463726753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd611ac0 0x55aebd613eb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff61000a480 tx=0x7ff61001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2661d93d2b5558 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff6267c8640 1 -- 172.21.15.169:0/463726753 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6100b0070 con 0x55aebd611ac0 2024-09-13T06:29:19.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff6267c8640 1 -- 172.21.15.169:0/463726753 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6100ab540 con 0x55aebd611ac0 2024-09-13T06:29:19.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff6267c8640 1 -- 172.21.15.169:0/463726753 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6100ab820 con 0x55aebd611ac0 2024-09-13T06:29:19.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 -- 172.21.15.169:0/463726753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd611ac0 msgr2=0x55aebd613eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 --2- 172.21.15.169:0/463726753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd611ac0 0x55aebd613eb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff61000a480 tx=0x7ff61001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:19.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 -- 172.21.15.169:0/463726753 shutdown_connections 2024-09-13T06:29:19.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 --2- 172.21.15.169:0/463726753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd611ac0 0x55aebd613eb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 -- 172.21.15.169:0/463726753 >> 172.21.15.169:0/463726753 conn(0x55aebd608090 msgr2=0x55aebd60a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 -- 172.21.15.169:0/463726753 shutdown_connections 2024-09-13T06:29:19.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.009+0000 7ff629cba980 1 -- 172.21.15.169:0/463726753 wait complete. 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff629cba980 1 Processor -- start 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff629cba980 1 -- start start 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff629cba980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd60db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff629cba980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aebd4bb200 con 0x55aebd582290 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd60db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd60db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35614/0 (socket says 172.21.15.169:35614) 2024-09-13T06:29:19.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff6277ca640 1 -- 172.21.15.169:0/2361826025 learned_addr learned my addr 172.21.15.169:0/2361826025 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff6277ca640 1 -- 172.21.15.169:0/2361826025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd60e0d0 con 0x55aebd582290 2024-09-13T06:29:19.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.021+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2361826025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd60db00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff620006fc0 tx=0x7ff620001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df57cd2c7d6289f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff51560a640 1 -- 172.21.15.169:0/2361826025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620004530 con 0x55aebd582290 2024-09-13T06:29:19.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff51560a640 1 -- 172.21.15.169:0/2361826025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6200046d0 con 0x55aebd582290 2024-09-13T06:29:19.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff51560a640 1 -- 172.21.15.169:0/2361826025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620004a70 con 0x55aebd582290 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2361826025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 msgr2=0x55aebd60db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 --2- 172.21.15.169:0/2361826025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd60db00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff620006fc0 tx=0x7ff620001af0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2361826025 shutdown_connections 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 --2- 172.21.15.169:0/2361826025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd60db00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2361826025 >> 172.21.15.169:0/2361826025 conn(0x55aebd608090 msgr2=0x55aebd6f4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2361826025 shutdown_connections 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2361826025 wait complete. 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 Processor -- start 2024-09-13T06:29:19.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- start start 2024-09-13T06:29:19.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd701d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aebd614f00 con 0x55aebd582290 2024-09-13T06:29:19.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd701d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd701d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35616/0 (socket says 172.21.15.169:35616) 2024-09-13T06:29:19.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff6277ca640 1 -- 172.21.15.169:0/2313975817 learned_addr learned my addr 172.21.15.169:0/2313975817 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff6277ca640 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd7022b0 con 0x55aebd582290 2024-09-13T06:29:19.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd701d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff620002260 tx=0x7ff620000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff513e07640 1 -- 172.21.15.169:0/2313975817 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620013760 con 0x55aebd582290 2024-09-13T06:29:19.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff513e07640 1 -- 172.21.15.169:0/2313975817 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff620013900 con 0x55aebd582290 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff513e07640 1 -- 172.21.15.169:0/2313975817 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620013c20 con 0x55aebd582290 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebd702540 con 0x55aebd582290 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.025+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebd705220 con 0x55aebd582290 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff513e07640 1 -- 172.21.15.169:0/2313975817 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff620010070 con 0x55aebd582290 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff513e07640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff50c034650 0x7ff50c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff513e07640 1 -- 172.21.15.169:0/2313975817 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff620018070 con 0x55aebd582290 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff50c034650 0x7ff50c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd611ac0 0x55aebd708d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd7093b0 con 0x55aebd611ac0 2024-09-13T06:29:19.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff627fcb640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd611ac0 0x55aebd708d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff50c034650 0x7ff50c036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ad000 tx=0x7ff6100a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff627fcb640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd611ac0 0x55aebd708d40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff627fcb640 1 -- 172.21.15.169:0/2313975817 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd611ac0 2024-09-13T06:29:19.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd70a1a0 0x55aebd70c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd70cbd0 con 0x55aebd70a1a0 2024-09-13T06:29:19.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd70a1a0 0x55aebd70c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd70a1a0 0x55aebd70c590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff6277ca640 1 -- 172.21.15.169:0/2313975817 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff62001b030 con 0x55aebd70a1a0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd70e480 con 0x55aebd70a1a0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff6277ca640 1 -- 172.21.15.169:0/2313975817 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff62001b030 con 0x55aebd70a1a0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.029+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd70d6b0 con 0x55aebd70a1a0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff6277ca640 1 -- 172.21.15.169:0/2313975817 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff62001b030 con 0x55aebd70a1a0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd70f830 0x55aebd711c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd712160 con 0x55aebd70f830 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd70f830 0x55aebd711c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd70f830 0x55aebd711c20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff626fc9640 1 -- 172.21.15.169:0/2313975817 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6100b3040 con 0x55aebd70f830 2024-09-13T06:29:19.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 Processor -- start 2024-09-13T06:29:19.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 -- start start 2024-09-13T06:29:19.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 0x55aebd71ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aebd514800 con 0x55aebd71fb60 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 0x55aebd71ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 0x55aebd71ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35632/0 (socket says 172.21.15.169:35632) 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff6277ca640 1 -- 172.21.15.169:0/525252178 learned_addr learned my addr 172.21.15.169:0/525252178 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff6277ca640 1 -- 172.21.15.169:0/525252178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd7204c0 con 0x55aebd71fb60 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff6277ca640 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 0x55aebd71ff80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff620048450 tx=0x7ff620010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff511602640 1 -- 172.21.15.169:0/525252178 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620020450 con 0x55aebd71fb60 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebd720750 con 0x55aebd71fb60 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff511602640 1 -- 172.21.15.169:0/525252178 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6200123c0 con 0x55aebd71fb60 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff511602640 1 -- 172.21.15.169:0/525252178 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620012570 con 0x55aebd71fb60 2024-09-13T06:29:19.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.033+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebd720750 con 0x55aebd71fb60 2024-09-13T06:29:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff511602640 1 -- 172.21.15.169:0/525252178 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff620012710 con 0x55aebd71fb60 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff511602640 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff500034650 0x7ff500036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff511602640 1 -- 172.21.15.169:0/525252178 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff620053aa0 con 0x55aebd71fb60 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff626fc9640 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff500034650 0x7ff500036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 Processor -- start 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- start start 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff626fc9640 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff500034650 0x7ff500036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55aebd706360 tx=0x7ff610005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd72c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aebd60c2f0 con 0x55aebd72c370 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd72c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd72c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35640/0 (socket says 172.21.15.169:35640) 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 -- 172.21.15.169:0/3511736471 learned_addr learned my addr 172.21.15.169:0/3511736471 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 -- 172.21.15.169:0/3511736471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd72cd40 con 0x55aebd72c370 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 --2- 172.21.15.169:0/3511736471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd72c770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff620012f90 tx=0x7ff62003eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a72e59390ca244 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff50affd640 1 -- 172.21.15.169:0/3511736471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620061030 con 0x55aebd72c370 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff50affd640 1 -- 172.21.15.169:0/3511736471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff620048dd0 con 0x55aebd72c370 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff50affd640 1 -- 172.21.15.169:0/3511736471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620048b10 con 0x55aebd72c370 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- 172.21.15.169:0/3511736471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 msgr2=0x55aebd72c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 --2- 172.21.15.169:0/3511736471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd72c770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff620012f90 tx=0x7ff62003eac0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- 172.21.15.169:0/3511736471 shutdown_connections 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 --2- 172.21.15.169:0/3511736471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd72c770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- 172.21.15.169:0/3511736471 >> 172.21.15.169:0/3511736471 conn(0x55aebd728700 msgr2=0x55aebd726800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- 172.21.15.169:0/3511736471 shutdown_connections 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- 172.21.15.169:0/3511736471 wait complete. 2024-09-13T06:29:19.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 Processor -- start 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- start start 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd733540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff629cba980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aebd72d290 con 0x55aebd72c370 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd733540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd733540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35654/0 (socket says 172.21.15.169:35654) 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.037+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 learned_addr learned my addr 172.21.15.169:0/2162769671 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd733a80 con 0x55aebd72c370 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd733540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff62003ee10 tx=0x7ff62004fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff5097fa640 1 -- 172.21.15.169:0/2162769671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff62006e070 con 0x55aebd72c370 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff5097fa640 1 -- 172.21.15.169:0/2162769671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff620041c30 con 0x55aebd72c370 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebd733a80 con 0x55aebd72c370 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff5097fa640 1 -- 172.21.15.169:0/2162769671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff620061030 con 0x55aebd72c370 2024-09-13T06:29:19.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebd733a80 con 0x55aebd72c370 2024-09-13T06:29:19.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff5097fa640 1 -- 172.21.15.169:0/2162769671 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff620071070 con 0x55aebd72c370 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff5097fa640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff4f0034650 0x7ff4f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff5097fa640 1 -- 172.21.15.169:0/2162769671 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff620062070 con 0x55aebd72c370 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff4f0034650 0x7ff4f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd73e510 0x55aebd7409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd741120 con 0x55aebd73e510 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff627fcb640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd73e510 0x55aebd7409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff4f0034650 0x7ff4f0036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ae040 tx=0x7ff6100b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff627fcb640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd73e510 0x55aebd7409d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 realm 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd73d9c0 con 0x55aebd73e510 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd741bf0 con 0x55aebd73e510 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd7427d0 0x55aebd744c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd745400 con 0x55aebd7427d0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.041+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd7427d0 0x55aebd744c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd7427d0 0x55aebd744c90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd7417e0 con 0x55aebd7427d0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 20 searching for the correct realm 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd747170 0x55aebd749630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aebd749d00 con 0x55aebd747170 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd747170 0x55aebd749630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff626fc9640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd747170 0x55aebd749630 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aebd749d00 con 0x55aebd7427d0 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff6277ca640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff620073070 0x7ff62003e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x7ff620073070 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff627fcb640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff620073070 0x7ff62003e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff627fcb640 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff620073070 0x7ff62003e410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.045+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd747170 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x7ff620073070 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x7ff620073070 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd747170 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.049+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd747170 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd747170 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x7ff620073070 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd73e510 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x7ff620073070 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd747170 2024-09-13T06:29:19.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x7ff620073070 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.053+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd747170 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff620066040 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd745a90 con 0x55aebd73e510 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd745e80 con 0x55aebd7427d0 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd745e80 con 0x55aebd747170 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 zone default found 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 4 Realm: () 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 zonegroup default 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74a180 con 0x7ff620073070 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74bf00 con 0x55aebd747170 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74c2a0 con 0x55aebd747170 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 started sync module instance, tier type = 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.057+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74b3a0 con 0x55aebd7427d0 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94208991213696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74b3a0 con 0x55aebd7427d0 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74cca0 con 0x55aebd73e510 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94208991217584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74d540 con 0x55aebd73e510 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74df40 con 0x55aebd7427d0 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94208991213696] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.061+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94208991217584] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94208991211248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74d090 con 0x55aebd7427d0 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74e7e0 con 0x7ff620073070 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94208991224624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74d090 con 0x7ff620073070 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74f2a0 con 0x55aebd7427d0 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94208991224624] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94208991211248] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94208991222352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74f260 con 0x55aebd7427d0 2024-09-13T06:29:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.065+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74f690 con 0x55aebd747170 2024-09-13T06:29:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94208991225680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74ff30 con 0x55aebd747170 2024-09-13T06:29:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd750930 con 0x55aebd747170 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94208991222352] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94208991227248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd750d50 con 0x55aebd747170 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd751750 con 0x7ff620073070 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.069+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94208991225680] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94208991227248] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94208991233088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd751260 con 0x7ff620073070 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=0 2024-09-13T06:29:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=1 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=2 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=3 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=4 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=5 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.073+0000 7ff629cba980 20 add_watcher() i=6 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.077+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94208991233088] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.077+0000 7ff629cba980 20 add_watcher() i=7 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.077+0000 7ff629cba980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.077+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd751740 con 0x55aebd73e510 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.077+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.077+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94208991230592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd751fa0 con 0x55aebd73e510 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94208991230592] v31'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff4ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 5 note: GC not initialized 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff4dcfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:19.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 20 Filter name: none 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff4567fc640 20 reqs_thread_entry: start 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aebd777b80 con 0x55aebd73e510 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:19.086 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:19.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff4ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.081+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94208991230592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd776ad0 con 0x55aebd73e510 2024-09-13T06:29:19.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.085+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94208991230592] v31'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.085+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94208991213696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74fa80 con 0x55aebd7427d0 2024-09-13T06:29:19.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.085+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94208991213696] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.085+0000 7ff629cba980 20 remove_watcher() i=0 2024-09-13T06:29:19.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.085+0000 7ff629cba980 2 removed watcher, disabling cache 2024-09-13T06:29:19.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.085+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94208991217584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74fa80 con 0x55aebd73e510 2024-09-13T06:29:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94208991217584] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x55aebd73e510 2024-09-13T06:29:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff629cba980 20 remove_watcher() i=1 2024-09-13T06:29:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94208991211248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74fa80 con 0x55aebd7427d0 2024-09-13T06:29:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94208991211248] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff629cba980 20 remove_watcher() i=2 2024-09-13T06:29:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94208991224624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74aef0 con 0x7ff620073070 2024-09-13T06:29:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94208991224624] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff629cba980 20 remove_watcher() i=3 2024-09-13T06:29:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.089+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94208991222352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74fa80 con 0x55aebd7427d0 2024-09-13T06:29:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff6277ca640 1 -- 172.21.15.169:0/2162769671 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94208991222352] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff62007a070 con 0x55aebd7427d0 2024-09-13T06:29:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff629cba980 20 remove_watcher() i=4 2024-09-13T06:29:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94208991225680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74e330 con 0x55aebd747170 2024-09-13T06:29:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94208991225680] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff629cba980 20 remove_watcher() i=5 2024-09-13T06:29:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94208991227248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74e7b0 con 0x55aebd747170 2024-09-13T06:29:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff626fc9640 1 -- 172.21.15.169:0/2162769671 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94208991227248] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6100c9030 con 0x55aebd747170 2024-09-13T06:29:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff629cba980 20 remove_watcher() i=6 2024-09-13T06:29:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.093+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94208991233088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aebd74fa80 con 0x7ff620073070 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94208991233088] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6180083f0 con 0x7ff620073070 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 20 remove_watcher() i=7 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd7427d0 msgr2=0x55aebd744c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd7427d0 0x55aebd744c90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd73e510 msgr2=0x55aebd7409d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd73e510 0x55aebd7409d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff620073070 msgr2=0x7ff62003e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ff620073070 0x7ff62003e410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd747170 msgr2=0x55aebd749630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd747170 0x55aebd749630 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff4f0034650 msgr2=0x7ff4f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff4f0034650 0x7ff4f0036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ae040 tx=0x7ff6100b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 msgr2=0x55aebd733540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff627fcb640 1 -- 172.21.15.169:0/2162769671 reap_dead start 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd733540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff62003ee10 tx=0x7ff62004fed0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 shutdown_connections 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2162769671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd72c370 0x55aebd733540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 >> 172.21.15.169:0/2162769671 conn(0x55aebd728700 msgr2=0x55aebd7267d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 shutdown_connections 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2162769671 wait complete. 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff500034650 msgr2=0x7ff500036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff500034650 0x7ff500036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55aebd706360 tx=0x7ff610005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 msgr2=0x55aebd71ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 0x55aebd71ff80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff620048450 tx=0x7ff620010d70 comp rx=0 tx=0).stop 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 shutdown_connections 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff500034650 0x7ff500036b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/525252178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd71fb60 0x55aebd71ff80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 >> 172.21.15.169:0/525252178 conn(0x55aebd714cb0 msgr2=0x55aebd717730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 shutdown_connections 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/525252178 wait complete. 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd70a1a0 msgr2=0x55aebd70c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55aebd70a1a0 0x55aebd70c590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd611ac0 msgr2=0x55aebd708d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55aebd611ac0 0x55aebd708d40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd70f830 msgr2=0x55aebd711c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55aebd70f830 0x55aebd711c20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff50c034650 msgr2=0x7ff50c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ff50c034650 0x7ff50c036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ad000 tx=0x7ff6100a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 msgr2=0x55aebd701d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 --2- 172.21.15.169:0/2313975817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aebd582290 0x55aebd701d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff620002260 tx=0x7ff620000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff627fcb640 1 -- 172.21.15.169:0/2313975817 reap_dead start 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 shutdown_connections 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 >> 172.21.15.169:0/2313975817 conn(0x55aebd608090 msgr2=0x55aebd6f4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 shutdown_connections 2024-09-13T06:29:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.097+0000 7ff629cba980 1 -- 172.21.15.169:0/2313975817 wait complete. 2024-09-13T06:29:19.112 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:19.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T06:29:19.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T06:29:19.113 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T06:29:19.183 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:19.183 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:19.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238884b980 1 Processor -- start 2024-09-13T06:29:19.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238884b980 1 -- start start 2024-09-13T06:29:19.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238884b980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5653bf9ca230 0x5653bfa5a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238884b980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653bf8ddae0 con 0x5653bfa5ac80 2024-09-13T06:29:19.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238884b980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5653bf901e30 con 0x5653bf9ca230 2024-09-13T06:29:19.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238635b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5653bf9ca230 0x5653bfa5a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238635b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5653bf9ca230 0x5653bfa5a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35670/0 (socket says 172.21.15.169:35670) 2024-09-13T06:29:19.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238635b640 1 -- 172.21.15.169:0/251051640 learned_addr learned my addr 172.21.15.169:0/251051640 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238635b640 1 -- 172.21.15.169:0/251051640 >> v1:172.21.15.112:6789/0 conn(0x5653bfa5ac80 legacy=0x5653bfa5d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.181+0000 7f238635b640 1 -- 172.21.15.169:0/251051640 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bf9ca610 con 0x5653bf9ca230 2024-09-13T06:29:19.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238635b640 1 --2- 172.21.15.169:0/251051640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfa5a740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f238000a4e0 tx=0x7f238001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4b465686c15bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f2385359640 1 -- 172.21.15.169:0/251051640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800aa540 con 0x5653bf9ca230 2024-09-13T06:29:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f2385359640 1 -- 172.21.15.169:0/251051640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800aa6e0 con 0x5653bf9ca230 2024-09-13T06:29:19.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f2385359640 1 -- 172.21.15.169:0/251051640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800aaa40 con 0x5653bf9ca230 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 -- 172.21.15.169:0/251051640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 msgr2=0x5653bfa5a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 --2- 172.21.15.169:0/251051640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfa5a740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f238000a4e0 tx=0x7f238001b090 comp rx=0 tx=0).stop 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 -- 172.21.15.169:0/251051640 shutdown_connections 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 --2- 172.21.15.169:0/251051640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfa5a740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 -- 172.21.15.169:0/251051640 >> 172.21.15.169:0/251051640 conn(0x5653bfa50030 msgr2=0x5653bfa52450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 -- 172.21.15.169:0/251051640 shutdown_connections 2024-09-13T06:29:19.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.185+0000 7f238884b980 1 -- 172.21.15.169:0/251051640 wait complete. 2024-09-13T06:29:19.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.197+0000 7f238884b980 1 Processor -- start 2024-09-13T06:29:19.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.197+0000 7f238884b980 1 -- start start 2024-09-13T06:29:19.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.197+0000 7f238884b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb42cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.197+0000 7f238884b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5653bf903200 con 0x5653bf9ca230 2024-09-13T06:29:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb42cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb42cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35674/0 (socket says 172.21.15.169:35674) 2024-09-13T06:29:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 -- 172.21.15.169:0/3857223283 learned_addr learned my addr 172.21.15.169:0/3857223283 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 -- 172.21.15.169:0/3857223283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bfb432a0 con 0x5653bf9ca230 2024-09-13T06:29:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 --2- 172.21.15.169:0/3857223283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb42cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2380018cc0 tx=0x7f23800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6644bf56be2a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f2274608640 1 -- 172.21.15.169:0/3857223283 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800b9030 con 0x5653bf9ca230 2024-09-13T06:29:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f2274608640 1 -- 172.21.15.169:0/3857223283 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800aaa80 con 0x5653bf9ca230 2024-09-13T06:29:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f2274608640 1 -- 172.21.15.169:0/3857223283 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800aad80 con 0x5653bf9ca230 2024-09-13T06:29:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- 172.21.15.169:0/3857223283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 msgr2=0x5653bfb42cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 --2- 172.21.15.169:0/3857223283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb42cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2380018cc0 tx=0x7f23800033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- 172.21.15.169:0/3857223283 shutdown_connections 2024-09-13T06:29:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 --2- 172.21.15.169:0/3857223283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb42cd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- 172.21.15.169:0/3857223283 >> 172.21.15.169:0/3857223283 conn(0x5653bfa50030 msgr2=0x5653bfb3e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- 172.21.15.169:0/3857223283 shutdown_connections 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- 172.21.15.169:0/3857223283 wait complete. 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 Processor -- start 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- start start 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb49fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238884b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5653bfa611c0 con 0x5653bf9ca230 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb49fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb49fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35682/0 (socket says 172.21.15.169:35682) 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 -- 172.21.15.169:0/1088725988 learned_addr learned my addr 172.21.15.169:0/1088725988 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bfb4a520 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.201+0000 7f238635b640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb49fe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2380018cc0 tx=0x7f2380017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2272e05640 1 -- 172.21.15.169:0/1088725988 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800b9070 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653bfb4a7b0 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2272e05640 1 -- 172.21.15.169:0/1088725988 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800c3030 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2272e05640 1 -- 172.21.15.169:0/1088725988 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800bf790 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bfb4d490 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2272e05640 1 -- 172.21.15.169:0/1088725988 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f23800b3040 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2272e05640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f226c0346a0 0x7f226c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2272e05640 1 -- 172.21.15.169:0/1088725988 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f23800ba070 con 0x5653bf9ca230 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f226c0346a0 0x7f226c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfa5ac80 0x5653bfb50f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb51540 con 0x5653bfa5ac80 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2386b5c640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfa5ac80 0x5653bfb50f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f226c0346a0 0x7f226c036b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2370001e20 tx=0x7f23700013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2386b5c640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfa5ac80 0x5653bfb50f70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f2386b5c640 1 -- 172.21.15.169:0/1088725988 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfa5ac80 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb52380 0x5653bfb54770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb54dd0 con 0x5653bfb52380 2024-09-13T06:29:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238635b640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb52380 0x5653bfb54770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.205+0000 7f238635b640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb52380 0x5653bfb54770 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 -- 172.21.15.169:0/1088725988 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23800cf070 con 0x5653bfb52380 2024-09-13T06:29:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb56680 con 0x5653bfb52380 2024-09-13T06:29:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 -- 172.21.15.169:0/1088725988 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f23800cf070 con 0x5653bfb52380 2024-09-13T06:29:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb558b0 con 0x5653bfb52380 2024-09-13T06:29:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 -- 172.21.15.169:0/1088725988 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23800cf070 con 0x5653bfb52380 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb57a30 0x5653bfb59e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb5a360 con 0x5653bfb57a30 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb57a30 0x5653bfb59e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb57a30 0x5653bfb59e20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f2385b5a640 1 -- 172.21.15.169:0/1088725988 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f237000d040 con 0x5653bfb57a30 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 Processor -- start 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 -- start start 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 0x5653bfb68210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238884b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5653bf95c800 con 0x5653bfb67df0 2024-09-13T06:29:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 0x5653bfb68210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 0x5653bfb68210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35692/0 (socket says 172.21.15.169:35692) 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 -- 172.21.15.169:0/3555392456 learned_addr learned my addr 172.21.15.169:0/3555392456 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.209+0000 7f238635b640 1 -- 172.21.15.169:0/3555392456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bfb68750 con 0x5653bfb67df0 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238635b640 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 0x5653bfb68210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23800c7540 tx=0x7f2380007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f226bfff640 1 -- 172.21.15.169:0/3555392456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2380005250 con 0x5653bfb67df0 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653bfb689e0 con 0x5653bfb67df0 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bfb6b660 con 0x5653bfb67df0 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f226bfff640 1 -- 172.21.15.169:0/3555392456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800053f0 con 0x5653bfb67df0 2024-09-13T06:29:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f226bfff640 1 -- 172.21.15.169:0/3555392456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800e22b0 con 0x5653bfb67df0 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f226bfff640 1 -- 172.21.15.169:0/3555392456 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f23800bf980 con 0x5653bfb67df0 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f226bfff640 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2260034650 0x7f2260036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f226bfff640 1 -- 172.21.15.169:0/3555392456 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f23800e06e0 con 0x5653bfb67df0 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f2385b5a640 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2260034650 0x7f2260036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238884b980 1 Processor -- start 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238884b980 1 -- start start 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f2385b5a640 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2260034650 0x7f2260036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5653bfb5a760 tx=0x7f2370006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238884b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb74b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238884b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5653bfb43560 con 0x5653bfb74770 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb74b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb74b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35700/0 (socket says 172.21.15.169:35700) 2024-09-13T06:29:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238635b640 1 -- 172.21.15.169:0/2005775401 learned_addr learned my addr 172.21.15.169:0/2005775401 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238635b640 1 -- 172.21.15.169:0/2005775401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bfb75140 con 0x5653bfb74770 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f238635b640 1 --2- 172.21.15.169:0/2005775401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb74b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f23800beff0 tx=0x7f23800d3cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e78a728cc6c16d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f2269ffb640 1 -- 172.21.15.169:0/2005775401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800bfc70 con 0x5653bfb74770 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f2269ffb640 1 -- 172.21.15.169:0/2005775401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800fd070 con 0x5653bfb74770 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.213+0000 7f2269ffb640 1 -- 172.21.15.169:0/2005775401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800a93c0 con 0x5653bfb74770 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/2005775401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 msgr2=0x5653bfb74b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 --2- 172.21.15.169:0/2005775401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb74b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f23800beff0 tx=0x7f23800d3cf0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/2005775401 shutdown_connections 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 --2- 172.21.15.169:0/2005775401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb74b70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/2005775401 >> 172.21.15.169:0/2005775401 conn(0x5653bfb70b00 msgr2=0x5653bfb6ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/2005775401 shutdown_connections 2024-09-13T06:29:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/2005775401 wait complete. 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 Processor -- start 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- start start 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb7b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5653bfb75690 con 0x5653bfb74770 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb7b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238635b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb7b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35714/0 (socket says 172.21.15.169:35714) 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 learned_addr learned my addr 172.21.15.169:0/1791516162 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bfb7be70 con 0x5653bfb74770 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238635b640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb7b930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f23800e26e0 tx=0x7f23800bd7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f2257fff640 1 -- 172.21.15.169:0/1791516162 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238010b070 con 0x5653bfb74770 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f2257fff640 1 -- 172.21.15.169:0/1791516162 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23800a93c0 con 0x5653bfb74770 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653bfb7be70 con 0x5653bfb74770 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f2257fff640 1 -- 172.21.15.169:0/1791516162 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23800a98e0 con 0x5653bfb74770 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bfb7be70 con 0x5653bfb74770 2024-09-13T06:29:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.217+0000 7f2257fff640 1 -- 172.21.15.169:0/1791516162 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f238010e070 con 0x5653bfb74770 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2257fff640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2250034650 0x7f2250036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2257fff640 1 -- 172.21.15.169:0/1791516162 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f23800f4050 con 0x5653bfb74770 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2250034650 0x7f2250036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfb86900 0x5653bfb88d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb894e0 con 0x5653bfb86900 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2386b5c640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfb86900 0x5653bfb88d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2250034650 0x7f2250036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23700207d0 tx=0x7f2370011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2386b5c640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfb86900 0x5653bfb88d90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 realm 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb85e40 con 0x5653bfb86900 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb89fa0 con 0x5653bfb86900 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb8ad80 0x5653bfb8d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb8d800 con 0x5653bfb8ad80 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238635b640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb8ad80 0x5653bfb8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238635b640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb8ad80 0x5653bfb8d170 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb8e050 con 0x5653bfb8ad80 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 20 searching for the correct realm 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb8fdc0 0x5653bfb921b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.221+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb8fdc0 0x5653bfb921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2385b5a640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb8fdc0 0x5653bfb921b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2380110070 0x7f23800cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x7f2380110070 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2380110070 0x7f23800cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2380110070 0x7f23800cc760 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.225+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x7f2380110070 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x7f2380110070 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.229+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x7f2380110070 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb86900 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x7f2380110070 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x7f2380110070 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8fdc0 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb92830 con 0x5653bfb8ad80 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb8e9d0 con 0x5653bfb86900 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.233+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb8f270 con 0x5653bfb8ad80 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb8e610 con 0x5653bfb8fdc0 2024-09-13T06:29:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 zone default found 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 4 Realm: () 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 zonegroup default 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb93140 con 0x7f2380110070 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb94ef0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb953e0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 started sync module instance, tier type = 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb94360 con 0x5653bfb8ad80 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94917698865280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb94360 con 0x5653bfb8ad80 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.237+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb95e60 con 0x5653bfb86900 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.241+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.241+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94917698869680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb96700 con 0x5653bfb86900 2024-09-13T06:29:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.241+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb97120 con 0x5653bfb8ad80 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.241+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94917698869680] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.241+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94917698865280] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94917698874384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb96250 con 0x5653bfb8ad80 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb979c0 con 0x7f2380110070 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94917698876688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb96250 con 0x7f2380110070 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb98440 con 0x5653bfb8ad80 2024-09-13T06:29:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94917698876688] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94917698874384] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.245+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94917698862768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb97f50 con 0x5653bfb8ad80 2024-09-13T06:29:19.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb98d10 con 0x5653bfb8fdc0 2024-09-13T06:29:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94917698881632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb97f50 con 0x5653bfb8fdc0 2024-09-13T06:29:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb99b80 con 0x5653bfb8fdc0 2024-09-13T06:29:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94917698862768] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.249+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94917698881632] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.253+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.253+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94917698883760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb996d0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.253+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb99f20 con 0x7f2380110070 2024-09-13T06:29:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94917698885808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb9a390 con 0x7f2380110070 2024-09-13T06:29:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=0 2024-09-13T06:29:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=1 2024-09-13T06:29:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=2 2024-09-13T06:29:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=3 2024-09-13T06:29:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=4 2024-09-13T06:29:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=5 2024-09-13T06:29:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94917698883760] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.257+0000 7f238884b980 20 add_watcher() i=6 2024-09-13T06:29:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94917698885808] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 add_watcher() i=7 2024-09-13T06:29:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb97930 con 0x5653bfb86900 2024-09-13T06:29:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94917698877744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb9a910 con 0x5653bfb86900 2024-09-13T06:29:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94917698877744] v31'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f223cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 5 note: GC not initialized 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f21b77fe640 20 reqs_thread_entry: start 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 Filter name: none 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f21b57fa640 20 reqs_thread_entry: start 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc0b80 con 0x5653bfb86900 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:19.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.261+0000 7f238884b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc15f0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:29:19.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc6f60 con 0x5653bfb86900 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v31'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94917699070416 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc2630 con 0x5653bfb8ad80 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94917698862768 notify 133143986179 ret 0) ==== 720+0+0 (crc 0 0 0) 0x5653bfb689e0 con 0x5653bfb8ad80 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f2269ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94917698862768 notifier 4337 bl.length()=678 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f2269ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f2269ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.4 [notify cookie 94917699070416 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f2269ffb640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f224c003eb0 con 0x5653bfb8ad80 2024-09-13T06:29:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify_complete (2) cookie 94917699070416 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653bfb68750 con 0x5653bfb8ad80 2024-09-13T06:29:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.265+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc69d0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238884b980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238884b980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238884b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94917699070416 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc2180 con 0x5653bfb8ad80 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 94917698874384 notify 133143986180 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5653bfb68750 con 0x5653bfb8ad80 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f2269ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94917698874384 notifier 4337 bl.length()=177 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(68 notify.2 [notify cookie 94917699070416 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f2269ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f2269ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f2269ffb640 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f224c003eb0 con 0x5653bfb8ad80 2024-09-13T06:29:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== watch-notify(notify_complete (2) cookie 94917699070416 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653bfb4d490 con 0x5653bfb8ad80 2024-09-13T06:29:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.273 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:29:19.269004Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f223cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.269+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94917698877744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbc2590 con 0x5653bfb86900 2024-09-13T06:29:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.273+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94917698877744] v31'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.273+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94917698865280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbbe920 con 0x5653bfb8ad80 2024-09-13T06:29:19.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.273+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94917698865280] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.273+0000 7f238884b980 20 remove_watcher() i=0 2024-09-13T06:29:19.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.273+0000 7f238884b980 2 removed watcher, disabling cache 2024-09-13T06:29:19.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.273+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94917698869680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbbe920 con 0x5653bfb86900 2024-09-13T06:29:19.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94917698869680] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x5653bfb86900 2024-09-13T06:29:19.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238884b980 20 remove_watcher() i=1 2024-09-13T06:29:19.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94917698874384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbbe920 con 0x5653bfb8ad80 2024-09-13T06:29:19.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94917698874384] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238884b980 20 remove_watcher() i=2 2024-09-13T06:29:19.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94917698876688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbbe920 con 0x7f2380110070 2024-09-13T06:29:19.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94917698876688] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238884b980 20 remove_watcher() i=3 2024-09-13T06:29:19.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.277+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94917698862768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfbbe920 con 0x5653bfb8ad80 2024-09-13T06:29:19.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238635b640 1 -- 172.21.15.169:0/1791516162 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94917698862768] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2380117070 con 0x5653bfb8ad80 2024-09-13T06:29:19.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238884b980 20 remove_watcher() i=4 2024-09-13T06:29:19.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94917698881632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb979c0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94917698881632] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238884b980 20 remove_watcher() i=5 2024-09-13T06:29:19.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94917698883760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb979c0 con 0x5653bfb8fdc0 2024-09-13T06:29:19.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f2385b5a640 1 -- 172.21.15.169:0/1791516162 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94917698883760] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2370036040 con 0x5653bfb8fdc0 2024-09-13T06:29:19.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238884b980 20 remove_watcher() i=6 2024-09-13T06:29:19.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.281+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94917698885808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653bfb98860 con 0x7f2380110070 2024-09-13T06:29:19.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94917698885808] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23780083f0 con 0x7f2380110070 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 20 remove_watcher() i=7 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb8ad80 msgr2=0x5653bfb8d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb8ad80 0x5653bfb8d170 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfb86900 msgr2=0x5653bfb88d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfb86900 0x5653bfb88d90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2380110070 msgr2=0x7f23800cc760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2380110070 0x7f23800cc760 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb8fdc0 msgr2=0x5653bfb921b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb8fdc0 0x5653bfb921b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2250034650 msgr2=0x7f2250036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2250034650 0x7f2250036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23700207d0 tx=0x7f2370011000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 msgr2=0x5653bfb7b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f2386b5c640 1 -- 172.21.15.169:0/1791516162 reap_dead start 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb7b930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f23800e26e0 tx=0x7f23800bd7f0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 shutdown_connections 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1791516162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb74770 0x5653bfb7b930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 >> 172.21.15.169:0/1791516162 conn(0x5653bfb70b00 msgr2=0x5653bfb6ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 shutdown_connections 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1791516162 wait complete. 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2260034650 msgr2=0x7f2260036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2260034650 0x7f2260036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5653bfb5a760 tx=0x7f2370006000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 msgr2=0x5653bfb68210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 0x5653bfb68210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23800c7540 tx=0x7f2380007dc0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 shutdown_connections 2024-09-13T06:29:19.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2260034650 0x7f2260036b10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/3555392456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bfb67df0 0x5653bfb68210 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 >> 172.21.15.169:0/3555392456 conn(0x5653bfb5cf40 msgr2=0x5653bfb5f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 shutdown_connections 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/3555392456 wait complete. 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb52380 msgr2=0x5653bfb54770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5653bfb52380 0x5653bfb54770 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfa5ac80 msgr2=0x5653bfb50f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5653bfa5ac80 0x5653bfb50f70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb57a30 msgr2=0x5653bfb59e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5653bfb57a30 0x5653bfb59e20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f226c0346a0 msgr2=0x7f226c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f226c0346a0 0x7f226c036b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2370001e20 tx=0x7f23700013a0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 msgr2=0x5653bfb49fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 --2- 172.21.15.169:0/1088725988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5653bf9ca230 0x5653bfb49fe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2380018cc0 tx=0x7f2380017e30 comp rx=0 tx=0).stop 2024-09-13T06:29:19.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f2386b5c640 1 -- 172.21.15.169:0/1088725988 reap_dead start 2024-09-13T06:29:19.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 shutdown_connections 2024-09-13T06:29:19.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 >> 172.21.15.169:0/1088725988 conn(0x5653bfa50030 msgr2=0x5653bfb3d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 shutdown_connections 2024-09-13T06:29:19.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.285+0000 7f238884b980 1 -- 172.21.15.169:0/1088725988 wait complete. 2024-09-13T06:29:19.297 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:29:19.269004Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:19.297 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:19.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:19.298 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:19.375 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:19.375 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dae730980 1 Processor -- start 2024-09-13T06:29:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dae730980 1 -- start start 2024-09-13T06:29:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dae730980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5600e50dfac0 0x5600e50e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dae730980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5600e4f69ae0 con 0x5600e50e23f0 2024-09-13T06:29:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dae730980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5600e4f8de30 con 0x5600e50dfac0 2024-09-13T06:29:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dac240640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5600e50dfac0 0x5600e50e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dac240640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5600e50dfac0 0x5600e50e1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35716/0 (socket says 172.21.15.169:35716) 2024-09-13T06:29:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dac240640 1 -- 172.21.15.169:0/744311986 learned_addr learned my addr 172.21.15.169:0/744311986 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4daba3f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5600e50e23f0 0x5600e50e8f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45076/0 (socket says 172.21.15.169:45076) 2024-09-13T06:29:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dac240640 1 -- 172.21.15.169:0/744311986 >> v1:172.21.15.112:6789/0 conn(0x5600e50e23f0 legacy=0x5600e50e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.373+0000 7f4dac240640 1 -- 172.21.15.169:0/744311986 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600e50e28c0 con 0x5600e50dfac0 2024-09-13T06:29:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dac240640 1 --2- 172.21.15.169:0/744311986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e50e1eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400a5c0 tx=0x7f4d9401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f0496a570a87b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dab23e640 1 -- 172.21.15.169:0/744311986 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940a6070 con 0x5600e50dfac0 2024-09-13T06:29:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dab23e640 1 -- 172.21.15.169:0/744311986 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940af070 con 0x5600e50dfac0 2024-09-13T06:29:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dab23e640 1 -- 172.21.15.169:0/744311986 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940aa5c0 con 0x5600e50dfac0 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 -- 172.21.15.169:0/744311986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 msgr2=0x5600e50e1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 --2- 172.21.15.169:0/744311986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e50e1eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400a5c0 tx=0x7f4d9401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 -- 172.21.15.169:0/744311986 shutdown_connections 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 --2- 172.21.15.169:0/744311986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e50e1eb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 -- 172.21.15.169:0/744311986 >> 172.21.15.169:0/744311986 conn(0x5600e50db7a0 msgr2=0x5600e50ddbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 -- 172.21.15.169:0/744311986 shutdown_connections 2024-09-13T06:29:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.377+0000 7f4dae730980 1 -- 172.21.15.169:0/744311986 wait complete. 2024-09-13T06:29:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.389+0000 7f4dae730980 1 Processor -- start 2024-09-13T06:29:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.389+0000 7f4dae730980 1 -- start start 2024-09-13T06:29:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5600e4f8f200 con 0x5600e50dfac0 2024-09-13T06:29:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35718/0 (socket says 172.21.15.169:35718) 2024-09-13T06:29:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 -- 172.21.15.169:0/1467797598 learned_addr learned my addr 172.21.15.169:0/1467797598 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 -- 172.21.15.169:0/1467797598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600e51cf200 con 0x5600e50dfac0 2024-09-13T06:29:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 --2- 172.21.15.169:0/1467797598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51cec30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d940ac040 tx=0x7f4d94003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c182353410e05403 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4c9a60c640 1 -- 172.21.15.169:0/1467797598 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940aa970 con 0x5600e50dfac0 2024-09-13T06:29:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4c9a60c640 1 -- 172.21.15.169:0/1467797598 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940aab30 con 0x5600e50dfac0 2024-09-13T06:29:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4c9a60c640 1 -- 172.21.15.169:0/1467797598 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940aae50 con 0x5600e50dfac0 2024-09-13T06:29:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- 172.21.15.169:0/1467797598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 msgr2=0x5600e51cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 --2- 172.21.15.169:0/1467797598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51cec30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d940ac040 tx=0x7f4d94003030 comp rx=0 tx=0).stop 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- 172.21.15.169:0/1467797598 shutdown_connections 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 --2- 172.21.15.169:0/1467797598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51cec30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- 172.21.15.169:0/1467797598 >> 172.21.15.169:0/1467797598 conn(0x5600e50db7a0 msgr2=0x5600e51ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- 172.21.15.169:0/1467797598 shutdown_connections 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- 172.21.15.169:0/1467797598 wait complete. 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 Processor -- start 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- start start 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dae730980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5600e50ed1d0 con 0x5600e50dfac0 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51d5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35720/0 (socket says 172.21.15.169:35720) 2024-09-13T06:29:19.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 -- 172.21.15.169:0/3049972090 learned_addr learned my addr 172.21.15.169:0/3049972090 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.393+0000 7f4dac240640 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600e51d63c0 con 0x5600e50dfac0 2024-09-13T06:29:19.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dac240640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51d5e80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d9401bbe0 tx=0x7f4d940180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4c98e09640 1 -- 172.21.15.169:0/3049972090 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940bd6d0 con 0x5600e50dfac0 2024-09-13T06:29:19.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600e51d6650 con 0x5600e50dfac0 2024-09-13T06:29:19.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4c98e09640 1 -- 172.21.15.169:0/3049972090 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940cc070 con 0x5600e50dfac0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600e51d9330 con 0x5600e50dfac0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4c98e09640 1 -- 172.21.15.169:0/3049972090 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940bd9a0 con 0x5600e50dfac0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4c98e09640 1 -- 172.21.15.169:0/3049972090 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d940bdbd0 con 0x5600e50dfac0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4c98e09640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c94034650 0x7f4c94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4c98e09640 1 -- 172.21.15.169:0/3049972090 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4d940e5450 con 0x5600e50dfac0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4daba3f640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c94034650 0x7f4c94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e50e23f0 0x5600e51dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e51dd4c0 con 0x5600e50e23f0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4daca41640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e50e23f0 0x5600e51dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4daba3f640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c94034650 0x7f4c94036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0012f0 tx=0x7f4d9c006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4daca41640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e50e23f0 0x5600e51dcf80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4daca41640 1 -- 172.21.15.169:0/3049972090 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e50e23f0 2024-09-13T06:29:19.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e51de2a0 0x5600e51e0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e51e0cd0 con 0x5600e51de2a0 2024-09-13T06:29:19.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dac240640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e51de2a0 0x5600e51e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.397+0000 7f4dac240640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e51de2a0 0x5600e51e0690 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dac240640 1 -- 172.21.15.169:0/3049972090 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e51de2a0 2024-09-13T06:29:19.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e51e2580 con 0x5600e51de2a0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dac240640 1 -- 172.21.15.169:0/3049972090 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e51de2a0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e51e16f0 con 0x5600e51de2a0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dac240640 1 -- 172.21.15.169:0/3049972090 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e51de2a0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e51e3930 0x5600e51e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e51e6260 con 0x5600e51e3930 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4daba3f640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e51e3930 0x5600e51e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4daba3f640 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e51e3930 0x5600e51e5d20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4daba3f640 1 -- 172.21.15.169:0/3049972090 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e51e3930 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 Processor -- start 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 -- start start 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 0x5600e51f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dae730980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5600e4fe8800 con 0x5600e51f3c40 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 0x5600e51f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 0x5600e51f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35732/0 (socket says 172.21.15.169:35732) 2024-09-13T06:29:19.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.401+0000 7f4dac240640 1 -- 172.21.15.169:0/1531328366 learned_addr learned my addr 172.21.15.169:0/1531328366 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 -- 172.21.15.169:0/1531328366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600e51f45a0 con 0x5600e51f3c40 2024-09-13T06:29:19.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 0x5600e51f4060 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4d940e3ae0 tx=0x7f4d940cf430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4c91ffb640 1 -- 172.21.15.169:0/1531328366 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940b3da0 con 0x5600e51f3c40 2024-09-13T06:29:19.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600e51f4830 con 0x5600e51f3c40 2024-09-13T06:29:19.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4c91ffb640 1 -- 172.21.15.169:0/1531328366 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940e57f0 con 0x5600e51f3c40 2024-09-13T06:29:19.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4c91ffb640 1 -- 172.21.15.169:0/1531328366 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940f4060 con 0x5600e51f3c40 2024-09-13T06:29:19.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600e51f74b0 con 0x5600e51f3c40 2024-09-13T06:29:19.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4c91ffb640 1 -- 172.21.15.169:0/1531328366 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d940e5ad0 con 0x5600e51f3c40 2024-09-13T06:29:19.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4c91ffb640 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c84034650 0x7f4c84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4c91ffb640 1 -- 172.21.15.169:0/1531328366 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4d940a4100 con 0x5600e51f3c40 2024-09-13T06:29:19.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4daba3f640 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c84034650 0x7f4c84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dae730980 1 Processor -- start 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dae730980 1 -- start start 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dae730980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e52009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dae730980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5600e51cf4c0 con 0x5600e52005c0 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4daba3f640 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c84034650 0x7f4c84036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5600e51da470 tx=0x7f4d9c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e52009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e52009c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35738/0 (socket says 172.21.15.169:35738) 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 -- 172.21.15.169:0/4008521164 learned_addr learned my addr 172.21.15.169:0/4008521164 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 -- 172.21.15.169:0/4008521164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600e5200f90 con 0x5600e52005c0 2024-09-13T06:29:19.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.405+0000 7f4dac240640 1 --2- 172.21.15.169:0/4008521164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e52009c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4d940b3a60 tx=0x7f4d940cf6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173763428dce1230 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4c8b7fe640 1 -- 172.21.15.169:0/4008521164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940cf7c0 con 0x5600e52005c0 2024-09-13T06:29:19.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4c8b7fe640 1 -- 172.21.15.169:0/4008521164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940e5000 con 0x5600e52005c0 2024-09-13T06:29:19.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4c8b7fe640 1 -- 172.21.15.169:0/4008521164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940cf960 con 0x5600e52005c0 2024-09-13T06:29:19.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/4008521164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 msgr2=0x5600e52009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 --2- 172.21.15.169:0/4008521164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e52009c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4d940b3a60 tx=0x7f4d940cf6a0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/4008521164 shutdown_connections 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 --2- 172.21.15.169:0/4008521164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e52009c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/4008521164 >> 172.21.15.169:0/4008521164 conn(0x5600e51fc9a0 msgr2=0x5600e51faaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/4008521164 shutdown_connections 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/4008521164 wait complete. 2024-09-13T06:29:19.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 Processor -- start 2024-09-13T06:29:19.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- start start 2024-09-13T06:29:19.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e5207750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5600e5201410 con 0x5600e52005c0 2024-09-13T06:29:19.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e5207750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dac240640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e5207750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35750/0 (socket says 172.21.15.169:35750) 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 learned_addr learned my addr 172.21.15.169:0/2704296230 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600e5207c90 con 0x5600e52005c0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dac240640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e5207750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d940c5f70 tx=0x7f4d940c4f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4c89ffb640 1 -- 172.21.15.169:0/2704296230 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940c5980 con 0x5600e52005c0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4c89ffb640 1 -- 172.21.15.169:0/2704296230 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94115070 con 0x5600e52005c0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4c89ffb640 1 -- 172.21.15.169:0/2704296230 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d940e30d0 con 0x5600e52005c0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600e5207c90 con 0x5600e52005c0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.409+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600e5208100 con 0x5600e52005c0 2024-09-13T06:29:19.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4c89ffb640 1 -- 172.21.15.169:0/2704296230 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d940e3270 con 0x5600e52005c0 2024-09-13T06:29:19.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4c89ffb640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c7c034650 0x7f4c7c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4c89ffb640 1 -- 172.21.15.169:0/2704296230 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4d940ea1f0 con 0x5600e52005c0 2024-09-13T06:29:19.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daba3f640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c7c034650 0x7f4c7c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e52126d0 0x5600e5214b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e52152c0 con 0x5600e52126d0 2024-09-13T06:29:19.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daca41640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e52126d0 0x5600e5214b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daba3f640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c7c034650 0x7f4c7c036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c004fd0 tx=0x7f4d9c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daca41640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e52126d0 0x5600e5214b70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 realm 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e5211bc0 con 0x5600e52126d0 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:19.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e5215d90 con 0x5600e52126d0 2024-09-13T06:29:19.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e5216970 0x5600e5218e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e52195a0 con 0x5600e5216970 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dac240640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e5216970 0x5600e5218e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dac240640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e5216970 0x5600e5218e30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.413+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dae730980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dae730980 20 searching for the correct realm 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e521bbb0 0x5600e521dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e521e620 con 0x5600e521bbb0 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daba3f640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e521bbb0 0x5600e521dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daba3f640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e521bbb0 0x5600e521dfa0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e521e620 con 0x5600e5216970 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dac240640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4d94009040 0x7f4d94115220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x7f4d94009040 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4d94009040 0x7f4d94115220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4d94009040 0x7f4d94115220 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e521bbb0 2024-09-13T06:29:19.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.417+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x7f4d94009040 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x7f4d94009040 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e521bbb0 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e521bbb0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.421+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e521bbb0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x7f4d94009040 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e52126d0 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x7f4d94009040 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e521bbb0 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x7f4d94009040 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e521bbb0 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.425+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5600e5219e40 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e521a690 con 0x5600e52126d0 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e521aa80 con 0x5600e5216970 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e521aa80 con 0x5600e521bbb0 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 zone default found 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 4 Realm: () 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 zonegroup default 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e521ea80 con 0x7f4d94009040 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e5220800 con 0x5600e521bbb0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e5220ba0 con 0x5600e521bbb0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 started sync module instance, tier type = 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.429+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e521fca0 con 0x5600e5216970 2024-09-13T06:29:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94561844199920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e521fca0 con 0x5600e5216970 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5221560 con 0x5600e52126d0 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94561844203696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5221db0 con 0x5600e52126d0 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5222800 con 0x5600e5216970 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94561844199920] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94561844203696] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94561844208368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5221900 con 0x5600e5216970 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.433+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52230a0 con 0x7f4d94009040 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94561844210672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5221900 con 0x7f4d94009040 2024-09-13T06:29:19.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5223b70 con 0x5600e5216970 2024-09-13T06:29:19.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94561844210672] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94561844208368] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94561844197360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5223b30 con 0x5600e5216970 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5223f60 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94561844211728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52247b0 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.437+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52251b0 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94561844197360] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94561844211728] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94561844213344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52255d0 con 0x5600e521bbb0 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5225e60 con 0x7f4d94009040 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94561844221392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5225a30 con 0x7f4d94009040 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 20 add_watcher() i=0 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 20 add_watcher() i=1 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 20 add_watcher() i=2 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 20 add_watcher() i=3 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 20 add_watcher() i=4 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.441+0000 7f4dae730980 20 add_watcher() i=5 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.445+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94561844213344] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.445+0000 7f4dae730980 20 add_watcher() i=6 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.445+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94561844221392] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.445+0000 7f4dae730980 20 add_watcher() i=7 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.445+0000 7f4dae730980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e5224cc0 con 0x5600e52126d0 2024-09-13T06:29:19.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94561844219072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5226880 con 0x5600e52126d0 2024-09-13T06:29:19.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94561844219072] v31'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4c627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:19.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:19.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 5 note: GC not initialized 2024-09-13T06:29:19.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4c617e2640 20 reqs_thread_entry: start 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 20 Filter name: none 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4bd2ffd640 20 reqs_thread_entry: start 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5600e524c5b0 con 0x5600e52126d0 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.449+0000 7f4dae730980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T06:29:19.457 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:29:19.269004Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:19.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.453+0000 7f4c627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.453+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94561844219072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e524b160 con 0x5600e52126d0 2024-09-13T06:29:19.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.453+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94561844219072] v31'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.453+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94561844199920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e524a440 con 0x5600e5216970 2024-09-13T06:29:19.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94561844199920] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 20 remove_watcher() i=0 2024-09-13T06:29:19.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 2 removed watcher, disabling cache 2024-09-13T06:29:19.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94561844203696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e524a440 con 0x5600e52126d0 2024-09-13T06:29:19.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94561844203696] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x5600e52126d0 2024-09-13T06:29:19.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 20 remove_watcher() i=1 2024-09-13T06:29:19.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94561844208368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e524a440 con 0x5600e5216970 2024-09-13T06:29:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94561844208368] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 20 remove_watcher() i=2 2024-09-13T06:29:19.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.457+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94561844210672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52222f0 con 0x7f4d94009040 2024-09-13T06:29:19.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94561844210672] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dae730980 20 remove_watcher() i=3 2024-09-13T06:29:19.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94561844197360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e524a440 con 0x5600e5216970 2024-09-13T06:29:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dac240640 1 -- 172.21.15.169:0/2704296230 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94561844197360] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d940d0410 con 0x5600e5216970 2024-09-13T06:29:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dae730980 20 remove_watcher() i=4 2024-09-13T06:29:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94561844211728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e5222bf0 con 0x5600e521bbb0 2024-09-13T06:29:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94561844211728] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dae730980 20 remove_watcher() i=5 2024-09-13T06:29:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.461+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94561844213344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52230a0 con 0x5600e521bbb0 2024-09-13T06:29:19.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4daba3f640 1 -- 172.21.15.169:0/2704296230 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94561844213344] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d9c00f070 con 0x5600e521bbb0 2024-09-13T06:29:19.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 20 remove_watcher() i=6 2024-09-13T06:29:19.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94561844221392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5600e52230a0 con 0x7f4d94009040 2024-09-13T06:29:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94561844221392] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40083f0 con 0x7f4d94009040 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 20 remove_watcher() i=7 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e5216970 msgr2=0x5600e5218e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e5216970 0x5600e5218e30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e52126d0 msgr2=0x5600e5214b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e52126d0 0x5600e5214b70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4d94009040 msgr2=0x7f4d94115220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4d94009040 0x7f4d94115220 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e521bbb0 msgr2=0x5600e521dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e521bbb0 0x5600e521dfa0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c7c034650 msgr2=0x7f4c7c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c7c034650 0x7f4c7c036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c004fd0 tx=0x7f4d9c010000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 msgr2=0x5600e5207750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4daca41640 1 -- 172.21.15.169:0/2704296230 reap_dead start 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e5207750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d940c5f70 tx=0x7f4d940c4f30 comp rx=0 tx=0).stop 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 shutdown_connections 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 --2- 172.21.15.169:0/2704296230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e52005c0 0x5600e5207750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 >> 172.21.15.169:0/2704296230 conn(0x5600e51fc9a0 msgr2=0x5600e51faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 shutdown_connections 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.465+0000 7f4dae730980 1 -- 172.21.15.169:0/2704296230 wait complete. 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c84034650 msgr2=0x7f4c84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c84034650 0x7f4c84036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5600e51da470 tx=0x7f4d9c00f000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 msgr2=0x5600e51f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 0x5600e51f4060 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4d940e3ae0 tx=0x7f4d940cf430 comp rx=0 tx=0).stop 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 shutdown_connections 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c84034650 0x7f4c84036b10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/1531328366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e51f3c40 0x5600e51f4060 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 >> 172.21.15.169:0/1531328366 conn(0x5600e51e8d90 msgr2=0x5600e51eb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 shutdown_connections 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/1531328366 wait complete. 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e51de2a0 msgr2=0x5600e51e0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5600e51de2a0 0x5600e51e0690 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e50e23f0 msgr2=0x5600e51dcf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5600e50e23f0 0x5600e51dcf80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e51e3930 msgr2=0x5600e51e5d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5600e51e3930 0x5600e51e5d20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c94034650 msgr2=0x7f4c94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4c94034650 0x7f4c94036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0012f0 tx=0x7f4d9c006700 comp rx=0 tx=0).stop 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 msgr2=0x5600e51d5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 --2- 172.21.15.169:0/3049972090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5600e50dfac0 0x5600e51d5e80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d9401bbe0 tx=0x7f4d940180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4daca41640 1 -- 172.21.15.169:0/3049972090 reap_dead start 2024-09-13T06:29:19.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 shutdown_connections 2024-09-13T06:29:19.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 >> 172.21.15.169:0/3049972090 conn(0x5600e50db7a0 msgr2=0x5600e51c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 shutdown_connections 2024-09-13T06:29:19.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.469+0000 7f4dae730980 1 -- 172.21.15.169:0/3049972090 wait complete. 2024-09-13T06:29:19.480 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:29:19.269004Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:19.480 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T06:29:19.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T06:29:19.481 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T06:29:19.551 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:19.552 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:19.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b9c2f5980 1 Processor -- start 2024-09-13T06:29:19.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b9c2f5980 1 -- start start 2024-09-13T06:29:19.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b9c2f5980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5558d5b648f0 0x5558d5b64cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b9c2f5980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558d59eaae0 con 0x5558d5b65240 2024-09-13T06:29:19.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b9c2f5980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5558d5a0ee30 con 0x5558d5b648f0 2024-09-13T06:29:19.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b99e05640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5558d5b648f0 0x5558d5b64cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b99e05640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5558d5b648f0 0x5558d5b64cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35760/0 (socket says 172.21.15.169:35760) 2024-09-13T06:29:19.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b99604640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5558d5b65240 0x5558d5b69c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45092/0 (socket says 172.21.15.169:45092) 2024-09-13T06:29:19.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b99e05640 1 -- 172.21.15.169:0/829900940 learned_addr learned my addr 172.21.15.169:0/829900940 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b99e05640 1 -- 172.21.15.169:0/829900940 >> v1:172.21.15.112:6789/0 conn(0x5558d5b65240 legacy=0x5558d5b69c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.549+0000 7f7b99e05640 1 -- 172.21.15.169:0/829900940 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d5b6c4c0 con 0x5558d5b648f0 2024-09-13T06:29:19.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b99e05640 1 --2- 172.21.15.169:0/829900940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5b64cd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00a5c0 tx=0x7f7b8c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66b84b8a0028552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b98e03640 1 -- 172.21.15.169:0/829900940 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0a6070 con 0x5558d5b648f0 2024-09-13T06:29:19.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b98e03640 1 -- 172.21.15.169:0/829900940 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0af070 con 0x5558d5b648f0 2024-09-13T06:29:19.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b98e03640 1 -- 172.21.15.169:0/829900940 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0aa5c0 con 0x5558d5b648f0 2024-09-13T06:29:19.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/829900940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 msgr2=0x5558d5b64cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/829900940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5b64cd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00a5c0 tx=0x7f7b8c01b340 comp rx=0 tx=0).stop 2024-09-13T06:29:19.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/829900940 shutdown_connections 2024-09-13T06:29:19.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/829900940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5b64cd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/829900940 >> 172.21.15.169:0/829900940 conn(0x5558d5ad8240 msgr2=0x5558d5ad8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/829900940 shutdown_connections 2024-09-13T06:29:19.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.553+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/829900940 wait complete. 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.565+0000 7f7b9c2f5980 1 Processor -- start 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.565+0000 7f7b9c2f5980 1 -- start start 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.565+0000 7f7b9c2f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c4fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.565+0000 7f7b9c2f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5558d5a10200 con 0x5558d5b648f0 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c4fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c4fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35772/0 (socket says 172.21.15.169:35772) 2024-09-13T06:29:19.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 -- 172.21.15.169:0/3441573868 learned_addr learned my addr 172.21.15.169:0/3441573868 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 -- 172.21.15.169:0/3441573868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d5c50210 con 0x5558d5b648f0 2024-09-13T06:29:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 --2- 172.21.15.169:0/3441573868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c4fc40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00a5c0 tx=0x7f7b8c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94baee08a5d98c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7a87e07640 1 -- 172.21.15.169:0/3441573868 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0aa9b0 con 0x5558d5b648f0 2024-09-13T06:29:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7a87e07640 1 -- 172.21.15.169:0/3441573868 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0aab50 con 0x5558d5b648f0 2024-09-13T06:29:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7a87e07640 1 -- 172.21.15.169:0/3441573868 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0aae50 con 0x5558d5b648f0 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3441573868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 msgr2=0x5558d5c4fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/3441573868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c4fc40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00a5c0 tx=0x7f7b8c003030 comp rx=0 tx=0).stop 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3441573868 shutdown_connections 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/3441573868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c4fc40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3441573868 >> 172.21.15.169:0/3441573868 conn(0x5558d5ad8240 msgr2=0x5558d5c4b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3441573868 shutdown_connections 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3441573868 wait complete. 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 Processor -- start 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- start start 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c56e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5558d5b6bf00 con 0x5558d5b648f0 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c56e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c56e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35784/0 (socket says 172.21.15.169:35784) 2024-09-13T06:29:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 -- 172.21.15.169:0/785389459 learned_addr learned my addr 172.21.15.169:0/785389459 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d5c573b0 con 0x5558d5b648f0 2024-09-13T06:29:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b99e05640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c56e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c01bbe0 tx=0x7f7b8c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7a86604640 1 -- 172.21.15.169:0/785389459 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0c6750 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.569+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558d5c57640 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7a86604640 1 -- 172.21.15.169:0/785389459 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0c68f0 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7a86604640 1 -- 172.21.15.169:0/785389459 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0c6c10 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558d5c5a320 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7a86604640 1 -- 172.21.15.169:0/785389459 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b8c0ce020 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7a86604640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a80034650 0x7f7a80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7a86604640 1 -- 172.21.15.169:0/785389459 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7b8c0cc020 con 0x5558d5b648f0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b99604640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a80034650 0x7f7a80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5b65240 0x5558d5c5df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c5e4b0 con 0x5558d5b65240 2024-09-13T06:29:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9a606640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5b65240 0x5558d5c5df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b99604640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a80034650 0x7f7a80036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b90001e50 tx=0x7f7b900013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9a606640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5b65240 0x5558d5c5df70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9a606640 1 -- 172.21.15.169:0/785389459 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5b65240 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c5f290 0x5558d5c61680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c61cb0 con 0x5558d5c5f290 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b99e05640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c5f290 0x5558d5c61680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b99e05640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c5f290 0x5558d5c61680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b99e05640 1 -- 172.21.15.169:0/785389459 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8c0c5d00 con 0x5558d5c5f290 2024-09-13T06:29:19.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.573+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c63560 con 0x5558d5c5f290 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99e05640 1 -- 172.21.15.169:0/785389459 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b8c0c5d00 con 0x5558d5c5f290 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c62790 con 0x5558d5c5f290 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99e05640 1 -- 172.21.15.169:0/785389459 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8c0c5d00 con 0x5558d5c5f290 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c64910 0x5558d5c66d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c67240 con 0x5558d5c64910 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99604640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c64910 0x5558d5c66d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99604640 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c64910 0x5558d5c66d00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99604640 1 -- 172.21.15.169:0/785389459 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b9000f700 con 0x5558d5c64910 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 Processor -- start 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 -- start start 2024-09-13T06:29:19.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 0x5558d5c750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b9c2f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5558d5a69800 con 0x5558d5c74cd0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 0x5558d5c750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 0x5558d5c750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35800/0 (socket says 172.21.15.169:35800) 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.577+0000 7f7b99e05640 1 -- 172.21.15.169:0/1644470896 learned_addr learned my addr 172.21.15.169:0/1644470896 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 -- 172.21.15.169:0/1644470896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d5c75630 con 0x5558d5c74cd0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 0x5558d5c750f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0e3750 tx=0x7f7b8c0b3950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7a7f7fe640 1 -- 172.21.15.169:0/1644470896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0e3470 con 0x5558d5c74cd0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7a7f7fe640 1 -- 172.21.15.169:0/1644470896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0e3b40 con 0x5558d5c74cd0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558d5c758c0 con 0x5558d5c74cd0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7a7f7fe640 1 -- 172.21.15.169:0/1644470896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0e3e40 con 0x5558d5c74cd0 2024-09-13T06:29:19.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558d5c78540 con 0x5558d5c74cd0 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7a7f7fe640 1 -- 172.21.15.169:0/1644470896 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b8c0ed060 con 0x5558d5c74cd0 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7a7f7fe640 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a74034650 0x7f7a74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7a7f7fe640 1 -- 172.21.15.169:0/1644470896 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7b8c0f0ab0 con 0x5558d5c74cd0 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99604640 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a74034650 0x7f7a74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b9c2f5980 1 Processor -- start 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b9c2f5980 1 -- start start 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99604640 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a74034650 0x7f7a74036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5558d5c67640 tx=0x7f7b9000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b9c2f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c819e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b9c2f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5558d5c504d0 con 0x5558d5c81600 2024-09-13T06:29:19.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c819e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35810/0 (socket says 172.21.15.169:35810) 2024-09-13T06:29:19.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 -- 172.21.15.169:0/3605202091 learned_addr learned my addr 172.21.15.169:0/3605202091 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 -- 172.21.15.169:0/3605202091 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d5c81fb0 con 0x5558d5c81600 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.581+0000 7f7b99e05640 1 --2- 172.21.15.169:0/3605202091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c819e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0a7700 tx=0x7f7b8c0a7930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8debf38ac40e06c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a7d7fa640 1 -- 172.21.15.169:0/3605202091 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0fd020 con 0x5558d5c81600 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a7d7fa640 1 -- 172.21.15.169:0/3605202091 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0b3cb0 con 0x5558d5c81600 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a7d7fa640 1 -- 172.21.15.169:0/3605202091 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0f0e30 con 0x5558d5c81600 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3605202091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 msgr2=0x5558d5c819e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/3605202091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c819e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0a7700 tx=0x7f7b8c0a7930 comp rx=0 tx=0).stop 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3605202091 shutdown_connections 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/3605202091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c819e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3605202091 >> 172.21.15.169:0/3605202091 conn(0x5558d5c7d9e0 msgr2=0x5558d5c7bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3605202091 shutdown_connections 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/3605202091 wait complete. 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 Processor -- start 2024-09-13T06:29:19.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- start start 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c886d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5558d5c81fb0 con 0x5558d5c81600 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b99e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c886d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35826/0 (socket says 172.21.15.169:35826) 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 learned_addr learned my addr 172.21.15.169:0/2178902561 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d5c88c10 con 0x5558d5c81600 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b99e05640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c886d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0bffa0 tx=0x7f7b8c0f7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a6b7fe640 1 -- 172.21.15.169:0/2178902561 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0c58a0 con 0x5558d5c81600 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558d5c88c10 con 0x5558d5c81600 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a6b7fe640 1 -- 172.21.15.169:0/2178902561 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0db440 con 0x5558d5c81600 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a6b7fe640 1 -- 172.21.15.169:0/2178902561 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8c0f0cb0 con 0x5558d5c81600 2024-09-13T06:29:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558d5c89080 con 0x5558d5c81600 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a6b7fe640 1 -- 172.21.15.169:0/2178902561 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b8c100020 con 0x5558d5c81600 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a6b7fe640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a64034650 0x7f7a64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.585+0000 7f7a6b7fe640 1 -- 172.21.15.169:0/2178902561 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7b8c0f5040 con 0x5558d5c81600 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99604640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a64034650 0x7f7a64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5c93690 0x5558d5c95b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c96280 con 0x5558d5c93690 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9a606640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5c93690 0x5558d5c95b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99604640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a64034650 0x7f7a64036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000baa0 tx=0x7f7b90010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9a606640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5c93690 0x5558d5c95b30 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 realm 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c92b80 con 0x5558d5c93690 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c96d40 con 0x5558d5c93690 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c97b20 0x5558d5c99f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9a5a0 con 0x5558d5c97b20 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99e05640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c97b20 0x5558d5c99f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99e05640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c97b20 0x5558d5c99f10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9adf0 con 0x5558d5c97b20 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 20 searching for the correct realm 2024-09-13T06:29:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c9cb60 0x5558d5c9ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99604640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c9cb60 0x5558d5c9ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.589+0000 7f7b99604640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c9cb60 0x5558d5c9ef50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7b8c102040 0x7f7b8c0f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x7f7b8c102040 2024-09-13T06:29:19.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7b8c102040 0x7f7b8c0f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7b8c102040 0x7f7b8c0f3920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.593+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x7f7b8c102040 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x7f7b8c102040 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x7f7b8c102040 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.597+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c93690 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x7f7b8c102040 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x7f7b8c102040 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c9cb60 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9f5d0 con 0x5558d5c97b20 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.601+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9b7a0 con 0x5558d5c93690 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9b3e0 con 0x5558d5c97b20 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9b3f0 con 0x5558d5c9cb60 2024-09-13T06:29:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 zone default found 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 4 Realm: () 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 zonegroup default 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5c9fee0 con 0x7f7b8c102040 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca1c60 con 0x5558d5c9cb60 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca2180 con 0x5558d5c9cb60 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 started sync module instance, tier type = 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca1100 con 0x5558d5c97b20 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93840032273920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca1100 con 0x5558d5c97b20 2024-09-13T06:29:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.605+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca2c00 con 0x5558d5c93690 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93840032278352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca34d0 con 0x5558d5c93690 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca3ed0 con 0x5558d5c97b20 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93840032273920] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93840032278352] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93840032271440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca3020 con 0x5558d5c97b20 2024-09-13T06:29:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca4770 con 0x7f7b8c102040 2024-09-13T06:29:19.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93840032285376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca3020 con 0x7f7b8c102040 2024-09-13T06:29:19.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.609+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca5220 con 0x5558d5c97b20 2024-09-13T06:29:19.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93840032285376] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93840032271440] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93840032283104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca4d30 con 0x5558d5c97b20 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca5af0 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93840032290368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca4d30 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca6960 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93840032283104] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93840032290368] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.613+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93840032294064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca6d00 con 0x5558d5c9cb60 2024-09-13T06:29:19.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca7550 con 0x7f7b8c102040 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93840032294064] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93840032297120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca7970 con 0x7f7b8c102040 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=0 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=1 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=2 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=3 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=4 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=5 2024-09-13T06:29:19.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=6 2024-09-13T06:29:19.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93840032297120] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 20 add_watcher() i=7 2024-09-13T06:29:19.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:19.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5caac50 con 0x5558d5c93690 2024-09-13T06:29:19.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.617+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93840032298544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca7f00 con 0x5558d5c93690 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93840032298544] v31'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7a4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 5 note: GC not initialized 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7a4a7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 20 Filter name: none 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f79bbfff640 20 reqs_thread_entry: start 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cce400 con 0x5558d5c93690 2024-09-13T06:29:19.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T06:29:19.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:19.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:19.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cd4a70 con 0x5558d5c93690 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93840032482528 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cd0140 con 0x5558d5c97b20 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 93840032283104 notify 133143986181 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5558d5c758c0 con 0x5558d5c97b20 2024-09-13T06:29:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7a7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 93840032283104 notifier 4351 bl.length()=567 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7a7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.621+0000 7f7a7d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7a7d7fa640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f7a5c003eb0 con 0x5558d5c97b20 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 93840032482528 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 93840032482528 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558d5c75630 con 0x5558d5c97b20 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cd44e0 con 0x5558d5c9cb60 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b9c2f5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93840032482528 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ccfc90 con 0x5558d5c97b20 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 93840032271440 notify 133143986182 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5558d5c75630 con 0x5558d5c97b20 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7a7cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 93840032271440 notifier 4351 bl.length()=170 2024-09-13T06:29:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7a7cff9640 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f79c40032d0 con 0x5558d5c97b20 2024-09-13T06:29:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(67 notify.2 [notify cookie 93840032482528 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== watch-notify(notify_complete (2) cookie 93840032482528 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558d5c5a320 con 0x5558d5c97b20 2024-09-13T06:29:19.630 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:19.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7a4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.625+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93840032298544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cd0140 con 0x5558d5c93690 2024-09-13T06:29:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.629+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93840032298544] v31'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.629+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93840032273920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cd0140 con 0x5558d5c97b20 2024-09-13T06:29:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93840032273920] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 20 remove_watcher() i=0 2024-09-13T06:29:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 2 removed watcher, disabling cache 2024-09-13T06:29:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93840032278352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5cd0110 con 0x5558d5c93690 2024-09-13T06:29:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93840032278352] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x5558d5c93690 2024-09-13T06:29:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 20 remove_watcher() i=1 2024-09-13T06:29:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93840032271440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca7630 con 0x5558d5c97b20 2024-09-13T06:29:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93840032271440] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 20 remove_watcher() i=2 2024-09-13T06:29:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.633+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93840032285376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca1600 con 0x7f7b8c102040 2024-09-13T06:29:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93840032285376] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9c2f5980 20 remove_watcher() i=3 2024-09-13T06:29:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93840032283104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca7630 con 0x5558d5c97b20 2024-09-13T06:29:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b99e05640 1 -- 172.21.15.169:0/2178902561 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93840032283104] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8c112020 con 0x5558d5c97b20 2024-09-13T06:29:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9c2f5980 20 remove_watcher() i=4 2024-09-13T06:29:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93840032290368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca1600 con 0x5558d5c9cb60 2024-09-13T06:29:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93840032290368] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9c2f5980 20 remove_watcher() i=5 2024-09-13T06:29:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.637+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93840032294064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca39e0 con 0x5558d5c9cb60 2024-09-13T06:29:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b99604640 1 -- 172.21.15.169:0/2178902561 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93840032294064] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b90037040 con 0x5558d5c9cb60 2024-09-13T06:29:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 20 remove_watcher() i=6 2024-09-13T06:29:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93840032297120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558d5ca7630 con 0x7f7b8c102040 2024-09-13T06:29:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93840032297120] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9400a4d0 con 0x7f7b8c102040 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 20 remove_watcher() i=7 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c97b20 msgr2=0x5558d5c99f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c97b20 0x5558d5c99f10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5c93690 msgr2=0x5558d5c95b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5c93690 0x5558d5c95b30 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7b8c102040 msgr2=0x7f7b8c0f3920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7b8c102040 0x7f7b8c0f3920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c9cb60 msgr2=0x5558d5c9ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c9cb60 0x5558d5c9ef50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a64034650 msgr2=0x7f7a64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a64034650 0x7f7a64036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000baa0 tx=0x7f7b90010000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 msgr2=0x5558d5c886d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/2178902561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c81600 0x5558d5c886d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0bffa0 tx=0x7f7b8c0f7000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 reap_dead start 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9a606640 1 -- 172.21.15.169:0/2178902561 reap_dead start 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 shutdown_connections 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 >> 172.21.15.169:0/2178902561 conn(0x5558d5c7d9e0 msgr2=0x5558d5c7bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 shutdown_connections 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/2178902561 wait complete. 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a74034650 msgr2=0x7f7a74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a74034650 0x7f7a74036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5558d5c67640 tx=0x7f7b9000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 msgr2=0x5558d5c750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 0x5558d5c750f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0e3750 tx=0x7f7b8c0b3950 comp rx=0 tx=0).stop 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 shutdown_connections 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a74034650 0x7f7a74036b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/1644470896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5c74cd0 0x5558d5c750f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 >> 172.21.15.169:0/1644470896 conn(0x5558d5c69e20 msgr2=0x5558d5c6c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 shutdown_connections 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/1644470896 wait complete. 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c5f290 msgr2=0x5558d5c61680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5558d5c5f290 0x5558d5c61680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5b65240 msgr2=0x5558d5c5df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5558d5b65240 0x5558d5c5df70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c64910 msgr2=0x5558d5c66d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5558d5c64910 0x5558d5c66d00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a80034650 msgr2=0x7f7a80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7a80034650 0x7f7a80036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b90001e50 tx=0x7f7b900013b0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 msgr2=0x5558d5c56e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 --2- 172.21.15.169:0/785389459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5558d5b648f0 0x5558d5c56e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c01bbe0 tx=0x7f7b8c0180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9a606640 1 -- 172.21.15.169:0/785389459 reap_dead start 2024-09-13T06:29:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 shutdown_connections 2024-09-13T06:29:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 >> 172.21.15.169:0/785389459 conn(0x5558d5ad8240 msgr2=0x5558d5c4a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 shutdown_connections 2024-09-13T06:29:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.641+0000 7f7b9c2f5980 1 -- 172.21.15.169:0/785389459 wait complete. 2024-09-13T06:29:19.653 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:19.654 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T06:29:19.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T06:29:19.654 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T06:29:19.733 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:19.733 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.729+0000 7fe399c47980 1 Processor -- start 2024-09-13T06:29:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.729+0000 7fe399c47980 1 -- start start 2024-09-13T06:29:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.729+0000 7fe399c47980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560dad774920 0x560dad776d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.729+0000 7fe399c47980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560dad5f9ae0 con 0x560dad770550 2024-09-13T06:29:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.729+0000 7fe399c47980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x560dad61de30 con 0x560dad774920 2024-09-13T06:29:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396f56640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560dad774920 0x560dad776d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396f56640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560dad774920 0x560dad776d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35834/0 (socket says 172.21.15.169:35834) 2024-09-13T06:29:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396f56640 1 -- 172.21.15.169:0/1223325710 learned_addr learned my addr 172.21.15.169:0/1223325710 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396f56640 1 -- 172.21.15.169:0/1223325710 >> v1:172.21.15.112:6789/0 conn(0x560dad770550 legacy=0x560dad770930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396f56640 1 -- 172.21.15.169:0/1223325710 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dad778260 con 0x560dad774920 2024-09-13T06:29:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396f56640 1 --2- 172.21.15.169:0/1223325710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad774920 0x560dad776d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00a5c0 tx=0x7fe38c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3fb04a97a0cb4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396755640 1 -- 172.21.15.169:0/1223325710 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38c0a6070 con 0x560dad774920 2024-09-13T06:29:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396755640 1 -- 172.21.15.169:0/1223325710 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c0af070 con 0x560dad774920 2024-09-13T06:29:19.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.733+0000 7fe396755640 1 -- 172.21.15.169:0/1223325710 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38c0aa5c0 con 0x560dad774920 2024-09-13T06:29:19.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 -- 172.21.15.169:0/1223325710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad774920 msgr2=0x560dad776d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 --2- 172.21.15.169:0/1223325710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad774920 0x560dad776d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00a5c0 tx=0x7fe38c01b340 comp rx=0 tx=0).stop 2024-09-13T06:29:19.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 -- 172.21.15.169:0/1223325710 shutdown_connections 2024-09-13T06:29:19.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 --2- 172.21.15.169:0/1223325710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad774920 0x560dad776d10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 -- 172.21.15.169:0/1223325710 >> 172.21.15.169:0/1223325710 conn(0x560dad76c070 msgr2=0x560dad76e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 -- 172.21.15.169:0/1223325710 shutdown_connections 2024-09-13T06:29:19.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.737+0000 7fe399c47980 1 -- 172.21.15.169:0/1223325710 wait complete. 2024-09-13T06:29:19.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe399c47980 1 Processor -- start 2024-09-13T06:29:19.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe399c47980 1 -- start start 2024-09-13T06:29:19.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe399c47980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad85b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe399c47980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560dad61f200 con 0x560dad770550 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad85b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad85b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35846/0 (socket says 172.21.15.169:35846) 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe397757640 1 -- 172.21.15.169:0/1450718135 learned_addr learned my addr 172.21.15.169:0/1450718135 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe397757640 1 -- 172.21.15.169:0/1450718135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dad85bf40 con 0x560dad770550 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.749+0000 7fe397757640 1 --2- 172.21.15.169:0/1450718135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad85b970 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3880016c0 tx=0x7fe388001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac79afb0203f9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe28560a640 1 -- 172.21.15.169:0/1450718135 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388016070 con 0x560dad770550 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe28560a640 1 -- 172.21.15.169:0/1450718135 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38800f640 con 0x560dad770550 2024-09-13T06:29:19.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe28560a640 1 -- 172.21.15.169:0/1450718135 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38800f9a0 con 0x560dad770550 2024-09-13T06:29:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/1450718135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 msgr2=0x560dad85b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 --2- 172.21.15.169:0/1450718135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad85b970 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3880016c0 tx=0x7fe388001b80 comp rx=0 tx=0).stop 2024-09-13T06:29:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/1450718135 shutdown_connections 2024-09-13T06:29:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 --2- 172.21.15.169:0/1450718135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad85b970 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/1450718135 >> 172.21.15.169:0/1450718135 conn(0x560dad76c070 msgr2=0x560dad8575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/1450718135 shutdown_connections 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/1450718135 wait complete. 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 Processor -- start 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- start start 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad862d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560dad777d60 con 0x560dad770550 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad862d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad862d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35858/0 (socket says 172.21.15.169:35858) 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe397757640 1 -- 172.21.15.169:0/22344173 learned_addr learned my addr 172.21.15.169:0/22344173 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe397757640 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dad863260 con 0x560dad770550 2024-09-13T06:29:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe397757640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad862d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe38800f610 tx=0x7fe388001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe283e07640 1 -- 172.21.15.169:0/22344173 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388016040 con 0x560dad770550 2024-09-13T06:29:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe283e07640 1 -- 172.21.15.169:0/22344173 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388011900 con 0x560dad770550 2024-09-13T06:29:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dad8634f0 con 0x560dad770550 2024-09-13T06:29:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe283e07640 1 -- 172.21.15.169:0/22344173 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388011c00 con 0x560dad770550 2024-09-13T06:29:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.753+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dad6e50d0 con 0x560dad770550 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe283e07640 1 -- 172.21.15.169:0/22344173 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe38802d440 con 0x560dad770550 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe283e07640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe27c0346a0 0x7fe27c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe283e07640 1 -- 172.21.15.169:0/22344173 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe388020070 con 0x560dad770550 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe396f56640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe27c0346a0 0x7fe27c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad774920 0x560dad869120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad6e5d50 con 0x560dad774920 2024-09-13T06:29:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397f58640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad774920 0x560dad869120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe396f56640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe27c0346a0 0x7fe27c036b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ae000 tx=0x7fe38c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397f58640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad774920 0x560dad869120 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397f58640 1 -- 172.21.15.169:0/22344173 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad774920 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad869dc0 0x560dad86c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad86c9f0 con 0x560dad869dc0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397757640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad869dc0 0x560dad86c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397757640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad869dc0 0x560dad86c280 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397757640 1 -- 172.21.15.169:0/22344173 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe38802a020 con 0x560dad869dc0 2024-09-13T06:29:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad86e2a0 con 0x560dad869dc0 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe397757640 1 -- 172.21.15.169:0/22344173 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe38802a020 con 0x560dad869dc0 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.757+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad86d4d0 con 0x560dad869dc0 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe397757640 1 -- 172.21.15.169:0/22344173 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe38802a020 con 0x560dad869dc0 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad86f650 0x560dad871a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad871f80 con 0x560dad86f650 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe396f56640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad86f650 0x560dad871a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe396f56640 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad86f650 0x560dad871a40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe396f56640 1 -- 172.21.15.169:0/22344173 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad86f650 2024-09-13T06:29:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 Processor -- start 2024-09-13T06:29:19.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 -- start start 2024-09-13T06:29:19.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 0x560dad87fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560dad678800 con 0x560dad87f940 2024-09-13T06:29:19.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 0x560dad87fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 0x560dad87fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35870/0 (socket says 172.21.15.169:35870) 2024-09-13T06:29:19.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe397757640 1 -- 172.21.15.169:0/988641454 learned_addr learned my addr 172.21.15.169:0/988641454 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe397757640 1 -- 172.21.15.169:0/988641454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dad8802a0 con 0x560dad87f940 2024-09-13T06:29:19.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe397757640 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 0x560dad87fd60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe388049740 tx=0x7fe3880482e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe281602640 1 -- 172.21.15.169:0/988641454 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38802b550 con 0x560dad87f940 2024-09-13T06:29:19.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe281602640 1 -- 172.21.15.169:0/988641454 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388010bc0 con 0x560dad87f940 2024-09-13T06:29:19.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dad880530 con 0x560dad87f940 2024-09-13T06:29:19.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe281602640 1 -- 172.21.15.169:0/988641454 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388010ea0 con 0x560dad87f940 2024-09-13T06:29:19.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.761+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dad8831b0 con 0x560dad87f940 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe281602640 1 -- 172.21.15.169:0/988641454 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe38802c730 con 0x560dad87f940 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe281602640 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2700345b0 0x7fe270036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe281602640 1 -- 172.21.15.169:0/988641454 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe388050b00 con 0x560dad87f940 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe396f56640 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2700345b0 0x7fe270036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 Processor -- start 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- start start 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad890b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe396f56640 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2700345b0 0x7fe270036a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x560dad6e61b0 tx=0x7fe38c005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560dad85c2c0 con 0x560dad890720 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad890b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad890b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35878/0 (socket says 172.21.15.169:35878) 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe397757640 1 -- 172.21.15.169:0/4024009584 learned_addr learned my addr 172.21.15.169:0/4024009584 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe397757640 1 -- 172.21.15.169:0/4024009584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dad8910d0 con 0x560dad890720 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe397757640 1 --2- 172.21.15.169:0/4024009584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad890b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe3880104f0 tx=0x7fe388042de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4a74ba9d43ea4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe27affd640 1 -- 172.21.15.169:0/4024009584 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38805e070 con 0x560dad890720 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe27affd640 1 -- 172.21.15.169:0/4024009584 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388042900 con 0x560dad890720 2024-09-13T06:29:19.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe27affd640 1 -- 172.21.15.169:0/4024009584 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38802be40 con 0x560dad890720 2024-09-13T06:29:19.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- 172.21.15.169:0/4024009584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 msgr2=0x560dad890b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 --2- 172.21.15.169:0/4024009584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad890b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe3880104f0 tx=0x7fe388042de0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- 172.21.15.169:0/4024009584 shutdown_connections 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 --2- 172.21.15.169:0/4024009584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad890b00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- 172.21.15.169:0/4024009584 >> 172.21.15.169:0/4024009584 conn(0x560dad888650 msgr2=0x560dad886750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- 172.21.15.169:0/4024009584 shutdown_connections 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- 172.21.15.169:0/4024009584 wait complete. 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 Processor -- start 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.765+0000 7fe399c47980 1 -- start start 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad8977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560dad8915f0 con 0x560dad890720 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad8977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397757640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad8977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35890/0 (socket says 172.21.15.169:35890) 2024-09-13T06:29:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 learned_addr learned my addr 172.21.15.169:0/4080523432 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dad897d20 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397757640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad8977e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe3880104f0 tx=0x7fe388002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe2797fa640 1 -- 172.21.15.169:0/4080523432 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388073070 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe2797fa640 1 -- 172.21.15.169:0/4080523432 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38803edf0 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dad897d20 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe2797fa640 1 -- 172.21.15.169:0/4080523432 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38801cc40 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dad897d20 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe2797fa640 1 -- 172.21.15.169:0/4080523432 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe388076070 con 0x560dad890720 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe2797fa640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe260034650 0x7fe260036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe2797fa640 1 -- 172.21.15.169:0/4080523432 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe38806a030 con 0x560dad890720 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe396f56640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe260034650 0x7fe260036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad8a2980 0x560dad8a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a5590 con 0x560dad8a2980 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397f58640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad8a2980 0x560dad8a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe396f56640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe260034650 0x7fe260036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe38c000c10 tx=0x7fe38c0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.769+0000 7fe397f58640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad8a2980 0x560dad8a4e40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 realm 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a1e30 con 0x560dad8a2980 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a6060 con 0x560dad8a2980 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad8a6e40 0x560dad8a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397757640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad8a6e40 0x560dad8a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397757640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad8a6e40 0x560dad8a9230 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8aa100 con 0x560dad8a6e40 2024-09-13T06:29:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 20 searching for the correct realm 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad8ab970 0x560dad8ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8ae500 con 0x560dad8ab970 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe396f56640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad8ab970 0x560dad8ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe396f56640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad8ab970 0x560dad8ade30 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.773+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8ae500 con 0x560dad8a6e40 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe388078060 0x7fe3880638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x7fe388078060 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe388078060 0x7fe3880638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe388078060 0x7fe3880638b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8ab970 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x7fe388078060 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.777+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x7fe388078060 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8ab970 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8ab970 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8ab970 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x7fe388078060 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a2980 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x7fe388078060 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.781+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8ab970 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x7fe388078060 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8ab970 2024-09-13T06:29:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a98b0 con 0x560dad8a6e40 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8a9da0 con 0x560dad8a2980 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.785+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8aa190 con 0x560dad8a6e40 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8aa190 con 0x560dad8ab970 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 zone default found 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 4 Realm: () 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 zonegroup default 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8ae980 con 0x7fe388078060 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b0760 con 0x560dad8ab970 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b0ba0 con 0x560dad8ab970 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 started sync module instance, tier type = 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.789+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8afba0 con 0x560dad8a6e40 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94616746131616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8afba0 con 0x560dad8a6e40 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b1660 con 0x560dad8a2980 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94616746135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b1f30 con 0x560dad8a2980 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b2970 con 0x560dad8a6e40 2024-09-13T06:29:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.793+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94616746131616] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94616746135920] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94616746140736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b1a80 con 0x560dad8a6e40 2024-09-13T06:29:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b3210 con 0x7fe388078060 2024-09-13T06:29:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94616746143072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b1a80 con 0x7fe388078060 2024-09-13T06:29:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.797+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b3c90 con 0x560dad8a6e40 2024-09-13T06:29:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94616746140736] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94616746143072] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94616746144128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b37a0 con 0x560dad8a6e40 2024-09-13T06:29:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b4530 con 0x560dad8ab970 2024-09-13T06:29:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94616746147968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b37a0 con 0x560dad8ab970 2024-09-13T06:29:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b53a0 con 0x560dad8ab970 2024-09-13T06:29:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.801+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94616746144128] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.805+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.805+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94616746147968] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.805+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94616746151664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b57c0 con 0x560dad8ab970 2024-09-13T06:29:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.805+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b48d0 con 0x7fe388078060 2024-09-13T06:29:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94616746151664] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94616746152720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b5730 con 0x7fe388078060 2024-09-13T06:29:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=0 2024-09-13T06:29:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=1 2024-09-13T06:29:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=2 2024-09-13T06:29:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=3 2024-09-13T06:29:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=4 2024-09-13T06:29:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=5 2024-09-13T06:29:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.809+0000 7fe399c47980 20 add_watcher() i=6 2024-09-13T06:29:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94616746152720] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 20 add_watcher() i=7 2024-09-13T06:29:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b91b0 con 0x560dad8a2980 2024-09-13T06:29:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94616746155216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b65a0 con 0x560dad8a2980 2024-09-13T06:29:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94616746155216] v31'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe399c47980 5 note: GC not initialized 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.813+0000 7fe24cfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 20 Filter name: none 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe1c67fc640 20 reqs_thread_entry: start 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8dc6e0 con 0x560dad8a2980 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8dd150 con 0x560dad8a2980 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8e2b20 con 0x560dad8a2980 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v31'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94616746337680 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8de160 con 0x560dad8a6e40 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94616746144128 notify 133143986183 ret 0) ==== 774+0+0 (crc 0 0 0) 0x560dad880530 con 0x560dad8a6e40 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe27affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94616746144128 notifier 4358 bl.length()=732 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe27affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe27affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe27affd640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe25c003eb0 con 0x560dad8a6e40 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.817+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.4 [notify cookie 94616746337680 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94616746337680 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dad8802a0 con 0x560dad8a6e40 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8e2590 con 0x560dad8a2980 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe399c47980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe399c47980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe399c47980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94616746337680 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560dad8dae40 con 0x560dad8a6e40 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 94616746131616 notify 133143986184 ret 0) ==== 208+0+0 (crc 0 0 0) 0x560dad8802a0 con 0x560dad8a6e40 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe27a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94616746131616 notifier 4358 bl.length()=166 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe27a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T06:29:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe27a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T06:29:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe27a7fc640 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe1cc003410 con 0x560dad8a6e40 2024-09-13T06:29:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(68 notify.0 [notify cookie 94616746337680 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== watch-notify(notify_complete (2) cookie 94616746337680 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dad6e50d0 con 0x560dad8a6e40 2024-09-13T06:29:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.821+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.829 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"qYj4POMOkcv9Hoxd29KNRX4mCV2r6hrQxodZ6dcl","active":true,"create_date":"2024-09-13T06:29:19.821794Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:19.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.825+0000 7fe24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:19.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.825+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94616746155216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8da510 con 0x560dad8a2980 2024-09-13T06:29:19.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.825+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94616746155216] v31'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.825+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94616746131616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8da510 con 0x560dad8a6e40 2024-09-13T06:29:19.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94616746131616] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 20 remove_watcher() i=0 2024-09-13T06:29:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 2 removed watcher, disabling cache 2024-09-13T06:29:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94616746135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8da510 con 0x560dad8a2980 2024-09-13T06:29:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94616746135920] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x560dad8a2980 2024-09-13T06:29:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 20 remove_watcher() i=1 2024-09-13T06:29:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94616746140736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8da510 con 0x560dad8a6e40 2024-09-13T06:29:19.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94616746140736] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 20 remove_watcher() i=2 2024-09-13T06:29:19.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.829+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94616746143072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b2440 con 0x7fe388078060 2024-09-13T06:29:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94616746143072] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe399c47980 20 remove_watcher() i=3 2024-09-13T06:29:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94616746144128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8da510 con 0x560dad8a6e40 2024-09-13T06:29:19.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe397757640 1 -- 172.21.15.169:0/4080523432 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94616746144128] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe388075030 con 0x560dad8a6e40 2024-09-13T06:29:19.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe399c47980 20 remove_watcher() i=4 2024-09-13T06:29:19.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94616746147968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b2440 con 0x560dad8ab970 2024-09-13T06:29:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94616746147968] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe399c47980 20 remove_watcher() i=5 2024-09-13T06:29:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.833+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94616746151664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8b31e0 con 0x560dad8ab970 2024-09-13T06:29:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe396f56640 1 -- 172.21.15.169:0/4080523432 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94616746151664] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe38c0aaad0 con 0x560dad8ab970 2024-09-13T06:29:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 20 remove_watcher() i=6 2024-09-13T06:29:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94616746152720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560dad8da510 con 0x7fe388078060 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94616746152720] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3900083f0 con 0x7fe388078060 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 20 remove_watcher() i=7 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad8a6e40 msgr2=0x560dad8a9230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad8a6e40 0x560dad8a9230 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad8a2980 msgr2=0x560dad8a4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad8a2980 0x560dad8a4e40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe388078060 msgr2=0x7fe3880638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe388078060 0x7fe3880638b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad8ab970 msgr2=0x560dad8ade30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad8ab970 0x560dad8ade30 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe260034650 msgr2=0x7fe260036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe260034650 0x7fe260036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe38c000c10 tx=0x7fe38c0c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 msgr2=0x560dad8977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/4080523432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad890720 0x560dad8977e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe3880104f0 tx=0x7fe388002f70 comp rx=0 tx=0).stop 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe397f58640 1 -- 172.21.15.169:0/4080523432 reap_dead start 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 shutdown_connections 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 >> 172.21.15.169:0/4080523432 conn(0x560dad888650 msgr2=0x560dad886720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 shutdown_connections 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/4080523432 wait complete. 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2700345b0 msgr2=0x7fe270036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2700345b0 0x7fe270036a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x560dad6e61b0 tx=0x7fe38c005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 msgr2=0x560dad87fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 0x560dad87fd60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe388049740 tx=0x7fe3880482e0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 shutdown_connections 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2700345b0 0x7fe270036a70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/988641454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad87f940 0x560dad87fd60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 >> 172.21.15.169:0/988641454 conn(0x560dad874a90 msgr2=0x560dad877510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 shutdown_connections 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/988641454 wait complete. 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad869dc0 msgr2=0x560dad86c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560dad869dc0 0x560dad86c280 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad774920 msgr2=0x560dad869120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560dad774920 0x560dad869120 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad86f650 msgr2=0x560dad871a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560dad86f650 0x560dad871a40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe27c0346a0 msgr2=0x7fe27c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe27c0346a0 0x7fe27c036b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ae000 tx=0x7fe38c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 msgr2=0x560dad862d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 --2- 172.21.15.169:0/22344173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560dad770550 0x560dad862d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe38800f610 tx=0x7fe388001260 comp rx=0 tx=0).stop 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe397f58640 1 -- 172.21.15.169:0/22344173 reap_dead start 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 shutdown_connections 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 >> 172.21.15.169:0/22344173 conn(0x560dad76c070 msgr2=0x560dad856120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 shutdown_connections 2024-09-13T06:29:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.837+0000 7fe399c47980 1 -- 172.21.15.169:0/22344173 wait complete. 2024-09-13T06:29:19.850 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'qYj4POMOkcv9Hoxd29KNRX4mCV2r6hrQxodZ6dcl', 'active': True, 'create_date': '2024-09-13T06:29:19.821794Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:19.850 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T06:29:19.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T06:29:19.851 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T06:29:19.929 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:19.930 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:19.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f364467a980 1 Processor -- start 2024-09-13T06:29:19.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f364467a980 1 -- start start 2024-09-13T06:29:19.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f364467a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562c2f54da30 0x562c2f54fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f364467a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c2f3d1ae0 con 0x562c2f4bda60 2024-09-13T06:29:19.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f364467a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x562c2f3f5e30 con 0x562c2f54da30 2024-09-13T06:29:19.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f3641989640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562c2f54da30 0x562c2f54fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f3641989640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562c2f54da30 0x562c2f54fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35892/0 (socket says 172.21.15.169:35892) 2024-09-13T06:29:19.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f3641989640 1 -- 172.21.15.169:0/130224451 learned_addr learned my addr 172.21.15.169:0/130224451 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f364218a640 1 --1- 172.21.15.169:0/130224451 >> v1:172.21.15.112:6789/0 conn(0x562c2f4bda60 0x562c2f54c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45112/0 (socket says 172.21.15.169:45112) 2024-09-13T06:29:19.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f3641989640 1 -- 172.21.15.169:0/130224451 >> v1:172.21.15.112:6789/0 conn(0x562c2f4bda60 legacy=0x562c2f54c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f3641989640 1 -- 172.21.15.169:0/130224451 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2f551370 con 0x562c2f54da30 2024-09-13T06:29:19.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.929+0000 7f3641989640 1 --2- 172.21.15.169:0/130224451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f54da30 0x562c2f54fe20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f363400a5c0 tx=0x7f363401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912603186896dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f3641188640 1 -- 172.21.15.169:0/130224451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36340a6070 con 0x562c2f54da30 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f3641188640 1 -- 172.21.15.169:0/130224451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36340af070 con 0x562c2f54da30 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f3641188640 1 -- 172.21.15.169:0/130224451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36340aa5c0 con 0x562c2f54da30 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 -- 172.21.15.169:0/130224451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f54da30 msgr2=0x562c2f54fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 --2- 172.21.15.169:0/130224451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f54da30 0x562c2f54fe20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f363400a5c0 tx=0x7f363401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 -- 172.21.15.169:0/130224451 shutdown_connections 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 --2- 172.21.15.169:0/130224451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f54da30 0x562c2f54fe20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 -- 172.21.15.169:0/130224451 >> 172.21.15.169:0/130224451 conn(0x562c2f544000 msgr2=0x562c2f546420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 -- 172.21.15.169:0/130224451 shutdown_connections 2024-09-13T06:29:19.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.933+0000 7f364467a980 1 -- 172.21.15.169:0/130224451 wait complete. 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 Processor -- start 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- start start 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f634a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562c2f3f7200 con 0x562c2f4bda60 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f634a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f634a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35896/0 (socket says 172.21.15.169:35896) 2024-09-13T06:29:19.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364218a640 1 -- 172.21.15.169:0/3315811556 learned_addr learned my addr 172.21.15.169:0/3315811556 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364218a640 1 -- 172.21.15.169:0/3315811556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2f635060 con 0x562c2f4bda60 2024-09-13T06:29:19.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364218a640 1 --2- 172.21.15.169:0/3315811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f634a90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3638001e50 tx=0x7f3638001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08a697cdc013e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f3530608640 1 -- 172.21.15.169:0/3315811556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363800e5d0 con 0x562c2f4bda60 2024-09-13T06:29:19.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f3530608640 1 -- 172.21.15.169:0/3315811556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363800e770 con 0x562c2f4bda60 2024-09-13T06:29:19.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f3530608640 1 -- 172.21.15.169:0/3315811556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363800eab0 con 0x562c2f4bda60 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- 172.21.15.169:0/3315811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 msgr2=0x562c2f634a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 --2- 172.21.15.169:0/3315811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f634a90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3638001e50 tx=0x7f3638001e80 comp rx=0 tx=0).stop 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- 172.21.15.169:0/3315811556 shutdown_connections 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 --2- 172.21.15.169:0/3315811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f634a90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- 172.21.15.169:0/3315811556 >> 172.21.15.169:0/3315811556 conn(0x562c2f544000 msgr2=0x562c2f6306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- 172.21.15.169:0/3315811556 shutdown_connections 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.945+0000 7f364467a980 1 -- 172.21.15.169:0/3315811556 wait complete. 2024-09-13T06:29:19.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 Processor -- start 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 -- start start 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f549c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562c2f550db0 con 0x562c2f4bda60 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f549c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f549c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35904/0 (socket says 172.21.15.169:35904) 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364218a640 1 -- 172.21.15.169:0/3335774919 learned_addr learned my addr 172.21.15.169:0/3335774919 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364218a640 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2f548330 con 0x562c2f4bda60 2024-09-13T06:29:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364218a640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f549c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x562c2f635c70 tx=0x7f3638000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f352ee05640 1 -- 172.21.15.169:0/3335774919 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638001260 con 0x562c2f4bda60 2024-09-13T06:29:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c2f5485c0 con 0x562c2f4bda60 2024-09-13T06:29:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f352ee05640 1 -- 172.21.15.169:0/3335774919 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363800fa40 con 0x562c2f4bda60 2024-09-13T06:29:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f352ee05640 1 -- 172.21.15.169:0/3335774919 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363800fd80 con 0x562c2f4bda60 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2f548ab0 con 0x562c2f4bda60 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f352ee05640 1 -- 172.21.15.169:0/3335774919 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3638017070 con 0x562c2f4bda60 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f352ee05640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3528034650 0x7f3528036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f352ee05640 1 -- 172.21.15.169:0/3335774919 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3638015020 con 0x562c2f4bda60 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f3641989640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3528034650 0x7f3528036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f54da30 0x562c2f6452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f645800 con 0x562c2f54da30 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f364298b640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f54da30 0x562c2f6452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.949+0000 7f3641989640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3528034650 0x7f3528036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36340ae000 tx=0x7f36340a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364298b640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f54da30 0x562c2f6452c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364298b640 1 -- 172.21.15.169:0/3335774919 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f54da30 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f646300 0x562c2f6487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f648f30 con 0x562c2f646300 2024-09-13T06:29:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364218a640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f646300 0x562c2f6487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364218a640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f646300 0x562c2f6487c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364218a640 1 -- 172.21.15.169:0/3335774919 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f363802e070 con 0x562c2f646300 2024-09-13T06:29:19.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f64a7e0 con 0x562c2f646300 2024-09-13T06:29:19.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364218a640 1 -- 172.21.15.169:0/3335774919 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f363802e070 con 0x562c2f646300 2024-09-13T06:29:19.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f649920 con 0x562c2f646300 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364218a640 1 -- 172.21.15.169:0/3335774919 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f363802e070 con 0x562c2f646300 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f64bb90 0x562c2f64df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f64e4c0 con 0x562c2f64bb90 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f3641989640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f64bb90 0x562c2f64df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f3641989640 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f64bb90 0x562c2f64df80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.953+0000 7f3641989640 1 -- 172.21.15.169:0/3335774919 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f64bb90 2024-09-13T06:29:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 Processor -- start 2024-09-13T06:29:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 -- start start 2024-09-13T06:29:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 0x562c2f65c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562c2f450800 con 0x562c2f65beb0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 0x562c2f65c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 0x562c2f65c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35906/0 (socket says 172.21.15.169:35906) 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364218a640 1 -- 172.21.15.169:0/2425469656 learned_addr learned my addr 172.21.15.169:0/2425469656 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364218a640 1 -- 172.21.15.169:0/2425469656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2f65c810 con 0x562c2f65beb0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364218a640 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 0x562c2f65c2d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f363804aa50 tx=0x7f3638017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3527fff640 1 -- 172.21.15.169:0/2425469656 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638042120 con 0x562c2f65beb0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c2f65caa0 con 0x562c2f65beb0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3527fff640 1 -- 172.21.15.169:0/2425469656 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36380422c0 con 0x562c2f65beb0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3527fff640 1 -- 172.21.15.169:0/2425469656 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363804aac0 con 0x562c2f65beb0 2024-09-13T06:29:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2f65f720 con 0x562c2f65beb0 2024-09-13T06:29:19.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3527fff640 1 -- 172.21.15.169:0/2425469656 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3638042510 con 0x562c2f65beb0 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3527fff640 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f351c034650 0x7f351c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3527fff640 1 -- 172.21.15.169:0/2425469656 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3638040b10 con 0x562c2f65beb0 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3641989640 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f351c034650 0x7f351c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 Processor -- start 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 -- start start 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f668980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f364467a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562c2f6353e0 con 0x562c2f6685a0 2024-09-13T06:29:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.957+0000 7f3641989640 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f351c034650 0x7f351c036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x562c2f649cc0 tx=0x7f3634005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f668980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f668980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35914/0 (socket says 172.21.15.169:35914) 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 -- 172.21.15.169:0/1351498305 learned_addr learned my addr 172.21.15.169:0/1351498305 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 -- 172.21.15.169:0/1351498305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2f668f50 con 0x562c2f6685a0 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 --2- 172.21.15.169:0/1351498305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f668980 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36380197f0 tx=0x7f36380313f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d2adf8b1f022d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f3525ffb640 1 -- 172.21.15.169:0/1351498305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638040e30 con 0x562c2f6685a0 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f3525ffb640 1 -- 172.21.15.169:0/1351498305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638019d80 con 0x562c2f6685a0 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f3525ffb640 1 -- 172.21.15.169:0/1351498305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363801dc70 con 0x562c2f6685a0 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- 172.21.15.169:0/1351498305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 msgr2=0x562c2f668980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 --2- 172.21.15.169:0/1351498305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f668980 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36380197f0 tx=0x7f36380313f0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- 172.21.15.169:0/1351498305 shutdown_connections 2024-09-13T06:29:19.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 --2- 172.21.15.169:0/1351498305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f668980 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- 172.21.15.169:0/1351498305 >> 172.21.15.169:0/1351498305 conn(0x562c2f664980 msgr2=0x562c2f662a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- 172.21.15.169:0/1351498305 shutdown_connections 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- 172.21.15.169:0/1351498305 wait complete. 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 Processor -- start 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- start start 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f66f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364467a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562c2f6693f0 con 0x562c2f6685a0 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f66f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f66f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35916/0 (socket says 172.21.15.169:35916) 2024-09-13T06:29:19.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 learned_addr learned my addr 172.21.15.169:0/1469642554 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2f66fc40 con 0x562c2f6685a0 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f364218a640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f66f700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36380197f0 tx=0x7f363801e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.961+0000 7f3513fff640 1 -- 172.21.15.169:0/1469642554 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363806f070 con 0x562c2f6685a0 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3513fff640 1 -- 172.21.15.169:0/1469642554 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638040e30 con 0x562c2f6685a0 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c2f66fc40 con 0x562c2f6685a0 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3513fff640 1 -- 172.21.15.169:0/1469642554 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638047200 con 0x562c2f6685a0 2024-09-13T06:29:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2f6700b0 con 0x562c2f6685a0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3513fff640 1 -- 172.21.15.169:0/1469642554 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3638072070 con 0x562c2f6685a0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3513fff640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f350c034650 0x7f350c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3513fff640 1 -- 172.21.15.169:0/1469642554 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3638075af0 con 0x562c2f6685a0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3641989640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f350c034650 0x7f350c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f67a670 0x562c2f67cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f67d260 con 0x562c2f67a670 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364298b640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f67a670 0x562c2f67cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f3641989640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f350c034650 0x7f350c036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3634000c10 tx=0x7f36340c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364298b640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f67a670 0x562c2f67cb10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 realm 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f679b60 con 0x562c2f67a670 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f67dd30 con 0x562c2f67a670 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f67eb10 0x562c2f680f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f681580 con 0x562c2f67eb10 2024-09-13T06:29:19.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364218a640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f67eb10 0x562c2f680f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.965+0000 7f364218a640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f67eb10 0x562c2f680f00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f681dd0 con 0x562c2f67eb10 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 20 searching for the correct realm 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f683b40 0x562c2f685f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f3641989640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f683b40 0x562c2f685f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f3641989640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f683b40 0x562c2f685f30 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364218a640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3638074060 0x7f3638078170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x7f3638074060 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3638074060 0x7f3638078170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:19.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3638074060 0x7f3638078170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.969+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x7f3638074060 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x7f3638074060 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.973+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x7f3638074060 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67a670 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x7f3638074060 2024-09-13T06:29:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x7f3638074060 2024-09-13T06:29:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f683b40 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.977+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6865b0 con 0x562c2f67eb10 2024-09-13T06:29:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f682750 con 0x562c2f67a670 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f682ff0 con 0x562c2f67eb10 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f682390 con 0x562c2f683b40 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 zone default found 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 4 Realm: () 2024-09-13T06:29:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 zonegroup default 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f686ee0 con 0x7f3638074060 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f689190 con 0x562c2f683b40 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f689530 con 0x562c2f683b40 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 started sync module instance, tier type = 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.981+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6885d0 con 0x562c2f67eb10 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747773930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6885d0 con 0x562c2f67eb10 2024-09-13T06:29:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f689ef0 con 0x562c2f67a670 2024-09-13T06:29:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747773934144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68a740 con 0x562c2f67a670 2024-09-13T06:29:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68b140 con 0x562c2f67eb10 2024-09-13T06:29:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747773930272] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.985+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747773934144] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747773927712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68a290 con 0x562c2f67eb10 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68b9e0 con 0x7f3638074060 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747773941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68a290 con 0x7f3638074060 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68c460 con 0x562c2f67eb10 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747773927712] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747773941040] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747773942096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68bf70 con 0x562c2f67eb10 2024-09-13T06:29:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.989+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68cd30 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747773945984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68bf70 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68dba0 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747773942096] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747773949680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68dfc0 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68e980 con 0x7f3638074060 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747773945984] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747773949680] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747773950736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68df30 con 0x7f3638074060 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=0 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=1 2024-09-13T06:29:20.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=2 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=3 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=4 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=5 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.993+0000 7f364467a980 20 add_watcher() i=6 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.997+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747773950736] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.997+0000 7f364467a980 20 add_watcher() i=7 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.997+0000 7f364467a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.997+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6919b0 con 0x562c2f67a670 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.997+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:19.997+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747773953232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68eda0 con 0x562c2f67a670 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747773953232] v31'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f34f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 5 note: GC not initialized 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f34737fe640 20 reqs_thread_entry: start 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 20 Filter name: none 2024-09-13T06:29:20.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f34717fa640 20 reqs_thread_entry: start 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6b4f20 con 0x562c2f67a670 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6bb6b0 con 0x562c2f67a670 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94747774136608 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6b6da0 con 0x562c2f67eb10 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94747773942096 notify 133143986185 ret 0) ==== 774+0+0 (crc 0 0 0) 0x562c2f65c810 con 0x562c2f67eb10 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f3525ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94747773942096 notifier 4365 bl.length()=732 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f3525ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f3525ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94747774136608 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.001+0000 7f3525ffb640 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3508003eb0 con 0x562c2f67eb10 2024-09-13T06:29:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.005+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.005+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94747774136608 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c2f548ab0 con 0x562c2f67eb10 2024-09-13T06:29:20.010 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.005+0000 7f34f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.005+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747773953232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f6b71d0 con 0x562c2f67a670 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.005+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94747773953232] v31'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.005+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747773930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68e4d0 con 0x562c2f67eb10 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94747773930272] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364467a980 20 remove_watcher() i=0 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364467a980 2 removed watcher, disabling cache 2024-09-13T06:29:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747773934144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68e4d0 con 0x562c2f67a670 2024-09-13T06:29:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94747773934144] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x562c2f67a670 2024-09-13T06:29:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364467a980 20 remove_watcher() i=1 2024-09-13T06:29:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.009+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747773927712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68e4d0 con 0x562c2f67eb10 2024-09-13T06:29:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94747773927712] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364467a980 20 remove_watcher() i=2 2024-09-13T06:29:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747773941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f688120 con 0x7f3638074060 2024-09-13T06:29:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94747773941040] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364467a980 20 remove_watcher() i=3 2024-09-13T06:29:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747773942096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68e4d0 con 0x562c2f67eb10 2024-09-13T06:29:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364218a640 1 -- 172.21.15.169:0/1469642554 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94747773942096] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3638071030 con 0x562c2f67eb10 2024-09-13T06:29:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.013+0000 7f364467a980 20 remove_watcher() i=4 2024-09-13T06:29:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747773945984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f688120 con 0x562c2f683b40 2024-09-13T06:29:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94747773945984] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f364467a980 20 remove_watcher() i=5 2024-09-13T06:29:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747773949680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68e4d0 con 0x562c2f683b40 2024-09-13T06:29:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f3641989640 1 -- 172.21.15.169:0/1469642554 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94747773949680] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340aaae0 con 0x562c2f683b40 2024-09-13T06:29:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f364467a980 20 remove_watcher() i=6 2024-09-13T06:29:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.017+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747773950736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c2f68c880 con 0x7f3638074060 2024-09-13T06:29:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94747773950736] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363c00a4d0 con 0x7f3638074060 2024-09-13T06:29:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 20 remove_watcher() i=7 2024-09-13T06:29:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f67eb10 msgr2=0x562c2f680f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f67eb10 0x562c2f680f00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f67a670 msgr2=0x562c2f67cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f67a670 0x562c2f67cb10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3638074060 msgr2=0x7f3638078170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3638074060 0x7f3638078170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f683b40 msgr2=0x562c2f685f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f683b40 0x562c2f685f30 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f350c034650 msgr2=0x7f350c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f350c034650 0x7f350c036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3634000c10 tx=0x7f36340c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 msgr2=0x562c2f66f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f66f700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36380197f0 tx=0x7f363801e420 comp rx=0 tx=0).stop 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364298b640 1 -- 172.21.15.169:0/1469642554 reap_dead start 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 shutdown_connections 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/1469642554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f6685a0 0x562c2f66f700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 >> 172.21.15.169:0/1469642554 conn(0x562c2f664980 msgr2=0x562c2f662a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 shutdown_connections 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/1469642554 wait complete. 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f351c034650 msgr2=0x7f351c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f351c034650 0x7f351c036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x562c2f649cc0 tx=0x7f3634005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 msgr2=0x562c2f65c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 0x562c2f65c2d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f363804aa50 tx=0x7f3638017d50 comp rx=0 tx=0).stop 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 shutdown_connections 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f351c034650 0x7f351c036b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 --2- 172.21.15.169:0/2425469656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f65beb0 0x562c2f65c2d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 >> 172.21.15.169:0/2425469656 conn(0x562c2f651000 msgr2=0x562c2f653a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 shutdown_connections 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.021+0000 7f364467a980 1 -- 172.21.15.169:0/2425469656 wait complete. 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f646300 msgr2=0x562c2f6487c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562c2f646300 0x562c2f6487c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f54da30 msgr2=0x562c2f6452c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562c2f54da30 0x562c2f6452c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f64bb90 msgr2=0x562c2f64df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562c2f64bb90 0x562c2f64df80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3528034650 msgr2=0x7f3528036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3528034650 0x7f3528036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36340ae000 tx=0x7f36340a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 msgr2=0x562c2f549c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 --2- 172.21.15.169:0/3335774919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562c2f4bda60 0x562c2f549c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x562c2f635c70 tx=0x7f3638000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364298b640 1 -- 172.21.15.169:0/3335774919 reap_dead start 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 shutdown_connections 2024-09-13T06:29:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 >> 172.21.15.169:0/3335774919 conn(0x562c2f544000 msgr2=0x562c2f62f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 shutdown_connections 2024-09-13T06:29:20.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.025+0000 7f364467a980 1 -- 172.21.15.169:0/3335774919 wait complete. 2024-09-13T06:29:20.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:20.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:20.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:20.035 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:20.105 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:20.106 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:20.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f553002c980 1 Processor -- start 2024-09-13T06:29:20.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f553002c980 1 -- start start 2024-09-13T06:29:20.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f553002c980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5608c972aec0 0x5608c972d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f553002c980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5608c95acae0 con 0x5608c9699290 2024-09-13T06:29:20.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f553002c980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5608c95d0e30 con 0x5608c972aec0 2024-09-13T06:29:20.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552db3c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5608c9699290 0x5608c97297a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45128/0 (socket says 172.21.15.169:45128) 2024-09-13T06:29:20.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552db3c640 1 -- 172.21.15.169:0/1947260106 learned_addr learned my addr 172.21.15.169:0/1947260106 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:20.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552d33b640 1 --2- 172.21.15.169:0/1947260106 >> v2:172.21.15.112:3300/0 conn(0x5608c972aec0 0x5608c972d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552cb3a640 1 -- 172.21.15.169:0/1947260106 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237730965 0 0) 0x5608c95acae0 con 0x5608c9699290 2024-09-13T06:29:20.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552cb3a640 1 -- 172.21.15.169:0/1947260106 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5518001e20 con 0x5608c9699290 2024-09-13T06:29:20.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552cb3a640 1 -- 172.21.15.169:0/1947260106 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1527804447 0 0) 0x7f5518001e20 con 0x5608c9699290 2024-09-13T06:29:20.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552d33b640 1 -- 172.21.15.169:0/1947260106 >> v1:172.21.15.112:6789/0 conn(0x5608c9699290 legacy=0x5608c97297a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.105+0000 7f552d33b640 1 -- 172.21.15.169:0/1947260106 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c9699670 con 0x5608c972aec0 2024-09-13T06:29:20.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f552d33b640 1 --2- 172.21.15.169:0/1947260106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c972aec0 0x5608c972d2b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f552400a480 tx=0x7f552401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4585ef50a22eacae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f552cb3a640 1 -- 172.21.15.169:0/1947260106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55240b0070 con 0x5608c972aec0 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f552cb3a640 1 -- 172.21.15.169:0/1947260106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55240ab540 con 0x5608c972aec0 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f552cb3a640 1 -- 172.21.15.169:0/1947260106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55240ab820 con 0x5608c972aec0 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 -- 172.21.15.169:0/1947260106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c972aec0 msgr2=0x5608c972d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 --2- 172.21.15.169:0/1947260106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c972aec0 0x5608c972d2b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f552400a480 tx=0x7f552401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 -- 172.21.15.169:0/1947260106 shutdown_connections 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 --2- 172.21.15.169:0/1947260106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c972aec0 0x5608c972d2b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 -- 172.21.15.169:0/1947260106 >> 172.21.15.169:0/1947260106 conn(0x5608c971f090 msgr2=0x5608c97214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 -- 172.21.15.169:0/1947260106 shutdown_connections 2024-09-13T06:29:20.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.109+0000 7f553002c980 1 -- 172.21.15.169:0/1947260106 wait complete. 2024-09-13T06:29:20.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f553002c980 1 Processor -- start 2024-09-13T06:29:20.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f553002c980 1 -- start start 2024-09-13T06:29:20.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f553002c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9811a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f553002c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608c95d2200 con 0x5608c9699290 2024-09-13T06:29:20.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9811a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9811a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35938/0 (socket says 172.21.15.169:35938) 2024-09-13T06:29:20.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f552db3c640 1 -- 172.21.15.169:0/2653455143 learned_addr learned my addr 172.21.15.169:0/2653455143 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f552db3c640 1 -- 172.21.15.169:0/2653455143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c9812030 con 0x5608c9699290 2024-09-13T06:29:20.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f552db3c640 1 --2- 172.21.15.169:0/2653455143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9811a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5520001de0 tx=0x7f552000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b91382127c76ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f541be07640 1 -- 172.21.15.169:0/2653455143 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520012020 con 0x5608c9699290 2024-09-13T06:29:20.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f541be07640 1 -- 172.21.15.169:0/2653455143 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552000e7e0 con 0x5608c9699290 2024-09-13T06:29:20.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.121+0000 7f541be07640 1 -- 172.21.15.169:0/2653455143 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552000eb00 con 0x5608c9699290 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2653455143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 msgr2=0x5608c9811a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 --2- 172.21.15.169:0/2653455143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9811a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5520001de0 tx=0x7f552000b6d0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2653455143 shutdown_connections 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 --2- 172.21.15.169:0/2653455143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9811a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2653455143 >> 172.21.15.169:0/2653455143 conn(0x5608c971f090 msgr2=0x5608c980d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2653455143 shutdown_connections 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2653455143 wait complete. 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 Processor -- start 2024-09-13T06:29:20.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- start start 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9818e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608c9730220 con 0x5608c9699290 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9818e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9818e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35942/0 (socket says 172.21.15.169:35942) 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552db3c640 1 -- 172.21.15.169:0/2554043319 learned_addr learned my addr 172.21.15.169:0/2554043319 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552db3c640 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c9819340 con 0x5608c9699290 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552db3c640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9818e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5520000c10 tx=0x7f55200040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f541a604640 1 -- 172.21.15.169:0/2554043319 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520012030 con 0x5608c9699290 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608c98195d0 con 0x5608c9699290 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f541a604640 1 -- 172.21.15.169:0/2554043319 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5520000ee0 con 0x5608c9699290 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f541a604640 1 -- 172.21.15.169:0/2554043319 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552001aaa0 con 0x5608c9699290 2024-09-13T06:29:20.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c981c2b0 con 0x5608c9699290 2024-09-13T06:29:20.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f541a604640 1 -- 172.21.15.169:0/2554043319 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5520015020 con 0x5608c9699290 2024-09-13T06:29:20.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f541a604640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5414034650 0x7f5414036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f541a604640 1 -- 172.21.15.169:0/2554043319 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5520020030 con 0x5608c9699290 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552d33b640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5414034650 0x7f5414036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c972aec0 0x5608c981fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c98203e0 con 0x5608c972aec0 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.125+0000 7f552e33d640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c972aec0 0x5608c981fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552d33b640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5414034650 0x7f5414036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55240ad000 tx=0x7f55240a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552e33d640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c972aec0 0x5608c981fd90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552e33d640 1 -- 172.21.15.169:0/2554043319 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c972aec0 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9821200 0x5608c98235f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9823c50 con 0x5608c9821200 2024-09-13T06:29:20.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552db3c640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9821200 0x5608c98235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552db3c640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9821200 0x5608c98235f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552db3c640 1 -- 172.21.15.169:0/2554043319 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5520008030 con 0x5608c9821200 2024-09-13T06:29:20.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9825500 con 0x5608c9821200 2024-09-13T06:29:20.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552db3c640 1 -- 172.21.15.169:0/2554043319 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5520008030 con 0x5608c9821200 2024-09-13T06:29:20.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9824730 con 0x5608c9821200 2024-09-13T06:29:20.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552db3c640 1 -- 172.21.15.169:0/2554043319 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5520008030 con 0x5608c9821200 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c98268b0 0x5608c9828ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c98291e0 con 0x5608c98268b0 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552d33b640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c98268b0 0x5608c9828ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.129+0000 7f552d33b640 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c98268b0 0x5608c9828ca0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552d33b640 1 -- 172.21.15.169:0/2554043319 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55240b3040 con 0x5608c98268b0 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 Processor -- start 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 -- start start 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 0x5608c9836f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608c962b800 con 0x5608c9836b60 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 0x5608c9836f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 0x5608c9836f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35946/0 (socket says 172.21.15.169:35946) 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552db3c640 1 -- 172.21.15.169:0/3096363013 learned_addr learned my addr 172.21.15.169:0/3096363013 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552db3c640 1 -- 172.21.15.169:0/3096363013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c98374c0 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552db3c640 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 0x5608c9836f80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f552004a110 tx=0x7f5520016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f54137fe640 1 -- 172.21.15.169:0/3096363013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520017c50 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f54137fe640 1 -- 172.21.15.169:0/3096363013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552004b020 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608c9837750 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f54137fe640 1 -- 172.21.15.169:0/3096363013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520048940 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c983a3d0 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f54137fe640 1 -- 172.21.15.169:0/3096363013 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f552004e030 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f54137fe640 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5408034650 0x7f5408036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f54137fe640 1 -- 172.21.15.169:0/3096363013 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f552004c070 con 0x5608c9836b60 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f552d33b640 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5408034650 0x7f5408036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.133+0000 7f553002c980 1 Processor -- start 2024-09-13T06:29:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- start start 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552d33b640 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5408034650 0x7f5408036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5608c981d3f0 tx=0x7f5524005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c9843a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608c98123b0 con 0x5608c9843620 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c9843a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c9843a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35954/0 (socket says 172.21.15.169:35954) 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 -- 172.21.15.169:0/568282565 learned_addr learned my addr 172.21.15.169:0/568282565 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 -- 172.21.15.169:0/568282565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c9843fd0 con 0x5608c9843620 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 --2- 172.21.15.169:0/568282565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c9843a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f552001afa0 tx=0x7f5520048ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d256157ed9f812b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f54117fa640 1 -- 172.21.15.169:0/568282565 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552000da60 con 0x5608c9843620 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f54117fa640 1 -- 172.21.15.169:0/568282565 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5520041330 con 0x5608c9843620 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f54117fa640 1 -- 172.21.15.169:0/568282565 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520041bc0 con 0x5608c9843620 2024-09-13T06:29:20.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- 172.21.15.169:0/568282565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 msgr2=0x5608c9843a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 --2- 172.21.15.169:0/568282565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c9843a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f552001afa0 tx=0x7f5520048ae0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- 172.21.15.169:0/568282565 shutdown_connections 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 --2- 172.21.15.169:0/568282565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c9843a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- 172.21.15.169:0/568282565 >> 172.21.15.169:0/568282565 conn(0x5608c983fa00 msgr2=0x5608c983db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- 172.21.15.169:0/568282565 shutdown_connections 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- 172.21.15.169:0/568282565 wait complete. 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 Processor -- start 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- start start 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c984a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608c9844470 con 0x5608c9843620 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c984a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c984a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35956/0 (socket says 172.21.15.169:35956) 2024-09-13T06:29:20.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 learned_addr learned my addr 172.21.15.169:0/2294783184 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c984acf0 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f552db3c640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c984a7b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5520053510 tx=0x7f552001ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f53ff7fe640 1 -- 172.21.15.169:0/2294783184 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520073070 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608c984acf0 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f53ff7fe640 1 -- 172.21.15.169:0/2294783184 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5520022320 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.137+0000 7f53ff7fe640 1 -- 172.21.15.169:0/2294783184 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520041bc0 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c984acf0 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f53ff7fe640 1 -- 172.21.15.169:0/2294783184 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5520076070 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f53ff7fe640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53f8034650 0x7f53f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f53ff7fe640 1 -- 172.21.15.169:0/2294783184 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f552006a030 con 0x5608c9843620 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552d33b640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53f8034650 0x7f53f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c98558d0 0x5608c9857d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c98584c0 con 0x5608c98558d0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552e33d640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c98558d0 0x5608c9857d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552d33b640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53f8034650 0x7f53f8036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5608c9825450 tx=0x7f55240a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552e33d640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c98558d0 0x5608c9857d70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 realm 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9854dc0 con 0x5608c98558d0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9858f90 con 0x5608c98558d0 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9859b40 0x5608c985c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c985c770 con 0x5608c9859b40 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552db3c640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9859b40 0x5608c985c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.141+0000 7f552db3c640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9859b40 0x5608c985c000 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 20 searching for the correct realm 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c985ed80 0x5608c9861170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c9861780 con 0x5608c985ed80 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552d33b640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c985ed80 0x5608c9861170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552d33b640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c985ed80 0x5608c9861170 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c9861780 con 0x5608c9859b40 2024-09-13T06:29:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552db3c640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5520078060 0x7f552001c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x7f5520078060 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5520078060 0x7f552001c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5520078060 0x7f552001c0e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c985ed80 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.145+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x7f5520078060 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x7f5520078060 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c985ed80 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.149+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c985ed80 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c985ed80 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x7f5520078060 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c98558d0 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x7f5520078060 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c985ed80 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x7f5520078060 2024-09-13T06:29:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c985ed80 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.153+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d010 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c985d860 con 0x5608c98558d0 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c985dc50 con 0x5608c9859b40 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c985dc50 con 0x5608c985ed80 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 zone default found 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 4 Realm: () 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 zonegroup default 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9861c00 con 0x7f5520078060 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863980 con 0x5608c985ed80 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863d20 con 0x5608c985ed80 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 started sync module instance, tier type = 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.157+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9862e20 con 0x5608c9859b40 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94595740742512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9862e20 con 0x5608c9859b40 2024-09-13T06:29:20.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9864740 con 0x5608c98558d0 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94595740746288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9864fe0 con 0x5608c98558d0 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c98659e0 con 0x5608c9859b40 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94595740746288] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94595740742512] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94595740739952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9864b30 con 0x5608c9859b40 2024-09-13T06:29:20.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.161+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c98662b0 con 0x7f5520078060 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94595740753408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9864b30 con 0x7f5520078060 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9866d30 con 0x5608c9859b40 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94595740739952] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94595740753408] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94595740754464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9866840 con 0x5608c9859b40 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.165+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c98675d0 con 0x5608c985ed80 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.169+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.169+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94595740758304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9866840 con 0x5608c985ed80 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.169+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9868440 con 0x5608c985ed80 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.169+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94595740754464] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.169+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94595740758304] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94595740751088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9868440 con 0x5608c985ed80 2024-09-13T06:29:20.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9868c90 con 0x7f5520078060 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94595740763712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c98690e0 con 0x7f5520078060 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 20 add_watcher() i=0 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 20 add_watcher() i=1 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 20 add_watcher() i=2 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 20 add_watcher() i=3 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 20 add_watcher() i=4 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.173+0000 7f553002c980 20 add_watcher() i=5 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94595740751088] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f553002c980 20 add_watcher() i=6 2024-09-13T06:29:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94595740763712] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f553002c980 20 add_watcher() i=7 2024-09-13T06:29:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f553002c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c9867f90 con 0x5608c98558d0 2024-09-13T06:29:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.177+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94595740762000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9869660 con 0x5608c98558d0 2024-09-13T06:29:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94595740762000] v31'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f53df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 5 note: GC not initialized 2024-09-13T06:29:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f53de7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 20 Filter name: none 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f534ffff640 20 reqs_thread_entry: start 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5608c988f3d0 con 0x5608c98558d0 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:29:20.185 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f53df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.181+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94595740762000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c988df80 con 0x5608c98558d0 2024-09-13T06:29:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.185+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94595740762000] v31'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.185+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94595740742512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9867f90 con 0x5608c9859b40 2024-09-13T06:29:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.185+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94595740742512] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.185+0000 7f553002c980 20 remove_watcher() i=0 2024-09-13T06:29:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.185+0000 7f553002c980 2 removed watcher, disabling cache 2024-09-13T06:29:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.185+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94595740746288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863370 con 0x5608c98558d0 2024-09-13T06:29:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94595740746288] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x5608c98558d0 2024-09-13T06:29:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f553002c980 20 remove_watcher() i=1 2024-09-13T06:29:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94595740739952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863370 con 0x5608c9859b40 2024-09-13T06:29:20.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94595740739952] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f553002c980 20 remove_watcher() i=2 2024-09-13T06:29:20.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94595740753408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863370 con 0x7f5520078060 2024-09-13T06:29:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94595740753408] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f553002c980 20 remove_watcher() i=3 2024-09-13T06:29:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.189+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94595740754464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9865e00 con 0x5608c9859b40 2024-09-13T06:29:20.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.193+0000 7f552db3c640 1 -- 172.21.15.169:0/2294783184 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94595740754464] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5520075030 con 0x5608c9859b40 2024-09-13T06:29:20.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.193+0000 7f553002c980 20 remove_watcher() i=4 2024-09-13T06:29:20.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.193+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94595740758304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863370 con 0x5608c985ed80 2024-09-13T06:29:20.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.193+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94595740758304] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.193+0000 7f553002c980 20 remove_watcher() i=5 2024-09-13T06:29:20.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.193+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94595740751088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c9863370 con 0x5608c985ed80 2024-09-13T06:29:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f552d33b640 1 -- 172.21.15.169:0/2294783184 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94595740751088] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240ca030 con 0x5608c985ed80 2024-09-13T06:29:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 20 remove_watcher() i=6 2024-09-13T06:29:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94595740763712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5608c98654f0 con 0x7f5520078060 2024-09-13T06:29:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94595740763712] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552800a4d0 con 0x7f5520078060 2024-09-13T06:29:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 20 remove_watcher() i=7 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9859b40 msgr2=0x5608c985c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9859b40 0x5608c985c000 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c98558d0 msgr2=0x5608c9857d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c98558d0 0x5608c9857d70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5520078060 msgr2=0x7f552001c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5520078060 0x7f552001c0e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c985ed80 msgr2=0x5608c9861170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c985ed80 0x5608c9861170 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53f8034650 msgr2=0x7f53f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53f8034650 0x7f53f8036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5608c9825450 tx=0x7f55240a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 msgr2=0x5608c984a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c984a7b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5520053510 tx=0x7f552001ef20 comp rx=0 tx=0).stop 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f552e33d640 1 -- 172.21.15.169:0/2294783184 reap_dead start 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 shutdown_connections 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2294783184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9843620 0x5608c984a7b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 >> 172.21.15.169:0/2294783184 conn(0x5608c983fa00 msgr2=0x5608c983dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 shutdown_connections 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2294783184 wait complete. 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5408034650 msgr2=0x7f5408036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5408034650 0x7f5408036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5608c981d3f0 tx=0x7f5524005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 msgr2=0x5608c9836f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 0x5608c9836f80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f552004a110 tx=0x7f5520016b00 comp rx=0 tx=0).stop 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 shutdown_connections 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5408034650 0x7f5408036b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/3096363013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9836b60 0x5608c9836f80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 >> 172.21.15.169:0/3096363013 conn(0x5608c982bcb0 msgr2=0x5608c982e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 shutdown_connections 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/3096363013 wait complete. 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9821200 msgr2=0x5608c98235f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5608c9821200 0x5608c98235f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c972aec0 msgr2=0x5608c981fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5608c972aec0 0x5608c981fd90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c98268b0 msgr2=0x5608c9828ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5608c98268b0 0x5608c9828ca0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5414034650 msgr2=0x7f5414036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5414034650 0x7f5414036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55240ad000 tx=0x7f55240a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 msgr2=0x5608c9818e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 --2- 172.21.15.169:0/2554043319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608c9699290 0x5608c9818e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5520000c10 tx=0x7f55200040f0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f552e33d640 1 -- 172.21.15.169:0/2554043319 reap_dead start 2024-09-13T06:29:20.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 shutdown_connections 2024-09-13T06:29:20.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 >> 172.21.15.169:0/2554043319 conn(0x5608c971f090 msgr2=0x5608c980c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 shutdown_connections 2024-09-13T06:29:20.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.197+0000 7f553002c980 1 -- 172.21.15.169:0/2554043319 wait complete. 2024-09-13T06:29:20.210 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:20.210 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:20.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:20.210 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f861d4980 1 Processor -- start 2024-09-13T06:29:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f861d4980 1 -- start start 2024-09-13T06:29:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f861d4980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5621bd6918f0 0x5621bd693ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f861d4980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621bd516ae0 con 0x5621bd68d570 2024-09-13T06:29:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f861d4980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5621bd53ae30 con 0x5621bd6918f0 2024-09-13T06:29:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f834e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5621bd6918f0 0x5621bd693ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f834e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5621bd6918f0 0x5621bd693ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35970/0 (socket says 172.21.15.169:35970) 2024-09-13T06:29:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f834e3640 1 -- 172.21.15.169:0/3291662013 learned_addr learned my addr 172.21.15.169:0/3291662013 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f834e3640 1 -- 172.21.15.169:0/3291662013 >> v1:172.21.15.112:6789/0 conn(0x5621bd68d570 legacy=0x5621bd68d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.281+0000 7f4f834e3640 1 -- 172.21.15.169:0/3291662013 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd695230 con 0x5621bd6918f0 2024-09-13T06:29:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f834e3640 1 --2- 172.21.15.169:0/3291662013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd6918f0 0x5621bd693ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800a5c0 tx=0x7f4f7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773fc51b9a4dcf03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f82ce2640 1 -- 172.21.15.169:0/3291662013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f780a6070 con 0x5621bd6918f0 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f82ce2640 1 -- 172.21.15.169:0/3291662013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f780af070 con 0x5621bd6918f0 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f82ce2640 1 -- 172.21.15.169:0/3291662013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f780aa5c0 con 0x5621bd6918f0 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 -- 172.21.15.169:0/3291662013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd6918f0 msgr2=0x5621bd693ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 --2- 172.21.15.169:0/3291662013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd6918f0 0x5621bd693ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800a5c0 tx=0x7f4f7801b340 comp rx=0 tx=0).stop 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 -- 172.21.15.169:0/3291662013 shutdown_connections 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 --2- 172.21.15.169:0/3291662013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd6918f0 0x5621bd693ce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 -- 172.21.15.169:0/3291662013 >> 172.21.15.169:0/3291662013 conn(0x5621bd689090 msgr2=0x5621bd68b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 -- 172.21.15.169:0/3291662013 shutdown_connections 2024-09-13T06:29:20.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.285+0000 7f4f861d4980 1 -- 172.21.15.169:0/3291662013 wait complete. 2024-09-13T06:29:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.297+0000 7f4f861d4980 1 Processor -- start 2024-09-13T06:29:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.297+0000 7f4f861d4980 1 -- start start 2024-09-13T06:29:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.297+0000 7f4f861d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd7777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.297+0000 7f4f861d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5621bd53c200 con 0x5621bd68d570 2024-09-13T06:29:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd7777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd7777f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35986/0 (socket says 172.21.15.169:35986) 2024-09-13T06:29:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 -- 172.21.15.169:0/3914331800 learned_addr learned my addr 172.21.15.169:0/3914331800 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 -- 172.21.15.169:0/3914331800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd777dc0 con 0x5621bd68d570 2024-09-13T06:29:20.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/3914331800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd7777f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0015f0 tx=0x7f4f7c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f47b041da0f121 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4e71e0b640 1 -- 172.21.15.169:0/3914331800 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c016070 con 0x5621bd68d570 2024-09-13T06:29:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4e71e0b640 1 -- 172.21.15.169:0/3914331800 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00f640 con 0x5621bd68d570 2024-09-13T06:29:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4e71e0b640 1 -- 172.21.15.169:0/3914331800 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c00f960 con 0x5621bd68d570 2024-09-13T06:29:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- 172.21.15.169:0/3914331800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 msgr2=0x5621bd7777f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 --2- 172.21.15.169:0/3914331800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd7777f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0015f0 tx=0x7f4f7c001ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- 172.21.15.169:0/3914331800 shutdown_connections 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 --2- 172.21.15.169:0/3914331800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd7777f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- 172.21.15.169:0/3914331800 >> 172.21.15.169:0/3914331800 conn(0x5621bd689090 msgr2=0x5621bd773420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- 172.21.15.169:0/3914331800 shutdown_connections 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- 172.21.15.169:0/3914331800 wait complete. 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 Processor -- start 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- start start 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd77eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5621bd694d30 con 0x5621bd68d570 2024-09-13T06:29:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd77eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd77eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:35998/0 (socket says 172.21.15.169:35998) 2024-09-13T06:29:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 -- 172.21.15.169:0/719555667 learned_addr learned my addr 172.21.15.169:0/719555667 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd77f0a0 con 0x5621bd68d570 2024-09-13T06:29:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd77eb60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c001af0 tx=0x7f4f7c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4e6bfff640 1 -- 172.21.15.169:0/719555667 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c016040 con 0x5621bd68d570 2024-09-13T06:29:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bd77f330 con 0x5621bd68d570 2024-09-13T06:29:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.301+0000 7f4e6bfff640 1 -- 172.21.15.169:0/719555667 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c022070 con 0x5621bd68d570 2024-09-13T06:29:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4e6bfff640 1 -- 172.21.15.169:0/719555667 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c006180 con 0x5621bd68d570 2024-09-13T06:29:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bd782010 con 0x5621bd68d570 2024-09-13T06:29:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4e6bfff640 1 -- 172.21.15.169:0/719555667 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f7c0117c0 con 0x5621bd68d570 2024-09-13T06:29:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4e6bfff640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e6c034650 0x7f4e6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4e6bfff640 1 -- 172.21.15.169:0/719555667 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4f7c0496e0 con 0x5621bd68d570 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f834e3640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e6c034650 0x7f4e6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd6918f0 0x5621bd785b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd786190 con 0x5621bd6918f0 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f844e5640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd6918f0 0x5621bd785b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f834e3640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e6c034650 0x7f4e6c036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f780ae000 tx=0x7f4f780a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f844e5640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd6918f0 0x5621bd785b50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f844e5640 1 -- 172.21.15.169:0/719555667 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd6918f0 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd786f80 0x5621bd789370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7899a0 con 0x5621bd786f80 2024-09-13T06:29:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd786f80 0x5621bd789370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.305+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd786f80 0x5621bd789370 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f83ce4640 1 -- 172.21.15.169:0/719555667 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd786f80 2024-09-13T06:29:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd78b250 con 0x5621bd786f80 2024-09-13T06:29:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f83ce4640 1 -- 172.21.15.169:0/719555667 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd786f80 2024-09-13T06:29:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd78a480 con 0x5621bd786f80 2024-09-13T06:29:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f83ce4640 1 -- 172.21.15.169:0/719555667 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd786f80 2024-09-13T06:29:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd78c600 0x5621bd78e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd78ef30 con 0x5621bd78c600 2024-09-13T06:29:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f834e3640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd78c600 0x5621bd78e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f834e3640 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd78c600 0x5621bd78e9f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f834e3640 1 -- 172.21.15.169:0/719555667 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd78c600 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 Processor -- start 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 -- start start 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 0x5621bd7a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f861d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5621bd595800 con 0x5621bd7a0dd0 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 0x5621bd7a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 0x5621bd7a11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36010/0 (socket says 172.21.15.169:36010) 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.309+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1670587342 learned_addr learned my addr 172.21.15.169:0/1670587342 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1670587342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd7a1730 con 0x5621bd7a0dd0 2024-09-13T06:29:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 0x5621bd7a11f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c047ce0 tx=0x7f4f7c0254b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e697fa640 1 -- 172.21.15.169:0/1670587342 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c0492c0 con 0x5621bd7a0dd0 2024-09-13T06:29:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e697fa640 1 -- 172.21.15.169:0/1670587342 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c049460 con 0x5621bd7a0dd0 2024-09-13T06:29:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bd7a19c0 con 0x5621bd7a0dd0 2024-09-13T06:29:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bd7a4640 con 0x5621bd7a0dd0 2024-09-13T06:29:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e697fa640 1 -- 172.21.15.169:0/1670587342 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c04e060 con 0x5621bd7a0dd0 2024-09-13T06:29:20.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e697fa640 1 -- 172.21.15.169:0/1670587342 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f7c049bf0 con 0x5621bd7a0dd0 2024-09-13T06:29:20.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e697fa640 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e5c034650 0x7f4e5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e697fa640 1 -- 172.21.15.169:0/1670587342 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4f7c041070 con 0x5621bd7a0dd0 2024-09-13T06:29:20.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f834e3640 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e5c034650 0x7f4e5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f861d4980 1 Processor -- start 2024-09-13T06:29:20.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f861d4980 1 -- start start 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f834e3640 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e5c034650 0x7f4e5c036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f78000c10 tx=0x7f4f78005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f861d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f861d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5621bd778140 con 0x5621bd7ad770 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36020/0 (socket says 172.21.15.169:36020) 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 -- 172.21.15.169:0/3259057507 learned_addr learned my addr 172.21.15.169:0/3259057507 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 -- 172.21.15.169:0/3259057507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd7ae140 con 0x5621bd7ad770 2024-09-13T06:29:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/3259057507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7adb70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c011fd0 tx=0x7f4f7c025cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bda76053792ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e62ffd640 1 -- 172.21.15.169:0/3259057507 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c01aba0 con 0x5621bd7ad770 2024-09-13T06:29:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e62ffd640 1 -- 172.21.15.169:0/3259057507 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c031430 con 0x5621bd7ad770 2024-09-13T06:29:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.313+0000 7f4e62ffd640 1 -- 172.21.15.169:0/3259057507 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c020120 con 0x5621bd7ad770 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/3259057507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 msgr2=0x5621bd7adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 --2- 172.21.15.169:0/3259057507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7adb70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c011fd0 tx=0x7f4f7c025cd0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/3259057507 shutdown_connections 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 --2- 172.21.15.169:0/3259057507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7adb70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/3259057507 >> 172.21.15.169:0/3259057507 conn(0x5621bd7a9b00 msgr2=0x5621bd7a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/3259057507 shutdown_connections 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/3259057507 wait complete. 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 Processor -- start 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- start start 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5621bd7ae690 con 0x5621bd7ad770 2024-09-13T06:29:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f83ce4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36036/0 (socket says 172.21.15.169:36036) 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 learned_addr learned my addr 172.21.15.169:0/1206054513 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd7b4e30 con 0x5621bd7ad770 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7b48f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c049a50 tx=0x7f4f7c016e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4e617fa640 1 -- 172.21.15.169:0/1206054513 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c06d020 con 0x5621bd7ad770 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4e617fa640 1 -- 172.21.15.169:0/1206054513 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c01a8a0 con 0x5621bd7ad770 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bd7b4e30 con 0x5621bd7ad770 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4e617fa640 1 -- 172.21.15.169:0/1206054513 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f7c041ba0 con 0x5621bd7ad770 2024-09-13T06:29:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bd7b5300 con 0x5621bd7ad770 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4e617fa640 1 -- 172.21.15.169:0/1206054513 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f7c070020 con 0x5621bd7ad770 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4e617fa640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e4c034650 0x7f4e4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4e617fa640 1 -- 172.21.15.169:0/1206054513 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4f7c064050 con 0x5621bd7ad770 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f834e3640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e4c034650 0x7f4e4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd7bf990 0x5621bd7c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.317+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c25a0 con 0x5621bd7bf990 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f844e5640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd7bf990 0x5621bd7c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f834e3640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e4c034650 0x7f4e4c036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f780aa910 tx=0x7f4f780c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f844e5640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd7bf990 0x5621bd7c1e50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 realm 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7bee40 con 0x5621bd7bf990 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c3060 con 0x5621bd7bf990 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd7c3e40 0x5621bd7c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c6890 con 0x5621bd7c3e40 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd7c3e40 0x5621bd7c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd7c3e40 0x5621bd7c6230 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 20 searching for the correct realm 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd7c8ea0 0x5621bd7cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cb8a0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f834e3640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd7c8ea0 0x5621bd7cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.321+0000 7f4f834e3640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd7c8ea0 0x5621bd7cb290 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cb8a0 con 0x5621bd7c3e40 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4f7c072020 0x7f4f7c06d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x7f4f7c072020 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4f7c072020 0x7f4f7c06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4f7c072020 0x7f4f7c06d920 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c8ea0 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.325+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x7f4f7c072020 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x7f4f7c072020 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c8ea0 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c8ea0 2024-09-13T06:29:20.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c8ea0 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.329+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x7f4f7c072020 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7bf990 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x7f4f7c072020 2024-09-13T06:29:20.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c8ea0 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x7f4f7c072020 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c8ea0 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7130 con 0x5621bd7c3e40 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7980 con 0x5621bd7bf990 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.333+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7d70 con 0x5621bd7c3e40 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7c7d70 con 0x5621bd7c8ea0 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 zone default found 2024-09-13T06:29:20.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 4 Realm: () 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 zonegroup default 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cbd00 con 0x7f4f7c072020 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cda80 con 0x5621bd7c8ea0 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cde20 con 0x5621bd7c8ea0 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 started sync module instance, tier type = 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7ccf20 con 0x5621bd7c3e40 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702912984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7ccf20 con 0x5621bd7c3e40 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.337+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7ce7e0 con 0x5621bd7bf990 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702912987952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cf080 con 0x5621bd7bf990 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cfa80 con 0x5621bd7c3e40 2024-09-13T06:29:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702912984096] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702912987952] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702912981616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cebd0 con 0x5621bd7c3e40 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d0320 con 0x7f4f7c072020 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702912994928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cebd0 con 0x7f4f7c072020 2024-09-13T06:29:20.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.341+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d0dc0 con 0x5621bd7c3e40 2024-09-13T06:29:20.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702912994928] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702912981616] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702912992656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d0d80 con 0x5621bd7c3e40 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d11b0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702912995984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d1a00 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d2420 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702912992656] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.345+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702912995984] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702913000784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d08b0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d2cc0 con 0x7f4f7c072020 2024-09-13T06:29:20.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702913000784] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702913003280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d2cc0 con 0x7f4f7c072020 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=0 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=1 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=2 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=3 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=4 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=5 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=6 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702913003280] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 20 add_watcher() i=7 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:20.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d6060 con 0x5621bd7bf990 2024-09-13T06:29:20.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.349+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702913018400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d2e30 con 0x5621bd7bf990 2024-09-13T06:29:20.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702913018400] v31'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4e39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 5 note: GC not initialized 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4e38fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 20 Filter name: none 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4db27fc640 20 reqs_thread_entry: start 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7f9300 con 0x5621bd7bf990 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.353+0000 7f4f861d4980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:29:20.360 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:20.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.357+0000 7f4e39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.357+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702913018400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7f7eb0 con 0x5621bd7bf990 2024-09-13T06:29:20.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.357+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94702913018400] v31'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.357+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702912984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d5a20 con 0x5621bd7c3e40 2024-09-13T06:29:20.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94702912984096] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 20 remove_watcher() i=0 2024-09-13T06:29:20.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 2 removed watcher, disabling cache 2024-09-13T06:29:20.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702912987952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d5a20 con 0x5621bd7bf990 2024-09-13T06:29:20.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94702912987952] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x5621bd7bf990 2024-09-13T06:29:20.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 20 remove_watcher() i=1 2024-09-13T06:29:20.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702912981616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d5a20 con 0x5621bd7c3e40 2024-09-13T06:29:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94702912981616] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 20 remove_watcher() i=2 2024-09-13T06:29:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.361+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702912994928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cca70 con 0x7f4f7c072020 2024-09-13T06:29:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94702912994928] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f861d4980 20 remove_watcher() i=3 2024-09-13T06:29:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702912992656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d5a20 con 0x5621bd7c3e40 2024-09-13T06:29:20.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f83ce4640 1 -- 172.21.15.169:0/1206054513 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94702912992656] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7c00f070 con 0x5621bd7c3e40 2024-09-13T06:29:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f861d4980 20 remove_watcher() i=4 2024-09-13T06:29:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702912995984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cfe70 con 0x5621bd7c8ea0 2024-09-13T06:29:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94702912995984] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f861d4980 20 remove_watcher() i=5 2024-09-13T06:29:20.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.365+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702913000784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7d02f0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f834e3640 1 -- 172.21.15.169:0/1206054513 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94702913000784] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f780aaae0 con 0x5621bd7c8ea0 2024-09-13T06:29:20.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 20 remove_watcher() i=6 2024-09-13T06:29:20.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702913003280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5621bd7cf590 con 0x7f4f7c072020 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94702913003280] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740083f0 con 0x7f4f7c072020 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 20 remove_watcher() i=7 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd7c3e40 msgr2=0x5621bd7c6230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd7c3e40 0x5621bd7c6230 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd7bf990 msgr2=0x5621bd7c1e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd7bf990 0x5621bd7c1e50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4f7c072020 msgr2=0x7f4f7c06d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4f7c072020 0x7f4f7c06d920 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd7c8ea0 msgr2=0x5621bd7cb290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd7c8ea0 0x5621bd7cb290 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e4c034650 msgr2=0x7f4e4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e4c034650 0x7f4e4c036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f780aa910 tx=0x7f4f780c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 msgr2=0x5621bd7b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f844e5640 1 -- 172.21.15.169:0/1206054513 reap_dead start 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7b48f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c049a50 tx=0x7f4f7c016e80 comp rx=0 tx=0).stop 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 shutdown_connections 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1206054513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7ad770 0x5621bd7b48f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 >> 172.21.15.169:0/1206054513 conn(0x5621bd7a9b00 msgr2=0x5621bd7a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 shutdown_connections 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1206054513 wait complete. 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e5c034650 msgr2=0x7f4e5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e5c034650 0x7f4e5c036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f78000c10 tx=0x7f4f78005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 msgr2=0x5621bd7a11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 0x5621bd7a11f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c047ce0 tx=0x7f4f7c0254b0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 shutdown_connections 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e5c034650 0x7f4e5c036b10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/1670587342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd7a0dd0 0x5621bd7a11f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 >> 172.21.15.169:0/1670587342 conn(0x5621bd791b10 msgr2=0x5621bd794590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 shutdown_connections 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/1670587342 wait complete. 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd786f80 msgr2=0x5621bd789370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5621bd786f80 0x5621bd789370 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd6918f0 msgr2=0x5621bd785b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5621bd6918f0 0x5621bd785b50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd78c600 msgr2=0x5621bd78e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5621bd78c600 0x5621bd78e9f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e6c034650 msgr2=0x7f4e6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4e6c034650 0x7f4e6c036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f780ae000 tx=0x7f4f780a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 msgr2=0x5621bd77eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 --2- 172.21.15.169:0/719555667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5621bd68d570 0x5621bd77eb60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c001af0 tx=0x7f4f7c000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f844e5640 1 -- 172.21.15.169:0/719555667 reap_dead start 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 shutdown_connections 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 >> 172.21.15.169:0/719555667 conn(0x5621bd689090 msgr2=0x5621bd771fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 shutdown_connections 2024-09-13T06:29:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.369+0000 7f4f861d4980 1 -- 172.21.15.169:0/719555667 wait complete. 2024-09-13T06:29:20.382 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:20.382 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T06:29:20.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T06:29:20.382 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T06:29:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9d199a980 1 Processor -- start 2024-09-13T06:29:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9d199a980 1 -- start start 2024-09-13T06:29:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9d199a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555dcfb904e0 0x555dcfb908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9d199a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555dcfa19ae0 con 0x555dcfb90e30 2024-09-13T06:29:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9d199a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x555dcfa3de30 con 0x555dcfb904e0 2024-09-13T06:29:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9cf4aa640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555dcfb904e0 0x555dcfb908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9cf4aa640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555dcfb904e0 0x555dcfb908c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36040/0 (socket says 172.21.15.169:36040) 2024-09-13T06:29:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/1935106282 learned_addr learned my addr 172.21.15.169:0/1935106282 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/1935106282 >> v1:172.21.15.112:6789/0 conn(0x555dcfb90e30 legacy=0x555dcfb958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.461+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/1935106282 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcfb98100 con 0x555dcfb904e0 2024-09-13T06:29:20.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/1935106282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfb908c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000a4e0 tx=0x7fd9c001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323d9a328bb720ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9ce4a8640 1 -- 172.21.15.169:0/1935106282 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00aa540 con 0x555dcfb904e0 2024-09-13T06:29:20.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9ce4a8640 1 -- 172.21.15.169:0/1935106282 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00aa6e0 con 0x555dcfb904e0 2024-09-13T06:29:20.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9ce4a8640 1 -- 172.21.15.169:0/1935106282 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00aaa40 con 0x555dcfb904e0 2024-09-13T06:29:20.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 -- 172.21.15.169:0/1935106282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 msgr2=0x555dcfb908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 --2- 172.21.15.169:0/1935106282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfb908c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000a4e0 tx=0x7fd9c001b090 comp rx=0 tx=0).stop 2024-09-13T06:29:20.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 -- 172.21.15.169:0/1935106282 shutdown_connections 2024-09-13T06:29:20.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 --2- 172.21.15.169:0/1935106282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfb908c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 -- 172.21.15.169:0/1935106282 >> 172.21.15.169:0/1935106282 conn(0x555dcfb8c000 msgr2=0x555dcfb8e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 -- 172.21.15.169:0/1935106282 shutdown_connections 2024-09-13T06:29:20.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.465+0000 7fd9d199a980 1 -- 172.21.15.169:0/1935106282 wait complete. 2024-09-13T06:29:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.477+0000 7fd9d199a980 1 Processor -- start 2024-09-13T06:29:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- start start 2024-09-13T06:29:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc7b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555dcfa3f200 con 0x555dcfb904e0 2024-09-13T06:29:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc7b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc7b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36050/0 (socket says 172.21.15.169:36050) 2024-09-13T06:29:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/2916632827 learned_addr learned my addr 172.21.15.169:0/2916632827 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/2916632827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcfc7bf80 con 0x555dcfb904e0 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/2916632827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc7b9b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0017ca0 tx=0x7fd9c00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa57db6152c856f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd8bd60a640 1 -- 172.21.15.169:0/2916632827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00c1070 con 0x555dcfb904e0 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd8bd60a640 1 -- 172.21.15.169:0/2916632827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00aaa40 con 0x555dcfb904e0 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd8bd60a640 1 -- 172.21.15.169:0/2916632827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00aad20 con 0x555dcfb904e0 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- 172.21.15.169:0/2916632827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 msgr2=0x555dcfc7b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 --2- 172.21.15.169:0/2916632827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc7b9b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0017ca0 tx=0x7fd9c00033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- 172.21.15.169:0/2916632827 shutdown_connections 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 --2- 172.21.15.169:0/2916632827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc7b9b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- 172.21.15.169:0/2916632827 >> 172.21.15.169:0/2916632827 conn(0x555dcfb8c000 msgr2=0x555dcfc775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- 172.21.15.169:0/2916632827 shutdown_connections 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- 172.21.15.169:0/2916632827 wait complete. 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 Processor -- start 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- start start 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc85fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9d199a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555dcfb97b40 con 0x555dcfb904e0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc85fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc85fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36062/0 (socket says 172.21.15.169:36062) 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.481+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/3609293712 learned_addr learned my addr 172.21.15.169:0/3609293712 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcfc864f0 con 0x555dcfb904e0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc85fb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9c001b0d0 tx=0x7fd9c0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd8bbe07640 1 -- 172.21.15.169:0/3609293712 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00c1040 con 0x555dcfb904e0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd8bbe07640 1 -- 172.21.15.169:0/3609293712 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00c5420 con 0x555dcfb904e0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dcfc86780 con 0x555dcfb904e0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd8bbe07640 1 -- 172.21.15.169:0/3609293712 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00c5700 con 0x555dcfb904e0 2024-09-13T06:29:20.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dcfc89460 con 0x555dcfb904e0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd8bbe07640 1 -- 172.21.15.169:0/3609293712 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9c00c58a0 con 0x555dcfb904e0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd8bbe07640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8b40346a0 0x7fd8b4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd8bbe07640 1 -- 172.21.15.169:0/3609293712 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd9c00b8030 con 0x555dcfb904e0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8b40346a0 0x7fd8b4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfb90e30 0x555dcfc8cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfc8d580 con 0x555dcfb90e30 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9cfcab640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfb90e30 0x555dcfc8cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8b40346a0 0x7fd8b4036b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8001e20 tx=0x7fd9b80013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9cfcab640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfb90e30 0x555dcfc8cf40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9cfcab640 1 -- 172.21.15.169:0/3609293712 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfb90e30 2024-09-13T06:29:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfc8e350 0x555dcfc90740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfc90da0 con 0x555dcfc8e350 2024-09-13T06:29:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.485+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfc8e350 0x555dcfc90740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfc8e350 0x555dcfc90740 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/3609293712 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfc8e350 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfc92650 con 0x555dcfc8e350 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/3609293712 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfc8e350 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfc91880 con 0x555dcfc8e350 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/3609293712 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfc8e350 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfc93a00 0x555dcfc95df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfc96330 con 0x555dcfc93a00 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfc93a00 0x555dcfc95df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfc93a00 0x555dcfc95df0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9ceca9640 1 -- 172.21.15.169:0/3609293712 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9b800d040 con 0x555dcfc93a00 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 Processor -- start 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 -- start start 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 0x555dcfca4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9d199a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555dcfa98800 con 0x555dcfca3d30 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 0x555dcfca4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 0x555dcfca4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36078/0 (socket says 172.21.15.169:36078) 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.489+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/182543843 learned_addr learned my addr 172.21.15.169:0/182543843 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/182543843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcfca4690 con 0x555dcfca3d30 2024-09-13T06:29:20.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 0x555dcfca4150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00ba530 tx=0x7fd9c00cea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd8b9602640 1 -- 172.21.15.169:0/182543843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00c4380 con 0x555dcfca3d30 2024-09-13T06:29:20.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd8b9602640 1 -- 172.21.15.169:0/182543843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00c4520 con 0x555dcfca3d30 2024-09-13T06:29:20.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dcfca4920 con 0x555dcfca3d30 2024-09-13T06:29:20.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd8b9602640 1 -- 172.21.15.169:0/182543843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c0005020 con 0x555dcfca3d30 2024-09-13T06:29:20.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dcfca75a0 con 0x555dcfca3d30 2024-09-13T06:29:20.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd8b9602640 1 -- 172.21.15.169:0/182543843 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9c00051c0 con 0x555dcfca3d30 2024-09-13T06:29:20.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd8b9602640 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8a8034650 0x7fd8a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd8b9602640 1 -- 172.21.15.169:0/182543843 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd9c00ecb20 con 0x555dcfca3d30 2024-09-13T06:29:20.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8a8034650 0x7fd8a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9d199a980 1 Processor -- start 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9d199a980 1 -- start start 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8a8034650 0x7fd8a8036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x555dcfc8a5a0 tx=0x7fd9b8006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9d199a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9d199a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555dcfc7c270 con 0x555dcfcb05d0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36084/0 (socket says 172.21.15.169:36084) 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/1600105792 learned_addr learned my addr 172.21.15.169:0/1600105792 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.493+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/1600105792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcfcb0fa0 con 0x555dcfcb05d0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/1600105792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb09d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00cec10 tx=0x7fd9c00d8500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51bfb22ab9c4815 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd8b2ffd640 1 -- 172.21.15.169:0/1600105792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00054b0 con 0x555dcfcb05d0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd8b2ffd640 1 -- 172.21.15.169:0/1600105792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00dcdf0 con 0x555dcfcb05d0 2024-09-13T06:29:20.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd8b2ffd640 1 -- 172.21.15.169:0/1600105792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00babf0 con 0x555dcfcb05d0 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/1600105792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 msgr2=0x555dcfcb09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 --2- 172.21.15.169:0/1600105792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb09d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00cec10 tx=0x7fd9c00d8500 comp rx=0 tx=0).stop 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/1600105792 shutdown_connections 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 --2- 172.21.15.169:0/1600105792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb09d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/1600105792 >> 172.21.15.169:0/1600105792 conn(0x555dcfcaca00 msgr2=0x555dcfcaab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/1600105792 shutdown_connections 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/1600105792 wait complete. 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 Processor -- start 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- start start 2024-09-13T06:29:20.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555dcfcb1470 con 0x555dcfcb05d0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9cf4aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36098/0 (socket says 172.21.15.169:36098) 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 learned_addr learned my addr 172.21.15.169:0/474726097 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dcfcb7d50 con 0x555dcfcb05d0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb7810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00f4f60 tx=0x7fd9c00dee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd8b17fa640 1 -- 172.21.15.169:0/474726097 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00054b0 con 0x555dcfcb05d0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dcfcb7d50 con 0x555dcfcb05d0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd8b17fa640 1 -- 172.21.15.169:0/474726097 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00ef170 con 0x555dcfcb05d0 2024-09-13T06:29:20.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd8b17fa640 1 -- 172.21.15.169:0/474726097 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c00ef320 con 0x555dcfcb05d0 2024-09-13T06:29:20.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.497+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dcfcb7d50 con 0x555dcfcb05d0 2024-09-13T06:29:20.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd8b17fa640 1 -- 172.21.15.169:0/474726097 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9c0110030 con 0x555dcfcb05d0 2024-09-13T06:29:20.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd8b17fa640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8980345b0 0x7fd898036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd8b17fa640 1 -- 172.21.15.169:0/474726097 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd9c010e070 con 0x555dcfcb05d0 2024-09-13T06:29:20.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8980345b0 0x7fd898036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfcc2870 0x555dcfcc4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcc5480 con 0x555dcfcc2870 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cfcab640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfcc2870 0x555dcfcc4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8980345b0 0x7fd898036a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x555dcfc925e0 tx=0x7fd9b8011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cfcab640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfcc2870 0x555dcfcc4d30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 realm 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcc1ca0 con 0x555dcfcc2870 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcc5f40 con 0x555dcfcc2870 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfcc6d20 0x555dcfcc9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcc97c0 con 0x555dcfcc6d20 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfcc6d20 0x555dcfcc9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfcc6d20 0x555dcfcc9110 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.501+0000 7fd9d199a980 20 searching for the correct realm 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfccbd80 0x555dcfcce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcce7f0 con 0x555dcfccbd80 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfccbd80 0x555dcfcce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9ceca9640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfccbd80 0x555dcfcce170 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcce7f0 con 0x555dcfcc6d20 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cf4aa640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd9c00ef540 0x7fd9c0116ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x7fd9c00ef540 2024-09-13T06:29:20.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd9c00ef540 0x7fd9c0116ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd9c00ef540 0x7fd9c0116ab0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfccbd80 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.505+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x7fd9c00ef540 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x7fd9c00ef540 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfccbd80 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfccbd80 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.509+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfccbd80 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x7fd9c00ef540 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc2870 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x7fd9c00ef540 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfccbd80 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x7fd9c00ef540 2024-09-13T06:29:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfccbd80 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.513+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca010 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcca860 con 0x555dcfcc2870 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfccac50 con 0x555dcfcc6d20 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfccac50 con 0x555dcfccbd80 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 zone default found 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 4 Realm: () 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 zonegroup default 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfccec70 con 0x7fd9c00ef540 2024-09-13T06:29:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd0ea0 con 0x555dcfccbd80 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd1240 con 0x555dcfccbd80 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 started sync module instance, tier type = 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.517+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd02e0 con 0x555dcfcc6d20 2024-09-13T06:29:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93861406640096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd02e0 con 0x555dcfcc6d20 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd1a90 con 0x555dcfcc2870 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93861406643680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd2330 con 0x555dcfcc2870 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd2d30 con 0x555dcfcc6d20 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93861406640096] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.521+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93861406643680] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93861406637616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd1e80 con 0x555dcfcc6d20 2024-09-13T06:29:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd35d0 con 0x7fd9c00ef540 2024-09-13T06:29:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93861406650656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd1e80 con 0x7fd9c00ef540 2024-09-13T06:29:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd40a0 con 0x555dcfcc6d20 2024-09-13T06:29:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93861406650656] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93861406637616] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93861406648384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4060 con 0x555dcfcc6d20 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.525+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4490 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93861406651712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4d30 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd5750 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93861406651712] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93861406659136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4d30 con 0x555dcfccbd80 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd61a0 con 0x7fd9c00ef540 2024-09-13T06:29:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93861406648384] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93861406659136] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93861406653328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4880 con 0x7fd9c00ef540 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=0 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=1 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=2 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=3 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=4 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=5 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.529+0000 7fd9d199a980 20 add_watcher() i=6 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93861406653328] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 add_watcher() i=7 2024-09-13T06:29:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4cd0 con 0x555dcfcc2870 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93861406661808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd4cd0 con 0x555dcfcc2870 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93861406661808] v31'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 5 note: GC not initialized 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd884fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 Filter name: none 2024-09-13T06:29:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd7fe7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfc780 con 0x555dcfcc2870 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfd490 con 0x7fd9c00ef540 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.533+0000 7fd9d199a980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfd03180 con 0x555dcfcc2870 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v31'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9d199a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9d199a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9d199a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93861406846000 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcffd30 con 0x555dcfcc6d20 2024-09-13T06:29:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 93861406648384 notify 133143986186 ret 0) ==== 891+0+0 (crc 0 0 0) 0x555dcfca4920 con 0x555dcfcc6d20 2024-09-13T06:29:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd8b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 93861406648384 notifier 4386 bl.length()=849 2024-09-13T06:29:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd8b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd8b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd8b2ffd640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd894003eb0 con 0x555dcfcc6d20 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.4 [notify cookie 93861406846000 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 93861406846000 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555dcfca4690 con 0x555dcfcc6d20 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.537+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfd02c30 con 0x7fd9c00ef540 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9d199a980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9d199a980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9d199a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93861406846000 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfd860 con 0x555dcfcc6d20 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 93861406640096 notify 133143986187 ret 0) ==== 208+0+0 (crc 0 0 0) 0x555dcfca4690 con 0x555dcfcc6d20 2024-09-13T06:29:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd8b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 93861406640096 notifier 4386 bl.length()=166 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd8b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd8b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd8b27fc640 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd804003410 con 0x555dcfcc6d20 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(68 notify.0 [notify cookie 93861406846000 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== watch-notify(notify_complete (2) cookie 93861406846000 notify 133143986187 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555dcfc89460 con 0x555dcfcc6d20 2024-09-13T06:29:20.548 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:29:20.540704Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:20.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.541+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93861406661808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfa570 con 0x555dcfcc2870 2024-09-13T06:29:20.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.545+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93861406661808] v31'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.545+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93861406640096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfa570 con 0x555dcfcc6d20 2024-09-13T06:29:20.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.545+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93861406640096] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.545+0000 7fd9d199a980 20 remove_watcher() i=0 2024-09-13T06:29:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.545+0000 7fd9d199a980 2 removed watcher, disabling cache 2024-09-13T06:29:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.545+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93861406643680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd07e0 con 0x555dcfcc2870 2024-09-13T06:29:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93861406643680] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x555dcfcc2870 2024-09-13T06:29:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9d199a980 20 remove_watcher() i=1 2024-09-13T06:29:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93861406637616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfa570 con 0x555dcfcc6d20 2024-09-13T06:29:20.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93861406637616] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9d199a980 20 remove_watcher() i=2 2024-09-13T06:29:20.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93861406650656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd15e0 con 0x7fd9c00ef540 2024-09-13T06:29:20.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93861406650656] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9d199a980 20 remove_watcher() i=3 2024-09-13T06:29:20.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.549+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93861406648384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcfa570 con 0x555dcfcc6d20 2024-09-13T06:29:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9cf4aa640 1 -- 172.21.15.169:0/474726097 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93861406648384] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c00c5d70 con 0x555dcfcc6d20 2024-09-13T06:29:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9d199a980 20 remove_watcher() i=4 2024-09-13T06:29:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93861406651712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd3120 con 0x555dcfccbd80 2024-09-13T06:29:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93861406651712] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9d199a980 20 remove_watcher() i=5 2024-09-13T06:29:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93861406659136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd35d0 con 0x555dcfccbd80 2024-09-13T06:29:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9ceca9640 1 -- 172.21.15.169:0/474726097 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93861406659136] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9b8036040 con 0x555dcfccbd80 2024-09-13T06:29:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9d199a980 20 remove_watcher() i=6 2024-09-13T06:29:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.553+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93861406653328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555dcfcd15e0 con 0x7fd9c00ef540 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93861406653328] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c80083f0 con 0x7fd9c00ef540 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 20 remove_watcher() i=7 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfcc6d20 msgr2=0x555dcfcc9110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfcc6d20 0x555dcfcc9110 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfcc2870 msgr2=0x555dcfcc4d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfcc2870 0x555dcfcc4d30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd9c00ef540 msgr2=0x7fd9c0116ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd9c00ef540 0x7fd9c0116ab0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfccbd80 msgr2=0x555dcfcce170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfccbd80 0x555dcfcce170 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8980345b0 msgr2=0x7fd898036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8980345b0 0x7fd898036a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x555dcfc925e0 tx=0x7fd9b8011000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 msgr2=0x555dcfcb7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9cfcab640 1 -- 172.21.15.169:0/474726097 reap_dead start 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb7810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00f4f60 tx=0x7fd9c00dee90 comp rx=0 tx=0).stop 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 shutdown_connections 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/474726097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfcb05d0 0x555dcfcb7810 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 >> 172.21.15.169:0/474726097 conn(0x555dcfcaca00 msgr2=0x555dcfcaaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 shutdown_connections 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/474726097 wait complete. 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8a8034650 msgr2=0x7fd8a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8a8034650 0x7fd8a8036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x555dcfc8a5a0 tx=0x7fd9b8006000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 msgr2=0x555dcfca4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 0x555dcfca4150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00ba530 tx=0x7fd9c00cea60 comp rx=0 tx=0).stop 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 shutdown_connections 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8a8034650 0x7fd8a8036b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/182543843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfca3d30 0x555dcfca4150 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 >> 172.21.15.169:0/182543843 conn(0x555dcfc98e80 msgr2=0x555dcfc9b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 shutdown_connections 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/182543843 wait complete. 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfc8e350 msgr2=0x555dcfc90740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555dcfc8e350 0x555dcfc90740 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfb90e30 msgr2=0x555dcfc8cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555dcfb90e30 0x555dcfc8cf40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfc93a00 msgr2=0x555dcfc95df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555dcfc93a00 0x555dcfc95df0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8b40346a0 msgr2=0x7fd8b4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd8b40346a0 0x7fd8b4036b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8001e20 tx=0x7fd9b80013a0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 msgr2=0x555dcfc85fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 --2- 172.21.15.169:0/3609293712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555dcfb904e0 0x555dcfc85fb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9c001b0d0 tx=0x7fd9c0017e30 comp rx=0 tx=0).stop 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9cfcab640 1 -- 172.21.15.169:0/3609293712 reap_dead start 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 shutdown_connections 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 >> 172.21.15.169:0/3609293712 conn(0x555dcfb8c000 msgr2=0x555dcfc76160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 shutdown_connections 2024-09-13T06:29:20.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.557+0000 7fd9d199a980 1 -- 172.21.15.169:0/3609293712 wait complete. 2024-09-13T06:29:20.569 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:29:20.540704Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:20.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:29:20.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:29:20.570 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:29:20.640 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:20.640 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:20.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653a75d980 1 Processor -- start 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653a75d980 1 -- start start 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653a75d980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5650c59e5650 0x5650c59e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653a75d980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650c586dae0 con 0x5650c59e5fa0 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653a75d980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5650c5891e30 con 0x5650c59e5650 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653826d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5650c59e5650 0x5650c59e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653826d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5650c59e5650 0x5650c59e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36106/0 (socket says 172.21.15.169:36106) 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f6537a6c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5650c59e5fa0 0x5650c59ea9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45146/0 (socket says 172.21.15.169:45146) 2024-09-13T06:29:20.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.637+0000 7f653826d640 1 -- 172.21.15.169:0/3903577099 learned_addr learned my addr 172.21.15.169:0/3903577099 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.641+0000 7f653826d640 1 -- 172.21.15.169:0/3903577099 >> v1:172.21.15.112:6789/0 conn(0x5650c59e5fa0 legacy=0x5650c59ea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.641+0000 7f653826d640 1 -- 172.21.15.169:0/3903577099 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c59ed220 con 0x5650c59e5650 2024-09-13T06:29:20.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.641+0000 7f653826d640 1 --2- 172.21.15.169:0/3903577099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c59e5a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f652800a5c0 tx=0x7f652801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d860fcf630e9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.641+0000 7f653726b640 1 -- 172.21.15.169:0/3903577099 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280a6070 con 0x5650c59e5650 2024-09-13T06:29:20.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.641+0000 7f653726b640 1 -- 172.21.15.169:0/3903577099 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280af070 con 0x5650c59e5650 2024-09-13T06:29:20.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.641+0000 7f653726b640 1 -- 172.21.15.169:0/3903577099 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280aa5c0 con 0x5650c59e5650 2024-09-13T06:29:20.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 -- 172.21.15.169:0/3903577099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 msgr2=0x5650c59e5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 --2- 172.21.15.169:0/3903577099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c59e5a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f652800a5c0 tx=0x7f652801b340 comp rx=0 tx=0).stop 2024-09-13T06:29:20.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 -- 172.21.15.169:0/3903577099 shutdown_connections 2024-09-13T06:29:20.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 --2- 172.21.15.169:0/3903577099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c59e5a30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 -- 172.21.15.169:0/3903577099 >> 172.21.15.169:0/3903577099 conn(0x5650c59e1170 msgr2=0x5650c59e3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 -- 172.21.15.169:0/3903577099 shutdown_connections 2024-09-13T06:29:20.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.645+0000 7f653a75d980 1 -- 172.21.15.169:0/3903577099 wait complete. 2024-09-13T06:29:20.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 Processor -- start 2024-09-13T06:29:20.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- start start 2024-09-13T06:29:20.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5650c5893200 con 0x5650c59e5650 2024-09-13T06:29:20.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36108/0 (socket says 172.21.15.169:36108) 2024-09-13T06:29:20.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653826d640 1 -- 172.21.15.169:0/2821387349 learned_addr learned my addr 172.21.15.169:0/2821387349 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653826d640 1 -- 172.21.15.169:0/2821387349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c5ad1010 con 0x5650c59e5650 2024-09-13T06:29:20.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653826d640 1 --2- 172.21.15.169:0/2821387349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad0a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f65280199f0 tx=0x7f6528003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30162b03be6bee22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f642660c640 1 -- 172.21.15.169:0/2821387349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280aaa00 con 0x5650c59e5650 2024-09-13T06:29:20.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f642660c640 1 -- 172.21.15.169:0/2821387349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280aaba0 con 0x5650c59e5650 2024-09-13T06:29:20.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f642660c640 1 -- 172.21.15.169:0/2821387349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280bd3f0 con 0x5650c59e5650 2024-09-13T06:29:20.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- 172.21.15.169:0/2821387349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 msgr2=0x5650c5ad0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 --2- 172.21.15.169:0/2821387349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad0a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f65280199f0 tx=0x7f6528003030 comp rx=0 tx=0).stop 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- 172.21.15.169:0/2821387349 shutdown_connections 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 --2- 172.21.15.169:0/2821387349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad0a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- 172.21.15.169:0/2821387349 >> 172.21.15.169:0/2821387349 conn(0x5650c59e1170 msgr2=0x5650c5acc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- 172.21.15.169:0/2821387349 shutdown_connections 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- 172.21.15.169:0/2821387349 wait complete. 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 Processor -- start 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- start start 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.657+0000 7f653a75d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5650c59ecc60 con 0x5650c59e5650 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36122/0 (socket says 172.21.15.169:36122) 2024-09-13T06:29:20.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653826d640 1 -- 172.21.15.169:0/3542820807 learned_addr learned my addr 172.21.15.169:0/3542820807 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653826d640 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c5ad81b0 con 0x5650c59e5650 2024-09-13T06:29:20.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653826d640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad7c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f65280199f0 tx=0x7f65280180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6424e09640 1 -- 172.21.15.169:0/3542820807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280bd7c0 con 0x5650c59e5650 2024-09-13T06:29:20.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6424e09640 1 -- 172.21.15.169:0/3542820807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280bd960 con 0x5650c59e5650 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6424e09640 1 -- 172.21.15.169:0/3542820807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280bdc40 con 0x5650c59e5650 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650c5ad8440 con 0x5650c59e5650 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650c5adb120 con 0x5650c59e5650 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6424e09640 1 -- 172.21.15.169:0/3542820807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65280ce020 con 0x5650c59e5650 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6424e09640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64200346a0 0x7f6420036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6424e09640 1 -- 172.21.15.169:0/3542820807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f65280cc020 con 0x5650c59e5650 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6537a6c640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64200346a0 0x7f6420036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c59e5fa0 0x5650c5adec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5adf2a0 con 0x5650c59e5fa0 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6538a6e640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c59e5fa0 0x5650c5adec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6537a6c640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64200346a0 0x7f6420036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f652c000f70 tx=0x7f652c001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.661+0000 7f6538a6e640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c59e5fa0 0x5650c5adec60 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f6538a6e640 1 -- 172.21.15.169:0/3542820807 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c59e5fa0 2024-09-13T06:29:20.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5ae0070 0x5650c5ae2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5ae2aa0 con 0x5650c5ae0070 2024-09-13T06:29:20.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653826d640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5ae0070 0x5650c5ae2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653826d640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5ae0070 0x5650c5ae2460 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653826d640 1 -- 172.21.15.169:0/3542820807 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5ae0070 2024-09-13T06:29:20.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5ae4350 con 0x5650c5ae0070 2024-09-13T06:29:20.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653826d640 1 -- 172.21.15.169:0/3542820807 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5ae0070 2024-09-13T06:29:20.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5ae3580 con 0x5650c5ae0070 2024-09-13T06:29:20.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653826d640 1 -- 172.21.15.169:0/3542820807 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5ae0070 2024-09-13T06:29:20.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5ae5700 0x5650c5ae7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5ae8030 con 0x5650c5ae5700 2024-09-13T06:29:20.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f6537a6c640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5ae5700 0x5650c5ae7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.665+0000 7f6537a6c640 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5ae5700 0x5650c5ae7af0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f6537a6c640 1 -- 172.21.15.169:0/3542820807 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f652c00f6a0 con 0x5650c5ae5700 2024-09-13T06:29:20.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 Processor -- start 2024-09-13T06:29:20.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 -- start start 2024-09-13T06:29:20.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 0x5650c5af5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5650c58ec800 con 0x5650c5af5ac0 2024-09-13T06:29:20.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 0x5650c5af5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 0x5650c5af5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36132/0 (socket says 172.21.15.169:36132) 2024-09-13T06:29:20.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653826d640 1 -- 172.21.15.169:0/708844291 learned_addr learned my addr 172.21.15.169:0/708844291 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653826d640 1 -- 172.21.15.169:0/708844291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c5af6420 con 0x5650c5af5ac0 2024-09-13T06:29:20.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653826d640 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 0x5650c5af5ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6528000c10 tx=0x7f65280e3e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f641e7fc640 1 -- 172.21.15.169:0/708844291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280ea070 con 0x5650c5af5ac0 2024-09-13T06:29:20.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650c5af66b0 con 0x5650c5af5ac0 2024-09-13T06:29:20.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f641e7fc640 1 -- 172.21.15.169:0/708844291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280c6750 con 0x5650c5af5ac0 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f641e7fc640 1 -- 172.21.15.169:0/708844291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280cf970 con 0x5650c5af5ac0 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650c5af9330 con 0x5650c5af5ac0 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f641e7fc640 1 -- 172.21.15.169:0/708844291 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65280cfb10 con 0x5650c5af5ac0 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f641e7fc640 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6410034650 0x7f6410036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f641e7fc640 1 -- 172.21.15.169:0/708844291 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f65280efab0 con 0x5650c5af5ac0 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f6537a6c640 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6410034650 0x7f6410036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 Processor -- start 2024-09-13T06:29:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.669+0000 7f653a75d980 1 -- start start 2024-09-13T06:29:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f6537a6c640 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6410034650 0x7f6410036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5650c5ae8430 tx=0x7f652c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b028c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5650c5ad12d0 con 0x5650c5b024e0 2024-09-13T06:29:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36136/0 (socket says 172.21.15.169:36136) 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 -- 172.21.15.169:0/333887249 learned_addr learned my addr 172.21.15.169:0/333887249 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 -- 172.21.15.169:0/333887249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c5b02e90 con 0x5650c5b024e0 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 --2- 172.21.15.169:0/333887249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b028c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65280cf620 tx=0x7f65280e3870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419970ce7b159114 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f64177fe640 1 -- 172.21.15.169:0/333887249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6528006710 con 0x5650c5b024e0 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f64177fe640 1 -- 172.21.15.169:0/333887249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280efdd0 con 0x5650c5b024e0 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f64177fe640 1 -- 172.21.15.169:0/333887249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280bc4d0 con 0x5650c5b024e0 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/333887249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 msgr2=0x5650c5b028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 --2- 172.21.15.169:0/333887249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b028c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65280cf620 tx=0x7f65280e3870 comp rx=0 tx=0).stop 2024-09-13T06:29:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/333887249 shutdown_connections 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 --2- 172.21.15.169:0/333887249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b028c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/333887249 >> 172.21.15.169:0/333887249 conn(0x5650c5afe810 msgr2=0x5650c5afc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/333887249 shutdown_connections 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/333887249 wait complete. 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 Processor -- start 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- start start 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5650c5b03220 con 0x5650c5b024e0 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36140/0 (socket says 172.21.15.169:36140) 2024-09-13T06:29:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 learned_addr learned my addr 172.21.15.169:0/1672854928 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c5b09b00 con 0x5650c5b024e0 2024-09-13T06:29:20.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653826d640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b095c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65280c9980 tx=0x7f65280d6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f6415ffb640 1 -- 172.21.15.169:0/1672854928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6528110020 con 0x5650c5b024e0 2024-09-13T06:29:20.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650c5b09b00 con 0x5650c5b024e0 2024-09-13T06:29:20.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f6415ffb640 1 -- 172.21.15.169:0/1672854928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6528006710 con 0x5650c5b024e0 2024-09-13T06:29:20.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650c5b09b00 con 0x5650c5b024e0 2024-09-13T06:29:20.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.673+0000 7f6415ffb640 1 -- 172.21.15.169:0/1672854928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280bc4d0 con 0x5650c5b024e0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6415ffb640 1 -- 172.21.15.169:0/1672854928 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6528113020 con 0x5650c5b024e0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6415ffb640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6400034650 0x7f6400036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6415ffb640 1 -- 172.21.15.169:0/1672854928 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f6528107050 con 0x5650c5b024e0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6537a6c640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6400034650 0x7f6400036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c5b146f0 0x5650c5b16bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b17300 con 0x5650c5b146f0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6538a6e640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c5b146f0 0x5650c5b16bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6537a6c640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6400034650 0x7f6400036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f652c00c010 tx=0x7f652c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6538a6e640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c5b146f0 0x5650c5b16bb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 realm 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b13ba0 con 0x5650c5b146f0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b17dc0 con 0x5650c5b146f0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5b18ba0 0x5650c5b1af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1b5f0 con 0x5650c5b18ba0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653826d640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5b18ba0 0x5650c5b1af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.677+0000 7f653826d640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5b18ba0 0x5650c5b1af90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 20 searching for the correct realm 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5b1dc00 0x5650c5b1fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b20600 con 0x5650c5b1dc00 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6537a6c640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5b1dc00 0x5650c5b1fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6537a6c640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5b1dc00 0x5650c5b1fff0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b20600 con 0x5650c5b18ba0 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653826d640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6528115020 0x7f65280b9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x7f6528115020 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6528115020 0x7f65280b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6528115020 0x7f65280b9200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b1dc00 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.681+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x7f6528115020 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x7f6528115020 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b1dc00 2024-09-13T06:29:20.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.685+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b1dc00 2024-09-13T06:29:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b1dc00 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x7f6528115020 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b146f0 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x7f6528115020 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b1dc00 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x7f6528115020 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.689+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b1dc00 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1be90 con 0x5650c5b18ba0 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:20.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1c6e0 con 0x5650c5b146f0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1cad0 con 0x5650c5b18ba0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b1cad0 con 0x5650c5b1dc00 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 zone default found 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 4 Realm: () 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 zonegroup default 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b20a60 con 0x7f6528115020 2024-09-13T06:29:20.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b227e0 con 0x5650c5b1dc00 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b22b80 con 0x5650c5b1dc00 2024-09-13T06:29:20.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 started sync module instance, tier type = 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.693+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b21c80 con 0x5650c5b18ba0 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94904914157984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b21c80 con 0x5650c5b18ba0 2024-09-13T06:29:20.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b235b0 con 0x5650c5b146f0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94904914161920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b23e00 con 0x5650c5b146f0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b248a0 con 0x5650c5b18ba0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94904914157984] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.697+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94904914161920] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94904914166640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b23950 con 0x5650c5b18ba0 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b25170 con 0x7f6528115020 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94904914169024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b23950 con 0x7f6528115020 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b25bf0 con 0x5650c5b18ba0 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94904914169024] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94904914166640] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94904914170080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b25700 con 0x5650c5b18ba0 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.701+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b26490 con 0x5650c5b1dc00 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94904914173920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b25700 con 0x5650c5b1dc00 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27300 con 0x5650c5b1dc00 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94904914179744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27f70 con 0x5650c5b1dc00 2024-09-13T06:29:20.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b28930 con 0x7f6528115020 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94904914170080] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94904914173920] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94904914179744] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94904914155472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27f70 con 0x7f6528115020 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=0 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=1 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=2 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=3 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=4 2024-09-13T06:29:20.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=5 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=6 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94904914155472] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 20 add_watcher() i=7 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.705+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b2b4b0 con 0x5650c5b146f0 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94904914180800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b28930 con 0x5650c5b146f0 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94904914180800] v31'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f63ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 5 note: GC not initialized 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f63ed7e2640 20 reqs_thread_entry: start 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 20 Filter name: none 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f635effd640 20 reqs_thread_entry: start 2024-09-13T06:29:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b4e3f0 con 0x5650c5b146f0 2024-09-13T06:29:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T06:29:20.727 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:29:20.540704Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f63ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.709+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94904914180800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b4e930 con 0x5650c5b146f0 2024-09-13T06:29:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.713+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94904914180800] v31'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.713+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94904914157984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27ac0 con 0x5650c5b18ba0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.713+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94904914157984] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.713+0000 7f653a75d980 20 remove_watcher() i=0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.713+0000 7f653a75d980 2 removed watcher, disabling cache 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.713+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94904914161920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27ac0 con 0x5650c5b146f0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94904914161920] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x5650c5b146f0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653a75d980 20 remove_watcher() i=1 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94904914166640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27ac0 con 0x5650c5b18ba0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94904914166640] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653a75d980 20 remove_watcher() i=2 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94904914169024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b24370 con 0x7f6528115020 2024-09-13T06:29:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94904914169024] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653a75d980 20 remove_watcher() i=3 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.717+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94904914170080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27ac0 con 0x5650c5b18ba0 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.721+0000 7f653826d640 1 -- 172.21.15.169:0/1672854928 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94904914170080] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65280cf370 con 0x5650c5b18ba0 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.721+0000 7f653a75d980 20 remove_watcher() i=4 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.721+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94904914173920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b24370 con 0x5650c5b1dc00 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.721+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94904914173920] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.721+0000 7f653a75d980 20 remove_watcher() i=5 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.721+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94904914179744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b27ac0 con 0x5650c5b1dc00 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f6537a6c640 1 -- 172.21.15.169:0/1672854928 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94904914179744] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652c037040 con 0x5650c5b1dc00 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 20 remove_watcher() i=6 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94904914155472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5650c5b25fe0 con 0x7f6528115020 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94904914155472] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653000a4d0 con 0x7f6528115020 2024-09-13T06:29:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 20 remove_watcher() i=7 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5b18ba0 msgr2=0x5650c5b1af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5b18ba0 0x5650c5b1af90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c5b146f0 msgr2=0x5650c5b16bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c5b146f0 0x5650c5b16bb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6528115020 msgr2=0x7f65280b9200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6528115020 0x7f65280b9200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5b1dc00 msgr2=0x5650c5b1fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5b1dc00 0x5650c5b1fff0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6400034650 msgr2=0x7f6400036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6400034650 0x7f6400036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f652c00c010 tx=0x7f652c010000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 msgr2=0x5650c5b095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/1672854928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5b024e0 0x5650c5b095c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65280c9980 tx=0x7f65280d6f90 comp rx=0 tx=0).stop 2024-09-13T06:29:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f6538a6e640 1 -- 172.21.15.169:0/1672854928 reap_dead start 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 shutdown_connections 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 >> 172.21.15.169:0/1672854928 conn(0x5650c5afe810 msgr2=0x5650c5afc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 shutdown_connections 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/1672854928 wait complete. 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6410034650 msgr2=0x7f6410036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6410034650 0x7f6410036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5650c5ae8430 tx=0x7f652c00f000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 msgr2=0x5650c5af5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 0x5650c5af5ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6528000c10 tx=0x7f65280e3e80 comp rx=0 tx=0).stop 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 shutdown_connections 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6410034650 0x7f6410036b10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/708844291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c5af5ac0 0x5650c5af5ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 >> 172.21.15.169:0/708844291 conn(0x5650c5aeac10 msgr2=0x5650c5aed690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 shutdown_connections 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/708844291 wait complete. 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5ae0070 msgr2=0x5650c5ae2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5650c5ae0070 0x5650c5ae2460 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c59e5fa0 msgr2=0x5650c5adec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5650c59e5fa0 0x5650c5adec60 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5ae5700 msgr2=0x5650c5ae7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5650c5ae5700 0x5650c5ae7af0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64200346a0 msgr2=0x7f6420036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64200346a0 0x7f6420036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f652c000f70 tx=0x7f652c001380 comp rx=0 tx=0).stop 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 msgr2=0x5650c5ad7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 --2- 172.21.15.169:0/3542820807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5650c59e5650 0x5650c5ad7c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f65280199f0 tx=0x7f65280180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f6538a6e640 1 -- 172.21.15.169:0/3542820807 reap_dead start 2024-09-13T06:29:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 shutdown_connections 2024-09-13T06:29:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 >> 172.21.15.169:0/3542820807 conn(0x5650c59e1170 msgr2=0x5650c5acb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 shutdown_connections 2024-09-13T06:29:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.725+0000 7f653a75d980 1 -- 172.21.15.169:0/3542820807 wait complete. 2024-09-13T06:29:20.740 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:29:20.540704Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:20.740 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T06:29:20.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T06:29:20.740 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T06:29:20.816 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:20.816 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f4437e80980 1 Processor -- start 2024-09-13T06:29:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f4437e80980 1 -- start start 2024-09-13T06:29:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f4437e80980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55ada1970e90 0x55ada1973280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f4437e80980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ada17f2ae0 con 0x55ada18df2e0 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f4437e80980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55ada1816e30 con 0x55ada1970e90 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f443518f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55ada1970e90 0x55ada1973280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f443518f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55ada1970e90 0x55ada1973280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36156/0 (socket says 172.21.15.169:36156) 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f443518f640 1 -- 172.21.15.169:0/1924259065 learned_addr learned my addr 172.21.15.169:0/1924259065 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f4435990640 1 --1- 172.21.15.169:0/1924259065 >> v1:172.21.15.112:6789/0 conn(0x55ada18df2e0 0x55ada196f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45162/0 (socket says 172.21.15.169:45162) 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f443518f640 1 -- 172.21.15.169:0/1924259065 >> v1:172.21.15.112:6789/0 conn(0x55ada18df2e0 legacy=0x55ada196f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.813+0000 7f443518f640 1 -- 172.21.15.169:0/1924259065 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada18df6c0 con 0x55ada1970e90 2024-09-13T06:29:20.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f443518f640 1 --2- 172.21.15.169:0/1924259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1970e90 0x55ada1973280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f442000a5c0 tx=0x7f442001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9b70073b45a965 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f443498e640 1 -- 172.21.15.169:0/1924259065 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44200a6070 con 0x55ada1970e90 2024-09-13T06:29:20.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f443498e640 1 -- 172.21.15.169:0/1924259065 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44200af070 con 0x55ada1970e90 2024-09-13T06:29:20.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f443498e640 1 -- 172.21.15.169:0/1924259065 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44200aa5c0 con 0x55ada1970e90 2024-09-13T06:29:20.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 -- 172.21.15.169:0/1924259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1970e90 msgr2=0x55ada1973280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 --2- 172.21.15.169:0/1924259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1970e90 0x55ada1973280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f442000a5c0 tx=0x7f442001b340 comp rx=0 tx=0).stop 2024-09-13T06:29:20.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 -- 172.21.15.169:0/1924259065 shutdown_connections 2024-09-13T06:29:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 --2- 172.21.15.169:0/1924259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1970e90 0x55ada1973280 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 -- 172.21.15.169:0/1924259065 >> 172.21.15.169:0/1924259065 conn(0x55ada19650a0 msgr2=0x55ada19674c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 -- 172.21.15.169:0/1924259065 shutdown_connections 2024-09-13T06:29:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.817+0000 7f4437e80980 1 -- 172.21.15.169:0/1924259065 wait complete. 2024-09-13T06:29:20.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.829+0000 7f4437e80980 1 Processor -- start 2024-09-13T06:29:20.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.829+0000 7f4437e80980 1 -- start start 2024-09-13T06:29:20.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a57bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ada1818200 con 0x55ada18df2e0 2024-09-13T06:29:20.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a57bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a57bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36162/0 (socket says 172.21.15.169:36162) 2024-09-13T06:29:20.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 -- 172.21.15.169:0/563513579 learned_addr learned my addr 172.21.15.169:0/563513579 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 -- 172.21.15.169:0/563513579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada1a581c0 con 0x55ada18df2e0 2024-09-13T06:29:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 --2- 172.21.15.169:0/563513579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a57bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44300015f0 tx=0x7f4430001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3a4e7abd06c3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4323e07640 1 -- 172.21.15.169:0/563513579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430013420 con 0x55ada18df2e0 2024-09-13T06:29:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4323e07640 1 -- 172.21.15.169:0/563513579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44300135e0 con 0x55ada18df2e0 2024-09-13T06:29:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4323e07640 1 -- 172.21.15.169:0/563513579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430013940 con 0x55ada18df2e0 2024-09-13T06:29:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- 172.21.15.169:0/563513579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 msgr2=0x55ada1a57bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 --2- 172.21.15.169:0/563513579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a57bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44300015f0 tx=0x7f4430001ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- 172.21.15.169:0/563513579 shutdown_connections 2024-09-13T06:29:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 --2- 172.21.15.169:0/563513579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a57bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- 172.21.15.169:0/563513579 >> 172.21.15.169:0/563513579 conn(0x55ada19650a0 msgr2=0x55ada1a53820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- 172.21.15.169:0/563513579 shutdown_connections 2024-09-13T06:29:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- 172.21.15.169:0/563513579 wait complete. 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 Processor -- start 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- start start 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a5ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4437e80980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ada1976220 con 0x55ada18df2e0 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a5ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a5ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36168/0 (socket says 172.21.15.169:36168) 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 -- 172.21.15.169:0/3958020240 learned_addr learned my addr 172.21.15.169:0/3958020240 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada1a5f480 con 0x55ada18df2e0 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.833+0000 7f4435990640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a5ef40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4430006640 tx=0x7f4430000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4322604640 1 -- 172.21.15.169:0/3958020240 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430022020 con 0x55ada18df2e0 2024-09-13T06:29:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada1a5f710 con 0x55ada18df2e0 2024-09-13T06:29:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4322604640 1 -- 172.21.15.169:0/3958020240 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4430006320 con 0x55ada18df2e0 2024-09-13T06:29:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4322604640 1 -- 172.21.15.169:0/3958020240 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430004af0 con 0x55ada18df2e0 2024-09-13T06:29:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada1a623f0 con 0x55ada18df2e0 2024-09-13T06:29:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4322604640 1 -- 172.21.15.169:0/3958020240 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4430025020 con 0x55ada18df2e0 2024-09-13T06:29:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4322604640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f431c0346a0 0x7f431c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4322604640 1 -- 172.21.15.169:0/3958020240 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4430018030 con 0x55ada18df2e0 2024-09-13T06:29:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f443518f640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f431c0346a0 0x7f431c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1970e90 0x55ada1a65f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a66550 con 0x55ada1970e90 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4436191640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1970e90 0x55ada1a65f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f443518f640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f431c0346a0 0x7f431c036b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44200ae000 tx=0x7f44200a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4436191640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1970e90 0x55ada1a65f30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4436191640 1 -- 172.21.15.169:0/3958020240 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1970e90 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a67340 0x55ada1a69730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a69d70 con 0x55ada1a67340 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4435990640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a67340 0x55ada1a69730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.837+0000 7f4435990640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a67340 0x55ada1a69730 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4435990640 1 -- 172.21.15.169:0/3958020240 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f443001b070 con 0x55ada1a67340 2024-09-13T06:29:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a6b620 con 0x55ada1a67340 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4435990640 1 -- 172.21.15.169:0/3958020240 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f443001b070 con 0x55ada1a67340 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a6a790 con 0x55ada1a67340 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4435990640 1 -- 172.21.15.169:0/3958020240 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f443001b070 con 0x55ada1a67340 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1a6c9d0 0x55ada1a6edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a6f300 con 0x55ada1a6c9d0 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f443518f640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1a6c9d0 0x55ada1a6edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f443518f640 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1a6c9d0 0x55ada1a6edc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f443518f640 1 -- 172.21.15.169:0/3958020240 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1a6c9d0 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 Processor -- start 2024-09-13T06:29:20.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 -- start start 2024-09-13T06:29:20.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 0x55ada1a7d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4437e80980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ada1871800 con 0x55ada1a7ccb0 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 0x55ada1a7d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 0x55ada1a7d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36172/0 (socket says 172.21.15.169:36172) 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.841+0000 7f4435990640 1 -- 172.21.15.169:0/3601848600 learned_addr learned my addr 172.21.15.169:0/3601848600 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 -- 172.21.15.169:0/3601848600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada1a7d610 con 0x55ada1a7ccb0 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 0x55ada1a7d0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4430048470 tx=0x7f4430005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f431b7fe640 1 -- 172.21.15.169:0/3601848600 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443001d950 con 0x55ada1a7ccb0 2024-09-13T06:29:20.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f431b7fe640 1 -- 172.21.15.169:0/3601848600 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443001daf0 con 0x55ada1a7ccb0 2024-09-13T06:29:20.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f431b7fe640 1 -- 172.21.15.169:0/3601848600 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443001ddd0 con 0x55ada1a7ccb0 2024-09-13T06:29:20.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada1a7d8a0 con 0x55ada1a7ccb0 2024-09-13T06:29:20.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada1a80520 con 0x55ada1a7ccb0 2024-09-13T06:29:20.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f431b7fe640 1 -- 172.21.15.169:0/3601848600 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4430046040 con 0x55ada1a7ccb0 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f431b7fe640 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4310034650 0x7f4310036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f431b7fe640 1 -- 172.21.15.169:0/3601848600 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4430054af0 con 0x55ada1a7ccb0 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f443518f640 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4310034650 0x7f4310036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4437e80980 1 Processor -- start 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4437e80980 1 -- start start 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4437e80980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a89a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4437e80980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ada1a58540 con 0x55ada1a896b0 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f443518f640 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4310034650 0x7f4310036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55ada1a63530 tx=0x7f4420005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a89a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a89a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36184/0 (socket says 172.21.15.169:36184) 2024-09-13T06:29:20.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 -- 172.21.15.169:0/2887670016 learned_addr learned my addr 172.21.15.169:0/2887670016 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 -- 172.21.15.169:0/2887670016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada1a8a060 con 0x55ada1a896b0 2024-09-13T06:29:20.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.845+0000 7f4435990640 1 --2- 172.21.15.169:0/2887670016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a89a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4430004d30 tx=0x7f443003e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8676bce9a128f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43197fa640 1 -- 172.21.15.169:0/2887670016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430059040 con 0x55ada1a896b0 2024-09-13T06:29:20.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43197fa640 1 -- 172.21.15.169:0/2887670016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4430063070 con 0x55ada1a896b0 2024-09-13T06:29:20.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43197fa640 1 -- 172.21.15.169:0/2887670016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430048af0 con 0x55ada1a896b0 2024-09-13T06:29:20.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/2887670016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 msgr2=0x55ada1a89a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 --2- 172.21.15.169:0/2887670016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a89a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4430004d30 tx=0x7f443003e410 comp rx=0 tx=0).stop 2024-09-13T06:29:20.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/2887670016 shutdown_connections 2024-09-13T06:29:20.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 --2- 172.21.15.169:0/2887670016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a89a90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/2887670016 >> 172.21.15.169:0/2887670016 conn(0x55ada1a85a90 msgr2=0x55ada1a83b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/2887670016 shutdown_connections 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/2887670016 wait complete. 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 Processor -- start 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- start start 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a90850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ada1a8a500 con 0x55ada1a896b0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a90850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4435990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a90850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36192/0 (socket says 172.21.15.169:36192) 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 learned_addr learned my addr 172.21.15.169:0/3314382249 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada1a90d90 con 0x55ada1a896b0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4435990640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a90850 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4430047310 tx=0x7f4430025fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43077fe640 1 -- 172.21.15.169:0/3314382249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430029cb0 con 0x55ada1a896b0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada1a90d90 con 0x55ada1a896b0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43077fe640 1 -- 172.21.15.169:0/3314382249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443006e070 con 0x55ada1a896b0 2024-09-13T06:29:20.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43077fe640 1 -- 172.21.15.169:0/3314382249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430049050 con 0x55ada1a896b0 2024-09-13T06:29:20.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada1a90d90 con 0x55ada1a896b0 2024-09-13T06:29:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.849+0000 7f43077fe640 1 -- 172.21.15.169:0/3314382249 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4430078060 con 0x55ada1a896b0 2024-09-13T06:29:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f43077fe640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4300034650 0x7f4300036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f43077fe640 1 -- 172.21.15.169:0/3314382249 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f443007bab0 con 0x55ada1a896b0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f443518f640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4300034650 0x7f4300036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1a9b7f0 0x55ada1a9dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a9e3e0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4436191640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1a9b7f0 0x55ada1a9dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4436191640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1a9b7f0 0x55ada1a9dc90 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f443518f640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4300034650 0x7f4300036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4420000c10 tx=0x7f44200c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 realm 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a9ace0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1a9eea0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a9fc80 0x55ada1aa2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa2700 con 0x55ada1a9fc80 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4435990640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a9fc80 0x55ada1aa2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4435990640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a9fc80 0x55ada1aa2070 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa2c40 con 0x55ada1a9fc80 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 20 searching for the correct realm 2024-09-13T06:29:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1aa4420 0x55ada1aa68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa6fb0 con 0x55ada1aa4420 2024-09-13T06:29:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.853+0000 7f443518f640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1aa4420 0x55ada1aa68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f443518f640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1aa4420 0x55ada1aa68e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa6fb0 con 0x55ada1a9fc80 2024-09-13T06:29:20.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4435990640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f443006a040 0x7f44300544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:20.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x7f443006a040 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f443006a040 0x7f44300544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f443006a040 0x7f44300544d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1aa4420 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.857+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x7f443006a040 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x7f443006a040 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1aa4420 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1aa4420 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1aa4420 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.861+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x7f443006a040 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9b7f0 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x7f443006a040 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1aa4420 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x7f443006a040 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1aa4420 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f4430067070 con 0x55ada1a9fc80 2024-09-13T06:29:20.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.865+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa2850 con 0x55ada1a9b7f0 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa2c40 con 0x55ada1a9fc80 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa2c40 con 0x55ada1aa4420 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 zone default found 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 4 Realm: () 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 zonegroup default 2024-09-13T06:29:20.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa7430 con 0x7f443006a040 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa9240 con 0x55ada1aa4420 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa96a0 con 0x55ada1aa4420 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:20.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 started sync module instance, tier type = 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.869+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa8650 con 0x55ada1a9fc80 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204230011728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aa8650 con 0x55ada1a9fc80 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aaa110 con 0x55ada1a9b7f0 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204230016032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aaa9e0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aab3e0 con 0x55ada1a9fc80 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204230016032] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204230011728] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204230009248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aaa530 con 0x55ada1a9fc80 2024-09-13T06:29:20.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.873+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aabcb0 con 0x7f443006a040 2024-09-13T06:29:20.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204230023168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aaa530 con 0x7f443006a040 2024-09-13T06:29:20.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aac6f0 con 0x55ada1a9fc80 2024-09-13T06:29:20.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204230009248] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204230023168] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204230024224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aac240 con 0x55ada1a9fc80 2024-09-13T06:29:20.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.877+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aacf90 con 0x55ada1aa4420 2024-09-13T06:29:20.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.881+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.881+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204230028000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aac240 con 0x55ada1aa4420 2024-09-13T06:29:20.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.881+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aade00 con 0x55ada1aa4420 2024-09-13T06:29:20.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.881+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204230024224] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.881+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204230028000] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.885+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.885+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204230020848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aade00 con 0x55ada1aa4420 2024-09-13T06:29:20.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.885+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aae6a0 con 0x7f443006a040 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.885+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204230020848] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204230034384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aade00 con 0x7f443006a040 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=0 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=1 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=2 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=3 2024-09-13T06:29:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=4 2024-09-13T06:29:20.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=5 2024-09-13T06:29:20.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=6 2024-09-13T06:29:20.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204230034384] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 add_watcher() i=7 2024-09-13T06:29:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ab1b50 con 0x55ada1a9b7f0 2024-09-13T06:29:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204230032240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aaf0a0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204230032240] v31'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f42e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.889+0000 7f4437e80980 5 note: GC not initialized 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f42e67fc640 20 reqs_thread_entry: start 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 20 Filter name: none 2024-09-13T06:29:20.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4257fff640 20 reqs_thread_entry: start 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 20 rados->read ofs=0 len=0 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad51e0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:20.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1adbdb0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94204230219808 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad7520 con 0x55ada1a9fc80 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94204230024224 notify 133143986188 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55ada1a7d8a0 con 0x55ada1a9fc80 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f43197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94204230024224 notifier 4400 bl.length()=758 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f43197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f43197fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f43197fa640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f42f8003eb0 con 0x55ada1a9fc80 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94204230219808 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.893+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94204230219808 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ada1a7d610 con 0x55ada1a9fc80 2024-09-13T06:29:20.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1adb820 con 0x55ada1a9b7f0 2024-09-13T06:29:20.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 foo:foo1 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4437e80980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T06:29:20.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94204230219808 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad7070 con 0x55ada1a9fc80 2024-09-13T06:29:20.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 94204230011728 notify 133143986189 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55ada1a7d610 con 0x55ada1a9fc80 2024-09-13T06:29:20.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4318ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94204230011728 notifier 4400 bl.length()=159 2024-09-13T06:29:20.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4318ff9640 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f42600032d0 con 0x55ada1a9fc80 2024-09-13T06:29:20.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(67 notify.0 [notify cookie 94204230219808 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== watch-notify(notify_complete (2) cookie 94204230219808 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ada1a623f0 con 0x55ada1a9fc80 2024-09-13T06:29:20.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.901 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:29:20.540704Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:20.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f42e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:20.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.897+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204230032240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x55ada1a9b7f0 2024-09-13T06:29:20.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.901+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94204230032240] v31'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.901+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204230011728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x55ada1a9fc80 2024-09-13T06:29:20.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.901+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94204230011728] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.901+0000 7f4437e80980 20 remove_watcher() i=0 2024-09-13T06:29:20.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.901+0000 7f4437e80980 2 removed watcher, disabling cache 2024-09-13T06:29:20.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.901+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204230016032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x55ada1a9b7f0 2024-09-13T06:29:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94204230016032] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x55ada1a9b7f0 2024-09-13T06:29:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4437e80980 20 remove_watcher() i=1 2024-09-13T06:29:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204230009248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x55ada1a9fc80 2024-09-13T06:29:20.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94204230009248] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4437e80980 20 remove_watcher() i=2 2024-09-13T06:29:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204230023168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x7f443006a040 2024-09-13T06:29:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94204230023168] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4437e80980 20 remove_watcher() i=3 2024-09-13T06:29:20.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.905+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204230024224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aab800 con 0x55ada1a9fc80 2024-09-13T06:29:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.909+0000 7f4435990640 1 -- 172.21.15.169:0/3314382249 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94204230024224] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443005c040 con 0x55ada1a9fc80 2024-09-13T06:29:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.909+0000 7f4437e80980 20 remove_watcher() i=4 2024-09-13T06:29:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.909+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204230028000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x55ada1aa4420 2024-09-13T06:29:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.909+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94204230028000] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.909+0000 7f4437e80980 20 remove_watcher() i=5 2024-09-13T06:29:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.909+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204230020848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1ad3010 con 0x55ada1aa4420 2024-09-13T06:29:20.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.913+0000 7f443518f640 1 -- 172.21.15.169:0/3314382249 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94204230020848] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44200aaae0 con 0x55ada1aa4420 2024-09-13T06:29:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.913+0000 7f4437e80980 20 remove_watcher() i=6 2024-09-13T06:29:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.913+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204230034384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ada1aaaef0 con 0x7f443006a040 2024-09-13T06:29:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94204230034384] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44280083f0 con 0x7f443006a040 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 20 remove_watcher() i=7 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a9fc80 msgr2=0x55ada1aa2070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a9fc80 0x55ada1aa2070 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1a9b7f0 msgr2=0x55ada1a9dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1a9b7f0 0x55ada1a9dc90 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f443006a040 msgr2=0x7f44300544d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f443006a040 0x7f44300544d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1aa4420 msgr2=0x55ada1aa68e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1aa4420 0x55ada1aa68e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4300034650 msgr2=0x7f4300036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4300034650 0x7f4300036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4420000c10 tx=0x7f44200c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4436191640 1 -- 172.21.15.169:0/3314382249 reap_dead start 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 msgr2=0x55ada1a90850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a90850 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4430047310 tx=0x7f4430025fe0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 shutdown_connections 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3314382249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a896b0 0x55ada1a90850 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 >> 172.21.15.169:0/3314382249 conn(0x55ada1a85a90 msgr2=0x55ada1a83b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 shutdown_connections 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3314382249 wait complete. 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4310034650 msgr2=0x7f4310036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4310034650 0x7f4310036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55ada1a63530 tx=0x7f4420005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 msgr2=0x55ada1a7d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 0x55ada1a7d0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4430048470 tx=0x7f4430005130 comp rx=0 tx=0).stop 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 shutdown_connections 2024-09-13T06:29:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4310034650 0x7f4310036b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3601848600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada1a7ccb0 0x55ada1a7d0d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 >> 172.21.15.169:0/3601848600 conn(0x55ada1a71e00 msgr2=0x55ada1a74880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 shutdown_connections 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3601848600 wait complete. 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a67340 msgr2=0x55ada1a69730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ada1a67340 0x55ada1a69730 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1970e90 msgr2=0x55ada1a65f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ada1970e90 0x55ada1a65f30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1a6c9d0 msgr2=0x55ada1a6edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ada1a6c9d0 0x55ada1a6edc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f431c0346a0 msgr2=0x7f431c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f431c0346a0 0x7f431c036b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44200ae000 tx=0x7f44200a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 msgr2=0x55ada1a5ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 --2- 172.21.15.169:0/3958020240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ada18df2e0 0x55ada1a5ef40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4430006640 tx=0x7f4430000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4436191640 1 -- 172.21.15.169:0/3958020240 reap_dead start 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 shutdown_connections 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 >> 172.21.15.169:0/3958020240 conn(0x55ada19650a0 msgr2=0x55ada1a523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 shutdown_connections 2024-09-13T06:29:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:20.917+0000 7f4437e80980 1 -- 172.21.15.169:0/3958020240 wait complete. 2024-09-13T06:29:20.929 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:29:20.540704Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:20.930 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T06:29:20.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T06:29:20.930 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T06:29:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2dc7fe980 1 Processor -- start 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2dc7fe980 1 -- start start 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2dc7fe980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55812a307570 0x55812a307950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2dc7fe980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55812a190ae0 con 0x55812a307ec0 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2dc7fe980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55812a1b4e30 con 0x55812a307570 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2da30e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55812a307570 0x55812a307950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2da30e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55812a307570 0x55812a307950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36206/0 (socket says 172.21.15.169:36206) 2024-09-13T06:29:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2da30e640 1 -- 172.21.15.169:0/4069699928 learned_addr learned my addr 172.21.15.169:0/4069699928 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2da30e640 1 -- 172.21.15.169:0/4069699928 >> v1:172.21.15.112:6789/0 conn(0x55812a307ec0 legacy=0x55812a30c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.001+0000 7fd2da30e640 1 -- 172.21.15.169:0/4069699928 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55812a30f140 con 0x55812a307570 2024-09-13T06:29:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2da30e640 1 --2- 172.21.15.169:0/4069699928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a307950 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00a7a0 tx=0x7fd2cc01d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9022ec3408f9426c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2d930c640 1 -- 172.21.15.169:0/4069699928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0b3070 con 0x55812a307570 2024-09-13T06:29:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2d930c640 1 -- 172.21.15.169:0/4069699928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0a6820 con 0x55812a307570 2024-09-13T06:29:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2d930c640 1 -- 172.21.15.169:0/4069699928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0a6b20 con 0x55812a307570 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4069699928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 msgr2=0x55812a307950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/4069699928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a307950 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00a7a0 tx=0x7fd2cc01d800 comp rx=0 tx=0).stop 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4069699928 shutdown_connections 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/4069699928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a307950 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4069699928 >> 172.21.15.169:0/4069699928 conn(0x55812a303090 msgr2=0x55812a3054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4069699928 shutdown_connections 2024-09-13T06:29:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.005+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4069699928 wait complete. 2024-09-13T06:29:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2dc7fe980 1 Processor -- start 2024-09-13T06:29:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2dc7fe980 1 -- start start 2024-09-13T06:29:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2dc7fe980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a3f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2dc7fe980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55812a1b6200 con 0x55812a307570 2024-09-13T06:29:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a3f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a3f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36218/0 (socket says 172.21.15.169:36218) 2024-09-13T06:29:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.017+0000 7fd2da30e640 1 -- 172.21.15.169:0/4293815593 learned_addr learned my addr 172.21.15.169:0/4293815593 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 -- 172.21.15.169:0/4293815593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55812a3f1e70 con 0x55812a307570 2024-09-13T06:29:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 --2- 172.21.15.169:0/4293815593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a3f18a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc01b430 tx=0x7fd2cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34c2a018d865229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd1c8608640 1 -- 172.21.15.169:0/4293815593 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0b3070 con 0x55812a307570 2024-09-13T06:29:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd1c8608640 1 -- 172.21.15.169:0/4293815593 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0b4040 con 0x55812a307570 2024-09-13T06:29:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd1c8608640 1 -- 172.21.15.169:0/4293815593 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0a6cd0 con 0x55812a307570 2024-09-13T06:29:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4293815593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 msgr2=0x55812a3f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/4293815593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a3f18a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc01b430 tx=0x7fd2cc0033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4293815593 shutdown_connections 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/4293815593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307570 0x55812a3f18a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4293815593 >> 172.21.15.169:0/4293815593 conn(0x55812a303090 msgr2=0x55812a3ed4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4293815593 shutdown_connections 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/4293815593 wait complete. 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 Processor -- start 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- start start 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307ec0 0x55812a3f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55812a30eb80 con 0x55812a307ec0 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307ec0 0x55812a3f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307ec0 0x55812a3f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36220/0 (socket says 172.21.15.169:36220) 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 -- 172.21.15.169:0/381752310 learned_addr learned my addr 172.21.15.169:0/381752310 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55812a3f91c0 con 0x55812a307ec0 2024-09-13T06:29:21.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2da30e640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307ec0 0x55812a3f8c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc01beb0 tx=0x7fd2cc01a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd1c6e05640 1 -- 172.21.15.169:0/381752310 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0aed50 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd1c6e05640 1 -- 172.21.15.169:0/381752310 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0c2470 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55812a3f9450 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd1c6e05640 1 -- 172.21.15.169:0/381752310 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0c2790 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.021+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55812a3fc130 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd1c6e05640 1 -- 172.21.15.169:0/381752310 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2cc0c2930 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd1c6e05640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1c0034650 0x7fd1c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd1c6e05640 1 -- 172.21.15.169:0/381752310 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd2cc0bd070 con 0x55812a307ec0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1c0034650 0x7fd1c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a3fdc00 0x55812a3ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a400640 con 0x55812a3fdc00 2024-09-13T06:29:21.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dab0f640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a3fdc00 0x55812a3ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1c0034650 0x7fd1c0036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4001e20 tx=0x7fd2c40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dab0f640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a3fdc00 0x55812a3ffff0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dab0f640 1 -- 172.21.15.169:0/381752310 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a3fdc00 2024-09-13T06:29:21.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a401410 0x55812a403800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a403e60 con 0x55812a401410 2024-09-13T06:29:21.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2da30e640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a401410 0x55812a403800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2da30e640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a401410 0x55812a403800 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2da30e640 1 -- 172.21.15.169:0/381752310 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2cc0b6070 con 0x55812a401410 2024-09-13T06:29:21.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.025+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a405710 con 0x55812a401410 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 -- 172.21.15.169:0/381752310 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2cc0b6070 con 0x55812a401410 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a404940 con 0x55812a401410 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 -- 172.21.15.169:0/381752310 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2cc0b6070 con 0x55812a401410 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a406ac0 0x55812a408eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a4093f0 con 0x55812a406ac0 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a406ac0 0x55812a408eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a406ac0 0x55812a408eb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/381752310 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2c400d040 con 0x55812a406ac0 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 Processor -- start 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 -- start start 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 0x55812a4172a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55812a20f800 con 0x55812a416e80 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 0x55812a4172a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 0x55812a4172a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36224/0 (socket says 172.21.15.169:36224) 2024-09-13T06:29:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 -- 172.21.15.169:0/849974688 learned_addr learned my addr 172.21.15.169:0/849974688 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 -- 172.21.15.169:0/849974688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55812a4177e0 con 0x55812a416e80 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2da30e640 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 0x55812a4172a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0e5360 tx=0x7fd2cc0c0be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd1bffff640 1 -- 172.21.15.169:0/849974688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0acbd0 con 0x55812a416e80 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55812a417a70 con 0x55812a416e80 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd1bffff640 1 -- 172.21.15.169:0/849974688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0acd70 con 0x55812a416e80 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd1bffff640 1 -- 172.21.15.169:0/849974688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0bf690 con 0x55812a416e80 2024-09-13T06:29:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.029+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55812a41a6f0 con 0x55812a416e80 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd1bffff640 1 -- 172.21.15.169:0/849974688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2cc0c0360 con 0x55812a416e80 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd1bffff640 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1b40346a0 0x7fd1b4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd1bffff640 1 -- 172.21.15.169:0/849974688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd2cc0deae0 con 0x55812a416e80 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1b40346a0 0x7fd1b4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 Processor -- start 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 -- start start 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1b40346a0 0x7fd1b4036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55812a4097f0 tx=0x7fd2c4006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a423b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55812a3f2130 con 0x55812a423700 2024-09-13T06:29:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a423b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a423b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36230/0 (socket says 172.21.15.169:36230) 2024-09-13T06:29:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2da30e640 1 -- 172.21.15.169:0/442029946 learned_addr learned my addr 172.21.15.169:0/442029946 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2da30e640 1 -- 172.21.15.169:0/442029946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55812a4240d0 con 0x55812a423700 2024-09-13T06:29:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2da30e640 1 --2- 172.21.15.169:0/442029946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a423b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0c0b90 tx=0x7fd2cc0b8d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb448c6215e11cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd1bdffb640 1 -- 172.21.15.169:0/442029946 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0c0650 con 0x55812a423700 2024-09-13T06:29:21.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd1bdffb640 1 -- 172.21.15.169:0/442029946 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0fe070 con 0x55812a423700 2024-09-13T06:29:21.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd1bdffb640 1 -- 172.21.15.169:0/442029946 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0ac340 con 0x55812a423700 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/442029946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 msgr2=0x55812a423b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/442029946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a423b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0c0b90 tx=0x7fd2cc0b8d10 comp rx=0 tx=0).stop 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/442029946 shutdown_connections 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/442029946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a423b00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.033+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/442029946 >> 172.21.15.169:0/442029946 conn(0x55812a41fb30 msgr2=0x55812a41dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/442029946 shutdown_connections 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/442029946 wait complete. 2024-09-13T06:29:21.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 Processor -- start 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- start start 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a42a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55812a4245a0 con 0x55812a423700 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a42a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2da30e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a42a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36232/0 (socket says 172.21.15.169:36232) 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 learned_addr learned my addr 172.21.15.169:0/2124197471 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55812a42ae70 con 0x55812a423700 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2da30e640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a42a930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0c0b90 tx=0x7fd2cc0e8590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd1abfff640 1 -- 172.21.15.169:0/2124197471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0e81f0 con 0x55812a423700 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55812a42ae70 con 0x55812a423700 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd1abfff640 1 -- 172.21.15.169:0/2124197471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0e8390 con 0x55812a423700 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd1abfff640 1 -- 172.21.15.169:0/2124197471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2cc0b8530 con 0x55812a423700 2024-09-13T06:29:21.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55812a42b2e0 con 0x55812a423700 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd1abfff640 1 -- 172.21.15.169:0/2124197471 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2cc0b86d0 con 0x55812a423700 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd1abfff640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1a4034650 0x7fd1a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd1abfff640 1 -- 172.21.15.169:0/2124197471 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd2cc108070 con 0x55812a423700 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1a4034650 0x7fd1a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a435940 0x55812a437de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a438530 con 0x55812a435940 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2dab0f640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a435940 0x55812a437de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.037+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1a4034650 0x7fd1a4036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40207d0 tx=0x7fd2c4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dab0f640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a435940 0x55812a437de0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 realm 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a434e30 con 0x55812a435940 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a439000 con 0x55812a435940 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a439db0 0x55812a43c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a43c820 con 0x55812a439db0 2024-09-13T06:29:21.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2da30e640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a439db0 0x55812a43c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2da30e640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a439db0 0x55812a43c1a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a43d070 con 0x55812a439db0 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 20 searching for the correct realm 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a43ede0 0x55812a4411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a43ede0 0x55812a4411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2d9b0d640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a43ede0 0x55812a4411d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.041+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd2cc10b030 0x7fd2cc0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x7fd2cc10b030 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd2cc10b030 0x7fd2cc0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd2cc10b030 0x7fd2cc0cb600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.045+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x7fd2cc10b030 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x7fd2cc10b030 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.049+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x7fd2cc10b030 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a435940 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x7fd2cc10b030 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x7fd2cc10b030 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a43ede0 2024-09-13T06:29:21.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55812a441850 con 0x55812a439db0 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a43da20 con 0x55812a435940 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.053+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a43d660 con 0x55812a439db0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a43e3c0 con 0x55812a43ede0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 zone default found 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 4 Realm: () 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:21.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 zonegroup default 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a4421c0 con 0x7fd2cc10b030 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a444490 con 0x55812a43ede0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a444830 con 0x55812a43ede0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 started sync module instance, tier type = 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a443920 con 0x55812a439db0 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94013248257600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a443920 con 0x55812a439db0 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.057+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a445230 con 0x55812a435940 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94013248261440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a445ad0 con 0x55812a435940 2024-09-13T06:29:21.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a4464f0 con 0x55812a439db0 2024-09-13T06:29:21.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94013248261440] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94013248257600] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94013248266208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a445620 con 0x55812a439db0 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.061+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a446dc0 con 0x7fd2cc10b030 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94013248266208] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94013248255088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a445620 con 0x7fd2cc10b030 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a4472b0 con 0x55812a439db0 2024-09-13T06:29:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94013248255088] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94013248268480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a447190 con 0x55812a439db0 2024-09-13T06:29:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a447cc0 con 0x55812a43ede0 2024-09-13T06:29:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94013248272400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a448510 con 0x55812a43ede0 2024-09-13T06:29:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.065+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a448ed0 con 0x55812a43ede0 2024-09-13T06:29:21.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.069+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94013248268480] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.069+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94013248272400] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.069+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.069+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94013248274528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a448480 con 0x55812a43ede0 2024-09-13T06:29:21.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.069+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a449380 con 0x7fd2cc10b030 2024-09-13T06:29:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94013248274528] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94013248278224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a4492f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=0 2024-09-13T06:29:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=1 2024-09-13T06:29:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=2 2024-09-13T06:29:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=3 2024-09-13T06:29:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=4 2024-09-13T06:29:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=5 2024-09-13T06:29:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=6 2024-09-13T06:29:21.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94013248278224] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 add_watcher() i=7 2024-09-13T06:29:21.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:21.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a44c750 con 0x55812a435940 2024-09-13T06:29:21.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94013248277024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a449ca0 con 0x55812a435940 2024-09-13T06:29:21.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94013248277024] v31'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd190fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:21.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:21.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.073+0000 7fd2dc7fe980 5 note: GC not initialized 2024-09-13T06:29:21.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd10b7fe640 20 reqs_thread_entry: start 2024-09-13T06:29:21.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:21.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 20 Filter name: none 2024-09-13T06:29:21.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd1097fa640 20 reqs_thread_entry: start 2024-09-13T06:29:21.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:21.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a46fdc0 con 0x55812a435940 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a476420 con 0x55812a435940 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:21.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:21.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94013248462480 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55812a471dc0 con 0x55812a439db0 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94013248268480 notify 133143986190 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55812a417a70 con 0x55812a439db0 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd1bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94013248268480 notifier 4407 bl.length()=732 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd1bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd1bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd1bdffb640 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd1a0003eb0 con 0x55812a439db0 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94013248462480 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.077+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.081+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94013248462480 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55812a4177e0 con 0x55812a439db0 2024-09-13T06:29:21.082 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:29:20.540704Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:21.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.081+0000 7fd190fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.081+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94013248277024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a46dbf0 con 0x55812a435940 2024-09-13T06:29:21.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.081+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94013248277024] v31'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.081+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94013248257600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a46dbf0 con 0x55812a439db0 2024-09-13T06:29:21.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94013248257600] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2dc7fe980 20 remove_watcher() i=0 2024-09-13T06:29:21.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2dc7fe980 2 removed watcher, disabling cache 2024-09-13T06:29:21.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94013248261440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a46dbf0 con 0x55812a435940 2024-09-13T06:29:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94013248261440] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x55812a435940 2024-09-13T06:29:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2dc7fe980 20 remove_watcher() i=1 2024-09-13T06:29:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.085+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94013248266208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a46dbf0 con 0x55812a439db0 2024-09-13T06:29:21.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94013248266208] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dc7fe980 20 remove_watcher() i=2 2024-09-13T06:29:21.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94013248255088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a445fe0 con 0x7fd2cc10b030 2024-09-13T06:29:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94013248255088] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dc7fe980 20 remove_watcher() i=3 2024-09-13T06:29:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94013248268480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a46dbf0 con 0x55812a439db0 2024-09-13T06:29:21.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2da30e640 1 -- 172.21.15.169:0/2124197471 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94013248268480] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2cc0ec020 con 0x55812a439db0 2024-09-13T06:29:21.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dc7fe980 20 remove_watcher() i=4 2024-09-13T06:29:21.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.089+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94013248272400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a443470 con 0x55812a43ede0 2024-09-13T06:29:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94013248272400] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 20 remove_watcher() i=5 2024-09-13T06:29:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94013248274528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a445fe0 con 0x55812a43ede0 2024-09-13T06:29:21.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2d9b0d640 1 -- 172.21.15.169:0/2124197471 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94013248274528] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4036040 con 0x55812a43ede0 2024-09-13T06:29:21.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 20 remove_watcher() i=6 2024-09-13T06:29:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94013248278224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55812a46dbf0 con 0x7fd2cc10b030 2024-09-13T06:29:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94013248278224] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d40083f0 con 0x7fd2cc10b030 2024-09-13T06:29:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 20 remove_watcher() i=7 2024-09-13T06:29:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a439db0 msgr2=0x55812a43c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a439db0 0x55812a43c1a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a435940 msgr2=0x55812a437de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a435940 0x55812a437de0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd2cc10b030 msgr2=0x7fd2cc0cb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd2cc10b030 0x7fd2cc0cb600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a43ede0 msgr2=0x55812a4411d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a43ede0 0x55812a4411d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1a4034650 msgr2=0x7fd1a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1a4034650 0x7fd1a4036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40207d0 tx=0x7fd2c4011000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 msgr2=0x55812a42a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/2124197471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a423700 0x55812a42a930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0c0b90 tx=0x7fd2cc0e8590 comp rx=0 tx=0).stop 2024-09-13T06:29:21.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dab0f640 1 -- 172.21.15.169:0/2124197471 reap_dead start 2024-09-13T06:29:21.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 shutdown_connections 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 >> 172.21.15.169:0/2124197471 conn(0x55812a41fb30 msgr2=0x55812a41dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 shutdown_connections 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/2124197471 wait complete. 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1b40346a0 msgr2=0x7fd1b4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1b40346a0 0x7fd1b4036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55812a4097f0 tx=0x7fd2c4006000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 msgr2=0x55812a4172a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 0x55812a4172a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0e5360 tx=0x7fd2cc0c0be0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 shutdown_connections 2024-09-13T06:29:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1b40346a0 0x7fd1b4036b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/849974688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a416e80 0x55812a4172a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 >> 172.21.15.169:0/849974688 conn(0x55812a40bfd0 msgr2=0x55812a40ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 shutdown_connections 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/849974688 wait complete. 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a401410 msgr2=0x55812a403800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55812a401410 0x55812a403800 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a3fdc00 msgr2=0x55812a3ffff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55812a3fdc00 0x55812a3ffff0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a406ac0 msgr2=0x55812a408eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55812a406ac0 0x55812a408eb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1c0034650 msgr2=0x7fd1c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd1c0034650 0x7fd1c0036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4001e20 tx=0x7fd2c40013a0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307ec0 msgr2=0x55812a3f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 --2- 172.21.15.169:0/381752310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55812a307ec0 0x55812a3f8c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc01beb0 tx=0x7fd2cc01a5a0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dab0f640 1 -- 172.21.15.169:0/381752310 reap_dead start 2024-09-13T06:29:21.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 shutdown_connections 2024-09-13T06:29:21.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 >> 172.21.15.169:0/381752310 conn(0x55812a303090 msgr2=0x55812a3ec050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 shutdown_connections 2024-09-13T06:29:21.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.093+0000 7fd2dc7fe980 1 -- 172.21.15.169:0/381752310 wait complete. 2024-09-13T06:29:21.109 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:29:20.540704Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:21.109 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T06:29:21.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T06:29:21.109 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T06:29:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.177+0000 7f1fb8aca980 1 Processor -- start 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.177+0000 7f1fb8aca980 1 -- start start 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.177+0000 7f1fb8aca980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555b8df3a890 0x555b8df3cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.177+0000 7f1fb8aca980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b8ddbfae0 con 0x555b8df36510 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.177+0000 7f1fb8aca980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x555b8dde3e30 con 0x555b8df3a890 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb5dd9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555b8df3a890 0x555b8df3cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb5dd9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555b8df3a890 0x555b8df3cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36236/0 (socket says 172.21.15.169:36236) 2024-09-13T06:29:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/542917658 learned_addr learned my addr 172.21.15.169:0/542917658 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb65da640 1 --1- 172.21.15.169:0/542917658 >> v1:172.21.15.112:6789/0 conn(0x555b8df36510 0x555b8df368f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45188/0 (socket says 172.21.15.169:45188) 2024-09-13T06:29:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/542917658 >> v1:172.21.15.112:6789/0 conn(0x555b8df36510 legacy=0x555b8df368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/542917658 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8df3e1d0 con 0x555b8df3a890 2024-09-13T06:29:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/542917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df3a890 0x555b8df3cc80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800a750 tx=0x7f1fa801d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a30e344566f84e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb55d8640 1 -- 172.21.15.169:0/542917658 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa80b1070 con 0x555b8df3a890 2024-09-13T06:29:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb55d8640 1 -- 172.21.15.169:0/542917658 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa800a200 con 0x555b8df3a890 2024-09-13T06:29:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb55d8640 1 -- 172.21.15.169:0/542917658 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa80085a0 con 0x555b8df3a890 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 -- 172.21.15.169:0/542917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df3a890 msgr2=0x555b8df3cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/542917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df3a890 0x555b8df3cc80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800a750 tx=0x7f1fa801d200 comp rx=0 tx=0).stop 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 -- 172.21.15.169:0/542917658 shutdown_connections 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/542917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df3a890 0x555b8df3cc80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 -- 172.21.15.169:0/542917658 >> 172.21.15.169:0/542917658 conn(0x555b8df32030 msgr2=0x555b8df34450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 -- 172.21.15.169:0/542917658 shutdown_connections 2024-09-13T06:29:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.181+0000 7f1fb8aca980 1 -- 172.21.15.169:0/542917658 wait complete. 2024-09-13T06:29:21.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 Processor -- start 2024-09-13T06:29:21.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- start start 2024-09-13T06:29:21.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e020790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b8dde5200 con 0x555b8df36510 2024-09-13T06:29:21.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e020790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e020790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36242/0 (socket says 172.21.15.169:36242) 2024-09-13T06:29:21.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb65da640 1 -- 172.21.15.169:0/2869475323 learned_addr learned my addr 172.21.15.169:0/2869475323 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb65da640 1 -- 172.21.15.169:0/2869475323 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e020d60 con 0x555b8df36510 2024-09-13T06:29:21.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb65da640 1 --2- 172.21.15.169:0/2869475323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e020790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0001e50 tx=0x7f1fa0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c61252c8a1c3bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1ea4608640 1 -- 172.21.15.169:0/2869475323 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa000e5d0 con 0x555b8df36510 2024-09-13T06:29:21.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1ea4608640 1 -- 172.21.15.169:0/2869475323 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa000e770 con 0x555b8df36510 2024-09-13T06:29:21.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1ea4608640 1 -- 172.21.15.169:0/2869475323 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa000eab0 con 0x555b8df36510 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2869475323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 msgr2=0x555b8e020790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/2869475323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e020790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0001e50 tx=0x7f1fa0001e80 comp rx=0 tx=0).stop 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2869475323 shutdown_connections 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/2869475323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e020790 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2869475323 >> 172.21.15.169:0/2869475323 conn(0x555b8df32030 msgr2=0x555b8e01c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2869475323 shutdown_connections 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2869475323 wait complete. 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 Processor -- start 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- start start 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e027b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.197+0000 7f1fb8aca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b8df3dcd0 con 0x555b8df36510 2024-09-13T06:29:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e027b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e027b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36244/0 (socket says 172.21.15.169:36244) 2024-09-13T06:29:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb65da640 1 -- 172.21.15.169:0/3601061183 learned_addr learned my addr 172.21.15.169:0/3601061183 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb65da640 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e0280a0 con 0x555b8df36510 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb65da640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e027b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x555b8e021970 tx=0x7f1fa0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1ea2e05640 1 -- 172.21.15.169:0/3601061183 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0001260 con 0x555b8df36510 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1ea2e05640 1 -- 172.21.15.169:0/3601061183 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa000fa40 con 0x555b8df36510 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b8e028330 con 0x555b8df36510 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1ea2e05640 1 -- 172.21.15.169:0/3601061183 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa000fd80 con 0x555b8df36510 2024-09-13T06:29:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8e02b010 con 0x555b8df36510 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1ea2e05640 1 -- 172.21.15.169:0/3601061183 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fa0017070 con 0x555b8df36510 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1ea2e05640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e9c034650 0x7f1e9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1ea2e05640 1 -- 172.21.15.169:0/3601061183 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1fa0015020 con 0x555b8df36510 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e9c034650 0x7f1e9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8df3a890 0x555b8e02eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e02f1a0 con 0x555b8df3a890 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb6ddb640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8df3a890 0x555b8e02eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e9c034650 0x7f1e9c036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80ae000 tx=0x7f1fa80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb6ddb640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8df3a890 0x555b8e02eb30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/3601061183 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8df3a890 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e02ff90 0x555b8e032380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0329c0 con 0x555b8e02ff90 2024-09-13T06:29:21.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.201+0000 7f1fb65da640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e02ff90 0x555b8e032380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb65da640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e02ff90 0x555b8e032380 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb65da640 1 -- 172.21.15.169:0/3601061183 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fa002e070 con 0x555b8e02ff90 2024-09-13T06:29:21.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e034270 con 0x555b8e02ff90 2024-09-13T06:29:21.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb65da640 1 -- 172.21.15.169:0/3601061183 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1fa002e070 con 0x555b8e02ff90 2024-09-13T06:29:21.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0333e0 con 0x555b8e02ff90 2024-09-13T06:29:21.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb65da640 1 -- 172.21.15.169:0/3601061183 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fa002e070 con 0x555b8e02ff90 2024-09-13T06:29:21.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e035620 0x555b8e037a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e037f50 con 0x555b8e035620 2024-09-13T06:29:21.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e035620 0x555b8e037a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e035620 0x555b8e037a10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/3601061183 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e035620 2024-09-13T06:29:21.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb8aca980 1 Processor -- start 2024-09-13T06:29:21.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.205+0000 7f1fb8aca980 1 -- start start 2024-09-13T06:29:21.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 0x555b8e04a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b8de3e800 con 0x555b8e049d50 2024-09-13T06:29:21.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 0x555b8e04a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 0x555b8e04a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36260/0 (socket says 172.21.15.169:36260) 2024-09-13T06:29:21.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb65da640 1 -- 172.21.15.169:0/2963312546 learned_addr learned my addr 172.21.15.169:0/2963312546 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb65da640 1 -- 172.21.15.169:0/2963312546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e04a6b0 con 0x555b8e049d50 2024-09-13T06:29:21.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb65da640 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 0x555b8e04a170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1fa004aa50 tx=0x7f1fa0017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1e9bfff640 1 -- 172.21.15.169:0/2963312546 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0042120 con 0x555b8e049d50 2024-09-13T06:29:21.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1e9bfff640 1 -- 172.21.15.169:0/2963312546 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa00422c0 con 0x555b8e049d50 2024-09-13T06:29:21.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b8e04a940 con 0x555b8e049d50 2024-09-13T06:29:21.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1e9bfff640 1 -- 172.21.15.169:0/2963312546 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa004aac0 con 0x555b8e049d50 2024-09-13T06:29:21.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8e04a940 con 0x555b8e049d50 2024-09-13T06:29:21.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1e9bfff640 1 -- 172.21.15.169:0/2963312546 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fa0042510 con 0x555b8e049d50 2024-09-13T06:29:21.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1e9bfff640 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e90034650 0x7f1e90036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1e9bfff640 1 -- 172.21.15.169:0/2963312546 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1fa0040ab0 con 0x555b8e049d50 2024-09-13T06:29:21.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e90034650 0x7f1e90036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 Processor -- start 2024-09-13T06:29:21.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 -- start start 2024-09-13T06:29:21.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e90034650 0x7f1e90036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x555b8e02c150 tx=0x7f1fa8005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e056800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.209+0000 7f1fb8aca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b8e0210e0 con 0x555b8e056400 2024-09-13T06:29:21.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e056800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e056800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36274/0 (socket says 172.21.15.169:36274) 2024-09-13T06:29:21.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 -- 172.21.15.169:0/1708703274 learned_addr learned my addr 172.21.15.169:0/1708703274 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 -- 172.21.15.169:0/1708703274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e056dd0 con 0x555b8e056400 2024-09-13T06:29:21.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 --2- 172.21.15.169:0/1708703274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e056800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00197f0 tx=0x7f1fa00318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a07a4f46fa135b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1e99ffb640 1 -- 172.21.15.169:0/1708703274 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0028c60 con 0x555b8e056400 2024-09-13T06:29:21.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1e99ffb640 1 -- 172.21.15.169:0/1708703274 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa0019d80 con 0x555b8e056400 2024-09-13T06:29:21.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1e99ffb640 1 -- 172.21.15.169:0/1708703274 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa001dc70 con 0x555b8e056400 2024-09-13T06:29:21.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- 172.21.15.169:0/1708703274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 msgr2=0x555b8e056800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/1708703274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e056800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00197f0 tx=0x7f1fa00318b0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- 172.21.15.169:0/1708703274 shutdown_connections 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/1708703274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e056800 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- 172.21.15.169:0/1708703274 >> 172.21.15.169:0/1708703274 conn(0x555b8e052830 msgr2=0x555b8e050930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- 172.21.15.169:0/1708703274 shutdown_connections 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- 172.21.15.169:0/1708703274 wait complete. 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 Processor -- start 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- start start 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e05d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb8aca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b8e0572a0 con 0x555b8e056400 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e05d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e05d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36284/0 (socket says 172.21.15.169:36284) 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 learned_addr learned my addr 172.21.15.169:0/805880825 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e05dbc0 con 0x555b8e056400 2024-09-13T06:29:21.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1fb65da640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e05d680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0034910 tx=0x7f1fa0032650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.213+0000 7f1e87fff640 1 -- 172.21.15.169:0/805880825 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa006f070 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1e87fff640 1 -- 172.21.15.169:0/805880825 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa001dda0 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b8e05dbc0 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1e87fff640 1 -- 172.21.15.169:0/805880825 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa00199b0 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8e05dbc0 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1e87fff640 1 -- 172.21.15.169:0/805880825 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fa0072070 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1e87fff640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e80034600 0x7f1e80036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1e87fff640 1 -- 172.21.15.169:0/805880825 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1fa005b030 con 0x555b8e056400 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e80034600 0x7f1e80036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8e0687e0 0x555b8e06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e06b3f0 con 0x555b8e0687e0 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb6ddb640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8e0687e0 0x555b8e06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e80034600 0x7f1e80036ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1fa801d240 tx=0x7f1fa80a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb6ddb640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8e0687e0 0x555b8e06aca0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 realm 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e067c90 con 0x555b8e0687e0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:21.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e06bec0 con 0x555b8e0687e0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e06cca0 0x555b8e06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e06f710 con 0x555b8e06cca0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb65da640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e06cca0 0x555b8e06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.217+0000 7f1fb65da640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e06cca0 0x555b8e06f090 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e06ff60 con 0x555b8e06cca0 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:21.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 20 searching for the correct realm 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e071cd0 0x555b8e0740c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e071cd0 0x555b8e0740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb5dd9640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e071cd0 0x555b8e0740c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb65da640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1fa0074060 0x7f1fa0032770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x7f1fa0074060 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1fa0074060 0x7f1fa0032770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1fa0074060 0x7f1fa0032770 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.221+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x7f1fa0074060 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x7f1fa0074060 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.225+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x7f1fa0074060 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x7f1fa0074060 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x7f1fa0074060 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.229+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e071cd0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555b8e074740 con 0x555b8e06cca0 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0708e0 con 0x555b8e0687e0 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e071180 con 0x555b8e06cca0 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e070520 con 0x555b8e071cd0 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 zone default found 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 4 Realm: () 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:21.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 zonegroup default 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0711a0 con 0x7f1fa0074060 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e076fa0 con 0x555b8e071cd0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e077340 con 0x555b8e071cd0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 started sync module instance, tier type = 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.233+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0763e0 con 0x555b8e06cca0 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93851713235168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0763e0 con 0x555b8e06cca0 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e077d00 con 0x555b8e0687e0 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93851713239120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e078550 con 0x555b8e0687e0 2024-09-13T06:29:21.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e078fb0 con 0x555b8e06cca0 2024-09-13T06:29:21.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93851713235168] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.237+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93851713239120] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93851713241248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e078a90 con 0x555b8e06cca0 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e079850 con 0x7f1fa0074060 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93851713246112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0797c0 con 0x7f1fa0074060 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07a710 con 0x555b8e06cca0 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93851713241248] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.241+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93851713246112] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93851713248320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07a260 con 0x555b8e06cca0 2024-09-13T06:29:21.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07afb0 con 0x555b8e071cd0 2024-09-13T06:29:21.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93851713252096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07a260 con 0x555b8e071cd0 2024-09-13T06:29:21.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07bd10 con 0x555b8e071cd0 2024-09-13T06:29:21.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93851713248320] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93851713252096] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93851713254224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07c100 con 0x555b8e071cd0 2024-09-13T06:29:21.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07c990 con 0x7f1fa0074060 2024-09-13T06:29:21.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93851713257728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07c560 con 0x7f1fa0074060 2024-09-13T06:29:21.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=0 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=1 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=2 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=3 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=4 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=5 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93851713254224] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.245+0000 7f1fb8aca980 20 add_watcher() i=6 2024-09-13T06:29:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93851713257728] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 add_watcher() i=7 2024-09-13T06:29:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07b770 con 0x555b8e0687e0 2024-09-13T06:29:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93851713260848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e07b770 con 0x555b8e0687e0 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93851713260848] v31'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1e6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 5 note: GC not initialized 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1de77fe640 20 reqs_thread_entry: start 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 Filter name: none 2024-09-13T06:29:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1de57fa640 20 reqs_thread_entry: start 2024-09-13T06:29:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a34d0 con 0x555b8e0687e0 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.249+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a9c00 con 0x555b8e0687e0 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93851713443440 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a5370 con 0x555b8e06cca0 2024-09-13T06:29:21.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 93851713248320 notify 133143986191 ret 0) ==== 609+0+0 (crc 0 0 0) 0x555b8e04a6b0 con 0x555b8e06cca0 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1e99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 93851713248320 notifier 4414 bl.length()=567 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1e99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1e99ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1e99ffb640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1e7c003eb0 con 0x555b8e06cca0 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 93851713443440 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 93851713443440 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b8e02b010 con 0x555b8e06cca0 2024-09-13T06:29:21.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a9670 con 0x7f1fa0074060 2024-09-13T06:29:21.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(66 foo:foo2 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T06:29:21.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.253+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93851713443440 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a4ec0 con 0x555b8e06cca0 2024-09-13T06:29:21.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 93851713235168 notify 133143986192 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f1fa0090040 con 0x555b8e06cca0 2024-09-13T06:29:21.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1e997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 93851713235168 notifier 4414 bl.length()=159 2024-09-13T06:29:21.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1e997fa640 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1dec0032d0 con 0x555b8e06cca0 2024-09-13T06:29:21.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(67 notify.0 [notify cookie 93851713443440 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== watch-notify(notify_complete (2) cookie 93851713443440 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b8e02b010 con 0x555b8e06cca0 2024-09-13T06:29:21.260 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:21.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1e6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.257+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93851713260848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e0687e0 2024-09-13T06:29:21.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93851713260848] v31'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93851713235168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e06cca0 2024-09-13T06:29:21.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93851713235168] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb8aca980 20 remove_watcher() i=0 2024-09-13T06:29:21.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb8aca980 2 removed watcher, disabling cache 2024-09-13T06:29:21.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93851713239120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e0687e0 2024-09-13T06:29:21.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93851713239120] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x555b8e0687e0 2024-09-13T06:29:21.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb8aca980 20 remove_watcher() i=1 2024-09-13T06:29:21.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.261+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93851713241248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e06cca0 2024-09-13T06:29:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.265+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93851713241248] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.265+0000 7f1fb8aca980 20 remove_watcher() i=2 2024-09-13T06:29:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.265+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93851713246112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x7f1fa0074060 2024-09-13T06:29:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.265+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93851713246112] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.265+0000 7f1fb8aca980 20 remove_watcher() i=3 2024-09-13T06:29:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.265+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93851713248320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e06cca0 2024-09-13T06:29:21.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb65da640 1 -- 172.21.15.169:0/805880825 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93851713248320] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa0071030 con 0x555b8e06cca0 2024-09-13T06:29:21.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 20 remove_watcher() i=4 2024-09-13T06:29:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93851713252096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e071cd0 2024-09-13T06:29:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93851713252096] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 20 remove_watcher() i=5 2024-09-13T06:29:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93851713254224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x555b8e071cd0 2024-09-13T06:29:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb5dd9640 1 -- 172.21.15.169:0/805880825 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93851713254224] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa80b4070 con 0x555b8e071cd0 2024-09-13T06:29:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 20 remove_watcher() i=6 2024-09-13T06:29:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93851713257728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555b8e0a1330 con 0x7f1fa0074060 2024-09-13T06:29:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93851713257728] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb000a4d0 con 0x7f1fa0074060 2024-09-13T06:29:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 20 remove_watcher() i=7 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e06cca0 msgr2=0x555b8e06f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e06cca0 0x555b8e06f090 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8e0687e0 msgr2=0x555b8e06aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8e0687e0 0x555b8e06aca0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1fa0074060 msgr2=0x7f1fa0032770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1fa0074060 0x7f1fa0032770 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e071cd0 msgr2=0x555b8e0740c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e071cd0 0x555b8e0740c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e80034600 msgr2=0x7f1e80036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e80034600 0x7f1e80036ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1fa801d240 tx=0x7f1fa80a9000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 msgr2=0x555b8e05d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e05d680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0034910 tx=0x7f1fa0032650 comp rx=0 tx=0).stop 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.269+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/805880825 reap_dead start 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 shutdown_connections 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/805880825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e056400 0x555b8e05d680 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 >> 172.21.15.169:0/805880825 conn(0x555b8e052830 msgr2=0x555b8e050900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 shutdown_connections 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/805880825 wait complete. 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e90034650 msgr2=0x7f1e90036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e90034650 0x7f1e90036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x555b8e02c150 tx=0x7f1fa8005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 msgr2=0x555b8e04a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 0x555b8e04a170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1fa004aa50 tx=0x7f1fa0017d50 comp rx=0 tx=0).stop 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 shutdown_connections 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e90034650 0x7f1e90036b10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/2963312546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8e049d50 0x555b8e04a170 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 >> 172.21.15.169:0/2963312546 conn(0x555b8e03aa90 msgr2=0x555b8e03d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 shutdown_connections 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/2963312546 wait complete. 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e02ff90 msgr2=0x555b8e032380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b8e02ff90 0x555b8e032380 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8df3a890 msgr2=0x555b8e02eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b8df3a890 0x555b8e02eb30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e035620 msgr2=0x555b8e037a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b8e035620 0x555b8e037a10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e9c034650 msgr2=0x7f1e9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1e9c034650 0x7f1e9c036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80ae000 tx=0x7f1fa80a7000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 msgr2=0x555b8e027b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 --2- 172.21.15.169:0/3601061183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b8df36510 0x555b8e027b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x555b8e021970 tx=0x7f1fa0000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb6ddb640 1 -- 172.21.15.169:0/3601061183 reap_dead start 2024-09-13T06:29:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 shutdown_connections 2024-09-13T06:29:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 >> 172.21.15.169:0/3601061183 conn(0x555b8df32030 msgr2=0x555b8e01af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 shutdown_connections 2024-09-13T06:29:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.273+0000 7f1fb8aca980 1 -- 172.21.15.169:0/3601061183 wait complete. 2024-09-13T06:29:21.284 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:21.284 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:29:21.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:29:21.284 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T06:29:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:21.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92e43f980 1 Processor -- start 2024-09-13T06:29:21.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92e43f980 1 -- start start 2024-09-13T06:29:21.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92e43f980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557aab430290 0x557aab4be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92e43f980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557aab343ae0 con 0x557aab4be8e0 2024-09-13T06:29:21.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92e43f980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x557aab367e30 con 0x557aab430290 2024-09-13T06:29:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92bf4f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557aab430290 0x557aab4be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92bf4f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557aab430290 0x557aab4be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36286/0 (socket says 172.21.15.169:36286) 2024-09-13T06:29:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92bf4f640 1 -- 172.21.15.169:0/4242806274 learned_addr learned my addr 172.21.15.169:0/4242806274 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92b74e640 1 --1- 172.21.15.169:0/4242806274 >> v1:172.21.15.112:6789/0 conn(0x557aab4be8e0 0x557aab4c0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45198/0 (socket says 172.21.15.169:45198) 2024-09-13T06:29:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92bf4f640 1 -- 172.21.15.169:0/4242806274 >> v1:172.21.15.112:6789/0 conn(0x557aab4be8e0 legacy=0x557aab4c0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.357+0000 7fd92bf4f640 1 -- 172.21.15.169:0/4242806274 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aab430820 con 0x557aab430290 2024-09-13T06:29:21.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/4242806274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab4be3a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd92400a4e0 tx=0x7fd92401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ca669c67051107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92af4d640 1 -- 172.21.15.169:0/4242806274 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240aa540 con 0x557aab430290 2024-09-13T06:29:21.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92af4d640 1 -- 172.21.15.169:0/4242806274 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240aa6e0 con 0x557aab430290 2024-09-13T06:29:21.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92af4d640 1 -- 172.21.15.169:0/4242806274 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240aaa40 con 0x557aab430290 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 -- 172.21.15.169:0/4242806274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 msgr2=0x557aab4be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 --2- 172.21.15.169:0/4242806274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab4be3a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd92400a4e0 tx=0x7fd92401b090 comp rx=0 tx=0).stop 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 -- 172.21.15.169:0/4242806274 shutdown_connections 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 --2- 172.21.15.169:0/4242806274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab4be3a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 -- 172.21.15.169:0/4242806274 >> 172.21.15.169:0/4242806274 conn(0x557aab4b6090 msgr2=0x557aab4b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 -- 172.21.15.169:0/4242806274 shutdown_connections 2024-09-13T06:29:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.361+0000 7fd92e43f980 1 -- 172.21.15.169:0/4242806274 wait complete. 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92e43f980 1 Processor -- start 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92e43f980 1 -- start start 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92e43f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92e43f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557aab369200 con 0x557aab430290 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5a69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36296/0 (socket says 172.21.15.169:36296) 2024-09-13T06:29:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3408471605 learned_addr learned my addr 172.21.15.169:0/3408471605 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3408471605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aab5a6f90 con 0x557aab430290 2024-09-13T06:29:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/3408471605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5a69c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd924017ca0 tx=0x7fd9240033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f625ee0c8fde811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.373+0000 7fd819e0b640 1 -- 172.21.15.169:0/3408471605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240b9030 con 0x557aab430290 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd819e0b640 1 -- 172.21.15.169:0/3408471605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240aaac0 con 0x557aab430290 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd819e0b640 1 -- 172.21.15.169:0/3408471605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240aada0 con 0x557aab430290 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/3408471605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 msgr2=0x557aab5a69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3408471605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5a69c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd924017ca0 tx=0x7fd9240033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/3408471605 shutdown_connections 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3408471605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5a69c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/3408471605 >> 172.21.15.169:0/3408471605 conn(0x557aab4b6090 msgr2=0x557aab5a25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/3408471605 shutdown_connections 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/3408471605 wait complete. 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 Processor -- start 2024-09-13T06:29:21.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- start start 2024-09-13T06:29:21.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557aab4c2f00 con 0x557aab430290 2024-09-13T06:29:21.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36304/0 (socket says 172.21.15.169:36304) 2024-09-13T06:29:21.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92bf4f640 1 -- 172.21.15.169:0/138087090 learned_addr learned my addr 172.21.15.169:0/138087090 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92bf4f640 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aab5ae0f0 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5adbb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd924005cc0 tx=0x7fd924017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd813fff640 1 -- 172.21.15.169:0/138087090 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240b9030 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aab5ae380 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd813fff640 1 -- 172.21.15.169:0/138087090 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240c3070 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd813fff640 1 -- 172.21.15.169:0/138087090 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240bf750 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.377+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aab5b1060 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd813fff640 1 -- 172.21.15.169:0/138087090 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9240c5030 con 0x557aab430290 2024-09-13T06:29:21.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd813fff640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd814034650 0x7fd814036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd813fff640 1 -- 172.21.15.169:0/138087090 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd9240ba070 con 0x557aab430290 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92b74e640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd814034650 0x7fd814036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab4be8e0 0x557aab5b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5b51f0 con 0x557aab4be8e0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92c750640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab4be8e0 0x557aab5b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92b74e640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd814034650 0x7fd814036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd914001e50 tx=0x7fd9140013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92c750640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab4be8e0 0x557aab5b4cb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92c750640 1 -- 172.21.15.169:0/138087090 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab4be8e0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5b5fd0 0x557aab5b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5b89f0 con 0x557aab5b5fd0 2024-09-13T06:29:21.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5b5fd0 0x557aab5b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5b5fd0 0x557aab5b83c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92bf4f640 1 -- 172.21.15.169:0/138087090 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9240ce070 con 0x557aab5b5fd0 2024-09-13T06:29:21.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5ba2a0 con 0x557aab5b5fd0 2024-09-13T06:29:21.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92bf4f640 1 -- 172.21.15.169:0/138087090 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9240ce070 con 0x557aab5b5fd0 2024-09-13T06:29:21.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.381+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5b94d0 con 0x557aab5b5fd0 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92bf4f640 1 -- 172.21.15.169:0/138087090 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9240ce070 con 0x557aab5b5fd0 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5bb650 0x557aab5bda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5bdf80 con 0x557aab5bb650 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92b74e640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5bb650 0x557aab5bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92b74e640 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5bb650 0x557aab5bda40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92b74e640 1 -- 172.21.15.169:0/138087090 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd91400f700 con 0x557aab5bb650 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 Processor -- start 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 -- start start 2024-09-13T06:29:21.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 0x557aab5cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557aab3c2800 con 0x557aab5cba10 2024-09-13T06:29:21.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 0x557aab5cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 0x557aab5cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36318/0 (socket says 172.21.15.169:36318) 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92bf4f640 1 -- 172.21.15.169:0/708619471 learned_addr learned my addr 172.21.15.169:0/708619471 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92bf4f640 1 -- 172.21.15.169:0/708619471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aab5cc370 con 0x557aab5cba10 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 0x557aab5cbe30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9240e35a0 tx=0x7fd9240c6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd8117fa640 1 -- 172.21.15.169:0/708619471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240bfd00 con 0x557aab5cba10 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aab5cc600 con 0x557aab5cba10 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd8117fa640 1 -- 172.21.15.169:0/708619471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240b43a0 con 0x557aab5cba10 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aab5cf280 con 0x557aab5cba10 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.385+0000 7fd8117fa640 1 -- 172.21.15.169:0/708619471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240b4550 con 0x557aab5cba10 2024-09-13T06:29:21.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd8117fa640 1 -- 172.21.15.169:0/708619471 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9240b3040 con 0x557aab5cba10 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd8117fa640 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd804034650 0x7fd804036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd8117fa640 1 -- 172.21.15.169:0/708619471 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd9240ebaa0 con 0x557aab5cba10 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92b74e640 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd804034650 0x7fd804036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 Processor -- start 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- start start 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92b74e640 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd804034650 0x7fd804036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x557aab5be380 tx=0x7fd91400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab4bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557aab5a7250 con 0x557aab4bb590 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab4bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab4bb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36332/0 (socket says 172.21.15.169:36332) 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 -- 172.21.15.169:0/1928829248 learned_addr learned my addr 172.21.15.169:0/1928829248 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 -- 172.21.15.169:0/1928829248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aab4bbf60 con 0x557aab4bb590 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/1928829248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab4bb990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd9240bf010 tx=0x7fd9240b9e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f167b025d72275a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd80affd640 1 -- 172.21.15.169:0/1928829248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240b48d0 con 0x557aab4bb590 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd80affd640 1 -- 172.21.15.169:0/1928829248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240fa030 con 0x557aab4bb590 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd80affd640 1 -- 172.21.15.169:0/1928829248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240da150 con 0x557aab4bb590 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- 172.21.15.169:0/1928829248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 msgr2=0x557aab4bb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 --2- 172.21.15.169:0/1928829248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab4bb990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd9240bf010 tx=0x7fd9240b9e80 comp rx=0 tx=0).stop 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- 172.21.15.169:0/1928829248 shutdown_connections 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 --2- 172.21.15.169:0/1928829248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab4bb990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- 172.21.15.169:0/1928829248 >> 172.21.15.169:0/1928829248 conn(0x557aab5d4790 msgr2=0x557aab5d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- 172.21.15.169:0/1928829248 shutdown_connections 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- 172.21.15.169:0/1928829248 wait complete. 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 Processor -- start 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- start start 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab5e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92e43f980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557aab4ba180 con 0x557aab4bb590 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab5e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab5e17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36346/0 (socket says 172.21.15.169:36346) 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.389+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 learned_addr learned my addr 172.21.15.169:0/3899334534 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aab5e1ce0 con 0x557aab4bb590 2024-09-13T06:29:21.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab5e17a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd9240bffd0 tx=0x7fd9240ac550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd8097fa640 1 -- 172.21.15.169:0/3899334534 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92410e070 con 0x557aab4bb590 2024-09-13T06:29:21.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd8097fa640 1 -- 172.21.15.169:0/3899334534 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240e3d50 con 0x557aab4bb590 2024-09-13T06:29:21.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aab5e1ce0 con 0x557aab4bb590 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd8097fa640 1 -- 172.21.15.169:0/3899334534 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9240d0b10 con 0x557aab4bb590 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aab5e1ce0 con 0x557aab4bb590 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd8097fa640 1 -- 172.21.15.169:0/3899334534 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd924111070 con 0x557aab4bb590 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd8097fa640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f4034650 0x7fd7f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd8097fa640 1 -- 172.21.15.169:0/3899334534 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd924106070 con 0x557aab4bb590 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92b74e640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f4034650 0x7fd7f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab5ec8b0 0x557aab5eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5ef4a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92c750640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab5ec8b0 0x557aab5eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92b74e640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f4034650 0x7fd7f4036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd91400baa0 tx=0x7fd914010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92c750640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab5ec8b0 0x557aab5eed50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 realm 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5ebda0 con 0x557aab5ec8b0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:21.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5eff60 con 0x557aab5ec8b0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5f0d40 0x557aab5f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f3790 con 0x557aab5f0d40 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.393+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5f0d40 0x557aab5f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5f0d40 0x557aab5f3130 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f4030 con 0x557aab5f0d40 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 20 searching for the correct realm 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5f5da0 0x557aab5f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92b74e640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5f5da0 0x557aab5f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92b74e640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5f5da0 0x557aab5f8190 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92bf4f640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd924113060 0x7fd9241051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x7fd924113060 2024-09-13T06:29:21.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92c750640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd924113060 0x7fd9241051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92c750640 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd924113060 0x7fd9241051d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.397+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x7fd924113060 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x7fd924113060 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.401+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x7fd924113060 2024-09-13T06:29:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5ec8b0 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x7fd924113060 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x7fd924113060 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.405+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f5da0 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f87a0 con 0x557aab5f0d40 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:21.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f49e0 con 0x557aab5ec8b0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f4e30 con 0x557aab5f0d40 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f5250 con 0x557aab5f5da0 2024-09-13T06:29:21.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 zone default found 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 4 Realm: () 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 zonegroup default 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5f8c00 con 0x7fd924113060 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fae30 con 0x557aab5f5da0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fb1d0 con 0x557aab5f5da0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 started sync module instance, tier type = 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.409+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fa270 con 0x557aab5f0d40 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93985349543872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fa270 con 0x557aab5f0d40 2024-09-13T06:29:21.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fbb90 con 0x557aab5ec8b0 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93985349547744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fc3e0 con 0x557aab5ec8b0 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fcde0 con 0x557aab5f0d40 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93985349543872] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.413+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93985349547744] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93985349541312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fbf30 con 0x557aab5f0d40 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fd680 con 0x7fd924113060 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93985349554640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fbf30 con 0x7fd924113060 2024-09-13T06:29:21.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fe100 con 0x557aab5f0d40 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93985349554640] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93985349541312] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.417+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93985349552368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fdc10 con 0x557aab5f0d40 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fe9d0 con 0x557aab5f5da0 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93985349559584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5fdc10 con 0x557aab5f5da0 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5ff750 con 0x557aab5f5da0 2024-09-13T06:29:21.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93985349552368] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93985349562912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab5ffb40 con 0x557aab5f5da0 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab600500 con 0x7fd924113060 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93985349559584] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93985349562912] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93985349555696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab600050 con 0x7fd924113060 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=0 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=1 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=2 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=3 2024-09-13T06:29:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=4 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=5 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.421+0000 7fd92e43f980 20 add_watcher() i=6 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93985349555696] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 add_watcher() i=7 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab600050 con 0x557aab5ec8b0 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93985349561712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab600c50 con 0x557aab5ec8b0 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93985349561712] v31'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 5 note: GC not initialized 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd7e0fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 Filter name: none 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd75a7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab626610 con 0x557aab5ec8b0 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab627000 con 0x557aab5ec8b0 2024-09-13T06:29:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aab628010 con 0x7fd924113060 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.425+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.429+0000 7fd7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.429+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93985349561712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5ec8b0 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.429+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93985349561712] v31'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.429+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93985349543872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5f0d40 2024-09-13T06:29:21.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93985349543872] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 20 remove_watcher() i=0 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 2 removed watcher, disabling cache 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93985349547744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5ec8b0 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93985349547744] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x557aab5ec8b0 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 20 remove_watcher() i=1 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93985349541312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5f0d40 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93985349541312] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 20 remove_watcher() i=2 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.433+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93985349554640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x7fd924113060 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93985349554640] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92e43f980 20 remove_watcher() i=3 2024-09-13T06:29:21.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93985349552368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5f0d40 2024-09-13T06:29:21.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92bf4f640 1 -- 172.21.15.169:0/3899334534 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93985349552368] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd924110030 con 0x557aab5f0d40 2024-09-13T06:29:21.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92e43f980 20 remove_watcher() i=4 2024-09-13T06:29:21.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93985349559584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5f5da0 2024-09-13T06:29:21.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93985349559584] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92e43f980 20 remove_watcher() i=5 2024-09-13T06:29:21.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.437+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93985349562912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x557aab5f5da0 2024-09-13T06:29:21.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92b74e640 1 -- 172.21.15.169:0/3899334534 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93985349562912] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd914037040 con 0x557aab5f5da0 2024-09-13T06:29:21.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 20 remove_watcher() i=6 2024-09-13T06:29:21.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93985349555696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aab6244d0 con 0x7fd924113060 2024-09-13T06:29:21.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93985349555696] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd91c0083f0 con 0x7fd924113060 2024-09-13T06:29:21.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 20 remove_watcher() i=7 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5f0d40 msgr2=0x557aab5f3130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5f0d40 0x557aab5f3130 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab5ec8b0 msgr2=0x557aab5eed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab5ec8b0 0x557aab5eed50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd924113060 msgr2=0x7fd9241051d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd924113060 0x7fd9241051d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5f5da0 msgr2=0x557aab5f8190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5f5da0 0x557aab5f8190 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f4034650 msgr2=0x7fd7f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f4034650 0x7fd7f4036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd91400baa0 tx=0x7fd914010000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 msgr2=0x557aab5e17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92c750640 1 -- 172.21.15.169:0/3899334534 reap_dead start 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab5e17a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd9240bffd0 tx=0x7fd9240ac550 comp rx=0 tx=0).stop 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 shutdown_connections 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/3899334534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab4bb590 0x557aab5e17a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 >> 172.21.15.169:0/3899334534 conn(0x557aab5d4790 msgr2=0x557aab5d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 shutdown_connections 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/3899334534 wait complete. 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd804034650 msgr2=0x7fd804036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd804034650 0x7fd804036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x557aab5be380 tx=0x7fd91400f000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 msgr2=0x557aab5cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 0x557aab5cbe30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9240e35a0 tx=0x7fd9240c6d30 comp rx=0 tx=0).stop 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 shutdown_connections 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd804034650 0x7fd804036b10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/708619471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab5cba10 0x557aab5cbe30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 >> 172.21.15.169:0/708619471 conn(0x557aab5c0b60 msgr2=0x557aab5c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 shutdown_connections 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/708619471 wait complete. 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5b5fd0 msgr2=0x557aab5b83c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557aab5b5fd0 0x557aab5b83c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab4be8e0 msgr2=0x557aab5b4cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557aab4be8e0 0x557aab5b4cb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5bb650 msgr2=0x557aab5bda40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557aab5bb650 0x557aab5bda40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd814034650 msgr2=0x7fd814036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd814034650 0x7fd814036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd914001e50 tx=0x7fd9140013b0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 msgr2=0x557aab5adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 --2- 172.21.15.169:0/138087090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557aab430290 0x557aab5adbb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd924005cc0 tx=0x7fd924017e30 comp rx=0 tx=0).stop 2024-09-13T06:29:21.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92c750640 1 -- 172.21.15.169:0/138087090 reap_dead start 2024-09-13T06:29:21.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 shutdown_connections 2024-09-13T06:29:21.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 >> 172.21.15.169:0/138087090 conn(0x557aab4b6090 msgr2=0x557aab5a1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 shutdown_connections 2024-09-13T06:29:21.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.441+0000 7fd92e43f980 1 -- 172.21.15.169:0/138087090 wait complete. 2024-09-13T06:29:21.454 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-09-13T06:29:21.454 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:29:21.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T06:29:21.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T06:29:21.454 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T06:29:21.529 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:21.529 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:21.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.525+0000 7f861f6b9980 1 Processor -- start 2024-09-13T06:29:21.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.525+0000 7f861f6b9980 1 -- start start 2024-09-13T06:29:21.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x556f590e8540 0x556f590e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f58f71ae0 con 0x556f590e8e90 2024-09-13T06:29:21.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x556f58f95e30 con 0x556f590e8540 2024-09-13T06:29:21.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861d1c9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x556f590e8540 0x556f590e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861d1c9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x556f590e8540 0x556f590e8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36352/0 (socket says 172.21.15.169:36352) 2024-09-13T06:29:21.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861d1c9640 1 -- 172.21.15.169:0/4158016904 learned_addr learned my addr 172.21.15.169:0/4158016904 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861c9c8640 1 --1- 172.21.15.169:0/4158016904 >> v1:172.21.15.112:6789/0 conn(0x556f590e8e90 0x556f590ed910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45204/0 (socket says 172.21.15.169:45204) 2024-09-13T06:29:21.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861d1c9640 1 -- 172.21.15.169:0/4158016904 >> v1:172.21.15.112:6789/0 conn(0x556f590e8e90 legacy=0x556f590ed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861d1c9640 1 -- 172.21.15.169:0/4158016904 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f590f0160 con 0x556f590e8540 2024-09-13T06:29:21.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861d1c9640 1 --2- 172.21.15.169:0/4158016904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f590e8920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f861000a750 tx=0x7f861001d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c871785c81677e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f860ffff640 1 -- 172.21.15.169:0/4158016904 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100b1070 con 0x556f590e8540 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f860ffff640 1 -- 172.21.15.169:0/4158016904 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861000a200 con 0x556f590e8540 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f860ffff640 1 -- 172.21.15.169:0/4158016904 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100085a0 con 0x556f590e8540 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 -- 172.21.15.169:0/4158016904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 msgr2=0x556f590e8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 --2- 172.21.15.169:0/4158016904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f590e8920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f861000a750 tx=0x7f861001d200 comp rx=0 tx=0).stop 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 -- 172.21.15.169:0/4158016904 shutdown_connections 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 --2- 172.21.15.169:0/4158016904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f590e8920 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.529+0000 7f861f6b9980 1 -- 172.21.15.169:0/4158016904 >> 172.21.15.169:0/4158016904 conn(0x556f590e4060 msgr2=0x556f590e6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.533+0000 7f861f6b9980 1 -- 172.21.15.169:0/4158016904 shutdown_connections 2024-09-13T06:29:21.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.533+0000 7f861f6b9980 1 -- 172.21.15.169:0/4158016904 wait complete. 2024-09-13T06:29:21.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 Processor -- start 2024-09-13T06:29:21.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- start start 2024-09-13T06:29:21.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556f58f97200 con 0x556f590e8540 2024-09-13T06:29:21.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36356/0 (socket says 172.21.15.169:36356) 2024-09-13T06:29:21.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 -- 172.21.15.169:0/225989833 learned_addr learned my addr 172.21.15.169:0/225989833 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 -- 172.21.15.169:0/225989833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f591d2ec0 con 0x556f590e8540 2024-09-13T06:29:21.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 --2- 172.21.15.169:0/225989833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d28f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8610019e10 tx=0x7f8610003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c53115a71e61b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f850b606640 1 -- 172.21.15.169:0/225989833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100b1050 con 0x556f590e8540 2024-09-13T06:29:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f850b606640 1 -- 172.21.15.169:0/225989833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86100b2040 con 0x556f590e8540 2024-09-13T06:29:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f850b606640 1 -- 172.21.15.169:0/225989833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100086f0 con 0x556f590e8540 2024-09-13T06:29:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- 172.21.15.169:0/225989833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 msgr2=0x556f591d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 --2- 172.21.15.169:0/225989833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d28f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8610019e10 tx=0x7f8610003030 comp rx=0 tx=0).stop 2024-09-13T06:29:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- 172.21.15.169:0/225989833 shutdown_connections 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 --2- 172.21.15.169:0/225989833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d28f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- 172.21.15.169:0/225989833 >> 172.21.15.169:0/225989833 conn(0x556f590e4060 msgr2=0x556f591ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- 172.21.15.169:0/225989833 shutdown_connections 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- 172.21.15.169:0/225989833 wait complete. 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 Processor -- start 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- start start 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861f6b9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556f590efba0 con 0x556f590e8540 2024-09-13T06:29:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36364/0 (socket says 172.21.15.169:36364) 2024-09-13T06:29:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.545+0000 7f861d1c9640 1 -- 172.21.15.169:0/1618982697 learned_addr learned my addr 172.21.15.169:0/1618982697 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861d1c9640 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f591da020 con 0x556f590e8540 2024-09-13T06:29:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861d1c9640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d9ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8610019e10 tx=0x7f8610019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f8509e03640 1 -- 172.21.15.169:0/1618982697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100c6070 con 0x556f590e8540 2024-09-13T06:29:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f591da2b0 con 0x556f590e8540 2024-09-13T06:29:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f8509e03640 1 -- 172.21.15.169:0/1618982697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86100c2680 con 0x556f590e8540 2024-09-13T06:29:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f8509e03640 1 -- 172.21.15.169:0/1618982697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100c2960 con 0x556f590e8540 2024-09-13T06:29:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f591dcf90 con 0x556f590e8540 2024-09-13T06:29:21.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f8509e03640 1 -- 172.21.15.169:0/1618982697 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86100c2bd0 con 0x556f590e8540 2024-09-13T06:29:21.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f8509e03640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8504034650 0x7f8504036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f8509e03640 1 -- 172.21.15.169:0/1618982697 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f86100bd070 con 0x556f590e8540 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861c9c8640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8504034650 0x7f8504036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f590e8e90 0x556f591e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f591e1110 con 0x556f590e8e90 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861d9ca640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f590e8e90 0x556f591e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861c9c8640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8504034650 0x7f8504036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8614001e50 tx=0x7f86140013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861d9ca640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f590e8e90 0x556f591e0ad0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861d9ca640 1 -- 172.21.15.169:0/1618982697 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f590e8e90 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f591e1f00 0x556f591e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f591e4920 con 0x556f591e1f00 2024-09-13T06:29:21.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.549+0000 7f861d1c9640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f591e1f00 0x556f591e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861d1c9640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f591e1f00 0x556f591e42f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861d1c9640 1 -- 172.21.15.169:0/1618982697 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86100c8070 con 0x556f591e1f00 2024-09-13T06:29:21.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f591e61d0 con 0x556f591e1f00 2024-09-13T06:29:21.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861d1c9640 1 -- 172.21.15.169:0/1618982697 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f86100c8070 con 0x556f591e1f00 2024-09-13T06:29:21.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f591e5340 con 0x556f591e1f00 2024-09-13T06:29:21.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861d1c9640 1 -- 172.21.15.169:0/1618982697 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86100c8070 con 0x556f591e1f00 2024-09-13T06:29:21.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f591e7580 0x556f591e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f591e9eb0 con 0x556f591e7580 2024-09-13T06:29:21.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861c9c8640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f591e7580 0x556f591e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861c9c8640 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f591e7580 0x556f591e9970 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861c9c8640 1 -- 172.21.15.169:0/1618982697 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f861400f700 con 0x556f591e7580 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 Processor -- start 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 -- start start 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 0x556f591f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.553+0000 7f861f6b9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556f58ff0800 con 0x556f591f7890 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 0x556f591f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 0x556f591f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36380/0 (socket says 172.21.15.169:36380) 2024-09-13T06:29:21.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 -- 172.21.15.169:0/226842141 learned_addr learned my addr 172.21.15.169:0/226842141 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 -- 172.21.15.169:0/226842141 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f591f81f0 con 0x556f591f7890 2024-09-13T06:29:21.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 0x556f591f7cb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86100cb5c0 tx=0x7f86100b6e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f8502ffd640 1 -- 172.21.15.169:0/226842141 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100e6780 con 0x556f591f7890 2024-09-13T06:29:21.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f591f8480 con 0x556f591f7890 2024-09-13T06:29:21.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f8502ffd640 1 -- 172.21.15.169:0/226842141 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86100e6cb0 con 0x556f591f7890 2024-09-13T06:29:21.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f591fb100 con 0x556f591f7890 2024-09-13T06:29:21.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f8502ffd640 1 -- 172.21.15.169:0/226842141 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100b6400 con 0x556f591f7890 2024-09-13T06:29:21.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f8502ffd640 1 -- 172.21.15.169:0/226842141 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86100e6040 con 0x556f591f7890 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f8502ffd640 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84f4034650 0x7f84f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f8502ffd640 1 -- 172.21.15.169:0/226842141 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f86100ae110 con 0x556f591f7890 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861c9c8640 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84f4034650 0x7f84f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861f6b9980 1 Processor -- start 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861f6b9980 1 -- start start 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861c9c8640 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84f4034650 0x7f84f4036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x556f591de0d0 tx=0x7f861400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861f6b9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f59204610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861f6b9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556f591d3180 con 0x556f59204230 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f59204610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f59204610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36394/0 (socket says 172.21.15.169:36394) 2024-09-13T06:29:21.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.557+0000 7f861d1c9640 1 -- 172.21.15.169:0/3181846926 learned_addr learned my addr 172.21.15.169:0/3181846926 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 -- 172.21.15.169:0/3181846926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f59204be0 con 0x556f59204230 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 --2- 172.21.15.169:0/3181846926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f59204610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f86100ca4c0 tx=0x7f86100ee880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3460fe28c6433a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f8500ff9640 1 -- 172.21.15.169:0/3181846926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100dbe20 con 0x556f59204230 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f8500ff9640 1 -- 172.21.15.169:0/3181846926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8610108070 con 0x556f59204230 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f8500ff9640 1 -- 172.21.15.169:0/3181846926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100cb760 con 0x556f59204230 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3181846926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 msgr2=0x556f59204610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3181846926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f59204610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f86100ca4c0 tx=0x7f86100ee880 comp rx=0 tx=0).stop 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3181846926 shutdown_connections 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3181846926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f59204610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3181846926 >> 172.21.15.169:0/3181846926 conn(0x556f59200610 msgr2=0x556f591fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3181846926 shutdown_connections 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3181846926 wait complete. 2024-09-13T06:29:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 Processor -- start 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- start start 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f5920b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556f59205080 con 0x556f59204230 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f5920b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f5920b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36408/0 (socket says 172.21.15.169:36408) 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 learned_addr learned my addr 172.21.15.169:0/3068088589 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5920b970 con 0x556f59204230 2024-09-13T06:29:21.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861d1c9640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f5920b430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8610105040 tx=0x7f86100d4f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f84f2ffd640 1 -- 172.21.15.169:0/3068088589 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100de1c0 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f84f2ffd640 1 -- 172.21.15.169:0/3068088589 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86100fc070 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f5920b970 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f84f2ffd640 1 -- 172.21.15.169:0/3068088589 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86100b67d0 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.561+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5920b970 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f84f2ffd640 1 -- 172.21.15.169:0/3068088589 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86100d7600 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f84f2ffd640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84e80346a0 0x7f84e8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f84f2ffd640 1 -- 172.21.15.169:0/3068088589 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f8610118ae0 con 0x556f59204230 2024-09-13T06:29:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861c9c8640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84e80346a0 0x7f84e8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f59216520 0x556f592189c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f59219110 con 0x556f59216520 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d9ca640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f59216520 0x556f592189c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861c9c8640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84e80346a0 0x7f84e8036b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x556f591e6130 tx=0x7f8614010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d9ca640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f59216520 0x556f592189c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 realm 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f59215a10 con 0x556f59216520 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f59219bd0 con 0x556f59216520 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f5921a9b0 0x556f5921cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f5921d400 con 0x556f5921a9b0 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d1c9640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f5921a9b0 0x556f5921cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d1c9640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f5921a9b0 0x556f5921cda0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.565+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f5921dca0 con 0x556f5921a9b0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861f6b9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861f6b9980 20 searching for the correct realm 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f5921fa10 0x556f59221e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861c9c8640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f5921fa10 0x556f59221e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861c9c8640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f5921fa10 0x556f59221e00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d1c9640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86100eec20 0x7f86101036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x7f86100eec20 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86100eec20 0x7f86101036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86100eec20 0x7f86101036a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.569+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x7f86100eec20 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x7f86100eec20 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.573+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x7f86100eec20 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f59216520 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x7f86100eec20 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x7f86100eec20 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921fa10 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.577+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556f59222480 con 0x556f5921a9b0 2024-09-13T06:29:21.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:21.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f5921e620 con 0x556f59216520 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f5921eaa0 con 0x556f5921a9b0 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f5921ef40 con 0x556f5921fa10 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 zone default found 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 4 Realm: () 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:21.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 zonegroup default 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f59222d90 con 0x7f86100eec20 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f592229a0 con 0x556f5921fa10 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f592250a0 con 0x556f5921fa10 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 started sync module instance, tier type = 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.581+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f592244a0 con 0x556f5921a9b0 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936725150112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f592244a0 con 0x556f5921a9b0 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59225b80 con 0x556f59216520 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936725153392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59226420 con 0x556f59216520 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59226e60 con 0x556f5921a9b0 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936725150112] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936725153392] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936725158192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59225f70 con 0x556f5921a9b0 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.585+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59227700 con 0x7f86100eec20 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936725160528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59225f70 con 0x7f86100eec20 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f592281c0 con 0x556f5921a9b0 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936725160528] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936725158192] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936725147632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59228180 con 0x556f5921a9b0 2024-09-13T06:29:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f592285b0 con 0x556f5921fa10 2024-09-13T06:29:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936725161584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59228e50 con 0x556f5921fa10 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.589+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59229850 con 0x556f5921fa10 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936725147632] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936725161584] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936725163152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59229c40 con 0x556f5921fa10 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5922a490 con 0x7f86100eec20 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936725171744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5922a8e0 con 0x7f86100eec20 2024-09-13T06:29:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=0 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=1 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=2 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=3 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=4 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=5 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936725163152] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=6 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936725171744] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 20 add_watcher() i=7 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f59229360 con 0x556f59216520 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.593+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936725168992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5922ae50 con 0x556f59216520 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936725168992] v31'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f84d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 5 note: GC not initialized 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f84d27e4640 20 reqs_thread_entry: start 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 Filter name: none 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f8443fff640 20 reqs_thread_entry: start 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f59250ae0 con 0x556f59216520 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f592514d0 con 0x556f59216520 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556f592524e0 con 0x7f86100eec20 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f84d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.597+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936725168992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x556f59216520 2024-09-13T06:29:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.601+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93936725168992] v31'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.601+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936725150112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x556f5921a9b0 2024-09-13T06:29:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.601+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93936725150112] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.601+0000 7f861f6b9980 20 remove_watcher() i=0 2024-09-13T06:29:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.601+0000 7f861f6b9980 2 removed watcher, disabling cache 2024-09-13T06:29:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.601+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936725153392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x556f59216520 2024-09-13T06:29:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93936725153392] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x556f59216520 2024-09-13T06:29:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861f6b9980 20 remove_watcher() i=1 2024-09-13T06:29:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936725158192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x556f5921a9b0 2024-09-13T06:29:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93936725158192] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861f6b9980 20 remove_watcher() i=2 2024-09-13T06:29:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936725160528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x7f86100eec20 2024-09-13T06:29:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93936725160528] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861f6b9980 20 remove_watcher() i=3 2024-09-13T06:29:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.605+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936725147632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x556f5921a9b0 2024-09-13T06:29:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861d1c9640 1 -- 172.21.15.169:0/3068088589 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93936725147632] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861011d020 con 0x556f5921a9b0 2024-09-13T06:29:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861f6b9980 20 remove_watcher() i=4 2024-09-13T06:29:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936725161584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f5924e9a0 con 0x556f5921fa10 2024-09-13T06:29:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93936725161584] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861f6b9980 20 remove_watcher() i=5 2024-09-13T06:29:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936725163152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59227700 con 0x556f5921fa10 2024-09-13T06:29:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861c9c8640 1 -- 172.21.15.169:0/3068088589 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93936725163152] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614037040 con 0x556f5921fa10 2024-09-13T06:29:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861f6b9980 20 remove_watcher() i=6 2024-09-13T06:29:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.609+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936725171744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556f59227700 con 0x7f86100eec20 2024-09-13T06:29:21.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93936725171744] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861800a4d0 con 0x7f86100eec20 2024-09-13T06:29:21.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 20 remove_watcher() i=7 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f5921a9b0 msgr2=0x556f5921cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f5921a9b0 0x556f5921cda0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f59216520 msgr2=0x556f592189c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f59216520 0x556f592189c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86100eec20 msgr2=0x7f86101036a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f86100eec20 0x7f86101036a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f5921fa10 msgr2=0x556f59221e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f5921fa10 0x556f59221e00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84e80346a0 msgr2=0x7f84e8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84e80346a0 0x7f84e8036b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x556f591e6130 tx=0x7f8614010000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861d9ca640 1 -- 172.21.15.169:0/3068088589 reap_dead start 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 msgr2=0x556f5920b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f5920b430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8610105040 tx=0x7f86100d4f30 comp rx=0 tx=0).stop 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 shutdown_connections 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/3068088589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f59204230 0x556f5920b430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 >> 172.21.15.169:0/3068088589 conn(0x556f59200610 msgr2=0x556f591fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 shutdown_connections 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/3068088589 wait complete. 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84f4034650 msgr2=0x7f84f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84f4034650 0x7f84f4036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x556f591de0d0 tx=0x7f861400f000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 msgr2=0x556f591f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 0x556f591f7cb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86100cb5c0 tx=0x7f86100b6e70 comp rx=0 tx=0).stop 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 shutdown_connections 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f84f4034650 0x7f84f4036b10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/226842141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f591f7890 0x556f591f7cb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 >> 172.21.15.169:0/226842141 conn(0x556f591ec9e0 msgr2=0x556f591ef460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 shutdown_connections 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/226842141 wait complete. 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f591e1f00 msgr2=0x556f591e42f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556f591e1f00 0x556f591e42f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f590e8e90 msgr2=0x556f591e0ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556f590e8e90 0x556f591e0ad0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f591e7580 msgr2=0x556f591e9970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556f591e7580 0x556f591e9970 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8504034650 msgr2=0x7f8504036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8504034650 0x7f8504036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8614001e50 tx=0x7f86140013b0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 msgr2=0x556f591d9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 --2- 172.21.15.169:0/1618982697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556f590e8540 0x556f591d9ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8610019e10 tx=0x7f8610019fa0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861d9ca640 1 -- 172.21.15.169:0/1618982697 reap_dead start 2024-09-13T06:29:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 shutdown_connections 2024-09-13T06:29:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 >> 172.21.15.169:0/1618982697 conn(0x556f590e4060 msgr2=0x556f591cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 shutdown_connections 2024-09-13T06:29:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.613+0000 7f861f6b9980 1 -- 172.21.15.169:0/1618982697 wait complete. 2024-09-13T06:29:21.624 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-09-13T06:29:21.625 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:29:21.671 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:21.671 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T06:29:21.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T06:29:21.671 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T06:29:21.700 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:21.701 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9156ae980 1 Processor -- start 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9156ae980 1 -- start start 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9156ae980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5576cb56fec0 0x5576cb5722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9156ae980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576cb3f1ae0 con 0x5576cb4de290 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9156ae980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5576cb415e30 con 0x5576cb56fec0 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9129bd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5576cb56fec0 0x5576cb5722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.697+0000 7fd9131be640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5576cb4de290 0x5576cb56e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45206/0 (socket says 172.21.15.169:45206) 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9129bd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5576cb56fec0 0x5576cb5722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36422/0 (socket says 172.21.15.169:36422) 2024-09-13T06:29:21.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9131be640 1 -- 172.21.15.169:0/3287356486 learned_addr learned my addr 172.21.15.169:0/3287356486 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:21.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9129bd640 1 -- 172.21.15.169:0/3287356486 >> v1:172.21.15.112:6789/0 conn(0x5576cb4de290 legacy=0x5576cb56e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9129bd640 1 -- 172.21.15.169:0/3287356486 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576cb4de670 con 0x5576cb56fec0 2024-09-13T06:29:21.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9129bd640 1 --2- 172.21.15.169:0/3287356486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb56fec0 0x5576cb5722b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd90800a480 tx=0x7fd90801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13d4635d6a754ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9121bc640 1 -- 172.21.15.169:0/3287356486 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9080b0070 con 0x5576cb56fec0 2024-09-13T06:29:21.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9121bc640 1 -- 172.21.15.169:0/3287356486 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080ab540 con 0x5576cb56fec0 2024-09-13T06:29:21.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9121bc640 1 -- 172.21.15.169:0/3287356486 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9080ab840 con 0x5576cb56fec0 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9156ae980 1 -- 172.21.15.169:0/3287356486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb56fec0 msgr2=0x5576cb5722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9156ae980 1 --2- 172.21.15.169:0/3287356486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb56fec0 0x5576cb5722b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd90800a480 tx=0x7fd90801b280 comp rx=0 tx=0).stop 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9156ae980 1 -- 172.21.15.169:0/3287356486 shutdown_connections 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9156ae980 1 --2- 172.21.15.169:0/3287356486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb56fec0 0x5576cb5722b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9156ae980 1 -- 172.21.15.169:0/3287356486 >> 172.21.15.169:0/3287356486 conn(0x5576cb564090 msgr2=0x5576cb5664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.701+0000 7fd9156ae980 1 -- 172.21.15.169:0/3287356486 shutdown_connections 2024-09-13T06:29:21.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.705+0000 7fd9156ae980 1 -- 172.21.15.169:0/3287356486 wait complete. 2024-09-13T06:29:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 Processor -- start 2024-09-13T06:29:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- start start 2024-09-13T06:29:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb656cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576cb417200 con 0x5576cb4de290 2024-09-13T06:29:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb656cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb656cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36432/0 (socket says 172.21.15.169:36432) 2024-09-13T06:29:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9131be640 1 -- 172.21.15.169:0/2567290348 learned_addr learned my addr 172.21.15.169:0/2567290348 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9131be640 1 -- 172.21.15.169:0/2567290348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576cb6572a0 con 0x5576cb4de290 2024-09-13T06:29:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9131be640 1 --2- 172.21.15.169:0/2567290348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb656cd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0017b0 tx=0x7fd90c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa7864b6e27de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd80160a640 1 -- 172.21.15.169:0/2567290348 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c016070 con 0x5576cb4de290 2024-09-13T06:29:21.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd80160a640 1 -- 172.21.15.169:0/2567290348 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c004530 con 0x5576cb4de290 2024-09-13T06:29:21.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd80160a640 1 -- 172.21.15.169:0/2567290348 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c004870 con 0x5576cb4de290 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- 172.21.15.169:0/2567290348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 msgr2=0x5576cb656cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2567290348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb656cd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0017b0 tx=0x7fd90c001c70 comp rx=0 tx=0).stop 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- 172.21.15.169:0/2567290348 shutdown_connections 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2567290348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb656cd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- 172.21.15.169:0/2567290348 >> 172.21.15.169:0/2567290348 conn(0x5576cb564090 msgr2=0x5576cb652900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- 172.21.15.169:0/2567290348 shutdown_connections 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- 172.21.15.169:0/2567290348 wait complete. 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 Processor -- start 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- start start 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb65dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.717+0000 7fd9156ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576cb575220 con 0x5576cb4de290 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb65dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb65dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36436/0 (socket says 172.21.15.169:36436) 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9131be640 1 -- 172.21.15.169:0/2747709027 learned_addr learned my addr 172.21.15.169:0/2747709027 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9131be640 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576cb65e520 con 0x5576cb4de290 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9131be640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb65dfe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd90c000f90 tx=0x7fd90c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd7ffe07640 1 -- 172.21.15.169:0/2747709027 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c020070 con 0x5576cb4de290 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576cb65e7b0 con 0x5576cb4de290 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576cb661490 con 0x5576cb4de290 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd7ffe07640 1 -- 172.21.15.169:0/2747709027 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c025450 con 0x5576cb4de290 2024-09-13T06:29:21.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd7ffe07640 1 -- 172.21.15.169:0/2747709027 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c02a060 con 0x5576cb4de290 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd7ffe07640 1 -- 172.21.15.169:0/2747709027 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd90c023070 con 0x5576cb4de290 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd7ffe07640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f8034650 0x7fd7f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd7ffe07640 1 -- 172.21.15.169:0/2747709027 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd90c0493f0 con 0x5576cb4de290 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f8034650 0x7fd7f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb56fec0 0x5576cb6650e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb665620 con 0x5576cb56fec0 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9139bf640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb56fec0 0x5576cb6650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f8034650 0x7fd7f8036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ad000 tx=0x7fd9080a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9139bf640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb56fec0 0x5576cb6650e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9139bf640 1 -- 172.21.15.169:0/2747709027 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb56fec0 2024-09-13T06:29:21.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb666120 0x5576cb6685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb668d50 con 0x5576cb666120 2024-09-13T06:29:21.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.721+0000 7fd9131be640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb666120 0x5576cb6685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9131be640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb666120 0x5576cb6685e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9131be640 1 -- 172.21.15.169:0/2747709027 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb666120 2024-09-13T06:29:21.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb66a600 con 0x5576cb666120 2024-09-13T06:29:21.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9131be640 1 -- 172.21.15.169:0/2747709027 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb666120 2024-09-13T06:29:21.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb669830 con 0x5576cb666120 2024-09-13T06:29:21.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9131be640 1 -- 172.21.15.169:0/2747709027 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb666120 2024-09-13T06:29:21.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb66b9b0 0x5576cb66dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb66e2e0 con 0x5576cb66b9b0 2024-09-13T06:29:21.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb66b9b0 0x5576cb66dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb66b9b0 0x5576cb66dda0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9129bd640 1 -- 172.21.15.169:0/2747709027 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9080ab8a0 con 0x5576cb66b9b0 2024-09-13T06:29:21.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 Processor -- start 2024-09-13T06:29:21.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 -- start start 2024-09-13T06:29:21.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 0x5576cb67c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.725+0000 7fd9156ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576cb470800 con 0x5576cb67bce0 2024-09-13T06:29:21.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 0x5576cb67c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 0x5576cb67c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36450/0 (socket says 172.21.15.169:36450) 2024-09-13T06:29:21.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 -- 172.21.15.169:0/286314566 learned_addr learned my addr 172.21.15.169:0/286314566 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 -- 172.21.15.169:0/286314566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576cb67c640 con 0x5576cb67bce0 2024-09-13T06:29:21.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 0x5576cb67c100 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd90c02e9f0 tx=0x7fd90c02d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd7fd602640 1 -- 172.21.15.169:0/286314566 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c0462d0 con 0x5576cb67bce0 2024-09-13T06:29:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576cb67c8d0 con 0x5576cb67bce0 2024-09-13T06:29:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576cb67f550 con 0x5576cb67bce0 2024-09-13T06:29:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd7fd602640 1 -- 172.21.15.169:0/286314566 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c046470 con 0x5576cb67bce0 2024-09-13T06:29:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd7fd602640 1 -- 172.21.15.169:0/286314566 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c04e060 con 0x5576cb67bce0 2024-09-13T06:29:21.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd7fd602640 1 -- 172.21.15.169:0/286314566 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd90c02d7e0 con 0x5576cb67bce0 2024-09-13T06:29:21.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd7fd602640 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7ec0346a0 0x7fd7ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd7fd602640 1 -- 172.21.15.169:0/286314566 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd90c03daa0 con 0x5576cb67bce0 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9129bd640 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7ec0346a0 0x7fd7ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9156ae980 1 Processor -- start 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9156ae980 1 -- start start 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9156ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb6889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9129bd640 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7ec0346a0 0x7fd7ec036b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5576cb65f0c0 tx=0x7fd908005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9156ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576cb657620 con 0x5576cb6885d0 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb6889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb6889b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36458/0 (socket says 172.21.15.169:36458) 2024-09-13T06:29:21.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.729+0000 7fd9131be640 1 -- 172.21.15.169:0/816796398 learned_addr learned my addr 172.21.15.169:0/816796398 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 -- 172.21.15.169:0/816796398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576cb688f80 con 0x5576cb6885d0 2024-09-13T06:29:21.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 --2- 172.21.15.169:0/816796398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb6889b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd90c04cfd0 tx=0x7fd90c025d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9b2985f51bfff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd7f6ffd640 1 -- 172.21.15.169:0/816796398 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c016e10 con 0x5576cb6885d0 2024-09-13T06:29:21.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd7f6ffd640 1 -- 172.21.15.169:0/816796398 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c041880 con 0x5576cb6885d0 2024-09-13T06:29:21.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd7f6ffd640 1 -- 172.21.15.169:0/816796398 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c025730 con 0x5576cb6885d0 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/816796398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 msgr2=0x5576cb6889b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 --2- 172.21.15.169:0/816796398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb6889b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd90c04cfd0 tx=0x7fd90c025d80 comp rx=0 tx=0).stop 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/816796398 shutdown_connections 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 --2- 172.21.15.169:0/816796398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb6889b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/816796398 >> 172.21.15.169:0/816796398 conn(0x5576cb6849b0 msgr2=0x5576cb682ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/816796398 shutdown_connections 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/816796398 wait complete. 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 Processor -- start 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- start start 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb68f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576cb689420 con 0x5576cb6885d0 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb68f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb68f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36462/0 (socket says 172.21.15.169:36462) 2024-09-13T06:29:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 learned_addr learned my addr 172.21.15.169:0/2077308073 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576cb68fca0 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9131be640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb68f760 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0017b0 tx=0x7fd90c02af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd7f57fa640 1 -- 172.21.15.169:0/2077308073 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c06d020 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd7f57fa640 1 -- 172.21.15.169:0/2077308073 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c016e10 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576cb68fca0 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd7f57fa640 1 -- 172.21.15.169:0/2077308073 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c032550 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.733+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576cb68fca0 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd7f57fa640 1 -- 172.21.15.169:0/2077308073 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd90c070020 con 0x5576cb6885d0 2024-09-13T06:29:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd7f57fa640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7dc034650 0x7fd7dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd7f57fa640 1 -- 172.21.15.169:0/2077308073 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd90c062040 con 0x5576cb6885d0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7dc034650 0x7fd7dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb69a880 0x5576cb69cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb69d490 con 0x5576cb69a880 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9139bf640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb69a880 0x5576cb69cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7dc034650 0x7fd7dc036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd90801b2c0 tx=0x7fd9080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9139bf640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb69a880 0x5576cb69cd40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 realm 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb699d30 con 0x5576cb69a880 2024-09-13T06:29:21.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb69df60 con 0x5576cb69a880 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb69eb10 0x5576cb6a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a1740 con 0x5576cb69eb10 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9131be640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb69eb10 0x5576cb6a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9131be640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb69eb10 0x5576cb6a0fd0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.737+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a1fe0 con 0x5576cb69eb10 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9156ae980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9156ae980 20 searching for the correct realm 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb6a3d50 0x5576cb6a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb6a3d50 0x5576cb6a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9129bd640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb6a3d50 0x5576cb6a6140 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9131be640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd90c072020 0x7fd90c053890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x7fd90c072020 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd90c072020 0x7fd90c053890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd90c072020 0x7fd90c053890 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.741+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x7fd90c072020 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x7fd90c072020 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.745+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x7fd90c072020 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x7fd90c072020 2024-09-13T06:29:21.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x7fd90c072020 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb6a3d50 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.749+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a67c0 con 0x5576cb69eb10 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a2930 con 0x5576cb69a880 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a2d80 con 0x5576cb69eb10 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a2d80 con 0x5576cb6a3d50 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 zone default found 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 4 Realm: () 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 zonegroup default 2024-09-13T06:29:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a6c70 con 0x7fd90c072020 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a3470 con 0x5576cb6a3d50 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a8f40 con 0x5576cb6a3d50 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 started sync module instance, tier type = 2024-09-13T06:29:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.753+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a8330 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93968707258448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a8330 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a9a50 con 0x5576cb69a880 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93968707261760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6aa2f0 con 0x5576cb69a880 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6aad30 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93968707258448] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93968707261760] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93968707266560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a9e40 con 0x5576cb69eb10 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.757+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ab5d0 con 0x7fd90c072020 2024-09-13T06:29:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93968707268896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6a9e40 con 0x7fd90c072020 2024-09-13T06:29:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ac090 con 0x5576cb69eb10 2024-09-13T06:29:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93968707268896] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93968707266560] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93968707255936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ac050 con 0x5576cb69eb10 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.761+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ac480 con 0x5576cb6a3d50 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93968707269952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6acd20 con 0x5576cb6a3d50 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ad6e0 con 0x5576cb6a3d50 2024-09-13T06:29:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93968707255936] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93968707269952] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93968707277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6adad0 con 0x5576cb6a3d50 2024-09-13T06:29:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ae320 con 0x7fd90c072020 2024-09-13T06:29:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93968707277360] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93968707279568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6ae710 con 0x7fd90c072020 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=0 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=1 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=2 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=3 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=4 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=5 2024-09-13T06:29:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.765+0000 7fd9156ae980 20 add_watcher() i=6 2024-09-13T06:29:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93968707279568] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 add_watcher() i=7 2024-09-13T06:29:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6b1740 con 0x5576cb69a880 2024-09-13T06:29:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93968707281168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6aec10 con 0x5576cb69a880 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93968707281168] v31'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 5 note: GC not initialized 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd7c8fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 Filter name: none 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd7427fc640 20 reqs_thread_entry: start 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d4920 con 0x5576cb69a880 2024-09-13T06:29:21.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:21.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d5310 con 0x5576cb69a880 2024-09-13T06:29:21.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.769+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd9156ae980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:21.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d6320 con 0x7fd90c072020 2024-09-13T06:29:21.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93968707281168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb69a880 2024-09-13T06:29:21.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93968707281168] v31'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.773+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93968707258448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb69eb10 2024-09-13T06:29:21.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93968707258448] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 20 remove_watcher() i=0 2024-09-13T06:29:21.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 2 removed watcher, disabling cache 2024-09-13T06:29:21.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93968707261760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb69a880 2024-09-13T06:29:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93968707261760] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x5576cb69a880 2024-09-13T06:29:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 20 remove_watcher() i=1 2024-09-13T06:29:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93968707266560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb69eb10 2024-09-13T06:29:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93968707266560] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 20 remove_watcher() i=2 2024-09-13T06:29:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.777+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93968707268896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x7fd90c072020 2024-09-13T06:29:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93968707268896] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9156ae980 20 remove_watcher() i=3 2024-09-13T06:29:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93968707255936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb69eb10 2024-09-13T06:29:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9131be640 1 -- 172.21.15.169:0/2077308073 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93968707255936] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c022030 con 0x5576cb69eb10 2024-09-13T06:29:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9156ae980 20 remove_watcher() i=4 2024-09-13T06:29:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93968707269952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb6a3d50 2024-09-13T06:29:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93968707269952] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9156ae980 20 remove_watcher() i=5 2024-09-13T06:29:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.781+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93968707277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x5576cb6a3d50 2024-09-13T06:29:21.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9129bd640 1 -- 172.21.15.169:0/2077308073 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93968707277360] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9080da070 con 0x5576cb6a3d50 2024-09-13T06:29:21.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 20 remove_watcher() i=6 2024-09-13T06:29:21.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93968707279568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576cb6d2810 con 0x7fd90c072020 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93968707279568] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040083f0 con 0x7fd90c072020 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 20 remove_watcher() i=7 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb69eb10 msgr2=0x5576cb6a0fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb69eb10 0x5576cb6a0fd0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb69a880 msgr2=0x5576cb69cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb69a880 0x5576cb69cd40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd90c072020 msgr2=0x7fd90c053890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd90c072020 0x7fd90c053890 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb6a3d50 msgr2=0x5576cb6a6140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb6a3d50 0x5576cb6a6140 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7dc034650 msgr2=0x7fd7dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7dc034650 0x7fd7dc036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd90801b2c0 tx=0x7fd9080a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 msgr2=0x5576cb68f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9139bf640 1 -- 172.21.15.169:0/2077308073 reap_dead start 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb68f760 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0017b0 tx=0x7fd90c02af40 comp rx=0 tx=0).stop 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 shutdown_connections 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2077308073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb6885d0 0x5576cb68f760 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 >> 172.21.15.169:0/2077308073 conn(0x5576cb6849b0 msgr2=0x5576cb682a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 shutdown_connections 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2077308073 wait complete. 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7ec0346a0 msgr2=0x7fd7ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7ec0346a0 0x7fd7ec036b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5576cb65f0c0 tx=0x7fd908005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 msgr2=0x5576cb67c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 0x5576cb67c100 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd90c02e9f0 tx=0x7fd90c02d580 comp rx=0 tx=0).stop 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 shutdown_connections 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7ec0346a0 0x7fd7ec036b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/286314566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb67bce0 0x5576cb67c100 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 >> 172.21.15.169:0/286314566 conn(0x5576cb670e30 msgr2=0x5576cb6738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 shutdown_connections 2024-09-13T06:29:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/286314566 wait complete. 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb666120 msgr2=0x5576cb6685e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5576cb666120 0x5576cb6685e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb56fec0 msgr2=0x5576cb6650e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5576cb56fec0 0x5576cb6650e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb66b9b0 msgr2=0x5576cb66dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5576cb66b9b0 0x5576cb66dda0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f8034650 msgr2=0x7fd7f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd7f8034650 0x7fd7f8036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ad000 tx=0x7fd9080a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 msgr2=0x5576cb65dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9156ae980 1 --2- 172.21.15.169:0/2747709027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576cb4de290 0x5576cb65dfe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd90c000f90 tx=0x7fd90c001260 comp rx=0 tx=0).stop 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.785+0000 7fd9139bf640 1 -- 172.21.15.169:0/2747709027 reap_dead start 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.789+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 shutdown_connections 2024-09-13T06:29:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.789+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 >> 172.21.15.169:0/2747709027 conn(0x5576cb564090 msgr2=0x5576cb651480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.789+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 shutdown_connections 2024-09-13T06:29:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.789+0000 7fd9156ae980 1 -- 172.21.15.169:0/2747709027 wait complete. 2024-09-13T06:29:21.800 INFO:teuthology.orchestra.run.smithi169.stdout:["myfoo"] 2024-09-13T06:29:21.800 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T06:29:21.803 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:21.803 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T06:29:21.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T06:29:21.804 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T06:29:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd245fd2980 1 Processor -- start 2024-09-13T06:29:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd245fd2980 1 -- start start 2024-09-13T06:29:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd245fd2980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5557c88278e0 0x5557c8829cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd245fd2980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557c86acae0 con 0x5557c8823560 2024-09-13T06:29:21.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd245fd2980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5557c86d0e30 con 0x5557c88278e0 2024-09-13T06:29:21.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd23b2e1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5557c88278e0 0x5557c8829cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd23b2e1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5557c88278e0 0x5557c8829cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36466/0 (socket says 172.21.15.169:36466) 2024-09-13T06:29:21.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd23b2e1640 1 -- 172.21.15.169:0/2873444515 learned_addr learned my addr 172.21.15.169:0/2873444515 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd243ae2640 1 --1- 172.21.15.169:0/2873444515 >> v1:172.21.15.112:6789/0 conn(0x5557c8823560 0x5557c8823940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45216/0 (socket says 172.21.15.169:45216) 2024-09-13T06:29:21.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd23b2e1640 1 -- 172.21.15.169:0/2873444515 >> v1:172.21.15.112:6789/0 conn(0x5557c8823560 legacy=0x5557c8823940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.865+0000 7fd23b2e1640 1 -- 172.21.15.169:0/2873444515 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c882b220 con 0x5557c88278e0 2024-09-13T06:29:21.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/2873444515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8829cd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00a5c0 tx=0x7fd22c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9884b299fdc2d681 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd2432e1640 1 -- 172.21.15.169:0/2873444515 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c0a6070 con 0x5557c88278e0 2024-09-13T06:29:21.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd2432e1640 1 -- 172.21.15.169:0/2873444515 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c0af070 con 0x5557c88278e0 2024-09-13T06:29:21.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd2432e1640 1 -- 172.21.15.169:0/2873444515 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c0aa5c0 con 0x5557c88278e0 2024-09-13T06:29:21.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 -- 172.21.15.169:0/2873444515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 msgr2=0x5557c8829cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 --2- 172.21.15.169:0/2873444515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8829cd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00a5c0 tx=0x7fd22c01b340 comp rx=0 tx=0).stop 2024-09-13T06:29:21.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 -- 172.21.15.169:0/2873444515 shutdown_connections 2024-09-13T06:29:21.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 --2- 172.21.15.169:0/2873444515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8829cd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 -- 172.21.15.169:0/2873444515 >> 172.21.15.169:0/2873444515 conn(0x5557c881f080 msgr2=0x5557c88214a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 -- 172.21.15.169:0/2873444515 shutdown_connections 2024-09-13T06:29:21.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.869+0000 7fd245fd2980 1 -- 172.21.15.169:0/2873444515 wait complete. 2024-09-13T06:29:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd245fd2980 1 Processor -- start 2024-09-13T06:29:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd245fd2980 1 -- start start 2024-09-13T06:29:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd245fd2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 0x5557c8798bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd245fd2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c86d2200 con 0x5557c8823560 2024-09-13T06:29:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 0x5557c8798bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 0x5557c8798bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36476/0 (socket says 172.21.15.169:36476) 2024-09-13T06:29:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.881+0000 7fd243ae2640 1 -- 172.21.15.169:0/2742097680 learned_addr learned my addr 172.21.15.169:0/2742097680 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 -- 172.21.15.169:0/2742097680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c87991c0 con 0x5557c8823560 2024-09-13T06:29:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 --2- 172.21.15.169:0/2742097680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 0x5557c8798bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd234001e50 tx=0x7fd234001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c3ddd0d922db1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd131e0b640 1 -- 172.21.15.169:0/2742097680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23400e5d0 con 0x5557c8823560 2024-09-13T06:29:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd131e0b640 1 -- 172.21.15.169:0/2742097680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23400e770 con 0x5557c8823560 2024-09-13T06:29:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd131e0b640 1 -- 172.21.15.169:0/2742097680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23400eab0 con 0x5557c8823560 2024-09-13T06:29:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/2742097680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 msgr2=0x5557c8798bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 --2- 172.21.15.169:0/2742097680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 0x5557c8798bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd234001e50 tx=0x7fd234001e80 comp rx=0 tx=0).stop 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/2742097680 shutdown_connections 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 --2- 172.21.15.169:0/2742097680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8823560 0x5557c8798bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/2742097680 >> 172.21.15.169:0/2742097680 conn(0x5557c881f080 msgr2=0x5557c890a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/2742097680 shutdown_connections 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/2742097680 wait complete. 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 Processor -- start 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- start start 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8910090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c882ad20 con 0x5557c88278e0 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8910090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8910090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36482/0 (socket says 172.21.15.169:36482) 2024-09-13T06:29:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 -- 172.21.15.169:0/3072189897 learned_addr learned my addr 172.21.15.169:0/3072189897 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c89105d0 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd243ae2640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8910090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd234004000 tx=0x7fd234000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd12bfff640 1 -- 172.21.15.169:0/3072189897 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234001260 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c890e7b0 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd12bfff640 1 -- 172.21.15.169:0/3072189897 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23400f9a0 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd12bfff640 1 -- 172.21.15.169:0/3072189897 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23400fce0 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.885+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c890eca0 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd12bfff640 1 -- 172.21.15.169:0/3072189897 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd234017070 con 0x5557c88278e0 2024-09-13T06:29:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd12bfff640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd12c0346a0 0x7fd12c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd12bfff640 1 -- 172.21.15.169:0/3072189897 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd234015020 con 0x5557c88278e0 2024-09-13T06:29:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd12c0346a0 0x7fd12c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c891e3b0 0x5557c89207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8920ce0 con 0x5557c891e3b0 2024-09-13T06:29:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd2442e3640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c891e3b0 0x5557c89207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd12c0346a0 0x7fd12c036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0ae000 tx=0x7fd22c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd2442e3640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c891e3b0 0x5557c89207a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd2442e3640 1 -- 172.21.15.169:0/3072189897 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c891e3b0 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8921750 0x5557c8923c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8924380 con 0x5557c8921750 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd243ae2640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8921750 0x5557c8923c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd243ae2640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8921750 0x5557c8923c10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd243ae2640 1 -- 172.21.15.169:0/3072189897 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8921750 2024-09-13T06:29:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.889+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8925c30 con 0x5557c8921750 2024-09-13T06:29:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd243ae2640 1 -- 172.21.15.169:0/3072189897 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8921750 2024-09-13T06:29:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8924e60 con 0x5557c8921750 2024-09-13T06:29:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd243ae2640 1 -- 172.21.15.169:0/3072189897 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8921750 2024-09-13T06:29:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c8926fe0 0x5557c89293d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8929950 con 0x5557c8926fe0 2024-09-13T06:29:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c8926fe0 0x5557c89293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c8926fe0 0x5557c89293d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd23b2e1640 1 -- 172.21.15.169:0/3072189897 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c8926fe0 2024-09-13T06:29:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 Processor -- start 2024-09-13T06:29:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 -- start start 2024-09-13T06:29:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 0x5557c89377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd245fd2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c872b800 con 0x5557c89373b0 2024-09-13T06:29:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 0x5557c89377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 0x5557c89377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36492/0 (socket says 172.21.15.169:36492) 2024-09-13T06:29:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd243ae2640 1 -- 172.21.15.169:0/3554842213 learned_addr learned my addr 172.21.15.169:0/3554842213 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.893+0000 7fd243ae2640 1 -- 172.21.15.169:0/3554842213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c8937d10 con 0x5557c89373b0 2024-09-13T06:29:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd243ae2640 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 0x5557c89377d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd234019550 tx=0x7fd23400e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd1297fa640 1 -- 172.21.15.169:0/3554842213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234042070 con 0x5557c89373b0 2024-09-13T06:29:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c8937fa0 con 0x5557c89373b0 2024-09-13T06:29:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c893ac20 con 0x5557c89373b0 2024-09-13T06:29:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd1297fa640 1 -- 172.21.15.169:0/3554842213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23404a0b0 con 0x5557c89373b0 2024-09-13T06:29:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd1297fa640 1 -- 172.21.15.169:0/3554842213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23404f060 con 0x5557c89373b0 2024-09-13T06:29:21.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd1297fa640 1 -- 172.21.15.169:0/3554842213 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd23401a480 con 0x5557c89373b0 2024-09-13T06:29:21.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd1297fa640 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd11c0346a0 0x7fd11c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd1297fa640 1 -- 172.21.15.169:0/3554842213 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd23402cd00 con 0x5557c89373b0 2024-09-13T06:29:21.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd11c0346a0 0x7fd11c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd245fd2980 1 Processor -- start 2024-09-13T06:29:21.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd245fd2980 1 -- start start 2024-09-13T06:29:21.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd245fd2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c8943e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd245fd2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c8799540 con 0x5557c8943aa0 2024-09-13T06:29:21.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd11c0346a0 0x7fd11c036b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000c10 tx=0x7fd22c005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c8943e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c8943e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36508/0 (socket says 172.21.15.169:36508) 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd243ae2640 1 -- 172.21.15.169:0/3616252195 learned_addr learned my addr 172.21.15.169:0/3616252195 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd243ae2640 1 -- 172.21.15.169:0/3616252195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c8944450 con 0x5557c8943aa0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd243ae2640 1 --2- 172.21.15.169:0/3616252195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c8943e80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd23401c020 tx=0x7fd2340235c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e574e3a72741c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd122ffd640 1 -- 172.21.15.169:0/3616252195 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23402ca50 con 0x5557c8943aa0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd122ffd640 1 -- 172.21.15.169:0/3616252195 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23404a930 con 0x5557c8943aa0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.897+0000 7fd122ffd640 1 -- 172.21.15.169:0/3616252195 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234023240 con 0x5557c8943aa0 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/3616252195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 msgr2=0x5557c8943e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3616252195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c8943e80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd23401c020 tx=0x7fd2340235c0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/3616252195 shutdown_connections 2024-09-13T06:29:21.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3616252195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c8943e80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/3616252195 >> 172.21.15.169:0/3616252195 conn(0x5557c893fe80 msgr2=0x5557c893df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/3616252195 shutdown_connections 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/3616252195 wait complete. 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 Processor -- start 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- start start 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c894ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c89448f0 con 0x5557c8943aa0 2024-09-13T06:29:21.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c894ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd243ae2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c894ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36518/0 (socket says 172.21.15.169:36518) 2024-09-13T06:29:21.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 learned_addr learned my addr 172.21.15.169:0/1555496505 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c894b160 con 0x5557c8943aa0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd243ae2640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c894ac20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd234025e70 tx=0x7fd23402c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd1217fa640 1 -- 172.21.15.169:0/1555496505 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2340256d0 con 0x5557c8943aa0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd1217fa640 1 -- 172.21.15.169:0/1555496505 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234025870 con 0x5557c8943aa0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c894b160 con 0x5557c8943aa0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd1217fa640 1 -- 172.21.15.169:0/1555496505 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234040a90 con 0x5557c8943aa0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c894b160 con 0x5557c8943aa0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.901+0000 7fd1217fa640 1 -- 172.21.15.169:0/1555496505 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd234040c30 con 0x5557c8943aa0 2024-09-13T06:29:21.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd1217fa640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd10c034650 0x7fd10c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd1217fa640 1 -- 172.21.15.169:0/1555496505 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd234065070 con 0x5557c8943aa0 2024-09-13T06:29:21.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c8955cf0 0x5557c8958190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c89588e0 con 0x5557c8955cf0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd10c034650 0x7fd10c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd2442e3640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c8955cf0 0x5557c8958190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd10c034650 0x7fd10c036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0aa910 tx=0x7fd22c0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd2442e3640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c8955cf0 0x5557c8958190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 realm 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c89551e0 con 0x5557c8955cf0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c89593b0 con 0x5557c8955cf0 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8959f90 0x5557c895c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c895cbc0 con 0x5557c8959f90 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd243ae2640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8959f90 0x5557c895c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd243ae2640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8959f90 0x5557c895c450 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.905+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd245fd2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd245fd2980 20 searching for the correct realm 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c895f1d0 0x5557c89615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8961c40 con 0x5557c895f1d0 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c895f1d0 0x5557c89615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd23b2e1640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c895f1d0 0x5557c89615c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8961c40 con 0x5557c8959f90 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd243ae2640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x5557c8823560 0x7fd23403d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8823560 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x5557c8823560 0x7fd23403d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x5557c8823560 0x7fd23403d800 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c895f1d0 2024-09-13T06:29:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.909+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8823560 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8823560 2024-09-13T06:29:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c895f1d0 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c895f1d0 2024-09-13T06:29:21.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.913+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c895f1d0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8823560 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8823560 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c895f1d0 2024-09-13T06:29:21.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8823560 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c895f1d0 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.917+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8959f90 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:21.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c895dcb0 con 0x5557c8955cf0 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c895e0a0 con 0x5557c8959f90 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:21.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c895e0a0 con 0x5557c895f1d0 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 zone default found 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 4 Realm: () 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 zonegroup default 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c89620f0 con 0x5557c8823560 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8963e70 con 0x5557c895f1d0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964210 con 0x5557c895f1d0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 started sync module instance, tier type = 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:21.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.921+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8963310 con 0x5557c8959f90 2024-09-13T06:29:21.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.925+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.925+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835515803664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8963310 con 0x5557c8959f90 2024-09-13T06:29:21.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.925+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8955cf0 2024-09-13T06:29:21.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.925+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.925+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835515807520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8965420 con 0x5557c8955cf0 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.925+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8965e20 con 0x5557c8959f90 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835515807520] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835515803664] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835515801184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964f70 con 0x5557c8959f90 2024-09-13T06:29:21.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c89666c0 con 0x5557c8823560 2024-09-13T06:29:21.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835515814416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964f70 con 0x5557c8823560 2024-09-13T06:29:21.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8967140 con 0x5557c8959f90 2024-09-13T06:29:21.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835515814416] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835515801184] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835515812144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c8959f90 2024-09-13T06:29:21.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.929+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c89679e0 con 0x5557c895f1d0 2024-09-13T06:29:21.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835515819312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c895f1d0 2024-09-13T06:29:21.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8968850 con 0x5557c895f1d0 2024-09-13T06:29:21.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835515812144] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835515823008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8968c70 con 0x5557c895f1d0 2024-09-13T06:29:21.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8969520 con 0x5557c8823560 2024-09-13T06:29:21.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835515819312] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835515821440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8969120 con 0x5557c8823560 2024-09-13T06:29:21.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=0 2024-09-13T06:29:21.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=1 2024-09-13T06:29:21.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=2 2024-09-13T06:29:21.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=3 2024-09-13T06:29:21.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=4 2024-09-13T06:29:21.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=5 2024-09-13T06:29:21.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835515823008] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.933+0000 7fd245fd2980 20 add_watcher() i=6 2024-09-13T06:29:21.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835515821440] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 20 add_watcher() i=7 2024-09-13T06:29:21.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:21.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557c8968f70 con 0x5557c8955cf0 2024-09-13T06:29:21.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835515824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8968f70 con 0x5557c8955cf0 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835515824528] v31'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd0f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 5 note: GC not initialized 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd0f8fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 20 Filter name: none 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd0727fc640 20 reqs_thread_entry: start 2024-09-13T06:29:21.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c898f200 con 0x5557c895f1d0 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.937+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c8959f90 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8955cf0 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8823560 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8959f90 2024-09-13T06:29:21.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8955cf0 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c895f1d0 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(69 [pgnls start_epoch 31 out=127b] v31'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8823560 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8959f90 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8955cf0 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.941+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c895f1d0 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8955cf0 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c895f1d0 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8823560 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c895f1d0 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8955cf0 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8959f90 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8823560 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8959f90 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8955cf0 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c895f1d0 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8823560 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8955cf0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.945+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8955cf0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c895f1d0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c895f1d0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8823560 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8955cf0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8959f90 2024-09-13T06:29:21.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c895f1d0 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fd23c041040 con 0x5557c8823560 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd245fd2980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd245fd2980 20 RGWRados::pool_iterate: got myfoo 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd0f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:21.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.949+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835515824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c8955cf0 2024-09-13T06:29:21.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.953+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93835515824528] v31'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.953+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835515803664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8964bd0 con 0x5557c8959f90 2024-09-13T06:29:21.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.953+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93835515803664] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.953+0000 7fd245fd2980 20 remove_watcher() i=0 2024-09-13T06:29:21.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.953+0000 7fd245fd2980 2 removed watcher, disabling cache 2024-09-13T06:29:21.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.953+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835515807520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d460 con 0x5557c8955cf0 2024-09-13T06:29:21.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93835515807520] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8955cf0 2024-09-13T06:29:21.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd245fd2980 20 remove_watcher() i=1 2024-09-13T06:29:21.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835515801184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c8959f90 2024-09-13T06:29:21.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93835515801184] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd245fd2980 20 remove_watcher() i=2 2024-09-13T06:29:21.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835515814416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c8823560 2024-09-13T06:29:21.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93835515814416] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd245fd2980 20 remove_watcher() i=3 2024-09-13T06:29:21.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.957+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835515812144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c8959f90 2024-09-13T06:29:21.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd243ae2640 1 -- 172.21.15.169:0/1555496505 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93835515812144] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23402e070 con 0x5557c8959f90 2024-09-13T06:29:21.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 20 remove_watcher() i=4 2024-09-13T06:29:21.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835515819312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c8966c50 con 0x5557c895f1d0 2024-09-13T06:29:21.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93835515819312] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 20 remove_watcher() i=5 2024-09-13T06:29:21.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835515823008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d420 con 0x5557c895f1d0 2024-09-13T06:29:21.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd23b2e1640 1 -- 172.21.15.169:0/1555496505 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93835515823008] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c0aaae0 con 0x5557c895f1d0 2024-09-13T06:29:21.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 20 remove_watcher() i=6 2024-09-13T06:29:21.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835515821440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557c895d420 con 0x5557c8823560 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93835515821440] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23c00a4d0 con 0x5557c8823560 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.961+0000 7fd245fd2980 20 remove_watcher() i=7 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8959f90 msgr2=0x5557c895c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8959f90 0x5557c895c450 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c8955cf0 msgr2=0x5557c8958190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c8955cf0 0x5557c8958190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x5557c8823560 msgr2=0x7fd23403d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x5557c8823560 0x7fd23403d800 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c895f1d0 msgr2=0x5557c89615c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c895f1d0 0x5557c89615c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd10c034650 msgr2=0x7fd10c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd10c034650 0x7fd10c036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0aa910 tx=0x7fd22c0c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 msgr2=0x5557c894ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/1555496505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c8943aa0 0x5557c894ac20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd234025e70 tx=0x7fd23402c900 comp rx=0 tx=0).stop 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd2442e3640 1 -- 172.21.15.169:0/1555496505 reap_dead start 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 shutdown_connections 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 >> 172.21.15.169:0/1555496505 conn(0x5557c893fe80 msgr2=0x5557c893df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 shutdown_connections 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/1555496505 wait complete. 2024-09-13T06:29:21.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd11c0346a0 msgr2=0x7fd11c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd11c0346a0 0x7fd11c036b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000c10 tx=0x7fd22c005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 msgr2=0x5557c89377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 0x5557c89377d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd234019550 tx=0x7fd23400e700 comp rx=0 tx=0).stop 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 shutdown_connections 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd11c0346a0 0x7fd11c036b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3554842213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c89373b0 0x5557c89377d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 >> 172.21.15.169:0/3554842213 conn(0x5557c892c500 msgr2=0x5557c892ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 shutdown_connections 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3554842213 wait complete. 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8921750 msgr2=0x5557c8923c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5557c8921750 0x5557c8923c10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c891e3b0 msgr2=0x5557c89207a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5557c891e3b0 0x5557c89207a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c8926fe0 msgr2=0x5557c89293d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5557c8926fe0 0x5557c89293d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd12c0346a0 msgr2=0x7fd12c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd12c0346a0 0x7fd12c036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0ae000 tx=0x7fd22c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 msgr2=0x5557c8910090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 --2- 172.21.15.169:0/3072189897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c88278e0 0x5557c8910090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd234004000 tx=0x7fd234000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd2442e3640 1 -- 172.21.15.169:0/3072189897 reap_dead start 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 shutdown_connections 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 >> 172.21.15.169:0/3072189897 conn(0x5557c881f080 msgr2=0x5557c8909080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 shutdown_connections 2024-09-13T06:29:21.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:21.965+0000 7fd245fd2980 1 -- 172.21.15.169:0/3072189897 wait complete. 2024-09-13T06:29:21.976 INFO:teuthology.orchestra.run.smithi169.stdout:["myfoo"] 2024-09-13T06:29:21.977 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T06:29:21.991 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.003 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.016 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.061 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T06:29:22.122 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.172 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.209 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.210 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:29:22.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:29:22.210 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T06:29:22.237 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:22.237 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:22.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a68ff1980 1 Processor -- start 2024-09-13T06:29:22.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a68ff1980 1 -- start start 2024-09-13T06:29:22.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a68ff1980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557f5b7903b0 0x557f5b78eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a68ff1980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f5b6a1ae0 con 0x557f5b7907c0 2024-09-13T06:29:22.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a68ff1980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x557f5b6c5e30 con 0x557f5b7903b0 2024-09-13T06:29:22.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a66b01640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557f5b7903b0 0x557f5b78eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a66b01640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557f5b7903b0 0x557f5b78eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36524/0 (socket says 172.21.15.169:36524) 2024-09-13T06:29:22.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a66b01640 1 -- 172.21.15.169:0/4173150352 learned_addr learned my addr 172.21.15.169:0/4173150352 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a66b01640 1 -- 172.21.15.169:0/4173150352 >> v1:172.21.15.112:6789/0 conn(0x557f5b7907c0 legacy=0x557f5b78f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a66b01640 1 -- 172.21.15.169:0/4173150352 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b78f8e0 con 0x557f5b7903b0 2024-09-13T06:29:22.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a66b01640 1 --2- 172.21.15.169:0/4173150352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b78eb70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800a5c0 tx=0x7f1a5801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d3fa9e3e8646ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.237+0000 7f1a65aff640 1 -- 172.21.15.169:0/4173150352 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580a6070 con 0x557f5b7903b0 2024-09-13T06:29:22.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a65aff640 1 -- 172.21.15.169:0/4173150352 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580af070 con 0x557f5b7903b0 2024-09-13T06:29:22.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a65aff640 1 -- 172.21.15.169:0/4173150352 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580aa5c0 con 0x557f5b7903b0 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4173150352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 msgr2=0x557f5b78eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/4173150352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b78eb70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800a5c0 tx=0x7f1a5801b340 comp rx=0 tx=0).stop 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4173150352 shutdown_connections 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/4173150352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b78eb70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4173150352 >> 172.21.15.169:0/4173150352 conn(0x557f5b8151b0 msgr2=0x557f5b8175d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4173150352 shutdown_connections 2024-09-13T06:29:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.241+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4173150352 wait complete. 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 Processor -- start 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- start start 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b906b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f5b6c7200 con 0x557f5b7903b0 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b906b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b906b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36540/0 (socket says 172.21.15.169:36540) 2024-09-13T06:29:22.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a66b01640 1 -- 172.21.15.169:0/4378869 learned_addr learned my addr 172.21.15.169:0/4378869 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a66b01640 1 -- 172.21.15.169:0/4378869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b907160 con 0x557f5b7903b0 2024-09-13T06:29:22.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a66b01640 1 --2- 172.21.15.169:0/4378869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b906b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1a58018f70 tx=0x7f1a58003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6655d2a6ff9c0a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1954e09640 1 -- 172.21.15.169:0/4378869 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580aa960 con 0x557f5b7903b0 2024-09-13T06:29:22.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1954e09640 1 -- 172.21.15.169:0/4378869 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580aab00 con 0x557f5b7903b0 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1954e09640 1 -- 172.21.15.169:0/4378869 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580aade0 con 0x557f5b7903b0 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4378869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 msgr2=0x557f5b906b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/4378869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b906b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1a58018f70 tx=0x7f1a58003030 comp rx=0 tx=0).stop 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4378869 shutdown_connections 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/4378869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b906b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4378869 >> 172.21.15.169:0/4378869 conn(0x557f5b8151b0 msgr2=0x557f5b9027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4378869 shutdown_connections 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.253+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4378869 wait complete. 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 Processor -- start 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 -- start start 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b90dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f5b825200 con 0x557f5b7903b0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b90dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b90dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36546/0 (socket says 172.21.15.169:36546) 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a66b01640 1 -- 172.21.15.169:0/2074446710 learned_addr learned my addr 172.21.15.169:0/2074446710 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a66b01640 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b90e320 con 0x557f5b7903b0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a66b01640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b90dde0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800a5c0 tx=0x7f1a580180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1953606640 1 -- 172.21.15.169:0/2074446710 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580cb030 con 0x557f5b7903b0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1953606640 1 -- 172.21.15.169:0/2074446710 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580bd7c0 con 0x557f5b7903b0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f5b90e5b0 con 0x557f5b7903b0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1953606640 1 -- 172.21.15.169:0/2074446710 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580bdaa0 con 0x557f5b7903b0 2024-09-13T06:29:22.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5b911290 con 0x557f5b7903b0 2024-09-13T06:29:22.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1953606640 1 -- 172.21.15.169:0/2074446710 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1a580ce070 con 0x557f5b7903b0 2024-09-13T06:29:22.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1953606640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f194c034650 0x7f194c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1953606640 1 -- 172.21.15.169:0/2074446710 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1a580cc070 con 0x557f5b7903b0 2024-09-13T06:29:22.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a66300640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f194c034650 0x7f194c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b7907c0 0x557f5b914dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b915410 con 0x557f5b7907c0 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.257+0000 7f1a67302640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b7907c0 0x557f5b914dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66300640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f194c034650 0x7f194c036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c001e20 tx=0x7f1a5c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a67302640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b7907c0 0x557f5b914dd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a67302640 1 -- 172.21.15.169:0/2074446710 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b7907c0 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b916200 0x557f5b9185f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b918c30 con 0x557f5b916200 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66b01640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b916200 0x557f5b9185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66b01640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b916200 0x557f5b9185f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66b01640 1 -- 172.21.15.169:0/2074446710 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a580c6a50 con 0x557f5b916200 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b91a4e0 con 0x557f5b916200 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66b01640 1 -- 172.21.15.169:0/2074446710 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a580c6a50 con 0x557f5b916200 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b919710 con 0x557f5b916200 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66b01640 1 -- 172.21.15.169:0/2074446710 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a580c6a50 con 0x557f5b916200 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b91b890 0x557f5b91dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b91e1c0 con 0x557f5b91b890 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66300640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b91b890 0x557f5b91dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.261+0000 7f1a66300640 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b91b890 0x557f5b91dc80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66300640 1 -- 172.21.15.169:0/2074446710 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a5c00d040 con 0x557f5b91b890 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a68ff1980 1 Processor -- start 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a68ff1980 1 -- start start 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a68ff1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 0x557f5b92bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a68ff1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f5b720800 con 0x557f5b92bb80 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 0x557f5b92bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 0x557f5b92bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36560/0 (socket says 172.21.15.169:36560) 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66b01640 1 -- 172.21.15.169:0/803842039 learned_addr learned my addr 172.21.15.169:0/803842039 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66b01640 1 -- 172.21.15.169:0/803842039 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b92c4e0 con 0x557f5b92bb80 2024-09-13T06:29:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66b01640 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 0x557f5b92bfa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1a580c1040 tx=0x7f1a580c6500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1950e01640 1 -- 172.21.15.169:0/803842039 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580e5050 con 0x557f5b92bb80 2024-09-13T06:29:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f5b92c770 con 0x557f5b92bb80 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5b92c770 con 0x557f5b92bb80 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1950e01640 1 -- 172.21.15.169:0/803842039 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580e51f0 con 0x557f5b92bb80 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1950e01640 1 -- 172.21.15.169:0/803842039 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580cf5e0 con 0x557f5b92bb80 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1950e01640 1 -- 172.21.15.169:0/803842039 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1a580cf780 con 0x557f5b92bb80 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1950e01640 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1940034650 0x7f1940036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1950e01640 1 -- 172.21.15.169:0/803842039 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1a580eb070 con 0x557f5b92bb80 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.265+0000 7f1a66300640 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1940034650 0x7f1940036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 Processor -- start 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- start start 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66300640 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1940034650 0x7f1940036b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x557f5b9123d0 tx=0x7f1a5c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b938710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f5b907420 con 0x557f5b938330 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b938710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b938710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36572/0 (socket says 172.21.15.169:36572) 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 -- 172.21.15.169:0/4241395883 learned_addr learned my addr 172.21.15.169:0/4241395883 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 -- 172.21.15.169:0/4241395883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b938ce0 con 0x557f5b938330 2024-09-13T06:29:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 --2- 172.21.15.169:0/4241395883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b938710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1a580da5c0 tx=0x7f1a580da400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1680556baccf4df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f194a7fc640 1 -- 172.21.15.169:0/4241395883 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a58109070 con 0x557f5b938330 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f194a7fc640 1 -- 172.21.15.169:0/4241395883 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580fd070 con 0x557f5b938330 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f194a7fc640 1 -- 172.21.15.169:0/4241395883 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a580e5790 con 0x557f5b938330 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4241395883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 msgr2=0x557f5b938710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/4241395883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b938710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1a580da5c0 tx=0x7f1a580da400 comp rx=0 tx=0).stop 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4241395883 shutdown_connections 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/4241395883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b938710 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4241395883 >> 172.21.15.169:0/4241395883 conn(0x557f5b934710 msgr2=0x557f5b932810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4241395883 shutdown_connections 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- 172.21.15.169:0/4241395883 wait complete. 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 Processor -- start 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- start start 2024-09-13T06:29:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b93f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a68ff1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f5b939180 con 0x557f5b938330 2024-09-13T06:29:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b93f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b93f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36580/0 (socket says 172.21.15.169:36580) 2024-09-13T06:29:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 learned_addr learned my addr 172.21.15.169:0/485737529 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b93fa10 con 0x557f5b938330 2024-09-13T06:29:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.269+0000 7f1a66b01640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b93f4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1a580e37e0 tx=0x7f1a580d6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1948ff9640 1 -- 172.21.15.169:0/485737529 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a58111070 con 0x557f5b938330 2024-09-13T06:29:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1948ff9640 1 -- 172.21.15.169:0/485737529 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580cfba0 con 0x557f5b938330 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f5b93fa10 con 0x557f5b938330 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1948ff9640 1 -- 172.21.15.169:0/485737529 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a58109040 con 0x557f5b938330 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5b93fa10 con 0x557f5b938330 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1948ff9640 1 -- 172.21.15.169:0/485737529 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1a58114070 con 0x557f5b938330 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1948ff9640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f19300346a0 0x7f1930036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1948ff9640 1 -- 172.21.15.169:0/485737529 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1a58117b00 con 0x557f5b938330 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a66300640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f19300346a0 0x7f1930036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b94a380 0x557f5b94c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b94cf70 con 0x557f5b94a380 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a67302640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b94a380 0x557f5b94c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a66300640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f19300346a0 0x7f1930036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x557f5b91a430 tx=0x7f1a5c011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a67302640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b94a380 0x557f5b94c820 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 realm 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b949870 con 0x557f5b94a380 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b94da30 con 0x557f5b94a380 2024-09-13T06:29:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b94e810 0x557f5b950c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b951260 con 0x557f5b94e810 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a66b01640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b94e810 0x557f5b950c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.273+0000 7f1a66b01640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b94e810 0x557f5b950c00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b951b00 con 0x557f5b94e810 2024-09-13T06:29:22.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 20 searching for the correct realm 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b953870 0x557f5b955c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66300640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b953870 0x557f5b955c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66300640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b953870 0x557f5b955c60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66b01640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1a58116070 0x7f1a5810d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x7f1a58116070 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1a58116070 0x7f1a5810d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1a58116070 0x7f1a5810d790 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.277+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x7f1a58116070 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x7f1a58116070 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.281+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x7f1a58116070 2024-09-13T06:29:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94a380 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x7f1a58116070 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x7f1a58116070 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b953870 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.285+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9562e0 con 0x557f5b94e810 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:22.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b952480 con 0x557f5b94a380 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9528a0 con 0x557f5b94e810 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b952cc0 con 0x557f5b953870 2024-09-13T06:29:22.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 zone default found 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 4 Realm: () 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 zonegroup default 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9520d0 con 0x7f1a58116070 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b958b40 con 0x557f5b953870 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b958ee0 con 0x557f5b953870 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 started sync module instance, tier type = 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.289+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b957fd0 con 0x557f5b94e810 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94005485733120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b957fd0 con 0x557f5b94e810 2024-09-13T06:29:22.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b959970 con 0x557f5b94a380 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94005485737056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95a210 con 0x557f5b94a380 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95ac30 con 0x557f5b94e810 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94005485737056] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.293+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94005485733120] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94005485730592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b959d60 con 0x557f5b94e810 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95b4d0 con 0x7f1a58116070 2024-09-13T06:29:22.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94005485744160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95b8f0 con 0x7f1a58116070 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95c330 con 0x557f5b94e810 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94005485730592] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94005485744160] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94005485747712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95b440 con 0x557f5b94e810 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.297+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95cbd0 con 0x557f5b953870 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94005485750048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95b440 con 0x557f5b953870 2024-09-13T06:29:22.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95da40 con 0x557f5b953870 2024-09-13T06:29:22.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94005485747712] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94005485750048] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94005485752176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95d590 con 0x557f5b953870 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95df50 con 0x7f1a58116070 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94005485755040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95e3d0 con 0x7f1a58116070 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=0 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=1 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=2 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=3 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=4 2024-09-13T06:29:22.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=5 2024-09-13T06:29:22.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94005485752176] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.301+0000 7f1a68ff1980 20 add_watcher() i=6 2024-09-13T06:29:22.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94005485755040] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 20 add_watcher() i=7 2024-09-13T06:29:22.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:22.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95a720 con 0x557f5b94a380 2024-09-13T06:29:22.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94005485741856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b95e920 con 0x557f5b94a380 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94005485741856] v31'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f191d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 5 note: GC not initialized 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1897fff640 20 reqs_thread_entry: start 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 20 Filter name: none 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1895ffb640 20 reqs_thread_entry: start 2024-09-13T06:29:22.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.305+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b984b20 con 0x7f1a58116070 2024-09-13T06:29:22.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:22.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9853b0 con 0x557f5b953870 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b983ec0 con 0x7f1a58116070 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9869c0 con 0x557f5b953870 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(65 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:22.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 4.8 4:11cfe723:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b988370 con 0x557f5b953870 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 4.32 4:4cfee7b6:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b98af10 con 0x557f5b94e810 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 4.1c 4:3a3f0fce:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b98d8d0 con 0x7f1a58116070 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 4.6 4:6172e498:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9903b0 con 0x557f5b953870 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 4.9 4:9013e599:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b992cc0 con 0x557f5b94a380 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 4.23 4:c56c80ea:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b995530 con 0x557f5b953870 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b998010 con 0x557f5b953870 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 4.25 4:a7766a67:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b998010 con 0x557f5b94e810 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(66 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(68 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 4.2 4:4033a47e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b98c8c0 con 0x557f5b94a380 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(69 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(72 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 4.7 4:e3e717b4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b987e00 con 0x557f5b94a380 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(71 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 4.13 4:cad017c4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557f5b997c70 con 0x7f1a58116070 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(67 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(75 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(74 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(76 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(73 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f191d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.309+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94005485741856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b94a380 2024-09-13T06:29:22.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.313+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94005485741856] v31'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.313+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94005485733120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b94e810 2024-09-13T06:29:22.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.313+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94005485733120] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.313+0000 7f1a68ff1980 20 remove_watcher() i=0 2024-09-13T06:29:22.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.313+0000 7f1a68ff1980 2 removed watcher, disabling cache 2024-09-13T06:29:22.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.313+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94005485737056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b94a380 2024-09-13T06:29:22.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.317+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94005485737056] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x557f5b94a380 2024-09-13T06:29:22.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.317+0000 7f1a68ff1980 20 remove_watcher() i=1 2024-09-13T06:29:22.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.317+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94005485730592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b94e810 2024-09-13T06:29:22.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.317+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94005485730592] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.317+0000 7f1a68ff1980 20 remove_watcher() i=2 2024-09-13T06:29:22.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.317+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94005485744160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x7f1a58116070 2024-09-13T06:29:22.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.321+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94005485744160] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.321+0000 7f1a68ff1980 20 remove_watcher() i=3 2024-09-13T06:29:22.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.321+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94005485747712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b94e810 2024-09-13T06:29:22.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.321+0000 7f1a66b01640 1 -- 172.21.15.169:0/485737529 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94005485747712] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5811d070 con 0x557f5b94e810 2024-09-13T06:29:22.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.321+0000 7f1a68ff1980 20 remove_watcher() i=4 2024-09-13T06:29:22.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.321+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94005485750048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b953870 2024-09-13T06:29:22.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94005485750048] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 20 remove_watcher() i=5 2024-09-13T06:29:22.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94005485752176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x557f5b953870 2024-09-13T06:29:22.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a66300640 1 -- 172.21.15.169:0/485737529 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94005485752176] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c036040 con 0x557f5b953870 2024-09-13T06:29:22.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 20 remove_watcher() i=6 2024-09-13T06:29:22.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94005485755040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557f5b9752d0 con 0x7f1a58116070 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94005485755040] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a6000a4d0 con 0x7f1a58116070 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 20 remove_watcher() i=7 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b94e810 msgr2=0x557f5b950c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b94e810 0x557f5b950c00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b94a380 msgr2=0x557f5b94c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b94a380 0x557f5b94c820 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1a58116070 msgr2=0x7f1a5810d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1a58116070 0x7f1a5810d790 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b953870 msgr2=0x557f5b955c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b953870 0x557f5b955c60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f19300346a0 msgr2=0x7f1930036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f19300346a0 0x7f1930036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x557f5b91a430 tx=0x7f1a5c011000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 msgr2=0x557f5b93f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a67302640 1 -- 172.21.15.169:0/485737529 reap_dead start 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b93f4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1a580e37e0 tx=0x7f1a580d6000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 shutdown_connections 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/485737529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b938330 0x557f5b93f4d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 >> 172.21.15.169:0/485737529 conn(0x557f5b934710 msgr2=0x557f5b9327e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 shutdown_connections 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/485737529 wait complete. 2024-09-13T06:29:22.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1940034650 msgr2=0x7f1940036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1940034650 0x7f1940036b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x557f5b9123d0 tx=0x7f1a5c006000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 msgr2=0x557f5b92bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 0x557f5b92bfa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1a580c1040 tx=0x7f1a580c6500 comp rx=0 tx=0).stop 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 shutdown_connections 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1940034650 0x7f1940036b10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/803842039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b92bb80 0x557f5b92bfa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 >> 172.21.15.169:0/803842039 conn(0x557f5b920cd0 msgr2=0x557f5b923750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 shutdown_connections 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/803842039 wait complete. 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b916200 msgr2=0x557f5b9185f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557f5b916200 0x557f5b9185f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b7907c0 msgr2=0x557f5b914dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557f5b7907c0 0x557f5b914dd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b91b890 msgr2=0x557f5b91dc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557f5b91b890 0x557f5b91dc80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f194c034650 msgr2=0x7f194c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f194c034650 0x7f194c036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c001e20 tx=0x7f1a5c0013a0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 msgr2=0x557f5b90dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 --2- 172.21.15.169:0/2074446710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f5b7903b0 0x557f5b90dde0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800a5c0 tx=0x7f1a580180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a67302640 1 -- 172.21.15.169:0/2074446710 reap_dead start 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 shutdown_connections 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 >> 172.21.15.169:0/2074446710 conn(0x557f5b8151b0 msgr2=0x557f5b901340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 shutdown_connections 2024-09-13T06:29:22.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.325+0000 7f1a68ff1980 1 -- 172.21.15.169:0/2074446710 wait complete. 2024-09-13T06:29:22.338 INFO:teuthology.orchestra.run.smithi169.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7fd9ecda-6337-4ce7-ac46-f04193654c7b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","marker":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:29:21.666248Z","creation_time":"2024-09-13T06:29:21.659221Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T06:29:22.338 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:29:21.666248Z', 'creation_time': '2024-09-13T06:29:21.659221Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:29:22.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:29:22.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:29:22.339 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T06:29:22.409 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:22.410 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79ba0d5980 1 Processor -- start 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79ba0d5980 1 -- start start 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79ba0d5980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55fa3f3ae8e0 0x55fa3f3aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79ba0d5980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa3f234ae0 con 0x55fa3f3af230 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79ba0d5980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55fa3f258e30 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79b7be5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55fa3f3ae8e0 0x55fa3f3aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79b7be5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55fa3f3ae8e0 0x55fa3f3aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36590/0 (socket says 172.21.15.169:36590) 2024-09-13T06:29:22.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79b7be5640 1 -- 172.21.15.169:0/1548587381 learned_addr learned my addr 172.21.15.169:0/1548587381 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79af3e4640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55fa3f3af230 0x55fa3f3b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45220/0 (socket says 172.21.15.169:45220) 2024-09-13T06:29:22.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79b7be5640 1 -- 172.21.15.169:0/1548587381 >> v1:172.21.15.112:6789/0 conn(0x55fa3f3af230 legacy=0x55fa3f3b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.409+0000 7f79b7be5640 1 -- 172.21.15.169:0/1548587381 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3f3b64b0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79b7be5640 1 --2- 172.21.15.169:0/1548587381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f3aecc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79a800a5c0 tx=0x7f79a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f004b875cbdf62f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79b73e4640 1 -- 172.21.15.169:0/1548587381 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80a6070 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79b73e4640 1 -- 172.21.15.169:0/1548587381 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80af070 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79b73e4640 1 -- 172.21.15.169:0/1548587381 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80aa5c0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1548587381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 msgr2=0x55fa3f3aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/1548587381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f3aecc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79a800a5c0 tx=0x7f79a801b340 comp rx=0 tx=0).stop 2024-09-13T06:29:22.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1548587381 shutdown_connections 2024-09-13T06:29:22.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/1548587381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f3aecc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1548587381 >> 172.21.15.169:0/1548587381 conn(0x55fa3f322230 msgr2=0x55fa3f322640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1548587381 shutdown_connections 2024-09-13T06:29:22.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.413+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1548587381 wait complete. 2024-09-13T06:29:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79ba0d5980 1 Processor -- start 2024-09-13T06:29:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79ba0d5980 1 -- start start 2024-09-13T06:29:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79ba0d5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f499bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79ba0d5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa3f25a200 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f499bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f499bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36594/0 (socket says 172.21.15.169:36594) 2024-09-13T06:29:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79b7be5640 1 -- 172.21.15.169:0/980234025 learned_addr learned my addr 172.21.15.169:0/980234025 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79b7be5640 1 -- 172.21.15.169:0/980234025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3f49a1a0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f79b7be5640 1 --2- 172.21.15.169:0/980234025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f499bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f79a800a5c0 tx=0x7f79a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499c401c3bfa2e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f78a5e0b640 1 -- 172.21.15.169:0/980234025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80aa9b0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f78a5e0b640 1 -- 172.21.15.169:0/980234025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80aab50 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.425+0000 7f78a5e0b640 1 -- 172.21.15.169:0/980234025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80aae50 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/980234025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 msgr2=0x55fa3f499bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/980234025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f499bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f79a800a5c0 tx=0x7f79a8003030 comp rx=0 tx=0).stop 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/980234025 shutdown_connections 2024-09-13T06:29:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/980234025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f499bd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/980234025 >> 172.21.15.169:0/980234025 conn(0x55fa3f322230 msgr2=0x55fa3f495800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/980234025 shutdown_connections 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/980234025 wait complete. 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 Processor -- start 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- start start 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f4a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa3f3b5ef0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f4a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f4a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36596/0 (socket says 172.21.15.169:36596) 2024-09-13T06:29:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79b7be5640 1 -- 172.21.15.169:0/3143465233 learned_addr learned my addr 172.21.15.169:0/3143465233 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79b7be5640 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3f4a1380 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79b7be5640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f4a0e40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79a801bbe0 tx=0x7f79a80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f789ffff640 1 -- 172.21.15.169:0/3143465233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80c6750 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa3f4a1610 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f789ffff640 1 -- 172.21.15.169:0/3143465233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80c68f0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f789ffff640 1 -- 172.21.15.169:0/3143465233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80c6c10 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3f4a42f0 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f789ffff640 1 -- 172.21.15.169:0/3143465233 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79a80ce020 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f789ffff640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f78a0034650 0x7f78a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f789ffff640 1 -- 172.21.15.169:0/3143465233 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f79a80cc020 con 0x55fa3f3ae8e0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79af3e4640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f78a0034650 0x7f78a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f3af230 0x55fa3f4a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4a8480 con 0x55fa3f3af230 2024-09-13T06:29:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.429+0000 7f79b83e6640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f3af230 0x55fa3f4a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79af3e4640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f78a0034650 0x7f78a0036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000f70 tx=0x7f79a0001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b83e6640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f3af230 0x55fa3f4a7f40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b83e6640 1 -- 172.21.15.169:0/3143465233 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f3af230 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4a9280 0x55fa3f4ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4abca0 con 0x55fa3f4a9280 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b7be5640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4a9280 0x55fa3f4ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b7be5640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4a9280 0x55fa3f4ab670 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b7be5640 1 -- 172.21.15.169:0/3143465233 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79a80c5d00 con 0x55fa3f4a9280 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ad550 con 0x55fa3f4a9280 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b7be5640 1 -- 172.21.15.169:0/3143465233 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79a80c5d00 con 0x55fa3f4a9280 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ac6c0 con 0x55fa3f4a9280 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79b7be5640 1 -- 172.21.15.169:0/3143465233 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79a80c5d00 con 0x55fa3f4a9280 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.433+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4ae900 0x55fa3f4b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4b1230 con 0x55fa3f4ae900 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79af3e4640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4ae900 0x55fa3f4b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79af3e4640 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4ae900 0x55fa3f4b0cf0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79af3e4640 1 -- 172.21.15.169:0/3143465233 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79a000f6a0 con 0x55fa3f4ae900 2024-09-13T06:29:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 Processor -- start 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 -- start start 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 0x55fa3f4bf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa3f2b3800 con 0x55fa3f4bec10 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 0x55fa3f4bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 0x55fa3f4bf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36598/0 (socket says 172.21.15.169:36598) 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79b7be5640 1 -- 172.21.15.169:0/1457367342 learned_addr learned my addr 172.21.15.169:0/1457367342 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79b7be5640 1 -- 172.21.15.169:0/1457367342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3f4bf570 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79b7be5640 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 0x55fa3f4bf030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79a8000c10 tx=0x7f79a80bc8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f789d7fa640 1 -- 172.21.15.169:0/1457367342 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80c5560 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa3f4bf800 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3f4c2480 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f789d7fa640 1 -- 172.21.15.169:0/1457367342 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80e3470 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f789d7fa640 1 -- 172.21.15.169:0/1457367342 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80bccd0 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.437+0000 7f789d7fa640 1 -- 172.21.15.169:0/1457367342 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79a80ee060 con 0x55fa3f4bec10 2024-09-13T06:29:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f789d7fa640 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7890034650 0x7f7890036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f789d7fa640 1 -- 172.21.15.169:0/1457367342 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f79a80f1ab0 con 0x55fa3f4bec10 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79af3e4640 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7890034650 0x7f7890036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 Processor -- start 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- start start 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79af3e4640 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7890034650 0x7f7890036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55fa3f4a5430 tx=0x7f79a000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa3f49a460 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36604/0 (socket says 172.21.15.169:36604) 2024-09-13T06:29:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 -- 172.21.15.169:0/2642269410 learned_addr learned my addr 172.21.15.169:0/2642269410 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 -- 172.21.15.169:0/2642269410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3f4cbf70 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 --2- 172.21.15.169:0/2642269410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4cb9a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f79a80c5720 tx=0x7f79a80cf370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52007e3ff4f5f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f7896ffd640 1 -- 172.21.15.169:0/2642269410 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80fe020 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f7896ffd640 1 -- 172.21.15.169:0/2642269410 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80b7eb0 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f7896ffd640 1 -- 172.21.15.169:0/2642269410 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80e7d80 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2642269410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 msgr2=0x55fa3f4cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2642269410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4cb9a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f79a80c5720 tx=0x7f79a80cf370 comp rx=0 tx=0).stop 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2642269410 shutdown_connections 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2642269410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4cb9a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2642269410 >> 172.21.15.169:0/2642269410 conn(0x55fa3f4c7980 msgr2=0x55fa3f4c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2642269410 shutdown_connections 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2642269410 wait complete. 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 Processor -- start 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- start start 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79ba0d5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa3f4cbf70 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4d25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36616/0 (socket says 172.21.15.169:36616) 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.441+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 learned_addr learned my addr 172.21.15.169:0/2771662311 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3f4d2b20 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b7be5640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4d25e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f79a80cf3b0 tx=0x7f79a80f9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f78957fa640 1 -- 172.21.15.169:0/2771662311 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a8112070 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa3f4d2b20 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f78957fa640 1 -- 172.21.15.169:0/2771662311 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a80e7460 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3f4d2b20 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f78957fa640 1 -- 172.21.15.169:0/2771662311 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a80e7610 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f78957fa640 1 -- 172.21.15.169:0/2771662311 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79a8115070 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f78957fa640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7880034650 0x7f7880036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f78957fa640 1 -- 172.21.15.169:0/2771662311 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f79a810a050 con 0x55fa3f4cb5a0 2024-09-13T06:29:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79af3e4640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7880034650 0x7f7880036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f4dd4d0 0x55fa3f4df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e00c0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b83e6640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f4dd4d0 0x55fa3f4df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79af3e4640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7880034650 0x7f7880036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79a000ffd0 tx=0x7f79a0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b83e6640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f4dd4d0 0x55fa3f4df970 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 realm 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4dc9c0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e0b90 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4e1740 0x55fa3f4e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e4370 con 0x55fa3f4e1740 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.445+0000 7f79b7be5640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4e1740 0x55fa3f4e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b7be5640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4e1740 0x55fa3f4e3c00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e4c10 con 0x55fa3f4e1740 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 20 searching for the correct realm 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4e6980 0x55fa3f4e8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79af3e4640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4e6980 0x55fa3f4e8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79af3e4640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4e6980 0x55fa3f4e8d70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b7be5640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f79a8117060 0x7f79a80f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x7f79a8117060 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b83e6640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f79a8117060 0x7f79a80f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b83e6640 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f79a8117060 0x7f79a80f51d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.449+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x7f79a8117060 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x7f79a8117060 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.453+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x7f79a8117060 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x7f79a8117060 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x7f79a8117060 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.457+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e6980 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9380 con 0x55fa3f4e1740 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e5560 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e59b0 con 0x55fa3f4e1740 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e5dd0 con 0x55fa3f4e6980 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 zone default found 2024-09-13T06:29:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 4 Realm: () 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 zonegroup default 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4e9800 con 0x7f79a8117060 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4eba30 con 0x55fa3f4e6980 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.461+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ebdd0 con 0x55fa3f4e6980 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 20 started sync module instance, tier type = 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4eae70 con 0x55fa3f4e1740 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94533292307360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4eae70 con 0x55fa3f4e1740 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4eae70 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94533292312320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ecfd0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ed990 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.465+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94533292307360] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94533292312320] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94533292315872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ecfd0 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ed900 con 0x7f79a8117060 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94533292316928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ee230 con 0x7f79a8117060 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4eec80 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94533292315872] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94533292316928] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.469+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94533292320624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4edd30 con 0x55fa3f4e1740 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ef520 con 0x55fa3f4e6980 2024-09-13T06:29:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94533292322928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4edd30 con 0x55fa3f4e6980 2024-09-13T06:29:22.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f0390 con 0x55fa3f4e6980 2024-09-13T06:29:22.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94533292320624] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94533292322928] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94533292313376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f0390 con 0x55fa3f4e6980 2024-09-13T06:29:22.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f0be0 con 0x7f79a8117060 2024-09-13T06:29:22.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94533292313376] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94533292327104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f0a90 con 0x7f79a8117060 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=0 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=1 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=2 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=3 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=4 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=5 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.473+0000 7f79ba0d5980 20 add_watcher() i=6 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94533292327104] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 20 add_watcher() i=7 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f4030 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94533292328224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f14e0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94533292328224] v31'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f786dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:22.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 5 note: GC not initialized 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f786cfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.477+0000 7f79ba0d5980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 Filter name: none 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f77e67fc640 20 reqs_thread_entry: start 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f517250 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f517c40 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f518c50 con 0x7f79a8117060 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f516500 con 0x7f79a8117060 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f518c30 con 0x55fa3f4e6980 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(66 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:22.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 4.8 4:11cfe723:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f518640 con 0x55fa3f4e6980 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 4.32 4:4cfee7b6:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f51d580 con 0x55fa3f4e1740 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 4.1c 4:3a3f0fce:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f51fe70 con 0x7f79a8117060 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 4.6 4:6172e498:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f51d580 con 0x55fa3f4e6980 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:71 4.9 4:9013e599:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f524fa0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 4.23 4:c56c80ea:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f527810 con 0x55fa3f4e6980 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f52a080 con 0x55fa3f4e6980 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 4.25 4:a7766a67:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f52c9f0 con 0x55fa3f4e1740 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 4.2 4:4033a47e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f52f450 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(70 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(73 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(72 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(69 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(71 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 4.7 4:e3e717b4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f52c9f0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(75 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 4.13 4:cad017c4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f524b80 con 0x7f79a8117060 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(68 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(77 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(76 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(74 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.481+0000 7f786dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94533292328224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f3d00 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94533292328224] v31'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94533292307360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f3d00 con 0x55fa3f4e1740 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94533292307360] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79ba0d5980 20 remove_watcher() i=0 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79ba0d5980 2 removed watcher, disabling cache 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.485+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94533292312320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f3d00 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94533292312320] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x55fa3f4dd4d0 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79ba0d5980 20 remove_watcher() i=1 2024-09-13T06:29:22.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94533292315872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ec700 con 0x55fa3f4e1740 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94533292315872] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79ba0d5980 20 remove_watcher() i=2 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94533292316928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f3d00 con 0x7f79a8117060 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94533292316928] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79ba0d5980 20 remove_watcher() i=3 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.489+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94533292320624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ec700 con 0x55fa3f4e1740 2024-09-13T06:29:22.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79b7be5640 1 -- 172.21.15.169:0/2771662311 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94533292320624] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a8114030 con 0x55fa3f4e1740 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79ba0d5980 20 remove_watcher() i=4 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94533292322928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4f3d00 con 0x55fa3f4e6980 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94533292322928] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79ba0d5980 20 remove_watcher() i=5 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94533292313376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ee770 con 0x55fa3f4e6980 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79af3e4640 1 -- 172.21.15.169:0/2771662311 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94533292313376] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79a0037040 con 0x55fa3f4e6980 2024-09-13T06:29:22.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79ba0d5980 20 remove_watcher() i=6 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.493+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94533292327104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fa3f4ef070 con 0x7f79a8117060 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94533292327104] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b000a4d0 con 0x7f79a8117060 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 20 remove_watcher() i=7 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4e1740 msgr2=0x55fa3f4e3c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4e1740 0x55fa3f4e3c00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f4dd4d0 msgr2=0x55fa3f4df970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f4dd4d0 0x55fa3f4df970 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f79a8117060 msgr2=0x7f79a80f51d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f79a8117060 0x7f79a80f51d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4e6980 msgr2=0x55fa3f4e8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4e6980 0x55fa3f4e8d70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7880034650 msgr2=0x7f7880036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7880034650 0x7f7880036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79a000ffd0 tx=0x7f79a0010000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79b83e6640 1 -- 172.21.15.169:0/2771662311 reap_dead start 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 msgr2=0x55fa3f4d25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4d25e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f79a80cf3b0 tx=0x7f79a80f9000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 shutdown_connections 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/2771662311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4cb5a0 0x55fa3f4d25e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 >> 172.21.15.169:0/2771662311 conn(0x55fa3f4c7980 msgr2=0x55fa3f4c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 shutdown_connections 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/2771662311 wait complete. 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7890034650 msgr2=0x7f7890036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7890034650 0x7f7890036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55fa3f4a5430 tx=0x7f79a000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 msgr2=0x55fa3f4bf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 0x55fa3f4bf030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79a8000c10 tx=0x7f79a80bc8a0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 shutdown_connections 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7890034650 0x7f7890036b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/1457367342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f4bec10 0x55fa3f4bf030 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 >> 172.21.15.169:0/1457367342 conn(0x55fa3f4b3d60 msgr2=0x55fa3f4b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 shutdown_connections 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/1457367342 wait complete. 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4a9280 msgr2=0x55fa3f4ab670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fa3f4a9280 0x55fa3f4ab670 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f3af230 msgr2=0x55fa3f4a7f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fa3f3af230 0x55fa3f4a7f40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4ae900 msgr2=0x55fa3f4b0cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fa3f4ae900 0x55fa3f4b0cf0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f78a0034650 msgr2=0x7f78a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f78a0034650 0x7f78a0036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000f70 tx=0x7f79a0001380 comp rx=0 tx=0).stop 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 msgr2=0x55fa3f4a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 --2- 172.21.15.169:0/3143465233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa3f3ae8e0 0x55fa3f4a0e40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79a801bbe0 tx=0x7f79a80180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79b83e6640 1 -- 172.21.15.169:0/3143465233 reap_dead start 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 shutdown_connections 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 >> 172.21.15.169:0/3143465233 conn(0x55fa3f322230 msgr2=0x55fa3f494380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 shutdown_connections 2024-09-13T06:29:22.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.497+0000 7f79ba0d5980 1 -- 172.21.15.169:0/3143465233 wait complete. 2024-09-13T06:29:22.518 INFO:teuthology.orchestra.run.smithi169.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7fd9ecda-6337-4ce7-ac46-f04193654c7b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","marker":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:29:21.666248Z","creation_time":"2024-09-13T06:29:21.659221Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T06:29:22.518 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:29:21.666248Z', 'creation_time': '2024-09-13T06:29:21.659221Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T06:29:22.527 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:29:22.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:29:22.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:29:22.527 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T06:29:22.589 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:22.590 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:22.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7eea7ae980 1 Processor -- start 2024-09-13T06:29:22.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7eea7ae980 1 -- start start 2024-09-13T06:29:22.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7eea7ae980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5629ed585290 0x5629ed6133a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7eea7ae980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5629ed498ae0 con 0x5629ed6138e0 2024-09-13T06:29:22.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7eea7ae980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5629ed4bce30 con 0x5629ed585290 2024-09-13T06:29:22.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7ee82be640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5629ed585290 0x5629ed6133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7ee82be640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5629ed585290 0x5629ed6133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36618/0 (socket says 172.21.15.169:36618) 2024-09-13T06:29:22.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7ee82be640 1 -- 172.21.15.169:0/2782028213 learned_addr learned my addr 172.21.15.169:0/2782028213 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7ee82be640 1 -- 172.21.15.169:0/2782028213 >> v1:172.21.15.112:6789/0 conn(0x5629ed6138e0 legacy=0x5629ed615cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.589+0000 7f7ee82be640 1 -- 172.21.15.169:0/2782028213 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed585820 con 0x5629ed585290 2024-09-13T06:29:22.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7ee82be640 1 --2- 172.21.15.169:0/2782028213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6133a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a4e0 tx=0x7f7ee001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1747c6f075c1c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7ee72bc640 1 -- 172.21.15.169:0/2782028213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00aa540 con 0x5629ed585290 2024-09-13T06:29:22.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7ee72bc640 1 -- 172.21.15.169:0/2782028213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee00aa6e0 con 0x5629ed585290 2024-09-13T06:29:22.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7ee72bc640 1 -- 172.21.15.169:0/2782028213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00aaa40 con 0x5629ed585290 2024-09-13T06:29:22.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 -- 172.21.15.169:0/2782028213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 msgr2=0x5629ed6133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/2782028213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6133a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a4e0 tx=0x7f7ee001b090 comp rx=0 tx=0).stop 2024-09-13T06:29:22.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 -- 172.21.15.169:0/2782028213 shutdown_connections 2024-09-13T06:29:22.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/2782028213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6133a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 -- 172.21.15.169:0/2782028213 >> 172.21.15.169:0/2782028213 conn(0x5629ed60b090 msgr2=0x5629ed60d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 -- 172.21.15.169:0/2782028213 shutdown_connections 2024-09-13T06:29:22.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.593+0000 7f7eea7ae980 1 -- 172.21.15.169:0/2782028213 wait complete. 2024-09-13T06:29:22.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7eea7ae980 1 Processor -- start 2024-09-13T06:29:22.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7eea7ae980 1 -- start start 2024-09-13T06:29:22.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7eea7ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7eea7ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629ed4be200 con 0x5629ed585290 2024-09-13T06:29:22.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6fba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36620/0 (socket says 172.21.15.169:36620) 2024-09-13T06:29:22.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7ee82be640 1 -- 172.21.15.169:0/466253579 learned_addr learned my addr 172.21.15.169:0/466253579 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7ee82be640 1 -- 172.21.15.169:0/466253579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed6fbfd0 con 0x5629ed585290 2024-09-13T06:29:22.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7ee82be640 1 --2- 172.21.15.169:0/466253579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6fba00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0017ca0 tx=0x7f7ee00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0fd9f7251f046e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7dd660c640 1 -- 172.21.15.169:0/466253579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00b9030 con 0x5629ed585290 2024-09-13T06:29:22.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7dd660c640 1 -- 172.21.15.169:0/466253579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee00aaac0 con 0x5629ed585290 2024-09-13T06:29:22.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.605+0000 7f7dd660c640 1 -- 172.21.15.169:0/466253579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00aada0 con 0x5629ed585290 2024-09-13T06:29:22.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/466253579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 msgr2=0x5629ed6fba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/466253579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6fba00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0017ca0 tx=0x7f7ee00033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/466253579 shutdown_connections 2024-09-13T06:29:22.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/466253579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed6fba00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/466253579 >> 172.21.15.169:0/466253579 conn(0x5629ed60b090 msgr2=0x5629ed6f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/466253579 shutdown_connections 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/466253579 wait complete. 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 Processor -- start 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- start start 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed702c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629ed617f00 con 0x5629ed585290 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed702c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed702c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36634/0 (socket says 172.21.15.169:36634) 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee82be640 1 -- 172.21.15.169:0/3054712728 learned_addr learned my addr 172.21.15.169:0/3054712728 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee82be640 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed703150 con 0x5629ed585290 2024-09-13T06:29:22.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee82be640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed702c10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0005cc0 tx=0x7f7ee0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7dd4e09640 1 -- 172.21.15.169:0/3054712728 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00b9030 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629ed7033e0 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7dd4e09640 1 -- 172.21.15.169:0/3054712728 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee00c3070 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7dd4e09640 1 -- 172.21.15.169:0/3054712728 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00bf750 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ed7060c0 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7dd4e09640 1 -- 172.21.15.169:0/3054712728 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ee00c5030 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7dd4e09640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dd0034650 0x7f7dd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7dd4e09640 1 -- 172.21.15.169:0/3054712728 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7ee00ba070 con 0x5629ed585290 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dd0034650 0x7f7dd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed6138e0 0x5629ed709d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed70a250 con 0x5629ed6138e0 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.609+0000 7f7ee8abf640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed6138e0 0x5629ed709d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dd0034650 0x7f7dd0036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7edc001e20 tx=0x7f7edc0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee8abf640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed6138e0 0x5629ed709d10 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee8abf640 1 -- 172.21.15.169:0/3054712728 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed6138e0 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed70b050 0x5629ed70d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed70da80 con 0x5629ed70b050 2024-09-13T06:29:22.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee82be640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed70b050 0x5629ed70d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee82be640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed70b050 0x5629ed70d440 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee82be640 1 -- 172.21.15.169:0/3054712728 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ee00ce070 con 0x5629ed70b050 2024-09-13T06:29:22.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed70f330 con 0x5629ed70b050 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee82be640 1 -- 172.21.15.169:0/3054712728 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ee00ce070 con 0x5629ed70b050 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed70e560 con 0x5629ed70b050 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee82be640 1 -- 172.21.15.169:0/3054712728 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ee00ce070 con 0x5629ed70b050 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed7106e0 0x5629ed712ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed713010 con 0x5629ed7106e0 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed7106e0 0x5629ed712ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.613+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed7106e0 0x5629ed712ad0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee7abd640 1 -- 172.21.15.169:0/3054712728 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7edc00d040 con 0x5629ed7106e0 2024-09-13T06:29:22.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 Processor -- start 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 -- start start 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 0x5629ed720ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629ed517800 con 0x5629ed720aa0 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 0x5629ed720ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 0x5629ed720ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36648/0 (socket says 172.21.15.169:36648) 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee82be640 1 -- 172.21.15.169:0/1703238222 learned_addr learned my addr 172.21.15.169:0/1703238222 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee82be640 1 -- 172.21.15.169:0/1703238222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed721400 con 0x5629ed720aa0 2024-09-13T06:29:22.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee82be640 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 0x5629ed720ec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00e35a0 tx=0x7f7ee00c6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7dcdffb640 1 -- 172.21.15.169:0/1703238222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00bfd00 con 0x5629ed720aa0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629ed721690 con 0x5629ed720aa0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ed724310 con 0x5629ed720aa0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7dcdffb640 1 -- 172.21.15.169:0/1703238222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee00b43a0 con 0x5629ed720aa0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7dcdffb640 1 -- 172.21.15.169:0/1703238222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00b4680 con 0x5629ed720aa0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7dcdffb640 1 -- 172.21.15.169:0/1703238222 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ee00b3040 con 0x5629ed720aa0 2024-09-13T06:29:22.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7dcdffb640 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dc0034650 0x7f7dc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7dcdffb640 1 -- 172.21.15.169:0/1703238222 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7ee00ebaa0 con 0x5629ed720aa0 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dc0034650 0x7f7dc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 Processor -- start 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.617+0000 7f7eea7ae980 1 -- start start 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dc0034650 0x7f7dc0036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5629ed713410 tx=0x7f7edc006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed60f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629ed6fc290 con 0x5629ed60f360 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed60f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed60f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36662/0 (socket says 172.21.15.169:36662) 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 -- 172.21.15.169:0/707199387 learned_addr learned my addr 172.21.15.169:0/707199387 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 -- 172.21.15.169:0/707199387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed60fd30 con 0x5629ed60f360 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 --2- 172.21.15.169:0/707199387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed60f760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0000f70 tx=0x7f7ee00bc830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fc3de1d895f990 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7dc77fe640 1 -- 172.21.15.169:0/707199387 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00d0e30 con 0x5629ed60f360 2024-09-13T06:29:22.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7dc77fe640 1 -- 172.21.15.169:0/707199387 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee00fa030 con 0x5629ed60f360 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7dc77fe640 1 -- 172.21.15.169:0/707199387 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00e3750 con 0x5629ed60f360 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- 172.21.15.169:0/707199387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 msgr2=0x5629ed60f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/707199387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed60f760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0000f70 tx=0x7f7ee00bc830 comp rx=0 tx=0).stop 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- 172.21.15.169:0/707199387 shutdown_connections 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/707199387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed60f760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- 172.21.15.169:0/707199387 >> 172.21.15.169:0/707199387 conn(0x5629ed729740 msgr2=0x5629ed727840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- 172.21.15.169:0/707199387 shutdown_connections 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- 172.21.15.169:0/707199387 wait complete. 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 Processor -- start 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- start start 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed736700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629ed610360 con 0x5629ed60f360 2024-09-13T06:29:22.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed736700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed736700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36672/0 (socket says 172.21.15.169:36672) 2024-09-13T06:29:22.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 learned_addr learned my addr 172.21.15.169:0/4015401645 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed736c40 con 0x5629ed60f360 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7ee82be640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed736700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00ebff0 tx=0x7f7ee0009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7dc5ffb640 1 -- 172.21.15.169:0/4015401645 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee010f070 con 0x5629ed60f360 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629ed736c40 con 0x5629ed60f360 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.621+0000 7f7dc5ffb640 1 -- 172.21.15.169:0/4015401645 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee00e3750 con 0x5629ed60f360 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7dc5ffb640 1 -- 172.21.15.169:0/4015401645 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee00d0510 con 0x5629ed60f360 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ed737110 con 0x5629ed60f360 2024-09-13T06:29:22.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7dc5ffb640 1 -- 172.21.15.169:0/4015401645 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ee0112070 con 0x5629ed60f360 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7dc5ffb640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7db8034600 0x7f7db8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7dc5ffb640 1 -- 172.21.15.169:0/4015401645 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7ee0107070 con 0x5629ed60f360 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7db8034600 0x7f7db8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed741850 0x5629ed743cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed744440 con 0x5629ed741850 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee8abf640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed741850 0x5629ed743cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7db8034600 0x7f7db8036ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0207d0 tx=0x7f7edc011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee8abf640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed741850 0x5629ed743cf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 realm 2024-09-13T06:29:22.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed740d40 con 0x5629ed741850 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed744ed0 con 0x5629ed741850 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed745cb0 0x5629ed7480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7486d0 con 0x5629ed745cb0 2024-09-13T06:29:22.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee82be640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed745cb0 0x5629ed7480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.625+0000 7f7ee82be640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed745cb0 0x5629ed7480a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed748f70 con 0x5629ed745cb0 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 20 searching for the correct realm 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed74ace0 0x5629ed74d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed74ace0 0x5629ed74d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee7abd640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed74ace0 0x5629ed74d0d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee82be640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7ee0114060 0x7f7ee00e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x7f7ee0114060 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7ee0114060 0x7f7ee00e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7ee0114060 0x7f7ee00e93a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.629+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x7f7ee0114060 2024-09-13T06:29:22.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x7f7ee0114060 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.633+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x7f7ee0114060 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed741850 2024-09-13T06:29:22.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x7f7ee0114060 2024-09-13T06:29:22.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x7f7ee0114060 2024-09-13T06:29:22.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed74ace0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.637+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74d750 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:22.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed749920 con 0x5629ed741850 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed749d40 con 0x5629ed745cb0 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed749d40 con 0x5629ed74ace0 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 zone default found 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 4 Realm: () 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 zonegroup default 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74dc00 con 0x7f7ee0114060 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74a430 con 0x5629ed74ace0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74ff60 con 0x5629ed74ace0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 started sync module instance, tier type = 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.641+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74f2c0 con 0x5629ed745cb0 2024-09-13T06:29:22.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94738077513696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed74f2c0 con 0x5629ed745cb0 2024-09-13T06:29:22.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed750ac0 con 0x5629ed741850 2024-09-13T06:29:22.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94738077517200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed751360 con 0x5629ed741850 2024-09-13T06:29:22.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed751d80 con 0x5629ed745cb0 2024-09-13T06:29:22.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94738077513696] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.645+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94738077517200] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94738077522032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed750eb0 con 0x5629ed745cb0 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed752650 con 0x7f7ee0114060 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94738077524384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed750eb0 con 0x7f7ee0114060 2024-09-13T06:29:22.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7530d0 con 0x5629ed745cb0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94738077524384] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94738077522032] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94738077511184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed752be0 con 0x5629ed745cb0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed753970 con 0x5629ed74ace0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94738077529280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed752be0 con 0x5629ed74ace0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.649+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7543f0 con 0x5629ed74ace0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94738077529280] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94738077530336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7543b0 con 0x5629ed74ace0 2024-09-13T06:29:22.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94738077511184] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7525c0 con 0x7f7ee0114060 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94738077530336] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94738077531904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7525c0 con 0x7f7ee0114060 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=0 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=1 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=2 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=3 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=4 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=5 2024-09-13T06:29:22.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=6 2024-09-13T06:29:22.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94738077531904] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 20 add_watcher() i=7 2024-09-13T06:29:22.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:22.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed757e30 con 0x5629ed741850 2024-09-13T06:29:22.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.653+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94738077534544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed755220 con 0x5629ed741850 2024-09-13T06:29:22.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94738077534544] v31'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7d9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:22.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:22.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 5 note: GC not initialized 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7d9d7e2640 20 reqs_thread_entry: start 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 Filter name: none 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7d0effd640 20 reqs_thread_entry: start 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed77b320 con 0x7f7ee0114060 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed77bbb0 con 0x5629ed74ace0 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed77a6c0 con 0x7f7ee0114060 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed77d1e0 con 0x5629ed74ace0 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.657+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(65 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 4.8 4:11cfe723:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed77eb70 con 0x5629ed74ace0 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 4.32 4:4cfee7b6:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed781710 con 0x5629ed745cb0 2024-09-13T06:29:22.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 4.1c 4:3a3f0fce:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7841d0 con 0x7f7ee0114060 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 4.6 4:6172e498:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed786aa0 con 0x5629ed74ace0 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 4.9 4:9013e599:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7895c0 con 0x5629ed741850 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 4.23 4:c56c80ea:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed786aa0 con 0x5629ed74ace0 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed78e860 con 0x5629ed74ace0 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 4.25 4:a7766a67:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7910d0 con 0x5629ed745cb0 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(66 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 4.2 4:4033a47e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed7910d0 con 0x5629ed741850 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 4.7 4:e3e717b4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed77ca90 con 0x5629ed741850 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(69 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(68 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 4.13 4:cad017c4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5629ed783d20 con 0x7f7ee0114060 2024-09-13T06:29:22.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(71 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(72 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(76 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(67 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(75 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(74 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(73 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7d9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.661+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94738077534544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed741850 2024-09-13T06:29:22.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94738077534544] v31'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94738077513696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed745cb0 2024-09-13T06:29:22.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94738077513696] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7eea7ae980 20 remove_watcher() i=0 2024-09-13T06:29:22.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7eea7ae980 2 removed watcher, disabling cache 2024-09-13T06:29:22.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94738077517200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed741850 2024-09-13T06:29:22.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94738077517200] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x5629ed741850 2024-09-13T06:29:22.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7eea7ae980 20 remove_watcher() i=1 2024-09-13T06:29:22.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.665+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94738077522032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed745cb0 2024-09-13T06:29:22.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.669+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94738077522032] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.669+0000 7f7eea7ae980 20 remove_watcher() i=2 2024-09-13T06:29:22.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.669+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94738077524384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x7f7ee0114060 2024-09-13T06:29:22.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.669+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94738077524384] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.669+0000 7f7eea7ae980 20 remove_watcher() i=3 2024-09-13T06:29:22.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.669+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94738077511184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed745cb0 2024-09-13T06:29:22.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7ee82be640 1 -- 172.21.15.169:0/4015401645 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94738077511184] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0111030 con 0x5629ed745cb0 2024-09-13T06:29:22.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7eea7ae980 20 remove_watcher() i=4 2024-09-13T06:29:22.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94738077529280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed74ace0 2024-09-13T06:29:22.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94738077529280] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7eea7ae980 20 remove_watcher() i=5 2024-09-13T06:29:22.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94738077530336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x5629ed74ace0 2024-09-13T06:29:22.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7ee7abd640 1 -- 172.21.15.169:0/4015401645 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94738077530336] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7edc036040 con 0x5629ed74ace0 2024-09-13T06:29:22.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7eea7ae980 20 remove_watcher() i=6 2024-09-13T06:29:22.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.673+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94738077531904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5629ed76baf0 con 0x7f7ee0114060 2024-09-13T06:29:22.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94738077531904] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ed80083f0 con 0x7f7ee0114060 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 20 remove_watcher() i=7 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed745cb0 msgr2=0x5629ed7480a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed745cb0 0x5629ed7480a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed741850 msgr2=0x5629ed743cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed741850 0x5629ed743cf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7ee0114060 msgr2=0x7f7ee00e93a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7ee0114060 0x7f7ee00e93a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed74ace0 msgr2=0x5629ed74d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed74ace0 0x5629ed74d0d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7db8034600 msgr2=0x7f7db8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7db8034600 0x7f7db8036ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0207d0 tx=0x7f7edc011000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7ee8abf640 1 -- 172.21.15.169:0/4015401645 reap_dead start 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 msgr2=0x5629ed736700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed736700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00ebff0 tx=0x7f7ee0009f00 comp rx=0 tx=0).stop 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 shutdown_connections 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/4015401645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed60f360 0x5629ed736700 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 >> 172.21.15.169:0/4015401645 conn(0x5629ed729740 msgr2=0x5629ed727810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 shutdown_connections 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/4015401645 wait complete. 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dc0034650 msgr2=0x7f7dc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dc0034650 0x7f7dc0036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5629ed713410 tx=0x7f7edc006000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 msgr2=0x5629ed720ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 0x5629ed720ec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00e35a0 tx=0x7f7ee00c6d30 comp rx=0 tx=0).stop 2024-09-13T06:29:22.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 shutdown_connections 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dc0034650 0x7f7dc0036b10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/1703238222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed720aa0 0x5629ed720ec0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 >> 172.21.15.169:0/1703238222 conn(0x5629ed715bf0 msgr2=0x5629ed718670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 shutdown_connections 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/1703238222 wait complete. 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed70b050 msgr2=0x5629ed70d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629ed70b050 0x5629ed70d440 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed6138e0 msgr2=0x5629ed709d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629ed6138e0 0x5629ed709d10 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed7106e0 msgr2=0x5629ed712ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629ed7106e0 0x5629ed712ad0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dd0034650 msgr2=0x7f7dd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7dd0034650 0x7f7dd0036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7edc001e20 tx=0x7f7edc0013a0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 msgr2=0x5629ed702c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 --2- 172.21.15.169:0/3054712728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629ed585290 0x5629ed702c10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0005cc0 tx=0x7f7ee0017e30 comp rx=0 tx=0).stop 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7ee8abf640 1 -- 172.21.15.169:0/3054712728 reap_dead start 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 shutdown_connections 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 >> 172.21.15.169:0/3054712728 conn(0x5629ed60b090 msgr2=0x5629ed6f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 shutdown_connections 2024-09-13T06:29:22.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.677+0000 7f7eea7ae980 1 -- 172.21.15.169:0/3054712728 wait complete. 2024-09-13T06:29:22.688 INFO:teuthology.orchestra.run.smithi169.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7fd9ecda-6337-4ce7-ac46-f04193654c7b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","marker":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:29:21.666248Z","creation_time":"2024-09-13T06:29:21.659221Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T06:29:22.688 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:29:21.666248Z', 'creation_time': '2024-09-13T06:29:21.659221Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:29:22.689 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T06:29:22.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T06:29:22.689 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T06:29:22.758 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:22.758 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc35d4980 1 Processor -- start 2024-09-13T06:29:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc35d4980 1 -- start start 2024-09-13T06:29:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc35d4980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5626b5d5f9e0 0x5626b5d61dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc35d4980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626b5be3ae0 con 0x5626b5d5b660 2024-09-13T06:29:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc35d4980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5626b5c07e30 con 0x5626b5d5f9e0 2024-09-13T06:29:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc08e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5626b5d5f9e0 0x5626b5d61dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc08e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5626b5d5f9e0 0x5626b5d61dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36688/0 (socket says 172.21.15.169:36688) 2024-09-13T06:29:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc08e3640 1 -- 172.21.15.169:0/1752147510 learned_addr learned my addr 172.21.15.169:0/1752147510 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc10e4640 1 --1- 172.21.15.169:0/1752147510 >> v1:172.21.15.112:6789/0 conn(0x5626b5d5b660 0x5626b5d5ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45252/0 (socket says 172.21.15.169:45252) 2024-09-13T06:29:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc08e3640 1 -- 172.21.15.169:0/1752147510 >> v1:172.21.15.112:6789/0 conn(0x5626b5d5b660 legacy=0x5626b5d5ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.757+0000 7f5cc08e3640 1 -- 172.21.15.169:0/1752147510 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5d63320 con 0x5626b5d5f9e0 2024-09-13T06:29:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/1752147510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5f9e0 0x5626b5d61dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800a5c0 tx=0x7f5cb801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae4943bfdee4d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cb3fff640 1 -- 172.21.15.169:0/1752147510 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb80a6070 con 0x5626b5d5f9e0 2024-09-13T06:29:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cb3fff640 1 -- 172.21.15.169:0/1752147510 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb80af070 con 0x5626b5d5f9e0 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cb3fff640 1 -- 172.21.15.169:0/1752147510 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb80aa5c0 con 0x5626b5d5f9e0 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 -- 172.21.15.169:0/1752147510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5f9e0 msgr2=0x5626b5d61dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/1752147510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5f9e0 0x5626b5d61dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800a5c0 tx=0x7f5cb801b340 comp rx=0 tx=0).stop 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 -- 172.21.15.169:0/1752147510 shutdown_connections 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/1752147510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5f9e0 0x5626b5d61dd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 -- 172.21.15.169:0/1752147510 >> 172.21.15.169:0/1752147510 conn(0x5626b5d57180 msgr2=0x5626b5d595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 -- 172.21.15.169:0/1752147510 shutdown_connections 2024-09-13T06:29:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.761+0000 7f5cc35d4980 1 -- 172.21.15.169:0/1752147510 wait complete. 2024-09-13T06:29:22.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc35d4980 1 Processor -- start 2024-09-13T06:29:22.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc35d4980 1 -- start start 2024-09-13T06:29:22.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc35d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e46a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc35d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b5c09200 con 0x5626b5d5b660 2024-09-13T06:29:22.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e46a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e46a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36694/0 (socket says 172.21.15.169:36694) 2024-09-13T06:29:22.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc10e4640 1 -- 172.21.15.169:0/581371030 learned_addr learned my addr 172.21.15.169:0/581371030 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.773+0000 7f5cc10e4640 1 -- 172.21.15.169:0/581371030 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5e47000 con 0x5626b5d5b660 2024-09-13T06:29:22.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/581371030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e46a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4001e50 tx=0x7f5cb4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa61f484809e5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5baf606640 1 -- 172.21.15.169:0/581371030 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb400e5d0 con 0x5626b5d5b660 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5baf606640 1 -- 172.21.15.169:0/581371030 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb400e770 con 0x5626b5d5b660 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5baf606640 1 -- 172.21.15.169:0/581371030 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb400eab0 con 0x5626b5d5b660 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/581371030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 msgr2=0x5626b5e46a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/581371030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e46a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4001e50 tx=0x7f5cb4001e80 comp rx=0 tx=0).stop 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/581371030 shutdown_connections 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/581371030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e46a30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/581371030 >> 172.21.15.169:0/581371030 conn(0x5626b5d57180 msgr2=0x5626b5e42660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/581371030 shutdown_connections 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/581371030 wait complete. 2024-09-13T06:29:22.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 Processor -- start 2024-09-13T06:29:22.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- start start 2024-09-13T06:29:22.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b5d62e20 con 0x5626b5d5b660 2024-09-13T06:29:22.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e4ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e4ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36710/0 (socket says 172.21.15.169:36710) 2024-09-13T06:29:22.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc10e4640 1 -- 172.21.15.169:0/4137766524 learned_addr learned my addr 172.21.15.169:0/4137766524 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc10e4640 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5e4e300 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e4ddc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5626b5e47c10 tx=0x7f5cb4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5bade03640 1 -- 172.21.15.169:0/4137766524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb4001260 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626b5e4e590 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5bade03640 1 -- 172.21.15.169:0/4137766524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb400fa40 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b5e51270 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.777+0000 7f5bade03640 1 -- 172.21.15.169:0/4137766524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb402c060 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5bade03640 1 -- 172.21.15.169:0/4137766524 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5cb4017070 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5bade03640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ba8034650 0x7f5ba8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5bade03640 1 -- 172.21.15.169:0/4137766524 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5cb4015020 con 0x5626b5d5b660 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ba8034650 0x7f5ba8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5d5f9e0 0x5626b5e54db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e55420 con 0x5626b5d5f9e0 2024-09-13T06:29:22.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc18e5640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5d5f9e0 0x5626b5e54db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ba8034650 0x7f5ba8036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80ae000 tx=0x7f5cb80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc18e5640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5d5f9e0 0x5626b5e54db0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc18e5640 1 -- 172.21.15.169:0/4137766524 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5d5f9e0 2024-09-13T06:29:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e561f0 0x5626b5e585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e58c20 con 0x5626b5e561f0 2024-09-13T06:29:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e561f0 0x5626b5e585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e561f0 0x5626b5e585e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc10e4640 1 -- 172.21.15.169:0/4137766524 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cb402e070 con 0x5626b5e561f0 2024-09-13T06:29:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.781+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e5a4d0 con 0x5626b5e561f0 2024-09-13T06:29:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 -- 172.21.15.169:0/4137766524 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5cb402e070 con 0x5626b5e561f0 2024-09-13T06:29:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e59700 con 0x5626b5e561f0 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 -- 172.21.15.169:0/4137766524 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cb402e070 con 0x5626b5e561f0 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e5b880 0x5626b5e5dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e5e1b0 con 0x5626b5e5b880 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e5b880 0x5626b5e5dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e5b880 0x5626b5e5dc70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc08e3640 1 -- 172.21.15.169:0/4137766524 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e5b880 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 Processor -- start 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 -- start start 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 0x5626b5e6c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b5c62800 con 0x5626b5e6bc40 2024-09-13T06:29:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 0x5626b5e6c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 0x5626b5e6c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36714/0 (socket says 172.21.15.169:36714) 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 -- 172.21.15.169:0/2674917309 learned_addr learned my addr 172.21.15.169:0/2674917309 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 -- 172.21.15.169:0/2674917309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5e6c5a0 con 0x5626b5e6bc40 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 0x5626b5e6c060 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5cb401b950 tx=0x7f5cb404a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5ba6ffd640 1 -- 172.21.15.169:0/2674917309 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb40422f0 con 0x5626b5e6bc40 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626b5e6c830 con 0x5626b5e6bc40 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5ba6ffd640 1 -- 172.21.15.169:0/2674917309 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb401bbd0 con 0x5626b5e6bc40 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5ba6ffd640 1 -- 172.21.15.169:0/2674917309 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb401a480 con 0x5626b5e6bc40 2024-09-13T06:29:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.785+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b5e6c830 con 0x5626b5e6bc40 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5ba6ffd640 1 -- 172.21.15.169:0/2674917309 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5cb401a620 con 0x5626b5e6bc40 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5ba6ffd640 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b98034650 0x7f5b98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5ba6ffd640 1 -- 172.21.15.169:0/2674917309 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5cb403fae0 con 0x5626b5e6bc40 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b98034650 0x7f5b98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 Processor -- start 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- start start 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5cd19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b5e47380 con 0x5626b5cd15f0 2024-09-13T06:29:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b98034650 0x7f5b98036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8000c10 tx=0x7f5cb8005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5cd19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5cd19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36720/0 (socket says 172.21.15.169:36720) 2024-09-13T06:29:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3818089396 learned_addr learned my addr 172.21.15.169:0/3818089396 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3818089396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5cd1fa0 con 0x5626b5cd15f0 2024-09-13T06:29:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/3818089396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5cd19d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400f700 tx=0x7f5cb400a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec87641ba76b8c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5ba4ff9640 1 -- 172.21.15.169:0/3818089396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb4027890 con 0x5626b5cd15f0 2024-09-13T06:29:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5ba4ff9640 1 -- 172.21.15.169:0/3818089396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb4042830 con 0x5626b5cd15f0 2024-09-13T06:29:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5ba4ff9640 1 -- 172.21.15.169:0/3818089396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb4027a30 con 0x5626b5cd15f0 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3818089396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 msgr2=0x5626b5cd19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3818089396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5cd19d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400f700 tx=0x7f5cb400a550 comp rx=0 tx=0).stop 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3818089396 shutdown_connections 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3818089396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5cd19d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3818089396 >> 172.21.15.169:0/3818089396 conn(0x5626b5e74750 msgr2=0x5626b5e72850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3818089396 shutdown_connections 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3818089396 wait complete. 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 Processor -- start 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- start start 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5e81720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc35d4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b5cd01e0 con 0x5626b5cd15f0 2024-09-13T06:29:22.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5e81720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.789+0000 7f5cc10e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5e81720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36724/0 (socket says 172.21.15.169:36724) 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 learned_addr learned my addr 172.21.15.169:0/3086964545 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b5e81c60 con 0x5626b5cd15f0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5e81720 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400f700 tx=0x7f5cb4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5b96ffd640 1 -- 172.21.15.169:0/3086964545 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb404aab0 con 0x5626b5cd15f0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626b5e81c60 con 0x5626b5cd15f0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5b96ffd640 1 -- 172.21.15.169:0/3086964545 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb406a030 con 0x5626b5cd15f0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5b96ffd640 1 -- 172.21.15.169:0/3086964545 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb4074060 con 0x5626b5cd15f0 2024-09-13T06:29:22.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b5e81c60 con 0x5626b5cd15f0 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5b96ffd640 1 -- 172.21.15.169:0/3086964545 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5cb4047530 con 0x5626b5cd15f0 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5b96ffd640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b8c034650 0x7f5b8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5b96ffd640 1 -- 172.21.15.169:0/3086964545 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5cb4066150 con 0x5626b5cd15f0 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b8c034650 0x7f5b8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5e8c6d0 0x5626b5e8eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e8f2b0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc18e5640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5e8c6d0 0x5626b5e8eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b8c034650 0x7f5b8c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80aa910 tx=0x7f5cb80c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc18e5640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5e8c6d0 0x5626b5e8eb60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 realm 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e8bc10 con 0x5626b5e8c6d0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e8fd80 con 0x5626b5e8c6d0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.793+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e90960 0x5626b5e92e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e93590 con 0x5626b5e90960 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e90960 0x5626b5e92e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e90960 0x5626b5e92e20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e93e30 con 0x5626b5e90960 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:22.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 20 searching for the correct realm 2024-09-13T06:29:22.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e95ba0 0x5626b5e97f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e95ba0 0x5626b5e97f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc08e3640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e95ba0 0x5626b5e97f90 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5cb4053070 0x7f5cb4085620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x7f5cb4053070 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.797+0000 7f5cc18e5640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5cb4053070 0x7f5cb4085620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5cb4053070 0x7f5cb4085620 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x7f5cb4053070 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x7f5cb4053070 2024-09-13T06:29:22.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.801+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x7f5cb4053070 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x7f5cb4053070 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x7f5cb4053070 2024-09-13T06:29:22.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.805+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e985a0 con 0x5626b5e90960 2024-09-13T06:29:22.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e94780 con 0x5626b5e8c6d0 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e94bd0 con 0x5626b5e90960 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.809+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e95030 con 0x5626b5e95ba0 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 zone default found 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 4 Realm: () 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 zonegroup default 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e98ed0 con 0x7f5cb4053070 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9ac50 con 0x5626b5e95ba0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9b0f0 con 0x5626b5e95ba0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 started sync module instance, tier type = 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9a0f0 con 0x5626b5e90960 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94724260734480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9a0f0 con 0x5626b5e90960 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9bbb0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94724260738720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9c450 con 0x5626b5e8c6d0 2024-09-13T06:29:22.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.813+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9ce90 con 0x5626b5e90960 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94724260738720] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94724260734480] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94724260743520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9bfa0 con 0x5626b5e90960 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9d730 con 0x7f5cb4053070 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94724260745856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9bfa0 con 0x7f5cb4053070 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9e1f0 con 0x5626b5e90960 2024-09-13T06:29:22.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.817+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94724260743520] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94724260745856] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94724260746912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e99c40 con 0x5626b5e90960 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9e660 con 0x5626b5e95ba0 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94724260749744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9eeb0 con 0x5626b5e95ba0 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9f8b0 con 0x5626b5e95ba0 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94724260746912] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94724260748480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9fca0 con 0x5626b5e95ba0 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ea0660 con 0x7f5cb4053070 2024-09-13T06:29:22.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.821+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94724260749744] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94724260751872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ea0660 con 0x7f5cb4053070 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=0 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=1 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=2 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=3 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=4 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=5 2024-09-13T06:29:22.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94724260748480] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=6 2024-09-13T06:29:22.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94724260751872] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 20 add_watcher() i=7 2024-09-13T06:29:22.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:22.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ea0660 con 0x5626b5e8c6d0 2024-09-13T06:29:22.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.825+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94724260757936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ea05d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94724260757936] v31'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5b777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 5 note: GC not initialized 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5b767e4640 20 reqs_thread_entry: start 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 Filter name: none 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5ae7fff640 20 reqs_thread_entry: start 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec6770 con 0x5626b5e8c6d0 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:22.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec7cc0 con 0x7f5cb4053070 2024-09-13T06:29:22.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec7cc0 con 0x5626b5e95ba0 2024-09-13T06:29:22.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:22.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:22.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 4.8 4:11cfe723:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec9730 con 0x5626b5e95ba0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 4.32 4:4cfee7b6:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ecc3e0 con 0x5626b5e90960 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 4.1c 4:3a3f0fce:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5eced40 con 0x7f5cb4053070 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 4.6 4:6172e498:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ed1640 con 0x5626b5e95ba0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 4.9 4:9013e599:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ed42a0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 4.23 4:c56c80ea:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ed1640 con 0x5626b5e95ba0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ed42a0 con 0x5626b5e95ba0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 4.25 4:a7766a67:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5edb580 con 0x5626b5e90960 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 4.2 4:4033a47e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ede200 con 0x5626b5e8c6d0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 4.7 4:e3e717b4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ede200 con 0x5626b5e8c6d0 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:75 4.13 4:cad017c4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ee3030 con 0x7f5cb4053070 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(67 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(65 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(68 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.829+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(70 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(73 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(74 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(71 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(75 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(72 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ecbc20 con 0x7f5cb4053070 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(76 foo.buckets [call] v31'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4f10 con 0x7f5cb4053070 2024-09-13T06:29:22.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(77 foo.buckets [call] v31'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc35d4980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4f10 con 0x5626b5e8c6d0 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc35d4980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4f10 con 0x7f5cb4053070 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.833+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.837+0000 7f5b777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.837+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94724260757936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4f10 con 0x5626b5e8c6d0 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.837+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94724260757936] v31'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.837+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94724260734480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4600 con 0x5626b5e90960 2024-09-13T06:29:22.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94724260734480] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 20 remove_watcher() i=0 2024-09-13T06:29:22.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 2 removed watcher, disabling cache 2024-09-13T06:29:22.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94724260738720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9a610 con 0x5626b5e8c6d0 2024-09-13T06:29:22.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94724260738720] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x5626b5e8c6d0 2024-09-13T06:29:22.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 20 remove_watcher() i=1 2024-09-13T06:29:22.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94724260743520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4600 con 0x5626b5e90960 2024-09-13T06:29:22.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94724260743520] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 20 remove_watcher() i=2 2024-09-13T06:29:22.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.841+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94724260745856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9a610 con 0x7f5cb4053070 2024-09-13T06:29:22.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94724260745856] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc35d4980 20 remove_watcher() i=3 2024-09-13T06:29:22.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94724260746912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9c960 con 0x5626b5e90960 2024-09-13T06:29:22.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc10e4640 1 -- 172.21.15.169:0/3086964545 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94724260746912] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb4050020 con 0x5626b5e90960 2024-09-13T06:29:22.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc35d4980 20 remove_watcher() i=4 2024-09-13T06:29:22.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94724260749744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5ec4600 con 0x5626b5e95ba0 2024-09-13T06:29:22.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94724260749744] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc35d4980 20 remove_watcher() i=5 2024-09-13T06:29:22.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.845+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94724260748480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9c960 con 0x5626b5e95ba0 2024-09-13T06:29:22.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc08e3640 1 -- 172.21.15.169:0/3086964545 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94724260748480] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb80aaae0 con 0x5626b5e95ba0 2024-09-13T06:29:22.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 20 remove_watcher() i=6 2024-09-13T06:29:22.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94724260751872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626b5e9e1b0 con 0x7f5cb4053070 2024-09-13T06:29:22.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94724260751872] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc00a4d0 con 0x7f5cb4053070 2024-09-13T06:29:22.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 20 remove_watcher() i=7 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e90960 msgr2=0x5626b5e92e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e90960 0x5626b5e92e20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5e8c6d0 msgr2=0x5626b5e8eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5e8c6d0 0x5626b5e8eb60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5cb4053070 msgr2=0x7f5cb4085620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5cb4053070 0x7f5cb4085620 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e95ba0 msgr2=0x5626b5e97f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e95ba0 0x5626b5e97f90 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b8c034650 msgr2=0x7f5b8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b8c034650 0x7f5b8c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80aa910 tx=0x7f5cb80c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 msgr2=0x5626b5e81720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc18e5640 1 -- 172.21.15.169:0/3086964545 reap_dead start 2024-09-13T06:29:22.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5e81720 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400f700 tx=0x7f5cb4007ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 shutdown_connections 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/3086964545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5cd15f0 0x5626b5e81720 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 >> 172.21.15.169:0/3086964545 conn(0x5626b5e74750 msgr2=0x5626b5e72820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 shutdown_connections 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/3086964545 wait complete. 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b98034650 msgr2=0x7f5b98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b98034650 0x7f5b98036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8000c10 tx=0x7f5cb8005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 msgr2=0x5626b5e6c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 0x5626b5e6c060 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5cb401b950 tx=0x7f5cb404a3b0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 shutdown_connections 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5b98034650 0x7f5b98036b10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/2674917309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5e6bc40 0x5626b5e6c060 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 >> 172.21.15.169:0/2674917309 conn(0x5626b5e60d90 msgr2=0x5626b5e63810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 shutdown_connections 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/2674917309 wait complete. 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e561f0 msgr2=0x5626b5e585e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5626b5e561f0 0x5626b5e585e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5d5f9e0 msgr2=0x5626b5e54db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5626b5d5f9e0 0x5626b5e54db0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e5b880 msgr2=0x5626b5e5dc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5626b5e5b880 0x5626b5e5dc70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ba8034650 msgr2=0x7f5ba8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ba8034650 0x7f5ba8036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80ae000 tx=0x7f5cb80a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 msgr2=0x5626b5e4ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 --2- 172.21.15.169:0/4137766524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b5d5b660 0x5626b5e4ddc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5626b5e47c10 tx=0x7f5cb4000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc18e5640 1 -- 172.21.15.169:0/4137766524 reap_dead start 2024-09-13T06:29:22.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 shutdown_connections 2024-09-13T06:29:22.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 >> 172.21.15.169:0/4137766524 conn(0x5626b5d57180 msgr2=0x5626b5e411e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 shutdown_connections 2024-09-13T06:29:22.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.849+0000 7f5cc35d4980 1 -- 172.21.15.169:0/4137766524 wait complete. 2024-09-13T06:29:22.861 INFO:teuthology.orchestra.run.smithi169.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T06:29:22.838315Z","last_stats_update":"2024-09-13T06:29:22.837093Z"} 2024-09-13T06:29:22.862 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T06:29:22.838315Z', 'last_stats_update': '2024-09-13T06:29:22.837093Z'} 2024-09-13T06:29:22.869 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:22.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T06:29:22.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T06:29:22.869 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T06:29:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e894d980 1 Processor -- start 2024-09-13T06:29:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e894d980 1 -- start start 2024-09-13T06:29:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e894d980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558106ef97d0 0x558106ef8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e894d980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558106e0aae0 con 0x558106ef93c0 2024-09-13T06:29:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e894d980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x558106e2ee30 con 0x558106ef97d0 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e5c5c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558106ef97d0 0x558106ef8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e645d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x558106ef93c0 0x558106ef7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45262/0 (socket says 172.21.15.169:45262) 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e645d640 1 -- 172.21.15.169:0/3998455567 learned_addr learned my addr 172.21.15.169:0/3998455567 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e545b640 1 -- 172.21.15.169:0/3998455567 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803615768 0 0) 0x558106e0aae0 con 0x558106ef93c0 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e545b640 1 -- 172.21.15.169:0/3998455567 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3d4001e20 con 0x558106ef93c0 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/3998455567 >> v1:172.21.15.112:6789/0 conn(0x558106ef93c0 legacy=0x558106ef7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.937+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/3998455567 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558106ef88f0 con 0x558106ef97d0 2024-09-13T06:29:22.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/3998455567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef97d0 0x558106ef8290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a480 tx=0x7fe3d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f614a1b930bc7aad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e545b640 1 -- 172.21.15.169:0/3998455567 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d00b0070 con 0x558106ef97d0 2024-09-13T06:29:22.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e545b640 1 -- 172.21.15.169:0/3998455567 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d00ab540 con 0x558106ef97d0 2024-09-13T06:29:22.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e545b640 1 -- 172.21.15.169:0/3998455567 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d00ab820 con 0x558106ef97d0 2024-09-13T06:29:22.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 -- 172.21.15.169:0/3998455567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef97d0 msgr2=0x558106ef8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 --2- 172.21.15.169:0/3998455567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef97d0 0x558106ef8290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a480 tx=0x7fe3d001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:22.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 -- 172.21.15.169:0/3998455567 shutdown_connections 2024-09-13T06:29:22.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 --2- 172.21.15.169:0/3998455567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef97d0 0x558106ef8290 secure :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a480 tx=0x7fe3d001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:22.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 -- 172.21.15.169:0/3998455567 >> 172.21.15.169:0/3998455567 conn(0x558106f7e1c0 msgr2=0x558106f805e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 -- 172.21.15.169:0/3998455567 shutdown_connections 2024-09-13T06:29:22.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.941+0000 7fe3e894d980 1 -- 172.21.15.169:0/3998455567 wait complete. 2024-09-13T06:29:22.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 Processor -- start 2024-09-13T06:29:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- start start 2024-09-13T06:29:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x55810706fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558106e30200 con 0x558106ef93c0 2024-09-13T06:29:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x55810706fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x55810706fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36746/0 (socket says 172.21.15.169:36746) 2024-09-13T06:29:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e645d640 1 -- 172.21.15.169:0/3546525081 learned_addr learned my addr 172.21.15.169:0/3546525081 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e645d640 1 -- 172.21.15.169:0/3546525081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558107070110 con 0x558106ef93c0 2024-09-13T06:29:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e645d640 1 --2- 172.21.15.169:0/3546525081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x55810706fb40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fc0 tx=0x7fe3e0001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd49d70220618fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe2d4608640 1 -- 172.21.15.169:0/3546525081 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0004530 con 0x558106ef93c0 2024-09-13T06:29:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe2d4608640 1 -- 172.21.15.169:0/3546525081 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e00046d0 con 0x558106ef93c0 2024-09-13T06:29:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe2d4608640 1 -- 172.21.15.169:0/3546525081 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0004a70 con 0x558106ef93c0 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- 172.21.15.169:0/3546525081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 msgr2=0x55810706fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 --2- 172.21.15.169:0/3546525081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x55810706fb40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fc0 tx=0x7fe3e0001af0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- 172.21.15.169:0/3546525081 shutdown_connections 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 --2- 172.21.15.169:0/3546525081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x55810706fb40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- 172.21.15.169:0/3546525081 >> 172.21.15.169:0/3546525081 conn(0x558106f7e1c0 msgr2=0x55810706b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- 172.21.15.169:0/3546525081 shutdown_connections 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- 172.21.15.169:0/3546525081 wait complete. 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 Processor -- start 2024-09-13T06:29:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- start start 2024-09-13T06:29:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x558107076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.957+0000 7fe3e894d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558106f8e210 con 0x558106ef93c0 2024-09-13T06:29:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x558107076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x558107076eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36748/0 (socket says 172.21.15.169:36748) 2024-09-13T06:29:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e645d640 1 -- 172.21.15.169:0/504562772 learned_addr learned my addr 172.21.15.169:0/504562772 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e645d640 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581070773f0 con 0x558106ef93c0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e645d640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x558107076eb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0002260 tx=0x7fe3e0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe2d2e05640 1 -- 172.21.15.169:0/504562772 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0013760 con 0x558106ef93c0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558107077680 con 0x558106ef93c0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe2d2e05640 1 -- 172.21.15.169:0/504562772 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0013900 con 0x558106ef93c0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe2d2e05640 1 -- 172.21.15.169:0/504562772 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0013be0 con 0x558106ef93c0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55810707a360 con 0x558106ef93c0 2024-09-13T06:29:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe2d2e05640 1 -- 172.21.15.169:0/504562772 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3e0010070 con 0x558106ef93c0 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe2d2e05640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2cc034650 0x7fe2cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe2d2e05640 1 -- 172.21.15.169:0/504562772 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe3e0018070 con 0x558106ef93c0 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2cc034650 0x7fe2cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55810707be30 0x55810707e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55810707e860 con 0x55810707be30 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e6c5e640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55810707be30 0x55810707e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2cc034650 0x7fe2cc036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00ad000 tx=0x7fe3d00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e6c5e640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55810707be30 0x55810707e220 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/504562772 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x55810707be30 2024-09-13T06:29:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55810707f630 0x558107081a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558107082060 con 0x55810707f630 2024-09-13T06:29:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.961+0000 7fe3e645d640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55810707f630 0x558107081a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e645d640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55810707f630 0x558107081a20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e645d640 1 -- 172.21.15.169:0/504562772 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3e001b030 con 0x55810707f630 2024-09-13T06:29:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558107083910 con 0x55810707f630 2024-09-13T06:29:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e645d640 1 -- 172.21.15.169:0/504562772 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3e001b030 con 0x55810707f630 2024-09-13T06:29:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558107082b40 con 0x55810707f630 2024-09-13T06:29:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e645d640 1 -- 172.21.15.169:0/504562772 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3e001b030 con 0x55810707f630 2024-09-13T06:29:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558107084cc0 0x5581070870b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070875f0 con 0x558107084cc0 2024-09-13T06:29:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558107084cc0 0x5581070870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558107084cc0 0x5581070870b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.965+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/504562772 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe3d00abba0 con 0x558107084cc0 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 Processor -- start 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 -- start start 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 0x558107095410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558106e89800 con 0x558107094ff0 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 0x558107095410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 0x558107095410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36762/0 (socket says 172.21.15.169:36762) 2024-09-13T06:29:22.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e645d640 1 -- 172.21.15.169:0/4172266060 learned_addr learned my addr 172.21.15.169:0/4172266060 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e645d640 1 -- 172.21.15.169:0/4172266060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558107095950 con 0x558107094ff0 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e645d640 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 0x558107095410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe3e004a000 tx=0x7fe3e0010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe2cbfff640 1 -- 172.21.15.169:0/4172266060 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0029940 con 0x558107094ff0 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558107095be0 con 0x558107094ff0 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe2cbfff640 1 -- 172.21.15.169:0/4172266060 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0041ac0 con 0x558107094ff0 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe2cbfff640 1 -- 172.21.15.169:0/4172266060 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0041de0 con 0x558107094ff0 2024-09-13T06:29:22.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558107098860 con 0x558107094ff0 2024-09-13T06:29:22.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe2cbfff640 1 -- 172.21.15.169:0/4172266060 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3e0029d10 con 0x558107094ff0 2024-09-13T06:29:22.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe2cbfff640 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2c0034650 0x7fe2c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe2cbfff640 1 -- 172.21.15.169:0/4172266060 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe3e0054af0 con 0x558107094ff0 2024-09-13T06:29:22.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2c0034650 0x7fe2c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 Processor -- start 2024-09-13T06:29:22.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 -- start start 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2c0034650 0x7fe2c0036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55810707b4a0 tx=0x7fe3d0005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.969+0000 7fe3e894d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558107070490 con 0x5581070a19f0 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36778/0 (socket says 172.21.15.169:36778) 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 -- 172.21.15.169:0/2754976428 learned_addr learned my addr 172.21.15.169:0/2754976428 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 -- 172.21.15.169:0/2754976428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581070a23a0 con 0x5581070a19f0 2024-09-13T06:29:22.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 --2- 172.21.15.169:0/2754976428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a1dd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0050fb0 tx=0x7fe3e003e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802fb6d6785caae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe2c9ffb640 1 -- 172.21.15.169:0/2754976428 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0061020 con 0x5581070a19f0 2024-09-13T06:29:22.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe2c9ffb640 1 -- 172.21.15.169:0/2754976428 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0054e10 con 0x5581070a19f0 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe2c9ffb640 1 -- 172.21.15.169:0/2754976428 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0033810 con 0x5581070a19f0 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/2754976428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 msgr2=0x5581070a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 --2- 172.21.15.169:0/2754976428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a1dd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0050fb0 tx=0x7fe3e003e4f0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/2754976428 shutdown_connections 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 --2- 172.21.15.169:0/2754976428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a1dd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/2754976428 >> 172.21.15.169:0/2754976428 conn(0x55810709dd20 msgr2=0x55810709be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/2754976428 shutdown_connections 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/2754976428 wait complete. 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 Processor -- start 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- start start 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581070a2730 con 0x5581070a19f0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36794/0 (socket says 172.21.15.169:36794) 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 learned_addr learned my addr 172.21.15.169:0/4262819098 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581070a9060 con 0x5581070a19f0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e645d640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a8b20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0048e20 tx=0x7fe3e0043eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe2b7fff640 1 -- 172.21.15.169:0/4262819098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0076070 con 0x5581070a19f0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581070a9060 con 0x5581070a19f0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581070a9060 con 0x5581070a19f0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe2b7fff640 1 -- 172.21.15.169:0/4262819098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0028800 con 0x5581070a19f0 2024-09-13T06:29:22.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.973+0000 7fe2b7fff640 1 -- 172.21.15.169:0/4262819098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0033af0 con 0x5581070a19f0 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe2b7fff640 1 -- 172.21.15.169:0/4262819098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3e0079070 con 0x5581070a19f0 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe2b7fff640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2b0034650 0x7fe2b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe2b7fff640 1 -- 172.21.15.169:0/4262819098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe3e006c030 con 0x5581070a19f0 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2b0034650 0x7fe2b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581070b3ad0 0x5581070b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070b66e0 con 0x5581070b3ad0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e6c5e640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581070b3ad0 0x5581070b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2b0034650 0x7fe2b0036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5581070838a0 tx=0x7fe3d00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e6c5e640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581070b3ad0 0x5581070b5f90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 realm 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070b2f00 con 0x5581070b3ad0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070b71a0 con 0x5581070b3ad0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581070b7f80 0x5581070ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070baa20 con 0x5581070b7f80 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e645d640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581070b7f80 0x5581070ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.977+0000 7fe3e645d640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581070b7f80 0x5581070ba370 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:22.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:22.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 20 searching for the correct realm 2024-09-13T06:29:22.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581070bcfe0 0x5581070bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bfa00 con 0x5581070bcfe0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581070bcfe0 0x5581070bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e5c5c640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581070bcfe0 0x5581070bf3d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bfa00 con 0x5581070b7f80 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e645d640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe3e007b060 0x7fe3e0087720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x7fe3e007b060 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe3e007b060 0x7fe3e0087720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe3e007b060 0x7fe3e0087720 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070bcfe0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.981+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x7fe3e007b060 2024-09-13T06:29:22.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:22.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x7fe3e007b060 2024-09-13T06:29:22.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:22.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070bcfe0 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.985+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070bcfe0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070bcfe0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x7fe3e007b060 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:22.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b3ad0 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x7fe3e007b060 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070bcfe0 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x7fe3e007b060 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.989+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070bcfe0 2024-09-13T06:29:22.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:22.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:22.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:22.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5581070bb270 con 0x5581070b7f80 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070bbac0 con 0x5581070b3ad0 2024-09-13T06:29:23.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070bbeb0 con 0x5581070b7f80 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070bbeb0 con 0x5581070bcfe0 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 zone default found 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 4 Realm: () 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:23.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 zonegroup default 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070bfe80 con 0x7fe3e007b060 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070c20b0 con 0x5581070bcfe0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.993+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070c2450 con 0x5581070bcfe0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 20 started sync module instance, tier type = 2024-09-13T06:29:23.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:23.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c14f0 con 0x5581070b7f80 2024-09-13T06:29:23.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94012657375456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c14f0 con 0x5581070b7f80 2024-09-13T06:29:23.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c2ca0 con 0x5581070b3ad0 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94012657379312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c34f0 con 0x5581070b3ad0 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:22.997+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c3f10 con 0x5581070b7f80 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94012657379312] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94012657375456] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94012657383936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c3040 con 0x5581070b7f80 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c47b0 con 0x7fe3e007b060 2024-09-13T06:29:23.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94012657386240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c3040 con 0x7fe3e007b060 2024-09-13T06:29:23.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c5250 con 0x5581070b7f80 2024-09-13T06:29:23.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94012657383936] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.001+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94012657386240] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94012657387296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c5210 con 0x5581070b7f80 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c5640 con 0x5581070bcfe0 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94012657373248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c5ee0 con 0x5581070bcfe0 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c68e0 con 0x5581070bcfe0 2024-09-13T06:29:23.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94012657387296] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94012657373248] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94012657388864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c6cd0 con 0x5581070bcfe0 2024-09-13T06:29:23.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c7520 con 0x7fe3e007b060 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94012657397424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c7900 con 0x7fe3e007b060 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 20 add_watcher() i=0 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 20 add_watcher() i=1 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 20 add_watcher() i=2 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 20 add_watcher() i=3 2024-09-13T06:29:23.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 20 add_watcher() i=4 2024-09-13T06:29:23.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.005+0000 7fe3e894d980 20 add_watcher() i=5 2024-09-13T06:29:23.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94012657388864] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e894d980 20 add_watcher() i=6 2024-09-13T06:29:23.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94012657397424] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e894d980 20 add_watcher() i=7 2024-09-13T06:29:23.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e894d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:23.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070c63f0 con 0x5581070b3ad0 2024-09-13T06:29:23.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.009+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94012657394672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070c7e20 con 0x5581070b3ad0 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94012657394672] v31'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe29d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 5 note: GC not initialized 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe2977fe640 20 reqs_thread_entry: start 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 Filter name: none 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe2957fa640 20 reqs_thread_entry: start 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070ee080 con 0x5581070b3ad0 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070f0160 con 0x7fe3e007b060 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:23.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070f1960 con 0x5581070bcfe0 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T06:29:23.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070f2e70 con 0x7fe3e007b060 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(65 foo.buckets [call] v31'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070f29c0 con 0x7fe3e007b060 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.013+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070f8ea0 con 0x7fe3e007b060 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e894d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e894d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e894d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94012657584560 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581070f6310 con 0x5581070bcfe0 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== watch-notify(notify (1) cookie 94012657388864 notify 133143986178 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5581070f1d50 con 0x5581070bcfe0 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe2c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94012657388864 notifier 4477 bl.length()=338 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe2c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe2c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(68 notify.6 [notify cookie 94012657584560 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe2c9ffb640 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe2ac003eb0 con 0x5581070bcfe0 2024-09-13T06:29:23.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== watch-notify(notify_complete (2) cookie 94012657584560 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5581070f0e80 con 0x5581070bcfe0 2024-09-13T06:29:23.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe29d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.017+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94012657394672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070b3ad0 2024-09-13T06:29:23.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.021+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94012657394672] v31'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.021+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94012657375456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070b7f80 2024-09-13T06:29:23.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.021+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94012657375456] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.021+0000 7fe3e894d980 20 remove_watcher() i=0 2024-09-13T06:29:23.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.021+0000 7fe3e894d980 2 removed watcher, disabling cache 2024-09-13T06:29:23.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.021+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94012657379312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070b3ad0 2024-09-13T06:29:23.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94012657379312] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x5581070b3ad0 2024-09-13T06:29:23.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e894d980 20 remove_watcher() i=1 2024-09-13T06:29:23.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94012657383936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070b7f80 2024-09-13T06:29:23.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94012657383936] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e894d980 20 remove_watcher() i=2 2024-09-13T06:29:23.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94012657386240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x7fe3e007b060 2024-09-13T06:29:23.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94012657386240] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e894d980 20 remove_watcher() i=3 2024-09-13T06:29:23.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.025+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94012657387296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070b7f80 2024-09-13T06:29:23.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e645d640 1 -- 172.21.15.169:0/4262819098 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94012657387296] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0078030 con 0x5581070b7f80 2024-09-13T06:29:23.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 20 remove_watcher() i=4 2024-09-13T06:29:23.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94012657373248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070bcfe0 2024-09-13T06:29:23.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94012657373248] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 20 remove_watcher() i=5 2024-09-13T06:29:23.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94012657388864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x5581070bcfe0 2024-09-13T06:29:23.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e5c5c640 1 -- 172.21.15.169:0/4262819098 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94012657388864] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d00da070 con 0x5581070bcfe0 2024-09-13T06:29:23.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 20 remove_watcher() i=6 2024-09-13T06:29:23.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94012657397424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581070deb80 con 0x7fe3e007b060 2024-09-13T06:29:23.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94012657397424] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80083f0 con 0x7fe3e007b060 2024-09-13T06:29:23.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 20 remove_watcher() i=7 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581070b7f80 msgr2=0x5581070ba370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581070b7f80 0x5581070ba370 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581070b3ad0 msgr2=0x5581070b5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581070b3ad0 0x5581070b5f90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe3e007b060 msgr2=0x7fe3e0087720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe3e007b060 0x7fe3e0087720 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581070bcfe0 msgr2=0x5581070bf3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581070bcfe0 0x5581070bf3d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2b0034650 msgr2=0x7fe2b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2b0034650 0x7fe2b0036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5581070838a0 tx=0x7fe3d00a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 msgr2=0x5581070a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a8b20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0048e20 tx=0x7fe3e0043eb0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.029+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/4262819098 reap_dead start 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 shutdown_connections 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4262819098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581070a19f0 0x5581070a8b20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 >> 172.21.15.169:0/4262819098 conn(0x55810709dd20 msgr2=0x55810709bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 shutdown_connections 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4262819098 wait complete. 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2c0034650 msgr2=0x7fe2c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2c0034650 0x7fe2c0036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55810707b4a0 tx=0x7fe3d0005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 msgr2=0x558107095410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 0x558107095410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe3e004a000 tx=0x7fe3e0010d30 comp rx=0 tx=0).stop 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 shutdown_connections 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2c0034650 0x7fe2c0036b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/4172266060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558107094ff0 0x558107095410 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 >> 172.21.15.169:0/4172266060 conn(0x55810708a140 msgr2=0x55810708cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 shutdown_connections 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/4172266060 wait complete. 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55810707f630 msgr2=0x558107081a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55810707f630 0x558107081a20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55810707be30 msgr2=0x55810707e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55810707be30 0x55810707e220 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558107084cc0 msgr2=0x5581070870b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558107084cc0 0x5581070870b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2cc034650 msgr2=0x7fe2cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe2cc034650 0x7fe2cc036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00ad000 tx=0x7fe3d00a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:23.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 msgr2=0x558107076eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 --2- 172.21.15.169:0/504562772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558106ef93c0 0x558107076eb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0002260 tx=0x7fe3e0000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:23.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e6c5e640 1 -- 172.21.15.169:0/504562772 reap_dead start 2024-09-13T06:29:23.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 shutdown_connections 2024-09-13T06:29:23.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 >> 172.21.15.169:0/504562772 conn(0x558106f7e1c0 msgr2=0x55810706a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 shutdown_connections 2024-09-13T06:29:23.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.033+0000 7fe3e894d980 1 -- 172.21.15.169:0/504562772 wait complete. 2024-09-13T06:29:23.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:29:23.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:29:23.044 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T06:29:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83e3ca980 1 Processor -- start 2024-09-13T06:29:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83e3ca980 1 -- start start 2024-09-13T06:29:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83e3ca980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562e9b847ad0 0x562e9b849ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83e3ca980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e9b6cbae0 con 0x562e9b7b7b00 2024-09-13T06:29:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83e3ca980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x562e9b6efe30 con 0x562e9b847ad0 2024-09-13T06:29:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83b6d9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562e9b847ad0 0x562e9b849ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83beda640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x562e9b7b7b00 0x562e9b8463b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45264/0 (socket says 172.21.15.169:45264) 2024-09-13T06:29:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83b6d9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562e9b847ad0 0x562e9b849ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36802/0 (socket says 172.21.15.169:36802) 2024-09-13T06:29:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83beda640 1 -- 172.21.15.169:0/3395498737 learned_addr learned my addr 172.21.15.169:0/3395498737 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83b6d9640 1 -- 172.21.15.169:0/3395498737 >> v1:172.21.15.112:6789/0 conn(0x562e9b7b7b00 legacy=0x562e9b8463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.117+0000 7fc83b6d9640 1 -- 172.21.15.169:0/3395498737 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9b84b410 con 0x562e9b847ad0 2024-09-13T06:29:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/3395498737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b847ad0 0x562e9b849ec0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc83000a480 tx=0x7fc83001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9de3c167300b471 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83aed8640 1 -- 172.21.15.169:0/3395498737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8300b0070 con 0x562e9b847ad0 2024-09-13T06:29:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83aed8640 1 -- 172.21.15.169:0/3395498737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8300ab540 con 0x562e9b847ad0 2024-09-13T06:29:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83aed8640 1 -- 172.21.15.169:0/3395498737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8300ab840 con 0x562e9b847ad0 2024-09-13T06:29:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 -- 172.21.15.169:0/3395498737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b847ad0 msgr2=0x562e9b849ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/3395498737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b847ad0 0x562e9b849ec0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc83000a480 tx=0x7fc83001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 -- 172.21.15.169:0/3395498737 shutdown_connections 2024-09-13T06:29:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/3395498737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b847ad0 0x562e9b849ec0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 -- 172.21.15.169:0/3395498737 >> 172.21.15.169:0/3395498737 conn(0x562e9b83e0a0 msgr2=0x562e9b8404c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 -- 172.21.15.169:0/3395498737 shutdown_connections 2024-09-13T06:29:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.121+0000 7fc83e3ca980 1 -- 172.21.15.169:0/3395498737 wait complete. 2024-09-13T06:29:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.133+0000 7fc83e3ca980 1 Processor -- start 2024-09-13T06:29:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.133+0000 7fc83e3ca980 1 -- start start 2024-09-13T06:29:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.133+0000 7fc83e3ca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b92eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.133+0000 7fc83e3ca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e9b6f1200 con 0x562e9b7b7b00 2024-09-13T06:29:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b92eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b92eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36804/0 (socket says 172.21.15.169:36804) 2024-09-13T06:29:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 -- 172.21.15.169:0/250073460 learned_addr learned my addr 172.21.15.169:0/250073460 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 -- 172.21.15.169:0/250073460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9b92f130 con 0x562e9b7b7b00 2024-09-13T06:29:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 --2- 172.21.15.169:0/250073460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b92eb60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0015f0 tx=0x7fc82c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9941fc6f116d012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc729e0b640 1 -- 172.21.15.169:0/250073460 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c004530 con 0x562e9b7b7b00 2024-09-13T06:29:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc729e0b640 1 -- 172.21.15.169:0/250073460 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0046f0 con 0x562e9b7b7b00 2024-09-13T06:29:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc729e0b640 1 -- 172.21.15.169:0/250073460 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c004a90 con 0x562e9b7b7b00 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- 172.21.15.169:0/250073460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 msgr2=0x562e9b92eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/250073460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b92eb60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0015f0 tx=0x7fc82c001ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- 172.21.15.169:0/250073460 shutdown_connections 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/250073460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b92eb60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- 172.21.15.169:0/250073460 >> 172.21.15.169:0/250073460 conn(0x562e9b83e0a0 msgr2=0x562e9b92a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- 172.21.15.169:0/250073460 shutdown_connections 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- 172.21.15.169:0/250073460 wait complete. 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 Processor -- start 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- start start 2024-09-13T06:29:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b935ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83e3ca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e9b84ae50 con 0x562e9b7b7b00 2024-09-13T06:29:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b935ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b935ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36814/0 (socket says 172.21.15.169:36814) 2024-09-13T06:29:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 -- 172.21.15.169:0/2156220064 learned_addr learned my addr 172.21.15.169:0/2156220064 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.137+0000 7fc83beda640 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9b936430 con 0x562e9b7b7b00 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83beda640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b935ef0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x562e9b92fd40 tx=0x7fc82c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc723fff640 1 -- 172.21.15.169:0/2156220064 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c013760 con 0x562e9b7b7b00 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e9b9366c0 con 0x562e9b7b7b00 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc723fff640 1 -- 172.21.15.169:0/2156220064 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c013900 con 0x562e9b7b7b00 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc723fff640 1 -- 172.21.15.169:0/2156220064 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c013be0 con 0x562e9b7b7b00 2024-09-13T06:29:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9b9393a0 con 0x562e9b7b7b00 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc723fff640 1 -- 172.21.15.169:0/2156220064 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc82c010070 con 0x562e9b7b7b00 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc723fff640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc724034650 0x7fc724036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc723fff640 1 -- 172.21.15.169:0/2156220064 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc82c018070 con 0x562e9b7b7b00 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc724034650 0x7fc724036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b847ad0 0x562e9b93cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b93d570 con 0x562e9b847ad0 2024-09-13T06:29:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83c6db640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b847ad0 0x562e9b93cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc724034650 0x7fc724036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8300ad000 tx=0x7fc8300a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83c6db640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b847ad0 0x562e9b93cff0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83c6db640 1 -- 172.21.15.169:0/2156220064 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b847ad0 2024-09-13T06:29:23.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b93e390 0x562e9b940780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b940dc0 con 0x562e9b93e390 2024-09-13T06:29:23.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83beda640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b93e390 0x562e9b940780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.141+0000 7fc83beda640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b93e390 0x562e9b940780 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83beda640 1 -- 172.21.15.169:0/2156220064 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc82c01b030 con 0x562e9b93e390 2024-09-13T06:29:23.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b942670 con 0x562e9b93e390 2024-09-13T06:29:23.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83beda640 1 -- 172.21.15.169:0/2156220064 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc82c01b030 con 0x562e9b93e390 2024-09-13T06:29:23.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9418a0 con 0x562e9b93e390 2024-09-13T06:29:23.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83beda640 1 -- 172.21.15.169:0/2156220064 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc82c01b030 con 0x562e9b93e390 2024-09-13T06:29:23.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b943a20 0x562e9b945e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b946350 con 0x562e9b943a20 2024-09-13T06:29:23.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b943a20 0x562e9b945e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b943a20 0x562e9b945e10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83b6d9640 1 -- 172.21.15.169:0/2156220064 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8300b3040 con 0x562e9b943a20 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 Processor -- start 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 -- start start 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 0x562e9b8423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83e3ca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e9b74a800 con 0x562e9b843d30 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 0x562e9b8423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 0x562e9b8423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36822/0 (socket says 172.21.15.169:36822) 2024-09-13T06:29:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.145+0000 7fc83beda640 1 -- 172.21.15.169:0/4113073716 learned_addr learned my addr 172.21.15.169:0/4113073716 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83beda640 1 -- 172.21.15.169:0/4113073716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9b844150 con 0x562e9b843d30 2024-09-13T06:29:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83beda640 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 0x562e9b8423b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc82c029f90 tx=0x7fc82c021d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc7217fa640 1 -- 172.21.15.169:0/4113073716 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c021e80 con 0x562e9b843d30 2024-09-13T06:29:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e9b842950 con 0x562e9b843d30 2024-09-13T06:29:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9b842e20 con 0x562e9b843d30 2024-09-13T06:29:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc7217fa640 1 -- 172.21.15.169:0/4113073716 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c010c90 con 0x562e9b843d30 2024-09-13T06:29:23.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc7217fa640 1 -- 172.21.15.169:0/4113073716 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0123c0 con 0x562e9b843d30 2024-09-13T06:29:23.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc7217fa640 1 -- 172.21.15.169:0/4113073716 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc82c012560 con 0x562e9b843d30 2024-09-13T06:29:23.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc7217fa640 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc714034650 0x7fc714036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc7217fa640 1 -- 172.21.15.169:0/4113073716 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc82c03d040 con 0x562e9b843d30 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc714034650 0x7fc714036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83e3ca980 1 Processor -- start 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83e3ca980 1 -- start start 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc714034650 0x7fc714036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc83001b2c0 tx=0x7fc830005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83e3ca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b962be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83e3ca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e9b92f4b0 con 0x562e9b9627e0 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b962be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b962be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36834/0 (socket says 172.21.15.169:36834) 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83beda640 1 -- 172.21.15.169:0/216606663 learned_addr learned my addr 172.21.15.169:0/216606663 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.149+0000 7fc83beda640 1 -- 172.21.15.169:0/216606663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9b9631b0 con 0x562e9b9627e0 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83beda640 1 --2- 172.21.15.169:0/216606663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b962be0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc82c033520 tx=0x7fc82c034500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8052ef53889ab5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc71affd640 1 -- 172.21.15.169:0/216606663 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c041a60 con 0x562e9b9627e0 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc71affd640 1 -- 172.21.15.169:0/216606663 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c063030 con 0x562e9b9627e0 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc71affd640 1 -- 172.21.15.169:0/216606663 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c028920 con 0x562e9b9627e0 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/216606663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 msgr2=0x562e9b962be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/216606663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b962be0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc82c033520 tx=0x7fc82c034500 comp rx=0 tx=0).stop 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/216606663 shutdown_connections 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/216606663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b962be0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/216606663 >> 172.21.15.169:0/216606663 conn(0x562e9b95ec10 msgr2=0x562e9b95cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/216606663 shutdown_connections 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/216606663 wait complete. 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 Processor -- start 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- start start 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b969a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562e9b963680 con 0x562e9b9627e0 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b969a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83beda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b969a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36836/0 (socket says 172.21.15.169:36836) 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 learned_addr learned my addr 172.21.15.169:0/1353130874 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9b969f50 con 0x562e9b9627e0 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83beda640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b969a10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc82c047250 tx=0x7fc82c036480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc7197fa640 1 -- 172.21.15.169:0/1353130874 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0533f0 con 0x562e9b9627e0 2024-09-13T06:29:23.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e9b969f50 con 0x562e9b9627e0 2024-09-13T06:29:23.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9b969f50 con 0x562e9b9627e0 2024-09-13T06:29:23.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc7197fa640 1 -- 172.21.15.169:0/1353130874 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0287f0 con 0x562e9b9627e0 2024-09-13T06:29:23.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc7197fa640 1 -- 172.21.15.169:0/1353130874 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c053590 con 0x562e9b9627e0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.153+0000 7fc7197fa640 1 -- 172.21.15.169:0/1353130874 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc82c053770 con 0x562e9b9627e0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc7197fa640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc704034650 0x7fc704036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc7197fa640 1 -- 172.21.15.169:0/1353130874 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc82c070070 con 0x562e9b9627e0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc704034650 0x7fc704036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b974b20 0x562e9b976fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b977730 con 0x562e9b974b20 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83c6db640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b974b20 0x562e9b976fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc704034650 0x7fc704036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc8300abaa0 tx=0x7fc8300b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83c6db640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b974b20 0x562e9b976fe0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 realm 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b973f50 con 0x562e9b974b20 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9781f0 con 0x562e9b974b20 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b978fd0 0x562e9b97b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83beda640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b978fd0 0x562e9b97b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83beda640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b978fd0 0x562e9b97b3c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc82c07a020 con 0x562e9b978fd0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.157+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97c2a0 con 0x562e9b978fd0 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc82c07a020 con 0x562e9b978fd0 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83e3ca980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83e3ca980 20 searching for the correct realm 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b97db00 0x562e9b97ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b980690 con 0x562e9b97db00 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b97db00 0x562e9b97ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83b6d9640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b97db00 0x562e9b97ffc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b980690 con 0x562e9b978fd0 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc82c07a020 con 0x562e9b978fd0 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83beda640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fc82c071bc0 0x7fc82c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x7fc82c071bc0 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fc82c071bc0 0x7fc82c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fc82c071bc0 0x7fc82c0712d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b97db00 2024-09-13T06:29:23.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.161+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c07a020 con 0x562e9b978fd0 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c07a020 con 0x562e9b978fd0 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x7fc82c071bc0 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x7fc82c071bc0 2024-09-13T06:29:23.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b97db00 2024-09-13T06:29:23.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.165+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b97db00 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b97db00 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x7fc82c071bc0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b974b20 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x7fc82c071bc0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b97db00 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x7fc82c071bc0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.169+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b97db00 2024-09-13T06:29:23.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97ba50 con 0x562e9b978fd0 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97bf10 con 0x562e9b974b20 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97c300 con 0x562e9b978fd0 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b97c300 con 0x562e9b97db00 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 zone default found 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 4 Realm: () 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:23.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 zonegroup default 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b980b10 con 0x7fc82c071bc0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.173+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b982d40 con 0x562e9b97db00 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9830e0 con 0x562e9b97db00 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 20 started sync module instance, tier type = 2024-09-13T06:29:23.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:23.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b982180 con 0x562e9b978fd0 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94758178923936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b982180 con 0x562e9b978fd0 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b983930 con 0x562e9b974b20 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.177+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94758178927744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b984180 con 0x562e9b974b20 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b984b40 con 0x562e9b978fd0 2024-09-13T06:29:23.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94758178927744] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94758178923936] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94758178932368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b984180 con 0x562e9b978fd0 2024-09-13T06:29:23.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b984ab0 con 0x7fc82c071bc0 2024-09-13T06:29:23.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94758178934576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b984ab0 con 0x7fc82c071bc0 2024-09-13T06:29:23.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b985e20 con 0x562e9b978fd0 2024-09-13T06:29:23.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.181+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94758178934576] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94758178932368] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94758178929872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b985970 con 0x562e9b978fd0 2024-09-13T06:29:23.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9866c0 con 0x562e9b97db00 2024-09-13T06:29:23.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94758178939408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b985970 con 0x562e9b97db00 2024-09-13T06:29:23.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b987530 con 0x562e9b97db00 2024-09-13T06:29:23.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94758178929872] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94758178943104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b987950 con 0x562e9b97db00 2024-09-13T06:29:23.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b988310 con 0x7fc82c071bc0 2024-09-13T06:29:23.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94758178939408] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94758178943104] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94758178944160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9878c0 con 0x7fc82c071bc0 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=0 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=1 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=2 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=3 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=4 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=5 2024-09-13T06:29:23.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.185+0000 7fc83e3ca980 20 add_watcher() i=6 2024-09-13T06:29:23.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94758178944160] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 20 add_watcher() i=7 2024-09-13T06:29:23.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:23.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b98b340 con 0x562e9b974b20 2024-09-13T06:29:23.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94758178946656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b988730 con 0x562e9b974b20 2024-09-13T06:29:23.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94758178946656] v31'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc6f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 5 note: GC not initialized 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc6f17e2640 20 reqs_thread_entry: start 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 20 Filter name: none 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc6ea7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ae8b0 con 0x7fc82c071bc0 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.189+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ad050 con 0x562e9b97db00 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:29:23.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ad920 con 0x7fc82c071bc0 2024-09-13T06:29:23.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:29:23.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94758179099760 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9b2350 con 0x562e9b97db00 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== watch-notify(notify (1) cookie 94758178939408 notify 133143986179 ret 0) ==== 598+0+0 (crc 0 0 0) 0x562e9b84b410 con 0x562e9b97db00 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc71a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94758178939408 notifier 4484 bl.length()=556 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(65 notify.5 [notify cookie 94758179099760 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc71a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc71a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc71a7fc640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc664003440 con 0x562e9b97db00 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== watch-notify(notify_complete (2) cookie 94758179099760 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8300dd650 con 0x562e9b97db00 2024-09-13T06:29:23.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.193+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ad470 con 0x562e9b97db00 2024-09-13T06:29:23.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83e3ca980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:29:23.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83e3ca980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83e3ca980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94758179114640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ad470 con 0x562e9b978fd0 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94758178932368 notify 133143986199 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562e9b842950 con 0x562e9b978fd0 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc71a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94758178932368 notifier 4484 bl.length()=177 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc71a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc71a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc71a7fc640 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc664003400 con 0x562e9b978fd0 2024-09-13T06:29:23.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [notify cookie 94758179114640 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify_complete (2) cookie 94758179114640 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e9b844150 con 0x562e9b978fd0 2024-09-13T06:29:23.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.201 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:29:23.197059Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:23.197049Z","tags":[],"group_ids":[]} 2024-09-13T06:29:23.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc6f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.197+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94758178946656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ac650 con 0x562e9b974b20 2024-09-13T06:29:23.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.201+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94758178946656] v31'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.201+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94758178923936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ac650 con 0x562e9b978fd0 2024-09-13T06:29:23.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.201+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94758178923936] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.201+0000 7fc83e3ca980 20 remove_watcher() i=0 2024-09-13T06:29:23.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.201+0000 7fc83e3ca980 2 removed watcher, disabling cache 2024-09-13T06:29:23.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.201+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94758178927744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ac650 con 0x562e9b974b20 2024-09-13T06:29:23.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94758178927744] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x562e9b974b20 2024-09-13T06:29:23.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83e3ca980 20 remove_watcher() i=1 2024-09-13T06:29:23.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94758178932368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b983480 con 0x562e9b978fd0 2024-09-13T06:29:23.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94758178932368] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83e3ca980 20 remove_watcher() i=2 2024-09-13T06:29:23.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94758178934576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ac650 con 0x7fc82c071bc0 2024-09-13T06:29:23.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94758178934576] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83e3ca980 20 remove_watcher() i=3 2024-09-13T06:29:23.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.205+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94758178929872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b984690 con 0x562e9b978fd0 2024-09-13T06:29:23.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83beda640 1 -- 172.21.15.169:0/1353130874 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94758178929872] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c094040 con 0x562e9b978fd0 2024-09-13T06:29:23.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83e3ca980 20 remove_watcher() i=4 2024-09-13T06:29:23.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94758178939408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b983480 con 0x562e9b97db00 2024-09-13T06:29:23.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94758178939408] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83e3ca980 20 remove_watcher() i=5 2024-09-13T06:29:23.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94758178943104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b9ac650 con 0x562e9b97db00 2024-09-13T06:29:23.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83b6d9640 1 -- 172.21.15.169:0/1353130874 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94758178943104] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8300c9030 con 0x562e9b97db00 2024-09-13T06:29:23.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83e3ca980 20 remove_watcher() i=6 2024-09-13T06:29:23.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.209+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94758178944160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e9b983cd0 con 0x7fc82c071bc0 2024-09-13T06:29:23.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94758178944160] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8340083f0 con 0x7fc82c071bc0 2024-09-13T06:29:23.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 20 remove_watcher() i=7 2024-09-13T06:29:23.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b978fd0 msgr2=0x562e9b97b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b978fd0 0x562e9b97b3c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b974b20 msgr2=0x562e9b976fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b974b20 0x562e9b976fe0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fc82c071bc0 msgr2=0x7fc82c0712d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fc82c071bc0 0x7fc82c0712d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b97db00 msgr2=0x562e9b97ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b97db00 0x562e9b97ffc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc704034650 msgr2=0x7fc704036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc704034650 0x7fc704036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc8300abaa0 tx=0x7fc8300b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 msgr2=0x562e9b969a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83c6db640 1 -- 172.21.15.169:0/1353130874 reap_dead start 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b969a10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc82c047250 tx=0x7fc82c036480 comp rx=0 tx=0).stop 2024-09-13T06:29:23.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 shutdown_connections 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/1353130874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b9627e0 0x562e9b969a10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 >> 172.21.15.169:0/1353130874 conn(0x562e9b95ec10 msgr2=0x562e9b95cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 shutdown_connections 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/1353130874 wait complete. 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc714034650 msgr2=0x7fc714036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc714034650 0x7fc714036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc83001b2c0 tx=0x7fc830005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 msgr2=0x562e9b8423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 0x562e9b8423b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc82c029f90 tx=0x7fc82c021d50 comp rx=0 tx=0).stop 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 shutdown_connections 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc714034650 0x7fc714036b10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/4113073716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b843d30 0x562e9b8423b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 >> 172.21.15.169:0/4113073716 conn(0x562e9b948ef0 msgr2=0x562e9b94b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 shutdown_connections 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/4113073716 wait complete. 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b93e390 msgr2=0x562e9b940780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562e9b93e390 0x562e9b940780 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b847ad0 msgr2=0x562e9b93cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562e9b847ad0 0x562e9b93cff0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b943a20 msgr2=0x562e9b945e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562e9b943a20 0x562e9b945e10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc724034650 msgr2=0x7fc724036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc724034650 0x7fc724036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8300ad000 tx=0x7fc8300a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 msgr2=0x562e9b935ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 --2- 172.21.15.169:0/2156220064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562e9b7b7b00 0x562e9b935ef0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x562e9b92fd40 tx=0x7fc82c000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:23.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83c6db640 1 -- 172.21.15.169:0/2156220064 reap_dead start 2024-09-13T06:29:23.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 shutdown_connections 2024-09-13T06:29:23.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 >> 172.21.15.169:0/2156220064 conn(0x562e9b83e0a0 msgr2=0x562e9b929310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 shutdown_connections 2024-09-13T06:29:23.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.213+0000 7fc83e3ca980 1 -- 172.21.15.169:0/2156220064 wait complete. 2024-09-13T06:29:23.224 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:29:23.197059Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:23.197049Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:23.230 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:29:23.235 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:23.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T06:29:23.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T06:29:23.235 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T06:29:23.299 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:23.299 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:23.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5af3f5980 1 Processor -- start 2024-09-13T06:29:23.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5af3f5980 1 -- start start 2024-09-13T06:29:23.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5af3f5980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564769a34c60 0x564769a37050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5af3f5980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647698b6ae0 con 0x564769a308e0 2024-09-13T06:29:23.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5af3f5980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5647698dae30 con 0x564769a34c60 2024-09-13T06:29:23.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5ac704640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564769a34c60 0x564769a37050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5acf05640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x564769a308e0 0x564769a30cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45270/0 (socket says 172.21.15.169:45270) 2024-09-13T06:29:23.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5acf05640 1 -- 172.21.15.169:0/1329462353 learned_addr learned my addr 172.21.15.169:0/1329462353 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:23.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5abf03640 1 -- 172.21.15.169:0/1329462353 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481293864 0 0) 0x5647698b6ae0 con 0x564769a308e0 2024-09-13T06:29:23.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5abf03640 1 -- 172.21.15.169:0/1329462353 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd598001e20 con 0x564769a308e0 2024-09-13T06:29:23.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5ac704640 1 -- 172.21.15.169:0/1329462353 >> v1:172.21.15.112:6789/0 conn(0x564769a308e0 legacy=0x564769a30cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.297+0000 7fd5ac704640 1 -- 172.21.15.169:0/1329462353 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769a385a0 con 0x564769a34c60 2024-09-13T06:29:23.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5ac704640 1 --2- 172.21.15.169:0/1329462353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a34c60 0x564769a37050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00a420 tx=0x7fd59c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a702973a1a251d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5abf03640 1 -- 172.21.15.169:0/1329462353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59c0af070 con 0x564769a34c60 2024-09-13T06:29:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5abf03640 1 -- 172.21.15.169:0/1329462353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c0aa530 con 0x564769a34c60 2024-09-13T06:29:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5abf03640 1 -- 172.21.15.169:0/1329462353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59c0aa850 con 0x564769a34c60 2024-09-13T06:29:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1329462353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a34c60 msgr2=0x564769a37050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1329462353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a34c60 0x564769a37050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00a420 tx=0x7fd59c01afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1329462353 shutdown_connections 2024-09-13T06:29:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1329462353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a34c60 0x564769a37050 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1329462353 >> 172.21.15.169:0/1329462353 conn(0x5647699a4230 msgr2=0x5647699a4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1329462353 shutdown_connections 2024-09-13T06:29:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.301+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1329462353 wait complete. 2024-09-13T06:29:23.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.313+0000 7fd5af3f5980 1 Processor -- start 2024-09-13T06:29:23.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.313+0000 7fd5af3f5980 1 -- start start 2024-09-13T06:29:23.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.313+0000 7fd5af3f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b1ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.313+0000 7fd5af3f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5647698dc200 con 0x564769a308e0 2024-09-13T06:29:23.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b1ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b1ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36860/0 (socket says 172.21.15.169:36860) 2024-09-13T06:29:23.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 -- 172.21.15.169:0/2782053792 learned_addr learned my addr 172.21.15.169:0/2782053792 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 -- 172.21.15.169:0/2782053792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769b1c020 con 0x564769a308e0 2024-09-13T06:29:23.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 --2- 172.21.15.169:0/2782053792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b1ba50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4001dc0 tx=0x7fd5a400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2006b68eb46516 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd49ae0d640 1 -- 172.21.15.169:0/2782053792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a4012020 con 0x564769a308e0 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd49ae0d640 1 -- 172.21.15.169:0/2782053792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a400e7c0 con 0x564769a308e0 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd49ae0d640 1 -- 172.21.15.169:0/2782053792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a400eb40 con 0x564769a308e0 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- 172.21.15.169:0/2782053792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 msgr2=0x564769b1ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/2782053792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b1ba50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4001dc0 tx=0x7fd5a400b6d0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- 172.21.15.169:0/2782053792 shutdown_connections 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/2782053792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b1ba50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- 172.21.15.169:0/2782053792 >> 172.21.15.169:0/2782053792 conn(0x5647699a4230 msgr2=0x564769b17680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- 172.21.15.169:0/2782053792 shutdown_connections 2024-09-13T06:29:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- 172.21.15.169:0/2782053792 wait complete. 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 Processor -- start 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- start start 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b22de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5af3f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564769a380a0 con 0x564769a308e0 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b22de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b22de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36868/0 (socket says 172.21.15.169:36868) 2024-09-13T06:29:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 -- 172.21.15.169:0/1146743651 learned_addr learned my addr 172.21.15.169:0/1146743651 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769b23320 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.317+0000 7fd5acf05640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b22de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x564769b1cc30 tx=0x7fd5a4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd49960a640 1 -- 172.21.15.169:0/1146743651 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a4012030 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564769b235b0 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564769b26290 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd49960a640 1 -- 172.21.15.169:0/1146743651 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a4001440 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd49960a640 1 -- 172.21.15.169:0/1146743651 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a401aaf0 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd49960a640 1 -- 172.21.15.169:0/1146743651 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5a4015020 con 0x564769a308e0 2024-09-13T06:29:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd49960a640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd494034650 0x7fd494036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd49960a640 1 -- 172.21.15.169:0/1146743651 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd5a4020030 con 0x564769a308e0 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5ac704640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd494034650 0x7fd494036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769a34c60 0x564769b29dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b2a410 con 0x564769a34c60 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5ad706640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769a34c60 0x564769b29dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5ac704640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd494034650 0x7fd494036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0ac000 tx=0x7fd59c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5ad706640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769a34c60 0x564769b29dd0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5ad706640 1 -- 172.21.15.169:0/1146743651 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769a34c60 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b2b200 0x564769b2d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b2dc30 con 0x564769b2b200 2024-09-13T06:29:23.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5acf05640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b2b200 0x564769b2d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.321+0000 7fd5acf05640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b2b200 0x564769b2d5f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 -- 172.21.15.169:0/1146743651 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5a4008030 con 0x564769b2b200 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b2f4e0 con 0x564769b2b200 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 -- 172.21.15.169:0/1146743651 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5a4008030 con 0x564769b2b200 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b2e650 con 0x564769b2b200 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 -- 172.21.15.169:0/1146743651 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5a4008030 con 0x564769b2b200 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b30890 0x564769b32c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b331c0 con 0x564769b30890 2024-09-13T06:29:23.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5ac704640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b30890 0x564769b32c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5ac704640 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b30890 0x564769b32c80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5ac704640 1 -- 172.21.15.169:0/1146743651 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd59c0b2070 con 0x564769b30890 2024-09-13T06:29:23.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 Processor -- start 2024-09-13T06:29:23.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 -- start start 2024-09-13T06:29:23.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 0x564769b40fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5af3f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564769935800 con 0x564769b40bb0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 0x564769b40fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 0x564769b40fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36874/0 (socket says 172.21.15.169:36874) 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 -- 172.21.15.169:0/714919901 learned_addr learned my addr 172.21.15.169:0/714919901 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.325+0000 7fd5acf05640 1 -- 172.21.15.169:0/714919901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769b41510 con 0x564769b40bb0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5acf05640 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 0x564769b40fd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40486c0 tx=0x7fd5a400df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd4927fc640 1 -- 172.21.15.169:0/714919901 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a401adc0 con 0x564769b40bb0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564769b417a0 con 0x564769b40bb0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564769b44420 con 0x564769b40bb0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd4927fc640 1 -- 172.21.15.169:0/714919901 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a403e020 con 0x564769b40bb0 2024-09-13T06:29:23.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd4927fc640 1 -- 172.21.15.169:0/714919901 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a4047210 con 0x564769b40bb0 2024-09-13T06:29:23.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd4927fc640 1 -- 172.21.15.169:0/714919901 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5a4009070 con 0x564769b40bb0 2024-09-13T06:29:23.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd4927fc640 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd484034650 0x7fd484036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd4927fc640 1 -- 172.21.15.169:0/714919901 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd5a403f030 con 0x564769b40bb0 2024-09-13T06:29:23.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5ac704640 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd484034650 0x7fd484036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5af3f5980 1 Processor -- start 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5af3f5980 1 -- start start 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5ac704640 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd484034650 0x7fd484036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x564769b273d0 tx=0x7fd59c005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5af3f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b4d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5af3f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564769b1c3a0 con 0x564769b4d4f0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b4d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b4d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36882/0 (socket says 172.21.15.169:36882) 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5acf05640 1 -- 172.21.15.169:0/1203174424 learned_addr learned my addr 172.21.15.169:0/1203174424 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5acf05640 1 -- 172.21.15.169:0/1203174424 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769b4dea0 con 0x564769b4d4f0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd5acf05640 1 --2- 172.21.15.169:0/1203174424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b4d8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd5a402dde0 tx=0x7fd5a404e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e41055864892bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd483fff640 1 -- 172.21.15.169:0/1203174424 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a4041320 con 0x564769b4d4f0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd483fff640 1 -- 172.21.15.169:0/1203174424 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a4048a70 con 0x564769b4d4f0 2024-09-13T06:29:23.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.329+0000 7fd483fff640 1 -- 172.21.15.169:0/1203174424 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a402d3f0 con 0x564769b4d4f0 2024-09-13T06:29:23.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1203174424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 msgr2=0x564769b4d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1203174424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b4d8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd5a402dde0 tx=0x7fd5a404e440 comp rx=0 tx=0).stop 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1203174424 shutdown_connections 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1203174424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b4d8d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1203174424 >> 172.21.15.169:0/1203174424 conn(0x564769b498d0 msgr2=0x564769b479d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1203174424 shutdown_connections 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1203174424 wait complete. 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 Processor -- start 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- start start 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564769b4e340 con 0x564769b4d4f0 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5acf05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36890/0 (socket says 172.21.15.169:36890) 2024-09-13T06:29:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 learned_addr learned my addr 172.21.15.169:0/3752277355 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769b54bf0 con 0x564769b4d4f0 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5acf05640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b546b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd5a402cd10 tx=0x7fd5a4005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd4827fc640 1 -- 172.21.15.169:0/3752277355 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a4041320 con 0x564769b4d4f0 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd4827fc640 1 -- 172.21.15.169:0/3752277355 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a4045bd0 con 0x564769b4d4f0 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564769b54bf0 con 0x564769b4d4f0 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd4827fc640 1 -- 172.21.15.169:0/3752277355 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5a401fae0 con 0x564769b4d4f0 2024-09-13T06:29:23.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564769b54bf0 con 0x564769b4d4f0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd4827fc640 1 -- 172.21.15.169:0/3752277355 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5a401fc80 con 0x564769b4d4f0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd4827fc640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd478034650 0x7fd478036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd4827fc640 1 -- 172.21.15.169:0/3752277355 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd5a4005050 con 0x564769b4d4f0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5ac704640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd478034650 0x7fd478036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769b5f6b0 0x564769b61b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b622c0 con 0x564769b5f6b0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.333+0000 7fd5ad706640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769b5f6b0 0x564769b61b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ac704640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd478034650 0x7fd478036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0aa500 tx=0x7fd59c0b8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ad706640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769b5f6b0 0x564769b61b70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 realm 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b5ebf0 con 0x564769b5f6b0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b62dd0 con 0x564769b5f6b0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b63bb0 0x564769b65fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b66600 con 0x564769b63bb0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5acf05640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b63bb0 0x564769b65fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5acf05640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b63bb0 0x564769b65fa0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b66ea0 con 0x564769b63bb0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:23.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 20 searching for the correct realm 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b68c10 0x564769b6b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ac704640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b68c10 0x564769b6b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ac704640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b68c10 0x564769b6b000 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.337+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd5a4017050 0x7fd5a4036390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x7fd5a4017050 2024-09-13T06:29:23.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd5a4017050 0x7fd5a4036390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd5a4017050 0x7fd5a4036390 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x7fd5a4017050 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.341+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x7fd5a4017050 2024-09-13T06:29:23.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x7fd5a4017050 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b5f6b0 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x7fd5a4017050 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.345+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x7fd5a4017050 2024-09-13T06:29:23.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b68c10 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564769b6b610 con 0x564769b63bb0 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:23.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b67820 con 0x564769b5f6b0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.349+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b67ca0 con 0x564769b63bb0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b680c0 con 0x564769b68c10 2024-09-13T06:29:23.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 zone default found 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 4 Realm: () 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 zonegroup default 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b6ba70 con 0x7fd5a4017050 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b6dca0 con 0x564769b68c10 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b6e040 con 0x564769b68c10 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 started sync module instance, tier type = 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6d0e0 con 0x564769b63bb0 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864716256512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6d0e0 con 0x564769b63bb0 2024-09-13T06:29:23.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.353+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6e8f0 con 0x564769b5f6b0 2024-09-13T06:29:23.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864716260320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6f190 con 0x564769b5f6b0 2024-09-13T06:29:23.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6fbb0 con 0x564769b63bb0 2024-09-13T06:29:23.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864716260320] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864716256512] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864716265120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6ece0 con 0x564769b63bb0 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b70450 con 0x7fd5a4017050 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864716267424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b6ece0 con 0x7fd5a4017050 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.357+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b70ed0 con 0x564769b63bb0 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864716265120] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864716267424] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864716268480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b709e0 con 0x564769b63bb0 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b71770 con 0x564769b68c10 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864716272320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b709e0 con 0x564769b68c10 2024-09-13T06:29:23.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b725e0 con 0x564769b68c10 2024-09-13T06:29:23.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864716268480] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864716254256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b72e30 con 0x564769b68c10 2024-09-13T06:29:23.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b73700 con 0x7fd5a4017050 2024-09-13T06:29:23.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.361+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864716272320] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864716254256] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864716274448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b72e30 con 0x7fd5a4017050 2024-09-13T06:29:23.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=0 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=1 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=2 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=3 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=4 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=5 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=6 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864716274448] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 add_watcher() i=7 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b72e30 con 0x564769b5f6b0 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864716278144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b72dd0 con 0x564769b5f6b0 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864716278144] v31'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd462fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.365+0000 7fd5af3f5980 5 note: GC not initialized 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd461fe3640 20 reqs_thread_entry: start 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5af3f5980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5af3f5980 20 Filter name: none 2024-09-13T06:29:23.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd3d37fe640 20 reqs_thread_entry: start 2024-09-13T06:29:23.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5af3f5980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564769b997b0 con 0x7fd5a4017050 2024-09-13T06:29:23.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5af3f5980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:23.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd462fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864716278144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b5f6b0 2024-09-13T06:29:23.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.369+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94864716278144] v31'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864716256512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b63bb0 2024-09-13T06:29:23.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94864716256512] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5af3f5980 20 remove_watcher() i=0 2024-09-13T06:29:23.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5af3f5980 2 removed watcher, disabling cache 2024-09-13T06:29:23.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864716260320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b5f6b0 2024-09-13T06:29:23.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94864716260320] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x564769b5f6b0 2024-09-13T06:29:23.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5af3f5980 20 remove_watcher() i=1 2024-09-13T06:29:23.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.373+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864716265120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b63bb0 2024-09-13T06:29:23.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94864716265120] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5af3f5980 20 remove_watcher() i=2 2024-09-13T06:29:23.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864716267424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x7fd5a4017050 2024-09-13T06:29:23.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94864716267424] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5af3f5980 20 remove_watcher() i=3 2024-09-13T06:29:23.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864716268480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b63bb0 2024-09-13T06:29:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5acf05640 1 -- 172.21.15.169:0/3752277355 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94864716268480] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5a406d070 con 0x564769b63bb0 2024-09-13T06:29:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.377+0000 7fd5af3f5980 20 remove_watcher() i=4 2024-09-13T06:29:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864716272320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b68c10 2024-09-13T06:29:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94864716272320] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 20 remove_watcher() i=5 2024-09-13T06:29:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864716254256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x564769b68c10 2024-09-13T06:29:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5ac704640 1 -- 172.21.15.169:0/3752277355 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94864716254256] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0c8030 con 0x564769b68c10 2024-09-13T06:29:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 20 remove_watcher() i=6 2024-09-13T06:29:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864716274448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564769b97760 con 0x7fd5a4017050 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94864716274448] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5940083f0 con 0x7fd5a4017050 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 20 remove_watcher() i=7 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b63bb0 msgr2=0x564769b65fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b63bb0 0x564769b65fa0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769b5f6b0 msgr2=0x564769b61b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769b5f6b0 0x564769b61b70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd5a4017050 msgr2=0x7fd5a4036390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd5a4017050 0x7fd5a4036390 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b68c10 msgr2=0x564769b6b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b68c10 0x564769b6b000 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd478034650 msgr2=0x7fd478036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd478034650 0x7fd478036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0aa500 tx=0x7fd59c0b8040 comp rx=0 tx=0).stop 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5ad706640 1 -- 172.21.15.169:0/3752277355 reap_dead start 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 msgr2=0x564769b546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b546b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd5a402cd10 tx=0x7fd5a4005eb0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 shutdown_connections 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/3752277355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b4d4f0 0x564769b546b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 >> 172.21.15.169:0/3752277355 conn(0x564769b498d0 msgr2=0x564769b479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 shutdown_connections 2024-09-13T06:29:23.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/3752277355 wait complete. 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd484034650 msgr2=0x7fd484036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd484034650 0x7fd484036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x564769b273d0 tx=0x7fd59c005d90 comp rx=0 tx=0).stop 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 msgr2=0x564769b40fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 0x564769b40fd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40486c0 tx=0x7fd5a400df10 comp rx=0 tx=0).stop 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 shutdown_connections 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd484034650 0x7fd484036b10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/714919901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769b40bb0 0x564769b40fd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 >> 172.21.15.169:0/714919901 conn(0x564769b35d00 msgr2=0x564769b38780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 shutdown_connections 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.381+0000 7fd5af3f5980 1 -- 172.21.15.169:0/714919901 wait complete. 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b2b200 msgr2=0x564769b2d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564769b2b200 0x564769b2d5f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769a34c60 msgr2=0x564769b29dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564769a34c60 0x564769b29dd0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b30890 msgr2=0x564769b32c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564769b30890 0x564769b32c80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd494034650 msgr2=0x7fd494036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd494034650 0x7fd494036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0ac000 tx=0x7fd59c0a5000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 msgr2=0x564769b22de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 --2- 172.21.15.169:0/1146743651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564769a308e0 0x564769b22de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x564769b1cc30 tx=0x7fd5a4000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5ad706640 1 -- 172.21.15.169:0/1146743651 reap_dead start 2024-09-13T06:29:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 shutdown_connections 2024-09-13T06:29:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 >> 172.21.15.169:0/1146743651 conn(0x5647699a4230 msgr2=0x564769b16200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 shutdown_connections 2024-09-13T06:29:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.385+0000 7fd5af3f5980 1 -- 172.21.15.169:0/1146743651 wait complete. 2024-09-13T06:29:23.395 INFO:teuthology.orchestra.run.smithi169.stdout:{"key":"bucket:myfoo","ver":{"tag":"_8rajPJ4HJbZNkanTDiDUMUz","ver":2},"mtime":"2024-09-13T06:29:23.020440Z","data":{"bucket":{"name":"myfoo","marker":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","bucket_id":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T06:29:21.659221Z","linked":false,"has_bucket_info":false}} 2024-09-13T06:29:23.395 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_8rajPJ4HJbZNkanTDiDUMUz', 'ver': 2}, 'mtime': '2024-09-13T06:29:23.020440Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'bucket_id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T06:29:21.659221Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T06:29:23.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1'] 2024-09-13T06:29:23.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1'] 2024-09-13T06:29:23.396 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a74d19980 1 Processor -- start 2024-09-13T06:29:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a74d19980 1 -- start start 2024-09-13T06:29:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a74d19980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d09faae970 0x55d09fab0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a74d19980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d09f932ae0 con 0x55d09faaa5f0 2024-09-13T06:29:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a74d19980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55d09f956e30 con 0x55d09faae970 2024-09-13T06:29:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a72829640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55d09faaa5f0 0x55d09faaa9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45280/0 (socket says 172.21.15.169:45280) 2024-09-13T06:29:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a72028640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d09faae970 0x55d09fab0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.473+0000 7f6a72829640 1 -- 172.21.15.169:0/3929657811 learned_addr learned my addr 172.21.15.169:0/3929657811 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a72028640 1 -- 172.21.15.169:0/3929657811 >> v1:172.21.15.112:6789/0 conn(0x55d09faaa5f0 legacy=0x55d09faaa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a72028640 1 -- 172.21.15.169:0/3929657811 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09fab22b0 con 0x55d09faae970 2024-09-13T06:29:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a72028640 1 --2- 172.21.15.169:0/3929657811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faae970 0x55d09fab0d60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800a420 tx=0x7f6a6801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c083e42127ddd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a71827640 1 -- 172.21.15.169:0/3929657811 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a680af070 con 0x55d09faae970 2024-09-13T06:29:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a71827640 1 -- 172.21.15.169:0/3929657811 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a680aa530 con 0x55d09faae970 2024-09-13T06:29:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a71827640 1 -- 172.21.15.169:0/3929657811 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a680aa850 con 0x55d09faae970 2024-09-13T06:29:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 -- 172.21.15.169:0/3929657811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faae970 msgr2=0x55d09fab0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3929657811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faae970 0x55d09fab0d60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800a420 tx=0x7f6a6801afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 -- 172.21.15.169:0/3929657811 shutdown_connections 2024-09-13T06:29:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3929657811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faae970 0x55d09fab0d60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 -- 172.21.15.169:0/3929657811 >> 172.21.15.169:0/3929657811 conn(0x55d09faa6110 msgr2=0x55d09faa8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 -- 172.21.15.169:0/3929657811 shutdown_connections 2024-09-13T06:29:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.477+0000 7f6a74d19980 1 -- 172.21.15.169:0/3929657811 wait complete. 2024-09-13T06:29:23.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 Processor -- start 2024-09-13T06:29:23.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- start start 2024-09-13T06:29:23.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb95ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d09f958200 con 0x55d09faaa5f0 2024-09-13T06:29:23.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb95ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb95ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36912/0 (socket says 172.21.15.169:36912) 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 -- 172.21.15.169:0/2855337467 learned_addr learned my addr 172.21.15.169:0/2855337467 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 -- 172.21.15.169:0/2855337467 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09fb960b0 con 0x55d09faaa5f0 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 --2- 172.21.15.169:0/2855337467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb95ae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001e20 tx=0x7f6a6400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22ed8703a4f8a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6960e09640 1 -- 172.21.15.169:0/2855337467 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64012020 con 0x55d09faaa5f0 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6960e09640 1 -- 172.21.15.169:0/2855337467 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6400e7c0 con 0x55d09faaa5f0 2024-09-13T06:29:23.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6960e09640 1 -- 172.21.15.169:0/2855337467 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6400eb00 con 0x55d09faaa5f0 2024-09-13T06:29:23.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- 172.21.15.169:0/2855337467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 msgr2=0x55d09fb95ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 --2- 172.21.15.169:0/2855337467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb95ae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001e20 tx=0x7f6a6400b790 comp rx=0 tx=0).stop 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- 172.21.15.169:0/2855337467 shutdown_connections 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 --2- 172.21.15.169:0/2855337467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb95ae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- 172.21.15.169:0/2855337467 >> 172.21.15.169:0/2855337467 conn(0x55d09faa6110 msgr2=0x55d09fb91710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- 172.21.15.169:0/2855337467 shutdown_connections 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- 172.21.15.169:0/2855337467 wait complete. 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 Processor -- start 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- start start 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb9cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a74d19980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d09fab1db0 con 0x55d09faaa5f0 2024-09-13T06:29:23.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb9cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb9cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36928/0 (socket says 172.21.15.169:36928) 2024-09-13T06:29:23.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.493+0000 7f6a72829640 1 -- 172.21.15.169:0/230889773 learned_addr learned my addr 172.21.15.169:0/230889773 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a72829640 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09fb9d430 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a72829640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb9cef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001e20 tx=0x7f6a64000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f695f606640 1 -- 172.21.15.169:0/230889773 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64012030 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d09fb9d6c0 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f695f606640 1 -- 172.21.15.169:0/230889773 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64001480 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f695f606640 1 -- 172.21.15.169:0/230889773 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6401a940 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09fba03a0 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f695f606640 1 -- 172.21.15.169:0/230889773 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a64015020 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f695f606640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6958034650 0x7f6958036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f695f606640 1 -- 172.21.15.169:0/230889773 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f6a64020030 con 0x55d09faaa5f0 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09faae970 0x55d09fba3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a72028640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6958034650 0x7f6958036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fba4530 con 0x55d09faae970 2024-09-13T06:29:23.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a7302a640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09faae970 0x55d09fba3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a72028640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6958034650 0x7f6958036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a680ac000 tx=0x7f6a680a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a7302a640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09faae970 0x55d09fba3ec0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a7302a640 1 -- 172.21.15.169:0/230889773 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09faae970 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fba5320 0x55d09fba7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fba7d40 con 0x55d09fba5320 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.497+0000 7f6a72829640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fba5320 0x55d09fba7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72829640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fba5320 0x55d09fba7710 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72829640 1 -- 172.21.15.169:0/230889773 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a64008030 con 0x55d09fba5320 2024-09-13T06:29:23.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fba95f0 con 0x55d09fba5320 2024-09-13T06:29:23.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72829640 1 -- 172.21.15.169:0/230889773 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a64008030 con 0x55d09fba5320 2024-09-13T06:29:23.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fba8820 con 0x55d09fba5320 2024-09-13T06:29:23.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72829640 1 -- 172.21.15.169:0/230889773 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a64008030 con 0x55d09fba5320 2024-09-13T06:29:23.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbaa9a0 0x55d09fbacd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbad2d0 con 0x55d09fbaa9a0 2024-09-13T06:29:23.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72028640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbaa9a0 0x55d09fbacd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72028640 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbaa9a0 0x55d09fbacd90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a72028640 1 -- 172.21.15.169:0/230889773 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a680b2070 con 0x55d09fbaa9a0 2024-09-13T06:29:23.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 Processor -- start 2024-09-13T06:29:23.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 -- start start 2024-09-13T06:29:23.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 0x55d09fbbb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.501+0000 7f6a74d19980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d09f9b1800 con 0x55d09fbbacb0 2024-09-13T06:29:23.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 0x55d09fbbb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 0x55d09fbbb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36934/0 (socket says 172.21.15.169:36934) 2024-09-13T06:29:23.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 -- 172.21.15.169:0/1590702504 learned_addr learned my addr 172.21.15.169:0/1590702504 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 -- 172.21.15.169:0/1590702504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09fbbb610 con 0x55d09fbbacb0 2024-09-13T06:29:23.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 0x55d09fbbb0d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6a6404a140 tx=0x7f6a6401af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f695ce01640 1 -- 172.21.15.169:0/1590702504 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64017e60 con 0x55d09fbbacb0 2024-09-13T06:29:23.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f695ce01640 1 -- 172.21.15.169:0/1590702504 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6400c580 con 0x55d09fbbacb0 2024-09-13T06:29:23.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d09fbbb8a0 con 0x55d09fbbacb0 2024-09-13T06:29:23.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f695ce01640 1 -- 172.21.15.169:0/1590702504 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6400c880 con 0x55d09fbbacb0 2024-09-13T06:29:23.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09fbbe520 con 0x55d09fbbacb0 2024-09-13T06:29:23.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f695ce01640 1 -- 172.21.15.169:0/1590702504 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a64009070 con 0x55d09fbbacb0 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f695ce01640 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f694c034600 0x7f694c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f695ce01640 1 -- 172.21.15.169:0/1590702504 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f6a64005050 con 0x55d09fbbacb0 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72028640 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f694c034600 0x7f694c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a74d19980 1 Processor -- start 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a74d19980 1 -- start start 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72028640 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f694c034600 0x7f694c036ac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6a68017be0 tx=0x7f6a68005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a74d19980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fa1f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a74d19980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d09fb96430 con 0x55d09fa1f350 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fa1f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fa1f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36946/0 (socket says 172.21.15.169:36946) 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.505+0000 7f6a72829640 1 -- 172.21.15.169:0/1636659308 learned_addr learned my addr 172.21.15.169:0/1636659308 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 -- 172.21.15.169:0/1636659308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09fa1fd20 con 0x55d09fa1f350 2024-09-13T06:29:23.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 --2- 172.21.15.169:0/1636659308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fa1f750 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6a6402de80 tx=0x7f6a64024b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155f911394dd41b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f69567fc640 1 -- 172.21.15.169:0/1636659308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64060070 con 0x55d09fa1f350 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f69567fc640 1 -- 172.21.15.169:0/1636659308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6400d510 con 0x55d09fa1f350 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f69567fc640 1 -- 172.21.15.169:0/1636659308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64055040 con 0x55d09fa1f350 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/1636659308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 msgr2=0x55d09fa1f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 --2- 172.21.15.169:0/1636659308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fa1f750 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6a6402de80 tx=0x7f6a64024b70 comp rx=0 tx=0).stop 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/1636659308 shutdown_connections 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 --2- 172.21.15.169:0/1636659308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fa1f750 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/1636659308 >> 172.21.15.169:0/1636659308 conn(0x55d09fbc39d0 msgr2=0x55d09fbc1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/1636659308 shutdown_connections 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/1636659308 wait complete. 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 Processor -- start 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- start start 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fbd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d09fa20350 con 0x55d09fa1f350 2024-09-13T06:29:23.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fbd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fbd09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36956/0 (socket says 172.21.15.169:36956) 2024-09-13T06:29:23.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 learned_addr learned my addr 172.21.15.169:0/3077734010 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09fbd0f30 con 0x55d09fa1f350 2024-09-13T06:29:23.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a72829640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fbd09f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6a6402de80 tx=0x7f6a64039f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6954ff9640 1 -- 172.21.15.169:0/3077734010 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64060030 con 0x55d09fa1f350 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d09fbd0f30 con 0x55d09fa1f350 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6954ff9640 1 -- 172.21.15.169:0/3077734010 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64027b10 con 0x55d09fa1f350 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6954ff9640 1 -- 172.21.15.169:0/3077734010 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64027df0 con 0x55d09fa1f350 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.509+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09fbd0f30 con 0x55d09fa1f350 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6954ff9640 1 -- 172.21.15.169:0/3077734010 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a6406e020 con 0x55d09fa1f350 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6954ff9640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f693c0346a0 0x7f693c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6954ff9640 1 -- 172.21.15.169:0/3077734010 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f6a6406c020 con 0x55d09fa1f350 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a72028640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f693c0346a0 0x7f693c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09fbdbaa0 0x55d09fbddf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbde690 con 0x55d09fbdbaa0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a7302a640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09fbdbaa0 0x55d09fbddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a72028640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f693c0346a0 0x7f693c036b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d09fba9580 tx=0x7f6a680a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a7302a640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09fbdbaa0 0x55d09fbddf40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 realm 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbdaf90 con 0x55d09fbdbaa0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbdf120 con 0x55d09fbdbaa0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fbdff00 0x55d09fbe22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe2950 con 0x55d09fbdff00 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a72829640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fbdff00 0x55d09fbe22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a72829640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fbdff00 0x55d09fbe22f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a64058040 con 0x55d09fbdff00 2024-09-13T06:29:23.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.513+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe2e90 con 0x55d09fbdff00 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a64058040 con 0x55d09fbdff00 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a74d19980 20 searching for the correct realm 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbe4670 0x55d09fbe6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe7200 con 0x55d09fbe4670 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72028640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbe4670 0x55d09fbe6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72028640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbe4670 0x55d09fbe6b30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe7200 con 0x55d09fbdff00 2024-09-13T06:29:23.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a64058040 con 0x55d09fbdff00 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72829640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a64017050 0x7f6a640128e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x7f6a64017050 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a64017050 0x7f6a640128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a64017050 0x7f6a640128e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbe4670 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.517+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64058040 con 0x55d09fbdff00 2024-09-13T06:29:23.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64058040 con 0x55d09fbdff00 2024-09-13T06:29:23.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x7f6a64017050 2024-09-13T06:29:23.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x7f6a64017050 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbe4670 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.521+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbe4670 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbe4670 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x7f6a64017050 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdbaa0 2024-09-13T06:29:23.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x7f6a64017050 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbe4670 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x7f6a64017050 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.525+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbe4670 2024-09-13T06:29:23.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6a6405a030 con 0x55d09fbdff00 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe2aa0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe2e90 con 0x55d09fbdff00 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe2e90 con 0x55d09fbe4670 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 zone default found 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 4 Realm: () 2024-09-13T06:29:23.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 zonegroup default 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe7680 con 0x7f6a64017050 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe98b0 con 0x55d09fbe4670 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe9c50 con 0x55d09fbe4670 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 started sync module instance, tier type = 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.529+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe8cf0 con 0x55d09fbdff00 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94354521624848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe8cf0 con 0x55d09fbdff00 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbea4a0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94354521628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbeacf0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbeb6f0 con 0x55d09fbdff00 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94354521624848] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.533+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94354521628656] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94354521622592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbea840 con 0x55d09fbdff00 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbebf90 con 0x7f6a64017050 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94354521635552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbea840 con 0x7f6a64017050 2024-09-13T06:29:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbeca30 con 0x55d09fbdff00 2024-09-13T06:29:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94354521622592] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94354521635552] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94354521636608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbec9f0 con 0x55d09fbdff00 2024-09-13T06:29:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.537+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbece50 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94354521633280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbed6f0 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbee0b0 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94354521636608] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94354521633280] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94354521644032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbee4a0 con 0x55d09fbe4670 2024-09-13T06:29:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbeecf0 con 0x7f6a64017050 2024-09-13T06:29:23.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94354521646720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbef160 con 0x7f6a64017050 2024-09-13T06:29:23.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=0 2024-09-13T06:29:23.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=1 2024-09-13T06:29:23.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=2 2024-09-13T06:29:23.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=3 2024-09-13T06:29:23.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=4 2024-09-13T06:29:23.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=5 2024-09-13T06:29:23.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94354521644032] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.541+0000 7f6a74d19980 20 add_watcher() i=6 2024-09-13T06:29:23.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94354521646720] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 add_watcher() i=7 2024-09-13T06:29:23.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:23.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbec520 con 0x55d09fbdbaa0 2024-09-13T06:29:23.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94354521648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbec520 con 0x55d09fbdbaa0 2024-09-13T06:29:23.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94354521648032] v31'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f69297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:23.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:23.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 5 note: GC not initialized 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f68a3fff640 20 reqs_thread_entry: start 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 Filter name: none 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f68a1ffb640 20 reqs_thread_entry: start 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc15840 con 0x7f6a64017050 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc17920 con 0x7f6a64017050 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.545+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc19180 con 0x55d09fbe4670 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:23.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:23.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:23.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:23.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T06:29:23.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc1d780 con 0x7f6a64017050 2024-09-13T06:29:23.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc236c0 con 0x55d09fbe4670 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(66 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.549+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94354521819664 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc1dbb0 con 0x55d09fbe4670 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== watch-notify(notify (1) cookie 94354521633280 notify 133143986180 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55d09fc19570 con 0x55d09fbe4670 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f69567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94354521633280 notifier 4498 bl.length()=752 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f69567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f69567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f69567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:23.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f69567fc640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6938003eb0 con 0x55d09fbe4670 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(67 notify.5 [notify cookie 94354521819664 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== watch-notify(notify_complete (2) cookie 94354521819664 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d09fc186b0 con 0x55d09fbe4670 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_sources= new_sources= 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential sources added=[] removed=[] 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_dests= new_dests= 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential dests added=[] removed=[] 2024-09-13T06:29:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc21ea0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(69 fud.buckets [call] v31'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc22eb0 con 0x7f6a64017050 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94354521819664 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc22350 con 0x55d09fbe4670 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== watch-notify(notify (1) cookie 94354521644032 notify 133143986181 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f6a680bd1f0 con 0x55d09fbe4670 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6955ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94354521644032 notifier 4498 bl.length()=314 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6955ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6955ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(71 notify.6 [notify cookie 94354521819664 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6955ffb640 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f68a8003410 con 0x55d09fbe4670 2024-09-13T06:29:23.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.553+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== watch-notify(notify_complete (2) cookie 94354521819664 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d09fab22b0 con 0x55d09fbe4670 2024-09-13T06:29:23.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.557+0000 7f69297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.557+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94354521648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbdbaa0 2024-09-13T06:29:23.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.557+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94354521648032] v31'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.557+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94354521624848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbdff00 2024-09-13T06:29:23.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94354521624848] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 20 remove_watcher() i=0 2024-09-13T06:29:23.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 2 removed watcher, disabling cache 2024-09-13T06:29:23.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94354521628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbdbaa0 2024-09-13T06:29:23.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94354521628656] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x55d09fbdbaa0 2024-09-13T06:29:23.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 20 remove_watcher() i=1 2024-09-13T06:29:23.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94354521622592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbdff00 2024-09-13T06:29:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94354521622592] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 20 remove_watcher() i=2 2024-09-13T06:29:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.561+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94354521635552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbe8840 con 0x7f6a64017050 2024-09-13T06:29:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94354521635552] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a74d19980 20 remove_watcher() i=3 2024-09-13T06:29:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94354521636608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbdff00 2024-09-13T06:29:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a72829640 1 -- 172.21.15.169:0/3077734010 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94354521636608] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64087040 con 0x55d09fbdff00 2024-09-13T06:29:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a74d19980 20 remove_watcher() i=4 2024-09-13T06:29:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94354521633280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbe4670 2024-09-13T06:29:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94354521633280] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a74d19980 20 remove_watcher() i=5 2024-09-13T06:29:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.565+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94354521644032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fc13670 con 0x55d09fbe4670 2024-09-13T06:29:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a72028640 1 -- 172.21.15.169:0/3077734010 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94354521644032] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680c9070 con 0x55d09fbe4670 2024-09-13T06:29:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 20 remove_watcher() i=6 2024-09-13T06:29:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94354521646720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d09fbedc00 con 0x7f6a64017050 2024-09-13T06:29:23.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94354521646720] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c0083f0 con 0x7f6a64017050 2024-09-13T06:29:23.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 20 remove_watcher() i=7 2024-09-13T06:29:23.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fbdff00 msgr2=0x55d09fbe22f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fbdff00 0x55d09fbe22f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09fbdbaa0 msgr2=0x55d09fbddf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09fbdbaa0 0x55d09fbddf40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a64017050 msgr2=0x7f6a640128e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a64017050 0x7f6a640128e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbe4670 msgr2=0x55d09fbe6b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbe4670 0x55d09fbe6b30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f693c0346a0 msgr2=0x7f693c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f693c0346a0 0x7f693c036b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d09fba9580 tx=0x7f6a680a7000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 msgr2=0x55d09fbd09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/3077734010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fa1f350 0x55d09fbd09f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6a6402de80 tx=0x7f6a64039f40 comp rx=0 tx=0).stop 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 reap_dead start 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a7302a640 1 -- 172.21.15.169:0/3077734010 reap_dead start 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 shutdown_connections 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 >> 172.21.15.169:0/3077734010 conn(0x55d09fbc39d0 msgr2=0x55d09fbc1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 shutdown_connections 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/3077734010 wait complete. 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f694c034600 msgr2=0x7f694c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f694c034600 0x7f694c036ac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6a68017be0 tx=0x7f6a68005d90 comp rx=0 tx=0).stop 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 msgr2=0x55d09fbbb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 0x55d09fbbb0d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6a6404a140 tx=0x7f6a6401af70 comp rx=0 tx=0).stop 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 shutdown_connections 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f694c034600 0x7f694c036ac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/1590702504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09fbbacb0 0x55d09fbbb0d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 >> 172.21.15.169:0/1590702504 conn(0x55d09fbafe00 msgr2=0x55d09fbb2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 shutdown_connections 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/1590702504 wait complete. 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fba5320 msgr2=0x55d09fba7710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d09fba5320 0x55d09fba7710 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09faae970 msgr2=0x55d09fba3ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d09faae970 0x55d09fba3ec0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbaa9a0 msgr2=0x55d09fbacd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d09fbaa9a0 0x55d09fbacd90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6958034650 msgr2=0x7f6958036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6958034650 0x7f6958036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a680ac000 tx=0x7f6a680a5000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 msgr2=0x55d09fb9cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 --2- 172.21.15.169:0/230889773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d09faaa5f0 0x55d09fb9cef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001e20 tx=0x7f6a64000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a7302a640 1 -- 172.21.15.169:0/230889773 reap_dead start 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 shutdown_connections 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 >> 172.21.15.169:0/230889773 conn(0x55d09faa6110 msgr2=0x55d09fb90290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 shutdown_connections 2024-09-13T06:29:23.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.569+0000 7f6a74d19980 1 -- 172.21.15.169:0/230889773 wait complete. 2024-09-13T06:29:23.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T06:29:23.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T06:29:23.582 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T06:29:23.653 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:23.653 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:23.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcf6f2980 1 Processor -- start 2024-09-13T06:29:23.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcf6f2980 1 -- start start 2024-09-13T06:29:23.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcf6f2980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ed1e728e0 0x560ed1e72cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcf6f2980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ed1cf8ae0 con 0x560ed1e73230 2024-09-13T06:29:23.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcf6f2980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x560ed1d1ce30 con 0x560ed1e728e0 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcd202640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ed1e728e0 0x560ed1e72cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcca01640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x560ed1e73230 0x560ed1e77c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45286/0 (socket says 172.21.15.169:45286) 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcca01640 1 -- 172.21.15.169:0/561619881 learned_addr learned my addr 172.21.15.169:0/561619881 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabc7fff640 1 -- 172.21.15.169:0/561619881 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024634099 0 0) 0x560ed1cf8ae0 con 0x560ed1e73230 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabc7fff640 1 -- 172.21.15.169:0/561619881 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabbc001e20 con 0x560ed1e73230 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcd202640 1 -- 172.21.15.169:0/561619881 >> v1:172.21.15.112:6789/0 conn(0x560ed1e73230 legacy=0x560ed1e77c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.653+0000 7fabcd202640 1 -- 172.21.15.169:0/561619881 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed1e7a4b0 con 0x560ed1e728e0 2024-09-13T06:29:23.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcd202640 1 --2- 172.21.15.169:0/561619881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1e72cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fabc800a420 tx=0x7fabc801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b06f434df174fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabc7fff640 1 -- 172.21.15.169:0/561619881 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80af070 con 0x560ed1e728e0 2024-09-13T06:29:23.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabc7fff640 1 -- 172.21.15.169:0/561619881 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80aa530 con 0x560ed1e728e0 2024-09-13T06:29:23.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabc7fff640 1 -- 172.21.15.169:0/561619881 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80aa850 con 0x560ed1e728e0 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 -- 172.21.15.169:0/561619881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 msgr2=0x560ed1e72cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/561619881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1e72cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fabc800a420 tx=0x7fabc801afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 -- 172.21.15.169:0/561619881 shutdown_connections 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/561619881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1e72cc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 -- 172.21.15.169:0/561619881 >> 172.21.15.169:0/561619881 conn(0x560ed1de6230 msgr2=0x560ed1de6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 -- 172.21.15.169:0/561619881 shutdown_connections 2024-09-13T06:29:23.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.657+0000 7fabcf6f2980 1 -- 172.21.15.169:0/561619881 wait complete. 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcf6f2980 1 Processor -- start 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcf6f2980 1 -- start start 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcf6f2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1f5d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcf6f2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ed1d1e200 con 0x560ed1e728e0 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1f5d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1f5d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36980/0 (socket says 172.21.15.169:36980) 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.669+0000 7fabcd202640 1 -- 172.21.15.169:0/1462900413 learned_addr learned my addr 172.21.15.169:0/1462900413 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 -- 172.21.15.169:0/1462900413 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed1f5dfa0 con 0x560ed1e728e0 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 --2- 172.21.15.169:0/1462900413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1f5d9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fabc8017be0 tx=0x7fabc80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167aff0df0123cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7faabb606640 1 -- 172.21.15.169:0/1462900413 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80af050 con 0x560ed1e728e0 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7faabb606640 1 -- 172.21.15.169:0/1462900413 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80b0040 con 0x560ed1e728e0 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7faabb606640 1 -- 172.21.15.169:0/1462900413 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80aaaf0 con 0x560ed1e728e0 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1462900413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 msgr2=0x560ed1f5d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1462900413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1f5d9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fabc8017be0 tx=0x7fabc80033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1462900413 shutdown_connections 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1462900413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e728e0 0x560ed1f5d9d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1462900413 >> 172.21.15.169:0/1462900413 conn(0x560ed1de6230 msgr2=0x560ed1f59600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1462900413 shutdown_connections 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1462900413 wait complete. 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 Processor -- start 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- start start 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e73230 0x560ed1f64f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ed1e79ef0 con 0x560ed1e73230 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e73230 0x560ed1f64f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e73230 0x560ed1f64f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36986/0 (socket says 172.21.15.169:36986) 2024-09-13T06:29:23.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 -- 172.21.15.169:0/2991233265 learned_addr learned my addr 172.21.15.169:0/2991233265 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed1f65440 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcd202640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e73230 0x560ed1f64f00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fabc8017be0 tx=0x7fabc8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7faab9e03640 1 -- 172.21.15.169:0/2991233265 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80c3070 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7faab9e03640 1 -- 172.21.15.169:0/2991233265 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80b6ac0 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ed1f656d0 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7faab9e03640 1 -- 172.21.15.169:0/2991233265 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80b6da0 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.673+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed1f683b0 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7faab9e03640 1 -- 172.21.15.169:0/2991233265 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fabc80bf400 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7faab9e03640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faab4034650 0x7faab4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7faab9e03640 1 -- 172.21.15.169:0/2991233265 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fabc80bb070 con 0x560ed1e73230 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcca01640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faab4034650 0x7faab4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1f69e80 0x560ed1f6c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1f6c8c0 con 0x560ed1f69e80 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcda03640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1f69e80 0x560ed1f6c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcca01640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faab4034650 0x7faab4036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fabb8000f70 tx=0x7fabb80010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcda03640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1f69e80 0x560ed1f6c270 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcda03640 1 -- 172.21.15.169:0/2991233265 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1f69e80 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1f6d690 0x560ed1f6fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1f700b0 con 0x560ed1f6d690 2024-09-13T06:29:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcd202640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1f6d690 0x560ed1f6fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcd202640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1f6d690 0x560ed1f6fa80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcd202640 1 -- 172.21.15.169:0/2991233265 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fabc80ce070 con 0x560ed1f6d690 2024-09-13T06:29:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.677+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1f71960 con 0x560ed1f6d690 2024-09-13T06:29:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 -- 172.21.15.169:0/2991233265 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fabc80ce070 con 0x560ed1f6d690 2024-09-13T06:29:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1f70b90 con 0x560ed1f6d690 2024-09-13T06:29:23.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 -- 172.21.15.169:0/2991233265 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fabc80ce070 con 0x560ed1f6d690 2024-09-13T06:29:23.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1f72d10 0x560ed1f75100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1f75640 con 0x560ed1f72d10 2024-09-13T06:29:23.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcca01640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1f72d10 0x560ed1f75100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcca01640 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1f72d10 0x560ed1f75100 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcca01640 1 -- 172.21.15.169:0/2991233265 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1f72d10 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 Processor -- start 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 -- start start 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 0x560ed1f83420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ed1d77800 con 0x560ed1f83000 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 0x560ed1f83420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 0x560ed1f83420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36994/0 (socket says 172.21.15.169:36994) 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 -- 172.21.15.169:0/3589709949 learned_addr learned my addr 172.21.15.169:0/3589709949 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 -- 172.21.15.169:0/3589709949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed1f83960 con 0x560ed1f83000 2024-09-13T06:29:23.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcd202640 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 0x560ed1f83420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabc80e2ea0 tx=0x7fabc80cf9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7faab2ffd640 1 -- 172.21.15.169:0/3589709949 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80beb30 con 0x560ed1f83000 2024-09-13T06:29:23.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7faab2ffd640 1 -- 172.21.15.169:0/3589709949 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80becd0 con 0x560ed1f83000 2024-09-13T06:29:23.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ed1f83bf0 con 0x560ed1f83000 2024-09-13T06:29:23.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7faab2ffd640 1 -- 172.21.15.169:0/3589709949 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80be360 con 0x560ed1f83000 2024-09-13T06:29:23.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.681+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed1f86870 con 0x560ed1f83000 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7faab2ffd640 1 -- 172.21.15.169:0/3589709949 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fabc80eb060 con 0x560ed1f83000 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7faab2ffd640 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faaa40346a0 0x7faaa4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7faab2ffd640 1 -- 172.21.15.169:0/3589709949 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fabc80d7040 con 0x560ed1f83000 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcca01640 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faaa40346a0 0x7faaa4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 Processor -- start 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- start start 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcca01640 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faaa40346a0 0x7faaa4036b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560ed1f694f0 tx=0x7fabb800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ed1f5e260 con 0x560ed1f8f8f0 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f8fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:36998/0 (socket says 172.21.15.169:36998) 2024-09-13T06:29:23.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcd202640 1 -- 172.21.15.169:0/621058183 learned_addr learned my addr 172.21.15.169:0/621058183 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcd202640 1 -- 172.21.15.169:0/621058183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed1f902c0 con 0x560ed1f8f8f0 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcd202640 1 --2- 172.21.15.169:0/621058183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f8fcf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fabc80cfc00 tx=0x7fabc80be8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab88a3aa84e77b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7faab0ff9640 1 -- 172.21.15.169:0/621058183 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80e1030 con 0x560ed1f8f8f0 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7faab0ff9640 1 -- 172.21.15.169:0/621058183 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80e5e40 con 0x560ed1f8f8f0 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7faab0ff9640 1 -- 172.21.15.169:0/621058183 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80d80e0 con 0x560ed1f8f8f0 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- 172.21.15.169:0/621058183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 msgr2=0x560ed1f8fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/621058183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f8fcf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fabc80cfc00 tx=0x7fabc80be8d0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- 172.21.15.169:0/621058183 shutdown_connections 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/621058183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f8fcf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- 172.21.15.169:0/621058183 >> 172.21.15.169:0/621058183 conn(0x560ed1f8bd20 msgr2=0x560ed1f89e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- 172.21.15.169:0/621058183 shutdown_connections 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- 172.21.15.169:0/621058183 wait complete. 2024-09-13T06:29:23.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 Processor -- start 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.685+0000 7fabcf6f2980 1 -- start start 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f96b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ed1f90790 con 0x560ed1f8f8f0 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f96b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcd202640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f96b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37000/0 (socket says 172.21.15.169:37000) 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 learned_addr learned my addr 172.21.15.169:0/1502724826 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed1f97070 con 0x560ed1f8f8f0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcd202640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f96b30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fabc80e5ff0 tx=0x7fabc80e6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7faaa2ffd640 1 -- 172.21.15.169:0/1502724826 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80d2cf0 con 0x560ed1f8f8f0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ed1f97070 con 0x560ed1f8f8f0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7faaa2ffd640 1 -- 172.21.15.169:0/1502724826 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80bf6f0 con 0x560ed1f8f8f0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed1f974e0 con 0x560ed1f8f8f0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7faaa2ffd640 1 -- 172.21.15.169:0/1502724826 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80e1030 con 0x560ed1f8f8f0 2024-09-13T06:29:23.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7faaa2ffd640 1 -- 172.21.15.169:0/1502724826 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fabc80f6070 con 0x560ed1f8f8f0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7faaa2ffd640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faa980345b0 0x7faa98036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7faaa2ffd640 1 -- 172.21.15.169:0/1502724826 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fabc810cae0 con 0x560ed1f8f8f0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcca01640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faa980345b0 0x7faa98036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1fa1ca0 0x560ed1fa4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa48b0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcda03640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1fa1ca0 0x560ed1fa4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcca01640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faa980345b0 0x7faa98036a70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c010 tx=0x7fabb8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcda03640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1fa1ca0 0x560ed1fa4160 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 20 realm 2024-09-13T06:29:23.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.689+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa1150 con 0x560ed1fa1ca0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa5380 con 0x560ed1fa1ca0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1fa6160 0x560ed1fa8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa8bd0 con 0x560ed1fa6160 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcd202640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1fa6160 0x560ed1fa8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcd202640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1fa6160 0x560ed1fa8550 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa9420 con 0x560ed1fa6160 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 20 searching for the correct realm 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1fab190 0x560ed1fad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcca01640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1fab190 0x560ed1fad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcca01640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1fab190 0x560ed1fad580 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.693+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fabc8102040 0x7fabc810f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x7fabc8102040 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fabc8102040 0x7fabc810f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fabc8102040 0x7fabc810f920 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x7fabc8102040 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x7fabc8102040 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.697+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x7fabc8102040 2024-09-13T06:29:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa1ca0 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x7fabc8102040 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.701+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x7fabc8102040 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fab190 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fadc00 con 0x560ed1fa6160 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa9dd0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fa99e0 con 0x560ed1fa6160 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1faa700 con 0x560ed1fab190 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 zone default found 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 4 Realm: () 2024-09-13T06:29:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.705+0000 7fabcf6f2980 20 zonegroup default 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fae550 con 0x7fabc8102040 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb0820 con 0x560ed1fab190 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb0bc0 con 0x560ed1fab190 2024-09-13T06:29:23.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 started sync module instance, tier type = 2024-09-13T06:29:23.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:23.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fafcb0 con 0x560ed1fa6160 2024-09-13T06:29:23.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94621652419024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fafcb0 con 0x560ed1fa6160 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb15d0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94621652422944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb1ea0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.709+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb28c0 con 0x560ed1fa6160 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94621652419024] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94621652422944] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94621652427696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb19f0 con 0x560ed1fa6160 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb3160 con 0x7fabc8102040 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94621652430000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb19f0 con 0x7fabc8102040 2024-09-13T06:29:23.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.713+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb3c00 con 0x560ed1fa6160 2024-09-13T06:29:23.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94621652427696] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94621652430000] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94621652431056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb3bc0 con 0x560ed1fa6160 2024-09-13T06:29:23.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb3ff0 con 0x560ed1fab190 2024-09-13T06:29:23.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94621652416512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb4840 con 0x560ed1fab190 2024-09-13T06:29:23.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.717+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb5280 con 0x560ed1fab190 2024-09-13T06:29:23.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94621652431056] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94621652438352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb5670 con 0x560ed1fab190 2024-09-13T06:29:23.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb6090 con 0x7fabc8102040 2024-09-13T06:29:23.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94621652416512] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94621652438352] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94621652432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb6050 con 0x7fabc8102040 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=0 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=1 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=2 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=3 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=4 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=5 2024-09-13T06:29:23.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=6 2024-09-13T06:29:23.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94621652432624] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 20 add_watcher() i=7 2024-09-13T06:29:23.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:23.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb4390 con 0x560ed1fa1ca0 2024-09-13T06:29:23.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.721+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94621652435856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb68e0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.725+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94621652435856] v31'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.725+0000 7faa837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.725+0000 7fabcf6f2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:23.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.725+0000 7fabcf6f2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:23.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.725+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc19b0 con 0x560ed1fa6160 2024-09-13T06:29:23.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.729+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.729+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc1ac0 con 0x7fabc8102040 2024-09-13T06:29:23.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.729+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.729+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc21d0 con 0x560ed1fab190 2024-09-13T06:29:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.729+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.729+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc2680 con 0x560ed1fa1ca0 2024-09-13T06:29:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.733+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'113 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.733+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fbf820 con 0x560ed1fa6160 2024-09-13T06:29:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.733+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.733+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fbf820 con 0x560ed1fab190 2024-09-13T06:29:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.733+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.733+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fbf820 con 0x560ed1fa6160 2024-09-13T06:29:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.737+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.737+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc31e0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.737+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.737+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3690 con 0x560ed1fa6160 2024-09-13T06:29:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.741+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.741+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3690 con 0x560ed1fa6160 2024-09-13T06:29:23.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.741+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.741+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3690 con 0x560ed1fa6160 2024-09-13T06:29:23.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.745+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.745+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3690 con 0x560ed1fab190 2024-09-13T06:29:23.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.745+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.745+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3a70 con 0x560ed1fa6160 2024-09-13T06:29:23.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.749+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.749+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3a70 con 0x560ed1fa1ca0 2024-09-13T06:29:23.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.749+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.749+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3f20 con 0x560ed1fa1ca0 2024-09-13T06:29:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.749+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.749+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3f20 con 0x560ed1fa6160 2024-09-13T06:29:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.753+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.753+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3f20 con 0x560ed1fa6160 2024-09-13T06:29:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.753+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.753+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3f20 con 0x560ed1fab190 2024-09-13T06:29:23.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.757+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.757+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3fb0 con 0x560ed1fa6160 2024-09-13T06:29:23.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.757+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.757+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3fb0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.761+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.761+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3fb0 con 0x560ed1fa6160 2024-09-13T06:29:23.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.761+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.761+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3fb0 con 0x560ed1fa6160 2024-09-13T06:29:23.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.765+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.765+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc3fb0 con 0x560ed1fab190 2024-09-13T06:29:23.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.765+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.765+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fa6160 2024-09-13T06:29:23.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.765+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.765+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fab190 2024-09-13T06:29:23.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.769+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.769+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fab190 2024-09-13T06:29:23.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.769+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.769+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fab190 2024-09-13T06:29:23.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.769+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.769+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fa6160 2024-09-13T06:29:23.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.773+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.773+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fa1ca0 2024-09-13T06:29:23.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.773+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.773+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fa6160 2024-09-13T06:29:23.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.777+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.777+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x560ed1fa1ca0 2024-09-13T06:29:23.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.777+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.777+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fc4060 con 0x7fabc8102040 2024-09-13T06:29:23.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7faa827e4640 20 reqs_thread_entry: start 2024-09-13T06:29:23.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:23.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 20 Filter name: none 2024-09-13T06:29:23.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fa9f3fff640 20 reqs_thread_entry: start 2024-09-13T06:29:23.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:23.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fbedd0 con 0x7fabc8102040 2024-09-13T06:29:23.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:29:23.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:29:23.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:23.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fbed80 con 0x560ed1fa1ca0 2024-09-13T06:29:23.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.785 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T06:29:23.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7faa837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.781+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94621652435856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fbb610 con 0x560ed1fa1ca0 2024-09-13T06:29:23.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94621652435856] v31'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94621652419024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb4390 con 0x560ed1fa6160 2024-09-13T06:29:23.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94621652419024] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcf6f2980 20 remove_watcher() i=0 2024-09-13T06:29:23.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcf6f2980 2 removed watcher, disabling cache 2024-09-13T06:29:23.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94621652422944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb01d0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94621652422944] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x560ed1fa1ca0 2024-09-13T06:29:23.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcf6f2980 20 remove_watcher() i=1 2024-09-13T06:29:23.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.785+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94621652427696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb4390 con 0x560ed1fa6160 2024-09-13T06:29:23.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.789+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94621652427696] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.789+0000 7fabcf6f2980 20 remove_watcher() i=2 2024-09-13T06:29:23.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.789+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94621652430000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb23b0 con 0x7fabc8102040 2024-09-13T06:29:23.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.789+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94621652430000] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.789+0000 7fabcf6f2980 20 remove_watcher() i=3 2024-09-13T06:29:23.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.789+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94621652431056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb23b0 con 0x560ed1fa6160 2024-09-13T06:29:23.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcd202640 1 -- 172.21.15.169:0/1502724826 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94621652431056] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc8111020 con 0x560ed1fa6160 2024-09-13T06:29:23.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcf6f2980 20 remove_watcher() i=4 2024-09-13T06:29:23.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94621652416512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb23b0 con 0x560ed1fab190 2024-09-13T06:29:23.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94621652416512] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcf6f2980 20 remove_watcher() i=5 2024-09-13T06:29:23.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94621652438352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb23b0 con 0x560ed1fab190 2024-09-13T06:29:23.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcca01640 1 -- 172.21.15.169:0/1502724826 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94621652438352] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb800e6c0 con 0x560ed1fab190 2024-09-13T06:29:23.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcf6f2980 20 remove_watcher() i=6 2024-09-13T06:29:23.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.793+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94621652432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560ed1fb23b0 con 0x7fabc8102040 2024-09-13T06:29:23.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94621652432624] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00083f0 con 0x7fabc8102040 2024-09-13T06:29:23.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 20 remove_watcher() i=7 2024-09-13T06:29:23.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1fa6160 msgr2=0x560ed1fa8550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1fa6160 0x560ed1fa8550 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1fa1ca0 msgr2=0x560ed1fa4160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1fa1ca0 0x560ed1fa4160 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fabc8102040 msgr2=0x7fabc810f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fabc8102040 0x7fabc810f920 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1fab190 msgr2=0x560ed1fad580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1fab190 0x560ed1fad580 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faa980345b0 msgr2=0x7faa98036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faa980345b0 0x7faa98036a70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c010 tx=0x7fabb8010000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 msgr2=0x560ed1f96b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcda03640 1 -- 172.21.15.169:0/1502724826 reap_dead start 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f96b30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fabc80e5ff0 tx=0x7fabc80e6f50 comp rx=0 tx=0).stop 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 shutdown_connections 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/1502724826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f8f8f0 0x560ed1f96b30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 >> 172.21.15.169:0/1502724826 conn(0x560ed1f8bd20 msgr2=0x560ed1f89df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 shutdown_connections 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/1502724826 wait complete. 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faaa40346a0 msgr2=0x7faaa4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faaa40346a0 0x7faaa4036b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560ed1f694f0 tx=0x7fabb800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 msgr2=0x560ed1f83420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 0x560ed1f83420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabc80e2ea0 tx=0x7fabc80cf9b0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 shutdown_connections 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faaa40346a0 0x7faaa4036b60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/3589709949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1f83000 0x560ed1f83420 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 >> 172.21.15.169:0/3589709949 conn(0x560ed1f78150 msgr2=0x560ed1f7abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 shutdown_connections 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/3589709949 wait complete. 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1f6d690 msgr2=0x560ed1f6fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ed1f6d690 0x560ed1f6fa80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1f69e80 msgr2=0x560ed1f6c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ed1f69e80 0x560ed1f6c270 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1f72d10 msgr2=0x560ed1f75100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ed1f72d10 0x560ed1f75100 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faab4034650 msgr2=0x7faab4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faab4034650 0x7faab4036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fabb8000f70 tx=0x7fabb80010b0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e73230 msgr2=0x560ed1f64f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 --2- 172.21.15.169:0/2991233265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ed1e73230 0x560ed1f64f00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fabc8017be0 tx=0x7fabc8019810 comp rx=0 tx=0).stop 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcda03640 1 -- 172.21.15.169:0/2991233265 reap_dead start 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 shutdown_connections 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 >> 172.21.15.169:0/2991233265 conn(0x560ed1de6230 msgr2=0x560ed1f58180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 shutdown_connections 2024-09-13T06:29:23.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.797+0000 7fabcf6f2980 1 -- 172.21.15.169:0/2991233265 wait complete. 2024-09-13T06:29:23.809 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:29:23.809 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T06:29:23.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T06:29:23.809 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T06:29:23.879 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:23.879 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:23.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546e05d980 1 Processor -- start 2024-09-13T06:29:23.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546e05d980 1 -- start start 2024-09-13T06:29:23.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546e05d980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5614e52f8900 0x5614e52facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546e05d980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614e517dae0 con 0x5614e52f4580 2024-09-13T06:29:23.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546e05d980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5614e51a1e30 con 0x5614e52f8900 2024-09-13T06:29:23.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546b36c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5614e52f8900 0x5614e52facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546b36c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5614e52f8900 0x5614e52facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37002/0 (socket says 172.21.15.169:37002) 2024-09-13T06:29:23.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546bb6d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5614e52f4580 0x5614e52f4960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45300/0 (socket says 172.21.15.169:45300) 2024-09-13T06:29:23.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546b36c640 1 -- 172.21.15.169:0/2150525343 learned_addr learned my addr 172.21.15.169:0/2150525343 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546b36c640 1 -- 172.21.15.169:0/2150525343 >> v1:172.21.15.112:6789/0 conn(0x5614e52f4580 legacy=0x5614e52f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.877+0000 7f546b36c640 1 -- 172.21.15.169:0/2150525343 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e52fc240 con 0x5614e52f8900 2024-09-13T06:29:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546b36c640 1 --2- 172.21.15.169:0/2150525343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e52facf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f546000a5c0 tx=0x7f546001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762510b81e46be9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546ab6b640 1 -- 172.21.15.169:0/2150525343 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54600a6070 con 0x5614e52f8900 2024-09-13T06:29:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546ab6b640 1 -- 172.21.15.169:0/2150525343 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54600af070 con 0x5614e52f8900 2024-09-13T06:29:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546ab6b640 1 -- 172.21.15.169:0/2150525343 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54600aa5c0 con 0x5614e52f8900 2024-09-13T06:29:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 -- 172.21.15.169:0/2150525343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 msgr2=0x5614e52facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 --2- 172.21.15.169:0/2150525343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e52facf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f546000a5c0 tx=0x7f546001b340 comp rx=0 tx=0).stop 2024-09-13T06:29:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 -- 172.21.15.169:0/2150525343 shutdown_connections 2024-09-13T06:29:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 --2- 172.21.15.169:0/2150525343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e52facf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 -- 172.21.15.169:0/2150525343 >> 172.21.15.169:0/2150525343 conn(0x5614e52f00a0 msgr2=0x5614e52f24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 -- 172.21.15.169:0/2150525343 shutdown_connections 2024-09-13T06:29:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.881+0000 7f546e05d980 1 -- 172.21.15.169:0/2150525343 wait complete. 2024-09-13T06:29:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.893+0000 7f546e05d980 1 Processor -- start 2024-09-13T06:29:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.893+0000 7f546e05d980 1 -- start start 2024-09-13T06:29:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.893+0000 7f546e05d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 0x5614e5269c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.893+0000 7f546e05d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5614e51a3200 con 0x5614e52f4580 2024-09-13T06:29:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 0x5614e5269c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 0x5614e5269c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37006/0 (socket says 172.21.15.169:37006) 2024-09-13T06:29:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 -- 172.21.15.169:0/2393430730 learned_addr learned my addr 172.21.15.169:0/2393430730 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 -- 172.21.15.169:0/2393430730 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e526a1e0 con 0x5614e52f4580 2024-09-13T06:29:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 --2- 172.21.15.169:0/2393430730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 0x5614e5269c10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f545c0015f0 tx=0x7f545c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e8f6113543233f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f5359e0b640 1 -- 172.21.15.169:0/2393430730 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c013420 con 0x5614e52f4580 2024-09-13T06:29:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f5359e0b640 1 -- 172.21.15.169:0/2393430730 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c0135e0 con 0x5614e52f4580 2024-09-13T06:29:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f5359e0b640 1 -- 172.21.15.169:0/2393430730 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c013940 con 0x5614e52f4580 2024-09-13T06:29:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- 172.21.15.169:0/2393430730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 msgr2=0x5614e5269c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 --2- 172.21.15.169:0/2393430730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 0x5614e5269c10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f545c0015f0 tx=0x7f545c001ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- 172.21.15.169:0/2393430730 shutdown_connections 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 --2- 172.21.15.169:0/2393430730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f4580 0x5614e5269c10 secure :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f545c0015f0 tx=0x7f545c001ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- 172.21.15.169:0/2393430730 >> 172.21.15.169:0/2393430730 conn(0x5614e52f00a0 msgr2=0x5614e53db550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- 172.21.15.169:0/2393430730 shutdown_connections 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- 172.21.15.169:0/2393430730 wait complete. 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 Processor -- start 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- start start 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e53e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5614e52fbd40 con 0x5614e52f8900 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e53e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e53e7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37022/0 (socket says 172.21.15.169:37022) 2024-09-13T06:29:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 -- 172.21.15.169:0/1345028307 learned_addr learned my addr 172.21.15.169:0/1345028307 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e53e84d0 con 0x5614e52f8900 2024-09-13T06:29:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546bb6d640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e53e7f90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f545c006640 tx=0x7f545c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f5353fff640 1 -- 172.21.15.169:0/1345028307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c022020 con 0x5614e52f8900 2024-09-13T06:29:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f5353fff640 1 -- 172.21.15.169:0/1345028307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c006320 con 0x5614e52f8900 2024-09-13T06:29:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614e53e8760 con 0x5614e52f8900 2024-09-13T06:29:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.897+0000 7f5353fff640 1 -- 172.21.15.169:0/1345028307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c004aa0 con 0x5614e52f8900 2024-09-13T06:29:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e53eb440 con 0x5614e52f8900 2024-09-13T06:29:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f5353fff640 1 -- 172.21.15.169:0/1345028307 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f545c025020 con 0x5614e52f8900 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f5353fff640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53540346a0 0x7f5354036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f5353fff640 1 -- 172.21.15.169:0/1345028307 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f545c018030 con 0x5614e52f8900 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546b36c640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53540346a0 0x7f5354036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e53ecf10 0x5614e53ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e53ef950 con 0x5614e53ecf10 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546c36e640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e53ecf10 0x5614e53ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546b36c640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53540346a0 0x7f5354036b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54600ae000 tx=0x7f54600a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546c36e640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e53ecf10 0x5614e53ef300 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546c36e640 1 -- 172.21.15.169:0/1345028307 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e53ecf10 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e53f0740 0x5614e53f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e53f3170 con 0x5614e53f0740 2024-09-13T06:29:23.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546bb6d640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e53f0740 0x5614e53f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.901+0000 7f546bb6d640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e53f0740 0x5614e53f2b30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 -- 172.21.15.169:0/1345028307 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f545c01b070 con 0x5614e53f0740 2024-09-13T06:29:23.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e53f4a20 con 0x5614e53f0740 2024-09-13T06:29:23.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 -- 172.21.15.169:0/1345028307 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f545c01b070 con 0x5614e53f0740 2024-09-13T06:29:23.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e53f3b90 con 0x5614e53f0740 2024-09-13T06:29:23.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 -- 172.21.15.169:0/1345028307 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f545c01b070 con 0x5614e53f0740 2024-09-13T06:29:23.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e53f5dd0 0x5614e53f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e53f8700 con 0x5614e53f5dd0 2024-09-13T06:29:23.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546b36c640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e53f5dd0 0x5614e53f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546b36c640 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e53f5dd0 0x5614e53f81c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546b36c640 1 -- 172.21.15.169:0/1345028307 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e53f5dd0 2024-09-13T06:29:23.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 Processor -- start 2024-09-13T06:29:23.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 -- start start 2024-09-13T06:29:23.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 0x5614e5406520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546e05d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5614e51fc800 con 0x5614e5406100 2024-09-13T06:29:23.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 0x5614e5406520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 0x5614e5406520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37026/0 (socket says 172.21.15.169:37026) 2024-09-13T06:29:23.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 -- 172.21.15.169:0/1109325078 learned_addr learned my addr 172.21.15.169:0/1109325078 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.905+0000 7f546bb6d640 1 -- 172.21.15.169:0/1109325078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e5406a60 con 0x5614e5406100 2024-09-13T06:29:23.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546bb6d640 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 0x5614e5406520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f545c006cc0 tx=0x7f545c010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f53517fa640 1 -- 172.21.15.169:0/1109325078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c041850 con 0x5614e5406100 2024-09-13T06:29:23.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614e5406cf0 con 0x5614e5406100 2024-09-13T06:29:23.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f53517fa640 1 -- 172.21.15.169:0/1109325078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c041a10 con 0x5614e5406100 2024-09-13T06:29:23.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f53517fa640 1 -- 172.21.15.169:0/1109325078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c041d30 con 0x5614e5406100 2024-09-13T06:29:23.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e5409970 con 0x5614e5406100 2024-09-13T06:29:23.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f53517fa640 1 -- 172.21.15.169:0/1109325078 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f545c010070 con 0x5614e5406100 2024-09-13T06:29:23.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f53517fa640 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5344034650 0x7f5344036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f53517fa640 1 -- 172.21.15.169:0/1109325078 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f545c01f070 con 0x5614e5406100 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546b36c640 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5344034650 0x7f5344036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546e05d980 1 Processor -- start 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546e05d980 1 -- start start 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546b36c640 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5344034650 0x7f5344036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5614e53ec580 tx=0x7f5460005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546e05d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e53e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546e05d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5614e526a560 con 0x5614e53e0a20 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e53e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e53e0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37042/0 (socket says 172.21.15.169:37042) 2024-09-13T06:29:23.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546bb6d640 1 -- 172.21.15.169:0/1009338202 learned_addr learned my addr 172.21.15.169:0/1009338202 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546bb6d640 1 -- 172.21.15.169:0/1009338202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e53e13f0 con 0x5614e53e0a20 2024-09-13T06:29:23.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f546bb6d640 1 --2- 172.21.15.169:0/1009338202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e53e0e20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f545c027fa0 tx=0x7f545c049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de38baaf44036ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f534affd640 1 -- 172.21.15.169:0/1009338202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c0279c0 con 0x5614e53e0a20 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f534affd640 1 -- 172.21.15.169:0/1009338202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c05a070 con 0x5614e53e0a20 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.909+0000 7f534affd640 1 -- 172.21.15.169:0/1009338202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c01daa0 con 0x5614e53e0a20 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/1009338202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 msgr2=0x5614e53e0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 --2- 172.21.15.169:0/1009338202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e53e0e20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f545c027fa0 tx=0x7f545c049450 comp rx=0 tx=0).stop 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/1009338202 shutdown_connections 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 --2- 172.21.15.169:0/1009338202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e53e0e20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/1009338202 >> 172.21.15.169:0/1009338202 conn(0x5614e540ee20 msgr2=0x5614e540cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/1009338202 shutdown_connections 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/1009338202 wait complete. 2024-09-13T06:29:23.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 Processor -- start 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- start start 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e541bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5614e53df600 con 0x5614e53e0a20 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e541bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546bb6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e541bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37058/0 (socket says 172.21.15.169:37058) 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 learned_addr learned my addr 172.21.15.169:0/30724029 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:23.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e541c320 con 0x5614e53e0a20 2024-09-13T06:29:23.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546bb6d640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e541bde0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f545c006a00 tx=0x7f545c02cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f53497fa640 1 -- 172.21.15.169:0/30724029 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c06e070 con 0x5614e53e0a20 2024-09-13T06:29:23.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614e541c320 con 0x5614e53e0a20 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f53497fa640 1 -- 172.21.15.169:0/30724029 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c01d6b0 con 0x5614e53e0a20 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f53497fa640 1 -- 172.21.15.169:0/30724029 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c030530 con 0x5614e53e0a20 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e541c320 con 0x5614e53e0a20 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f53497fa640 1 -- 172.21.15.169:0/30724029 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f545c071070 con 0x5614e53e0a20 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f53497fa640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53340345b0 0x7f5334036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f53497fa640 1 -- 172.21.15.169:0/30724029 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f545c066070 con 0x5614e53e0a20 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.913+0000 7f546b36c640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53340345b0 0x7f5334036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e5426f40 0x5614e5429400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5429b50 con 0x5614e5426f40 2024-09-13T06:29:23.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546c36e640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e5426f40 0x5614e5429400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546b36c640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53340345b0 0x7f5334036a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5460000c10 tx=0x7f54600c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546c36e640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e5426f40 0x5614e5429400 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 realm 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5426370 con 0x5614e5426f40 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542a620 con 0x5614e5426f40 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e542b400 0x5614e542d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542de70 con 0x5614e542b400 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546bb6d640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e542b400 0x5614e542d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546bb6d640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e542b400 0x5614e542d7f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542e3b0 con 0x5614e542b400 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:23.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 20 searching for the correct realm 2024-09-13T06:29:23.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e542fb90 0x5614e5432050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614e5432720 con 0x5614e542fb90 2024-09-13T06:29:23.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546b36c640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e542fb90 0x5614e5432050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.917+0000 7f546b36c640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e542fb90 0x5614e5432050 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614e5432720 con 0x5614e542b400 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546bb6d640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f545c073060 0x7f545c069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x7f545c073060 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f545c073060 0x7f545c069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f545c073060 0x7f545c069870 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542fb90 2024-09-13T06:29:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.921+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x7f545c073060 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x7f545c073060 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542fb90 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542fb90 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542fb90 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.925+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x7f545c073060 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e5426f40 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x7f545c073060 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542fb90 2024-09-13T06:29:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x7f545c073060 2024-09-13T06:29:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542fb90 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f545c069070 con 0x5614e542b400 2024-09-13T06:29:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.929+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542dfc0 con 0x5614e5426f40 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542e3b0 con 0x5614e542b400 2024-09-13T06:29:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542e3b0 con 0x5614e542fb90 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 zone default found 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 4 Realm: () 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 zonegroup default 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5432ba0 con 0x7f545c073060 2024-09-13T06:29:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e542e890 con 0x5614e542fb90 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5434e20 con 0x5614e542fb90 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 started sync module instance, tier type = 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.933+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5434260 con 0x5614e542b400 2024-09-13T06:29:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94647745726336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5434260 con 0x5614e542b400 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e54358d0 con 0x5614e5426f40 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94647745729440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5436170 con 0x5614e5426f40 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5436bb0 con 0x5614e542b400 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94647745726336] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94647745729440] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94647745734272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5435cc0 con 0x5614e542b400 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.937+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5437450 con 0x7f545c073060 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94647745736608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5435cc0 con 0x7f545c073060 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5437f20 con 0x5614e542b400 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94647745734272] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94647745736608] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94647745737664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5437ee0 con 0x5614e542b400 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5438310 con 0x5614e542fb90 2024-09-13T06:29:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94647745723824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5438bb0 con 0x5614e542fb90 2024-09-13T06:29:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.941+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e54395b0 con 0x5614e542fb90 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94647745723824] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94647745737664] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94647745742592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e54399a0 con 0x5614e542fb90 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5437a10 con 0x7f545c073060 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94647745742592] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94647745745088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5437a10 con 0x7f545c073060 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=0 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=1 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=2 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=3 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=4 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=5 2024-09-13T06:29:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=6 2024-09-13T06:29:23.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94647745745088] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 20 add_watcher() i=7 2024-09-13T06:29:23.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:23.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e543d390 con 0x5614e5426f40 2024-09-13T06:29:23.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.945+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94647745748656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e543a7f0 con 0x5614e5426f40 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94647745748656] v31'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f5321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 5 note: GC not initialized 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f5320fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 Filter name: none 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f529a7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5460970 con 0x7f545c073060 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5462a50 con 0x7f545c073060 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:23.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5464250 con 0x5614e542fb90 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:23.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.949+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e54657a0 con 0x5614e5426f40 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 fud.buckets [call] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 20 rados->read ofs=0 len=0 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5465ba0 con 0x7f545c073060 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e546b790 con 0x7f545c073060 2024-09-13T06:29:23.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94647745933984 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614e5468be0 con 0x5614e542fb90 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== watch-notify(notify (1) cookie 94647745742592 notify 133143986182 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5614e5464640 con 0x5614e542fb90 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f534affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94647745742592 notifier 4512 bl.length()=338 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f534affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f534affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(68 notify.6 [notify cookie 94647745933984 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f534affd640 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5330003eb0 con 0x5614e542fb90 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== watch-notify(notify_complete (2) cookie 94647745933984 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5614e5463770 con 0x5614e542fb90 2024-09-13T06:29:23.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f5321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:23.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.953+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94647745748656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e5426f40 2024-09-13T06:29:23.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.957+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94647745748656] v31'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.957+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94647745726336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e542b400 2024-09-13T06:29:23.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.957+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94647745726336] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.957+0000 7f546e05d980 20 remove_watcher() i=0 2024-09-13T06:29:23.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.957+0000 7f546e05d980 2 removed watcher, disabling cache 2024-09-13T06:29:23.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.957+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94647745729440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e5426f40 2024-09-13T06:29:23.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94647745729440] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x5614e5426f40 2024-09-13T06:29:23.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546e05d980 20 remove_watcher() i=1 2024-09-13T06:29:23.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94647745734272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e542b400 2024-09-13T06:29:23.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94647745734272] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546e05d980 20 remove_watcher() i=2 2024-09-13T06:29:23.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94647745736608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x7f545c073060 2024-09-13T06:29:23.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94647745736608] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546e05d980 20 remove_watcher() i=3 2024-09-13T06:29:23.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.961+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94647745737664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e542b400 2024-09-13T06:29:23.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546bb6d640 1 -- 172.21.15.169:0/30724029 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94647745737664] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c070030 con 0x5614e542b400 2024-09-13T06:29:23.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546e05d980 20 remove_watcher() i=4 2024-09-13T06:29:23.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94647745723824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e542fb90 2024-09-13T06:29:23.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94647745723824] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546e05d980 20 remove_watcher() i=5 2024-09-13T06:29:23.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94647745742592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e545e7a0 con 0x5614e542fb90 2024-09-13T06:29:23.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546b36c640 1 -- 172.21.15.169:0/30724029 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94647745742592] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54600aaae0 con 0x5614e542fb90 2024-09-13T06:29:23.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546e05d980 20 remove_watcher() i=6 2024-09-13T06:29:23.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.965+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94647745745088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614e5438700 con 0x7f545c073060 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94647745745088] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54640083f0 con 0x7f545c073060 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 20 remove_watcher() i=7 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e542b400 msgr2=0x5614e542d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e542b400 0x5614e542d7f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e5426f40 msgr2=0x5614e5429400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e5426f40 0x5614e5429400 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f545c073060 msgr2=0x7f545c069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f545c073060 0x7f545c069870 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e542fb90 msgr2=0x5614e5432050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e542fb90 0x5614e5432050 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53340345b0 msgr2=0x7f5334036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53340345b0 0x7f5334036a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5460000c10 tx=0x7f54600c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 msgr2=0x5614e541bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e541bde0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f545c006a00 tx=0x7f545c02cf60 comp rx=0 tx=0).stop 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546c36e640 1 -- 172.21.15.169:0/30724029 reap_dead start 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 shutdown_connections 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/30724029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e53e0a20 0x5614e541bde0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 >> 172.21.15.169:0/30724029 conn(0x5614e540ee20 msgr2=0x5614e540cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 shutdown_connections 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/30724029 wait complete. 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5344034650 msgr2=0x7f5344036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5344034650 0x7f5344036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5614e53ec580 tx=0x7f5460005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 msgr2=0x5614e5406520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 0x5614e5406520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f545c006cc0 tx=0x7f545c010ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 shutdown_connections 2024-09-13T06:29:23.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5344034650 0x7f5344036b10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1109325078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e5406100 0x5614e5406520 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 >> 172.21.15.169:0/1109325078 conn(0x5614e53fb250 msgr2=0x5614e53fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 shutdown_connections 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1109325078 wait complete. 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e53f0740 msgr2=0x5614e53f2b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5614e53f0740 0x5614e53f2b30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e53ecf10 msgr2=0x5614e53ef300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5614e53ecf10 0x5614e53ef300 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e53f5dd0 msgr2=0x5614e53f81c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5614e53f5dd0 0x5614e53f81c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53540346a0 msgr2=0x7f5354036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53540346a0 0x7f5354036b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54600ae000 tx=0x7f54600a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:23.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 msgr2=0x5614e53e7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:23.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 --2- 172.21.15.169:0/1345028307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5614e52f8900 0x5614e53e7f90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f545c006640 tx=0x7f545c000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:23.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546c36e640 1 -- 172.21.15.169:0/1345028307 reap_dead start 2024-09-13T06:29:23.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 shutdown_connections 2024-09-13T06:29:23.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 >> 172.21.15.169:0/1345028307 conn(0x5614e52f00a0 msgr2=0x5614e53da0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:23.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 shutdown_connections 2024-09-13T06:29:23.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:23.969+0000 7f546e05d980 1 -- 172.21.15.169:0/1345028307 wait complete. 2024-09-13T06:29:23.981 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1'] 2024-09-13T06:29:23.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1'] 2024-09-13T06:29:23.981 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fdb925980 1 Processor -- start 2024-09-13T06:29:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fdb925980 1 -- start start 2024-09-13T06:29:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fdb925980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5617c4376aa0 0x5617c44052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fdb925980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617c428aae0 con 0x5617c4405810 2024-09-13T06:29:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fdb925980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5617c42aee30 con 0x5617c4376aa0 2024-09-13T06:29:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd9435640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5617c4376aa0 0x5617c44052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd8c34640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5617c4405810 0x5617c4407c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45312/0 (socket says 172.21.15.169:45312) 2024-09-13T06:29:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd8c34640 1 -- 172.21.15.169:0/4271827472 learned_addr learned my addr 172.21.15.169:0/4271827472 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd9435640 1 -- 172.21.15.169:0/4271827472 >> v1:172.21.15.112:6789/0 conn(0x5617c4405810 legacy=0x5617c4407c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd9435640 1 -- 172.21.15.169:0/4271827472 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c440a330 con 0x5617c4376aa0 2024-09-13T06:29:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd9435640 1 --2- 172.21.15.169:0/4271827472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44052d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400a420 tx=0x7f7fd401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7cad8fd4dcf393 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd3fff640 1 -- 172.21.15.169:0/4271827472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40af070 con 0x5617c4376aa0 2024-09-13T06:29:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd3fff640 1 -- 172.21.15.169:0/4271827472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd40aa530 con 0x5617c4376aa0 2024-09-13T06:29:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.061+0000 7f7fd3fff640 1 -- 172.21.15.169:0/4271827472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40aa850 con 0x5617c4376aa0 2024-09-13T06:29:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 -- 172.21.15.169:0/4271827472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 msgr2=0x5617c44052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 --2- 172.21.15.169:0/4271827472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44052d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400a420 tx=0x7f7fd401afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 -- 172.21.15.169:0/4271827472 shutdown_connections 2024-09-13T06:29:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 --2- 172.21.15.169:0/4271827472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44052d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 -- 172.21.15.169:0/4271827472 >> 172.21.15.169:0/4271827472 conn(0x5617c43fd000 msgr2=0x5617c43ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 -- 172.21.15.169:0/4271827472 shutdown_connections 2024-09-13T06:29:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.065+0000 7f7fdb925980 1 -- 172.21.15.169:0/4271827472 wait complete. 2024-09-13T06:29:24.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fdb925980 1 Processor -- start 2024-09-13T06:29:24.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fdb925980 1 -- start start 2024-09-13T06:29:24.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fdb925980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44edb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fdb925980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5617c42b0200 con 0x5617c4376aa0 2024-09-13T06:29:24.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44edb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37082/0 (socket says 172.21.15.169:37082) 2024-09-13T06:29:24.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fd9435640 1 -- 172.21.15.169:0/2921756635 learned_addr learned my addr 172.21.15.169:0/2921756635 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fd9435640 1 -- 172.21.15.169:0/2921756635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c44ee0f0 con 0x5617c4376aa0 2024-09-13T06:29:24.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2921756635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44edb20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40ad040 tx=0x7f7fd40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e50f55310f2c084 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7ec7606640 1 -- 172.21.15.169:0/2921756635 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40af050 con 0x5617c4376aa0 2024-09-13T06:29:24.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7ec7606640 1 -- 172.21.15.169:0/2921756635 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd40b0040 con 0x5617c4376aa0 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.077+0000 7f7ec7606640 1 -- 172.21.15.169:0/2921756635 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40aaca0 con 0x5617c4376aa0 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2921756635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 msgr2=0x5617c44edb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2921756635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44edb20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40ad040 tx=0x7f7fd40033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2921756635 shutdown_connections 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2921756635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44edb20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2921756635 >> 172.21.15.169:0/2921756635 conn(0x5617c43fd000 msgr2=0x5617c44e9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2921756635 shutdown_connections 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2921756635 wait complete. 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 Processor -- start 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- start start 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5617c4409dd0 con 0x5617c4376aa0 2024-09-13T06:29:24.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37084/0 (socket says 172.21.15.169:37084) 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fd9435640 1 -- 172.21.15.169:0/2059836339 learned_addr learned my addr 172.21.15.169:0/2059836339 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fd9435640 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c44f5330 con 0x5617c4376aa0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44f4df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4019680 tx=0x7f7fd4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7ec5e03640 1 -- 172.21.15.169:0/2059836339 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40c5070 con 0x5617c4376aa0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7ec5e03640 1 -- 172.21.15.169:0/2059836339 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd40b6d60 con 0x5617c4376aa0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617c44f55c0 con 0x5617c4376aa0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7ec5e03640 1 -- 172.21.15.169:0/2059836339 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40c15f0 con 0x5617c4376aa0 2024-09-13T06:29:24.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c44f82a0 con 0x5617c4376aa0 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7ec5e03640 1 -- 172.21.15.169:0/2059836339 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fd40c8070 con 0x5617c4376aa0 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7ec5e03640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ec0034650 0x7f7ec0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.081+0000 7f7ec5e03640 1 -- 172.21.15.169:0/2059836339 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7fd40bb070 con 0x5617c4376aa0 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ec0034650 0x7f7ec0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c4405810 0x5617c44fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c44fc3a0 con 0x5617c4405810 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9c36640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c4405810 0x5617c44fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ec0034650 0x7f7ec0036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f70 tx=0x7f7fc40012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9c36640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c4405810 0x5617c44fbd80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2059836339 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c4405810 2024-09-13T06:29:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c44fd1e0 0x5617c44ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c44ffc10 con 0x5617c44fd1e0 2024-09-13T06:29:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c44fd1e0 0x5617c44ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c44fd1e0 0x5617c44ff5d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9435640 1 -- 172.21.15.169:0/2059836339 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fd40d1070 con 0x5617c44fd1e0 2024-09-13T06:29:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c45014c0 con 0x5617c44fd1e0 2024-09-13T06:29:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fd9435640 1 -- 172.21.15.169:0/2059836339 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7fd40d1070 con 0x5617c44fd1e0 2024-09-13T06:29:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.085+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c45006f0 con 0x5617c44fd1e0 2024-09-13T06:29:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd9435640 1 -- 172.21.15.169:0/2059836339 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fd40d1070 con 0x5617c44fd1e0 2024-09-13T06:29:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c4502870 0x5617c4504c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c45051a0 con 0x5617c4502870 2024-09-13T06:29:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c4502870 0x5617c4504c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c4502870 0x5617c4504c60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2059836339 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c4502870 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 Processor -- start 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 -- start start 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 0x5617c4512fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5617c4309800 con 0x5617c4512ba0 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 0x5617c4512fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 0x5617c4512fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37100/0 (socket says 172.21.15.169:37100) 2024-09-13T06:29:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd9435640 1 -- 172.21.15.169:0/665495385 learned_addr learned my addr 172.21.15.169:0/665495385 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd9435640 1 -- 172.21.15.169:0/665495385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c4513500 con 0x5617c4512ba0 2024-09-13T06:29:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fd9435640 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 0x5617c4512fc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40e3740 tx=0x7f7fd40a9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7ebeffd640 1 -- 172.21.15.169:0/665495385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40eb020 con 0x5617c4512ba0 2024-09-13T06:29:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617c4513790 con 0x5617c4512ba0 2024-09-13T06:29:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7ebeffd640 1 -- 172.21.15.169:0/665495385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd40bfe00 con 0x5617c4512ba0 2024-09-13T06:29:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7ebeffd640 1 -- 172.21.15.169:0/665495385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40c1930 con 0x5617c4512ba0 2024-09-13T06:29:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.089+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c4516410 con 0x5617c4512ba0 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7ebeffd640 1 -- 172.21.15.169:0/665495385 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fd40e6070 con 0x5617c4512ba0 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7ebeffd640 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7eb0034650 0x7f7eb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7ebeffd640 1 -- 172.21.15.169:0/665495385 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7fd40cc080 con 0x5617c4512ba0 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7eb0034650 0x7f7eb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 Processor -- start 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- start start 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c451f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7eb0034650 0x7f7eb0036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400bf60 tx=0x7f7fc400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5617c44ee3b0 con 0x5617c451f470 2024-09-13T06:29:24.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c451f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c451f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37102/0 (socket says 172.21.15.169:37102) 2024-09-13T06:29:24.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 -- 172.21.15.169:0/2628000664 learned_addr learned my addr 172.21.15.169:0/2628000664 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 -- 172.21.15.169:0/2628000664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c451fe20 con 0x5617c451f470 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2628000664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c451f850 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40cc000 tx=0x7f7fd40f0b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7339bb4bd9c1ef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7ebcff9640 1 -- 172.21.15.169:0/2628000664 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40fe030 con 0x5617c451f470 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7ebcff9640 1 -- 172.21.15.169:0/2628000664 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd40c1cb0 con 0x5617c451f470 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7ebcff9640 1 -- 172.21.15.169:0/2628000664 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40e38f0 con 0x5617c451f470 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- 172.21.15.169:0/2628000664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 msgr2=0x5617c451f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2628000664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c451f850 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40cc000 tx=0x7f7fd40f0b50 comp rx=0 tx=0).stop 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- 172.21.15.169:0/2628000664 shutdown_connections 2024-09-13T06:29:24.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2628000664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c451f850 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- 172.21.15.169:0/2628000664 >> 172.21.15.169:0/2628000664 conn(0x5617c451b850 msgr2=0x5617c4519950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- 172.21.15.169:0/2628000664 shutdown_connections 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- 172.21.15.169:0/2628000664 wait complete. 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 Processor -- start 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- start start 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c4526620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fdb925980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5617c45202c0 con 0x5617c451f470 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c4526620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c4526620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37110/0 (socket says 172.21.15.169:37110) 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.093+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 learned_addr learned my addr 172.21.15.169:0/2017068286 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c4526b60 con 0x5617c451f470 2024-09-13T06:29:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c4526620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40e2500 tx=0x7f7fd40b3f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7eaeffd640 1 -- 172.21.15.169:0/2017068286 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd4113070 con 0x5617c451f470 2024-09-13T06:29:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617c4526b60 con 0x5617c451f470 2024-09-13T06:29:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7eaeffd640 1 -- 172.21.15.169:0/2017068286 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd40e7e30 con 0x5617c451f470 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7eaeffd640 1 -- 172.21.15.169:0/2017068286 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd40d9710 con 0x5617c451f470 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c4526b60 con 0x5617c451f470 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7eaeffd640 1 -- 172.21.15.169:0/2017068286 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fd4116070 con 0x5617c451f470 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7eaeffd640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ea4034650 0x7f7ea4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7eaeffd640 1 -- 172.21.15.169:0/2017068286 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7fd4109030 con 0x5617c451f470 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ea4034650 0x7f7ea4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c45317b0 0x5617c4533c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c45343c0 con 0x5617c45317b0 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd9c36640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c45317b0 0x5617c4533c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ea4034650 0x7f7ea4036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5617c44f93e0 tx=0x7f7fc4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd9c36640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c45317b0 0x5617c4533c70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 20 realm 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4530c60 con 0x5617c45317b0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.097+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4534e80 con 0x5617c45317b0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c4535c60 0x5617c4538050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c45386e0 con 0x5617c4535c60 2024-09-13T06:29:24.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c4535c60 0x5617c4538050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c4535c60 0x5617c4538050 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:24.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 20 searching for the correct realm 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c453aca0 0x5617c453d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c453d710 con 0x5617c453aca0 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c453aca0 0x5617c453d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd8c34640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c453aca0 0x5617c453d090 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c453d710 con 0x5617c4535c60 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7fd4118060 0x7f7fd40fa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x7f7fd4118060 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.101+0000 7f7fd9c36640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7fd4118060 0x7f7fd40fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7fd4118060 0x7f7fd40fa440 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c453aca0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x7f7fd4118060 2024-09-13T06:29:24.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x7f7fd4118060 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.105+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c453aca0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c453aca0 2024-09-13T06:29:24.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c453aca0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x7f7fd4118060 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c45317b0 2024-09-13T06:29:24.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x7f7fd4118060 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.109+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c453aca0 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x7f7fd4118060 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c453aca0 2024-09-13T06:29:24.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5617c4538f30 con 0x5617c4535c60 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4539780 con 0x5617c45317b0 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.113+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4539b70 con 0x5617c4535c60 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4539b70 con 0x5617c453aca0 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 zone default found 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 4 Realm: () 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:24.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 zonegroup default 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c453db70 con 0x7f7fd4118060 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c453fda0 con 0x5617c453aca0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4540140 con 0x5617c453aca0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 started sync module instance, tier type = 2024-09-13T06:29:24.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:24.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.117+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c453f1e0 con 0x5617c4535c60 2024-09-13T06:29:24.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94660078073296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c453f1e0 con 0x5617c4535c60 2024-09-13T06:29:24.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4540990 con 0x5617c45317b0 2024-09-13T06:29:24.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94660078077152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4541230 con 0x5617c45317b0 2024-09-13T06:29:24.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4541c70 con 0x5617c4535c60 2024-09-13T06:29:24.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94660078073296] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94660078077152] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94660078081856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4540d80 con 0x5617c4535c60 2024-09-13T06:29:24.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.121+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4542510 con 0x7f7fd4118060 2024-09-13T06:29:24.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94660078084192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4540d80 con 0x7f7fd4118060 2024-09-13T06:29:24.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4542fe0 con 0x5617c4535c60 2024-09-13T06:29:24.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94660078084192] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94660078081856] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94660078071088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4542fa0 con 0x5617c4535c60 2024-09-13T06:29:24.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c45433d0 con 0x5617c453aca0 2024-09-13T06:29:24.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94660078085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4543c20 con 0x5617c453aca0 2024-09-13T06:29:24.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.125+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4544640 con 0x5617c453aca0 2024-09-13T06:29:24.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94660078085248] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94660078071088] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94660078086864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4543770 con 0x5617c453aca0 2024-09-13T06:29:24.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4544f10 con 0x7f7fd4118060 2024-09-13T06:29:24.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94660078094944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4544e80 con 0x7f7fd4118060 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=0 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=1 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=2 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=3 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=4 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=5 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94660078086864] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=6 2024-09-13T06:29:24.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94660078094944] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 20 add_watcher() i=7 2024-09-13T06:29:24.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:24.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c45441f0 con 0x5617c45317b0 2024-09-13T06:29:24.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.129+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94660078097072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4545cf0 con 0x5617c45317b0 2024-09-13T06:29:24.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94660078097072] v31'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7e8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:24.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:24.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 5 note: GC not initialized 2024-09-13T06:29:24.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7e8e7e4640 20 reqs_thread_entry: start 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 Filter name: none 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7dfffff640 20 reqs_thread_entry: start 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c456bb40 con 0x5617c45317b0 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:24.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c456b690 con 0x7f7fd4118060 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c456f790 con 0x5617c453aca0 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:24.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:24.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:24.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:24.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T06:29:24.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.133+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4573e30 con 0x5617c45317b0 2024-09-13T06:29:24.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(65 fud.buckets [call] v31'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4579d10 con 0x5617c453aca0 2024-09-13T06:29:24.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(66 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94660078268512 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4574260 con 0x5617c453aca0 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== watch-notify(notify (1) cookie 94660078085248 notify 133143986183 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5617c456fb80 con 0x5617c453aca0 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(67 notify.5 [notify cookie 94660078268512 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7eaffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94660078085248 notifier 4519 bl.length()=752 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7eaffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7eaffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7eaffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7eaffff640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f7e0c003540 con 0x5617c453aca0 2024-09-13T06:29:24.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== watch-notify(notify_complete (2) cookie 94660078268512 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5617c456ecd0 con 0x5617c453aca0 2024-09-13T06:29:24.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_sources= new_sources= 2024-09-13T06:29:24.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential sources added=[] removed=[] 2024-09-13T06:29:24.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_dests= new_dests= 2024-09-13T06:29:24.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential dests added=[] removed=[] 2024-09-13T06:29:24.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.137+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c456f060 con 0x7f7fd4118060 2024-09-13T06:29:24.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(69 foo.buckets [call] v31'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c456f060 con 0x7f7fd4118060 2024-09-13T06:29:24.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fdb925980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:29:24.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fdb925980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fdb925980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94660078268512 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5617c4578a00 con 0x5617c453aca0 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== watch-notify(notify (1) cookie 94660078086864 notify 133143986184 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5617c428aae0 con 0x5617c453aca0 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7eaffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94660078086864 notifier 4519 bl.length()=314 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7eaffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7eaffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(71 notify.6 [notify cookie 94660078268512 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7eaffff640 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f7e0c003570 con 0x5617c453aca0 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== watch-notify(notify_complete (2) cookie 94660078268512 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7fc4038c80 con 0x5617c453aca0 2024-09-13T06:29:24.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7e8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.141+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94660078097072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4569970 con 0x5617c45317b0 2024-09-13T06:29:24.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.145+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94660078097072] v31'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.145+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94660078073296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4569970 con 0x5617c4535c60 2024-09-13T06:29:24.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.145+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94660078073296] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.145+0000 7f7fdb925980 20 remove_watcher() i=0 2024-09-13T06:29:24.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.145+0000 7f7fdb925980 2 removed watcher, disabling cache 2024-09-13T06:29:24.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.145+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94660078077152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4569970 con 0x5617c45317b0 2024-09-13T06:29:24.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94660078077152] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x5617c45317b0 2024-09-13T06:29:24.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fdb925980 20 remove_watcher() i=1 2024-09-13T06:29:24.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94660078081856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4569970 con 0x5617c4535c60 2024-09-13T06:29:24.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94660078081856] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fdb925980 20 remove_watcher() i=2 2024-09-13T06:29:24.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94660078084192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4541740 con 0x7f7fd4118060 2024-09-13T06:29:24.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94660078084192] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fdb925980 20 remove_watcher() i=3 2024-09-13T06:29:24.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.149+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94660078071088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4569970 con 0x5617c4535c60 2024-09-13T06:29:24.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fd9435640 1 -- 172.21.15.169:0/2017068286 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94660078071088] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fd4115030 con 0x5617c4535c60 2024-09-13T06:29:24.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 20 remove_watcher() i=4 2024-09-13T06:29:24.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94660078085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4542060 con 0x5617c453aca0 2024-09-13T06:29:24.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94660078085248] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 20 remove_watcher() i=5 2024-09-13T06:29:24.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94660078086864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c453ed30 con 0x5617c453aca0 2024-09-13T06:29:24.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fd8c34640 1 -- 172.21.15.169:0/2017068286 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94660078086864] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc400e620 con 0x5617c453aca0 2024-09-13T06:29:24.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 20 remove_watcher() i=6 2024-09-13T06:29:24.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94660078094944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5617c4569970 con 0x7f7fd4118060 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94660078094944] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fcc0083f0 con 0x7f7fd4118060 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 20 remove_watcher() i=7 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.153+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c4535c60 msgr2=0x5617c4538050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c4535c60 0x5617c4538050 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c45317b0 msgr2=0x5617c4533c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c45317b0 0x5617c4533c70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7fd4118060 msgr2=0x7f7fd40fa440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7fd4118060 0x7f7fd40fa440 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c453aca0 msgr2=0x5617c453d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c453aca0 0x5617c453d090 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ea4034650 msgr2=0x7f7ea4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ea4034650 0x7f7ea4036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5617c44f93e0 tx=0x7f7fc4010000 comp rx=0 tx=0).stop 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 msgr2=0x5617c4526620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2017068286 reap_dead start 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c4526620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40e2500 tx=0x7f7fd40b3f50 comp rx=0 tx=0).stop 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 shutdown_connections 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2017068286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c451f470 0x5617c4526620 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 >> 172.21.15.169:0/2017068286 conn(0x5617c451b850 msgr2=0x5617c4519920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 shutdown_connections 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2017068286 wait complete. 2024-09-13T06:29:24.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7eb0034650 msgr2=0x7f7eb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7eb0034650 0x7f7eb0036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400bf60 tx=0x7f7fc400f000 comp rx=0 tx=0).stop 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 msgr2=0x5617c4512fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 0x5617c4512fc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40e3740 tx=0x7f7fd40a9690 comp rx=0 tx=0).stop 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 shutdown_connections 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7eb0034650 0x7f7eb0036b10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/665495385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4512ba0 0x5617c4512fc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 >> 172.21.15.169:0/665495385 conn(0x5617c4507cf0 msgr2=0x5617c450a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 shutdown_connections 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/665495385 wait complete. 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c44fd1e0 msgr2=0x5617c44ff5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5617c44fd1e0 0x5617c44ff5d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c4405810 msgr2=0x5617c44fbd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5617c4405810 0x5617c44fbd80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c4502870 msgr2=0x5617c4504c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5617c4502870 0x5617c4504c60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ec0034650 msgr2=0x7f7ec0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ec0034650 0x7f7ec0036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f70 tx=0x7f7fc40012c0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 msgr2=0x5617c44f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 --2- 172.21.15.169:0/2059836339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5617c4376aa0 0x5617c44f4df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4019680 tx=0x7f7fd4019810 comp rx=0 tx=0).stop 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fd9c36640 1 -- 172.21.15.169:0/2059836339 reap_dead start 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 shutdown_connections 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 >> 172.21.15.169:0/2059836339 conn(0x5617c43fd000 msgr2=0x5617c44e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 shutdown_connections 2024-09-13T06:29:24.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.157+0000 7f7fdb925980 1 -- 172.21.15.169:0/2059836339 wait complete. 2024-09-13T06:29:24.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T06:29:24.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T06:29:24.168 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T06:29:24.247 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:24.247 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:24.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1debdbc980 1 Processor -- start 2024-09-13T06:29:24.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1debdbc980 1 -- start start 2024-09-13T06:29:24.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1debdbc980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562a42df38f0 0x562a42df5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1debdbc980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a42c78ae0 con 0x562a42def570 2024-09-13T06:29:24.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1debdbc980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x562a42c9ce30 con 0x562a42df38f0 2024-09-13T06:29:24.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1de90cb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562a42df38f0 0x562a42df5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1de98cc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x562a42def570 0x562a42def950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45314/0 (socket says 172.21.15.169:45314) 2024-09-13T06:29:24.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1de98cc640 1 -- 172.21.15.169:0/2620613945 learned_addr learned my addr 172.21.15.169:0/2620613945 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:24.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1de90cb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x562a42df38f0 0x562a42df5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37124/0 (socket says 172.21.15.169:37124) 2024-09-13T06:29:24.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1de90cb640 1 -- 172.21.15.169:0/2620613945 >> v1:172.21.15.112:6789/0 conn(0x562a42def570 legacy=0x562a42def950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.245+0000 7f1de90cb640 1 -- 172.21.15.169:0/2620613945 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a42df7230 con 0x562a42df38f0 2024-09-13T06:29:24.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1de90cb640 1 --2- 172.21.15.169:0/2620613945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42df38f0 0x562a42df5ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1de000a480 tx=0x7f1de001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b34580d866955e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1de88ca640 1 -- 172.21.15.169:0/2620613945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de00b0070 con 0x562a42df38f0 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1de88ca640 1 -- 172.21.15.169:0/2620613945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de00ab540 con 0x562a42df38f0 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1de88ca640 1 -- 172.21.15.169:0/2620613945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de00ab840 con 0x562a42df38f0 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 -- 172.21.15.169:0/2620613945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42df38f0 msgr2=0x562a42df5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 --2- 172.21.15.169:0/2620613945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42df38f0 0x562a42df5ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1de000a480 tx=0x7f1de001b280 comp rx=0 tx=0).stop 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 -- 172.21.15.169:0/2620613945 shutdown_connections 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 --2- 172.21.15.169:0/2620613945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42df38f0 0x562a42df5ce0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 -- 172.21.15.169:0/2620613945 >> 172.21.15.169:0/2620613945 conn(0x562a42deb090 msgr2=0x562a42ded4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 -- 172.21.15.169:0/2620613945 shutdown_connections 2024-09-13T06:29:24.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.249+0000 7f1debdbc980 1 -- 172.21.15.169:0/2620613945 wait complete. 2024-09-13T06:29:24.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.261+0000 7f1debdbc980 1 Processor -- start 2024-09-13T06:29:24.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- start start 2024-09-13T06:29:24.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42eda940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562a42c9e200 con 0x562a42def570 2024-09-13T06:29:24.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42eda940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42eda940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37132/0 (socket says 172.21.15.169:37132) 2024-09-13T06:29:24.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 -- 172.21.15.169:0/366869514 learned_addr learned my addr 172.21.15.169:0/366869514 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 -- 172.21.15.169:0/366869514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a42edaf10 con 0x562a42def570 2024-09-13T06:29:24.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 --2- 172.21.15.169:0/366869514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42eda940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1de40017b0 tx=0x7f1de4001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ae084e9c8eeb1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1cd7e07640 1 -- 172.21.15.169:0/366869514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4016070 con 0x562a42def570 2024-09-13T06:29:24.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1cd7e07640 1 -- 172.21.15.169:0/366869514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de4004530 con 0x562a42def570 2024-09-13T06:29:24.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1cd7e07640 1 -- 172.21.15.169:0/366869514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4004870 con 0x562a42def570 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- 172.21.15.169:0/366869514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 msgr2=0x562a42eda940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 --2- 172.21.15.169:0/366869514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42eda940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1de40017b0 tx=0x7f1de4001c70 comp rx=0 tx=0).stop 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- 172.21.15.169:0/366869514 shutdown_connections 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 --2- 172.21.15.169:0/366869514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42eda940 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- 172.21.15.169:0/366869514 >> 172.21.15.169:0/366869514 conn(0x562a42deb090 msgr2=0x562a42ed6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- 172.21.15.169:0/366869514 shutdown_connections 2024-09-13T06:29:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- 172.21.15.169:0/366869514 wait complete. 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 Processor -- start 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- start start 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42ee1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1debdbc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562a42df6d30 con 0x562a42def570 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42ee1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42ee1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37146/0 (socket says 172.21.15.169:37146) 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 -- 172.21.15.169:0/4148418512 learned_addr learned my addr 172.21.15.169:0/4148418512 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.265+0000 7f1de98cc640 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a42ee2220 con 0x562a42def570 2024-09-13T06:29:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1de98cc640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42ee1ce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1de4014040 tx=0x7f1de4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1cd6604640 1 -- 172.21.15.169:0/4148418512 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4020070 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1cd6604640 1 -- 172.21.15.169:0/4148418512 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de4011400 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1cd6604640 1 -- 172.21.15.169:0/4148418512 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4016040 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a42ee24b0 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a42ee5190 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1cd6604640 1 -- 172.21.15.169:0/4148418512 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1de4023070 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1cd6604640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cd0034650 0x7f1cd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1cd6604640 1 -- 172.21.15.169:0/4148418512 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1de4048f20 con 0x562a42def570 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1de90cb640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cd0034650 0x7f1cd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42df38f0 0x562a42ee8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42ee9320 con 0x562a42df38f0 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1dea0cd640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42df38f0 0x562a42ee8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1de90cb640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cd0034650 0x7f1cd0036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1de00ad000 tx=0x7f1de00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1dea0cd640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42df38f0 0x562a42ee8de0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1dea0cd640 1 -- 172.21.15.169:0/4148418512 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42df38f0 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42eea100 0x562a42eec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42eecb20 con 0x562a42eea100 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.269+0000 7f1de98cc640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42eea100 0x562a42eec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de98cc640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42eea100 0x562a42eec4f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de98cc640 1 -- 172.21.15.169:0/4148418512 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1de402c070 con 0x562a42eea100 2024-09-13T06:29:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42eee3d0 con 0x562a42eea100 2024-09-13T06:29:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de98cc640 1 -- 172.21.15.169:0/4148418512 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1de402c070 con 0x562a42eea100 2024-09-13T06:29:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42eed600 con 0x562a42eea100 2024-09-13T06:29:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de98cc640 1 -- 172.21.15.169:0/4148418512 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1de402c070 con 0x562a42eea100 2024-09-13T06:29:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42eef780 0x562a42ef1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42ef20b0 con 0x562a42eef780 2024-09-13T06:29:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de90cb640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42eef780 0x562a42ef1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de90cb640 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42eef780 0x562a42ef1b70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1de90cb640 1 -- 172.21.15.169:0/4148418512 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1de00b3040 con 0x562a42eef780 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 Processor -- start 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 -- start start 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 0x562a42f01020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.273+0000 7f1debdbc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562a42cf7800 con 0x562a42f00be0 2024-09-13T06:29:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 0x562a42f01020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 0x562a42f01020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37162/0 (socket says 172.21.15.169:37162) 2024-09-13T06:29:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 -- 172.21.15.169:0/2298587168 learned_addr learned my addr 172.21.15.169:0/2298587168 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 -- 172.21.15.169:0/2298587168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a42f01560 con 0x562a42f00be0 2024-09-13T06:29:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 0x562a42f01020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1de401cfd0 tx=0x7f1de4024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1ccf7fe640 1 -- 172.21.15.169:0/2298587168 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de401ba10 con 0x562a42f00be0 2024-09-13T06:29:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a42f04190 con 0x562a42f00be0 2024-09-13T06:29:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1ccf7fe640 1 -- 172.21.15.169:0/2298587168 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de401bbb0 con 0x562a42f00be0 2024-09-13T06:29:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1ccf7fe640 1 -- 172.21.15.169:0/2298587168 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4026970 con 0x562a42f00be0 2024-09-13T06:29:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a42f04540 con 0x562a42f00be0 2024-09-13T06:29:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1ccf7fe640 1 -- 172.21.15.169:0/2298587168 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1de4043040 con 0x562a42f00be0 2024-09-13T06:29:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1ccf7fe640 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cc4034650 0x7f1cc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1ccf7fe640 1 -- 172.21.15.169:0/2298587168 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1de404caa0 con 0x562a42f00be0 2024-09-13T06:29:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de90cb640 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cc4034650 0x7f1cc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1debdbc980 1 Processor -- start 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1debdbc980 1 -- start start 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1debdbc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1debdbc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562a42edb290 con 0x562a42f0d4f0 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de90cb640 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cc4034650 0x7f1cc4036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1de000a480 tx=0x7f1de0005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f0d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37176/0 (socket says 172.21.15.169:37176) 2024-09-13T06:29:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.277+0000 7f1de98cc640 1 -- 172.21.15.169:0/3013334038 learned_addr learned my addr 172.21.15.169:0/3013334038 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 -- 172.21.15.169:0/3013334038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a42f0dea0 con 0x562a42f0d4f0 2024-09-13T06:29:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 --2- 172.21.15.169:0/3013334038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f0d8d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1de40117c0 tx=0x7f1de4025510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c705c65b7f547d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1ccd7fa640 1 -- 172.21.15.169:0/3013334038 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4050040 con 0x562a42f0d4f0 2024-09-13T06:29:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1ccd7fa640 1 -- 172.21.15.169:0/3013334038 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de402dce0 con 0x562a42f0d4f0 2024-09-13T06:29:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1ccd7fa640 1 -- 172.21.15.169:0/3013334038 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4041000 con 0x562a42f0d4f0 2024-09-13T06:29:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/3013334038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 msgr2=0x562a42f0d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 --2- 172.21.15.169:0/3013334038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f0d8d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1de40117c0 tx=0x7f1de4025510 comp rx=0 tx=0).stop 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/3013334038 shutdown_connections 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 --2- 172.21.15.169:0/3013334038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f0d8d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/3013334038 >> 172.21.15.169:0/3013334038 conn(0x562a42f098d0 msgr2=0x562a42f079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/3013334038 shutdown_connections 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/3013334038 wait complete. 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 Processor -- start 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- start start 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562a42f0e340 con 0x562a42f0d4f0 2024-09-13T06:29:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f146d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37178/0 (socket says 172.21.15.169:37178) 2024-09-13T06:29:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 learned_addr learned my addr 172.21.15.169:0/757185465 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a42f14c10 con 0x562a42f0d4f0 2024-09-13T06:29:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1de98cc640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f146d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1de40257f0 tx=0x7f1de400df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1cbb7fe640 1 -- 172.21.15.169:0/757185465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de406d070 con 0x562a42f0d4f0 2024-09-13T06:29:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a42f14c10 con 0x562a42f0d4f0 2024-09-13T06:29:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1cbb7fe640 1 -- 172.21.15.169:0/757185465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de4032630 con 0x562a42f0d4f0 2024-09-13T06:29:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1cbb7fe640 1 -- 172.21.15.169:0/757185465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de4050050 con 0x562a42f0d4f0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.281+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a42f15080 con 0x562a42f0d4f0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1cbb7fe640 1 -- 172.21.15.169:0/757185465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1de4070070 con 0x562a42f0d4f0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1cbb7fe640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cb4034650 0x7f1cb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1cbb7fe640 1 -- 172.21.15.169:0/757185465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1de4065070 con 0x562a42f0d4f0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1de90cb640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cb4034650 0x7f1cb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42f1f600 0x562a42f21aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f221f0 con 0x562a42f1f600 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1dea0cd640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42f1f600 0x562a42f21aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1de90cb640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cb4034650 0x7f1cb4036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1de00ae040 tx=0x7f1de00b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1dea0cd640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42f1f600 0x562a42f21aa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 realm 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f1eaf0 con 0x562a42f1f600 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f22cc0 con 0x562a42f1f600 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42f23aa0 0x562a42f25e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f26510 con 0x562a42f23aa0 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1de98cc640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42f23aa0 0x562a42f25e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1de98cc640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42f23aa0 0x562a42f25e90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.285+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f26d60 con 0x562a42f23aa0 2024-09-13T06:29:24.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1debdbc980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1debdbc980 20 searching for the correct realm 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42f28ad0 0x562a42f2aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de90cb640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42f28ad0 0x562a42f2aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de90cb640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42f28ad0 0x562a42f2aec0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de98cc640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1de4072060 0x7f1de404c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x7f1de4072060 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1de4072060 0x7f1de404c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1de4072060 0x7f1de404c070 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.289+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x7f1de4072060 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x7f1de4072060 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.293+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x7f1de4072060 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f1f600 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x7f1de4072060 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x7f1de4072060 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f28ad0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.297+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2b540 con 0x562a42f23aa0 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f276b0 con 0x562a42f1f600 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f272f0 con 0x562a42f23aa0 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f27fd0 con 0x562a42f28ad0 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 zone default found 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 4 Realm: () 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 zonegroup default 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f27be0 con 0x7f1de4072060 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2dd80 con 0x562a42f28ad0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2e120 con 0x562a42f28ad0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 started sync module instance, tier type = 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.301+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2d1c0 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.305+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.305+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739511826112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2d1c0 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.305+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2eae0 con 0x562a42f1f600 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.305+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.305+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739511830064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2f330 con 0x562a42f1f600 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.305+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2fd30 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739511830064] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739511826112] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739511823632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2ee80 con 0x562a42f23aa0 2024-09-13T06:29:24.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f305d0 con 0x7f1de4072060 2024-09-13T06:29:24.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739511836960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2ee80 con 0x7f1de4072060 2024-09-13T06:29:24.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f310a0 con 0x562a42f23aa0 2024-09-13T06:29:24.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.309+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739511836960] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739511823632] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739511834688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f31060 con 0x562a42f23aa0 2024-09-13T06:29:24.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f31490 con 0x562a42f28ad0 2024-09-13T06:29:24.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739511838016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f31d30 con 0x562a42f28ad0 2024-09-13T06:29:24.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f32750 con 0x562a42f28ad0 2024-09-13T06:29:24.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739511834688] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739511845440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f32b40 con 0x562a42f28ad0 2024-09-13T06:29:24.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f33500 con 0x7f1de4072060 2024-09-13T06:29:24.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.313+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739511838016] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739511842944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f33500 con 0x7f1de4072060 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=0 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=1 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=2 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=3 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=4 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=5 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739511845440] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=6 2024-09-13T06:29:24.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739511842944] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 20 add_watcher() i=7 2024-09-13T06:29:24.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:24.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f36530 con 0x562a42f1f600 2024-09-13T06:29:24.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.317+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739511849040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f33920 con 0x562a42f1f600 2024-09-13T06:29:24.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739511849040] v31'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1c9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1debdbc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:24.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1debdbc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:24.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3ecd0 con 0x562a42f23aa0 2024-09-13T06:29:24.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.321+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3ed90 con 0x7f1de4072060 2024-09-13T06:29:24.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.325+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.325+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3f420 con 0x562a42f28ad0 2024-09-13T06:29:24.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.325+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.325+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3f990 con 0x562a42f1f600 2024-09-13T06:29:24.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.329+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'122 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.329+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3fe40 con 0x562a42f23aa0 2024-09-13T06:29:24.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.329+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.329+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3fe40 con 0x562a42f28ad0 2024-09-13T06:29:24.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.329+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.329+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3dcf0 con 0x562a42f23aa0 2024-09-13T06:29:24.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.333+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.333+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3dcf0 con 0x562a42f1f600 2024-09-13T06:29:24.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.333+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.333+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f409a0 con 0x562a42f23aa0 2024-09-13T06:29:24.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.337+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.337+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f409a0 con 0x562a42f23aa0 2024-09-13T06:29:24.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.337+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.337+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f409a0 con 0x562a42f23aa0 2024-09-13T06:29:24.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.341+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.341+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f409a0 con 0x562a42f28ad0 2024-09-13T06:29:24.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.341+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.341+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f40e50 con 0x562a42f23aa0 2024-09-13T06:29:24.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.345+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.345+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f40e50 con 0x562a42f1f600 2024-09-13T06:29:24.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.345+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.345+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41020 con 0x562a42f1f600 2024-09-13T06:29:24.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.349+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.349+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41020 con 0x562a42f23aa0 2024-09-13T06:29:24.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.349+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.349+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41020 con 0x562a42f23aa0 2024-09-13T06:29:24.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.353+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.353+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41020 con 0x562a42f28ad0 2024-09-13T06:29:24.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.353+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.353+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f410b0 con 0x562a42f23aa0 2024-09-13T06:29:24.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.357+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.357+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f1f600 2024-09-13T06:29:24.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.357+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.357+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f23aa0 2024-09-13T06:29:24.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.361+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.361+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f23aa0 2024-09-13T06:29:24.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.365+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.365+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f28ad0 2024-09-13T06:29:24.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.365+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.365+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f23aa0 2024-09-13T06:29:24.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.365+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.369+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f28ad0 2024-09-13T06:29:24.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.369+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.369+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f28ad0 2024-09-13T06:29:24.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.369+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.369+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f28ad0 2024-09-13T06:29:24.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.373+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.373+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f23aa0 2024-09-13T06:29:24.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.373+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.373+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f41560 con 0x562a42f1f600 2024-09-13T06:29:24.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.377+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.377+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f412b0 con 0x562a42f23aa0 2024-09-13T06:29:24.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.377+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.381+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f412b0 con 0x562a42f1f600 2024-09-13T06:29:24.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.381+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.381+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f412b0 con 0x7f1de4072060 2024-09-13T06:29:24.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1c9a7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 20 Filter name: none 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1c0bfff640 20 reqs_thread_entry: start 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3cec0 con 0x7f1de4072060 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:29:24.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:29:24.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:29:24.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:24.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f3c960 con 0x562a42f1f600 2024-09-13T06:29:24.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T06:29:24.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5cdf0 con 0x562a42f28ad0 2024-09-13T06:29:24.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:29:24.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94739512023376 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5f230 con 0x562a42f23aa0 2024-09-13T06:29:24.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== watch-notify(notify (1) cookie 94739511823632 notify 133143986200 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562a42f40b70 con 0x562a42f23aa0 2024-09-13T06:29:24.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1ccd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94739511823632 notifier 4526 bl.length()=170 2024-09-13T06:29:24.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(97 notify.2 [notify cookie 94739512023376 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.385+0000 7f1ccd7fa640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1cac003d70 con 0x562a42f23aa0 2024-09-13T06:29:24.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== watch-notify(notify_complete (2) cookie 94739512023376 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a42f01560 con 0x562a42f23aa0 2024-09-13T06:29:24.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 10 removing email index: 2024-09-13T06:29:24.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 10 removing user buckets index 2024-09-13T06:29:24.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5cdf0 con 0x562a42f1f600 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(99 fud.buckets [delete] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94739512023376 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5f230 con 0x562a42f28ad0 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== watch-notify(notify (1) cookie 94739511845440 notify 133143986185 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562a42f3d970 con 0x562a42f28ad0 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1ccd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94739511845440 notifier 4526 bl.length()=160 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(100 notify.6 [notify cookie 94739512023376 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1ccd7fa640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1cac003d70 con 0x562a42f28ad0 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== watch-notify(notify_complete (2) cookie 94739512023376 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a42f3dec0 con 0x562a42f28ad0 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 10 removing user index: fud 2024-09-13T06:29:24.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.389+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5ef70 con 0x7f1de4072060 2024-09-13T06:29:24.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(102 fud [call,call,delete] v31'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1debdbc980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T06:29:24.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1debdbc980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:29:24.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94739512027840 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5eee0 con 0x562a42f28ad0 2024-09-13T06:29:24.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== watch-notify(notify (1) cookie 94739511838016 notify 133143986186 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562a42f3dec0 con 0x562a42f28ad0 2024-09-13T06:29:24.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1cccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94739511838016 notifier 4526 bl.length()=152 2024-09-13T06:29:24.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(103 notify.5 [notify cookie 94739512027840 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1cccff9640 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1c140032d0 con 0x562a42f28ad0 2024-09-13T06:29:24.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== watch-notify(notify_complete (2) cookie 94739512027840 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a42f3e4c0 con 0x562a42f28ad0 2024-09-13T06:29:24.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1c9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.393+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739511849040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f5eac0 con 0x562a42f1f600 2024-09-13T06:29:24.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94739511849040] v31'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739511826112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f33050 con 0x562a42f23aa0 2024-09-13T06:29:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94739511826112] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1debdbc980 20 remove_watcher() i=0 2024-09-13T06:29:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1debdbc980 2 removed watcher, disabling cache 2024-09-13T06:29:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739511830064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f33050 con 0x562a42f1f600 2024-09-13T06:29:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.397+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94739511830064] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x562a42f1f600 2024-09-13T06:29:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1debdbc980 20 remove_watcher() i=1 2024-09-13T06:29:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739511823632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2e630 con 0x562a42f23aa0 2024-09-13T06:29:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94739511823632] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1debdbc980 20 remove_watcher() i=2 2024-09-13T06:29:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739511836960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f33050 con 0x7f1de4072060 2024-09-13T06:29:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94739511836960] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1debdbc980 20 remove_watcher() i=3 2024-09-13T06:29:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.401+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739511834688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2e630 con 0x562a42f23aa0 2024-09-13T06:29:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1de98cc640 1 -- 172.21.15.169:0/757185465 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94739511834688] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de406f030 con 0x562a42f23aa0 2024-09-13T06:29:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1debdbc980 20 remove_watcher() i=4 2024-09-13T06:29:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739511838016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2f840 con 0x562a42f28ad0 2024-09-13T06:29:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94739511838016] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1debdbc980 20 remove_watcher() i=5 2024-09-13T06:29:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739511845440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2e630 con 0x562a42f28ad0 2024-09-13T06:29:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1de90cb640 1 -- 172.21.15.169:0/757185465 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94739511845440] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de00c9030 con 0x562a42f28ad0 2024-09-13T06:29:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1debdbc980 20 remove_watcher() i=6 2024-09-13T06:29:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.405+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739511842944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a42f2f840 con 0x7f1de4072060 2024-09-13T06:29:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94739511842944] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1de4072060 2024-09-13T06:29:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 20 remove_watcher() i=7 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42f23aa0 msgr2=0x562a42f25e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42f23aa0 0x562a42f25e90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42f1f600 msgr2=0x562a42f21aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42f1f600 0x562a42f21aa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1de4072060 msgr2=0x7f1de404c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f1de4072060 0x7f1de404c070 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42f28ad0 msgr2=0x562a42f2aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42f28ad0 0x562a42f2aec0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cb4034650 msgr2=0x7f1cb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cb4034650 0x7f1cb4036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1de00ae040 tx=0x7f1de00b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1dea0cd640 1 -- 172.21.15.169:0/757185465 reap_dead start 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 msgr2=0x562a42f146d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f146d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1de40257f0 tx=0x7f1de400df90 comp rx=0 tx=0).stop 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 shutdown_connections 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/757185465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f0d4f0 0x562a42f146d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 >> 172.21.15.169:0/757185465 conn(0x562a42f098d0 msgr2=0x562a42f079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 shutdown_connections 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/757185465 wait complete. 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cc4034650 msgr2=0x7f1cc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cc4034650 0x7f1cc4036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1de000a480 tx=0x7f1de0005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 msgr2=0x562a42f01020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 0x562a42f01020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1de401cfd0 tx=0x7f1de4024fa0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 shutdown_connections 2024-09-13T06:29:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cc4034650 0x7f1cc4036b10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/2298587168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42f00be0 0x562a42f01020 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 >> 172.21.15.169:0/2298587168 conn(0x562a42ef6320 msgr2=0x562a42ef8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 shutdown_connections 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/2298587168 wait complete. 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42eea100 msgr2=0x562a42eec4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562a42eea100 0x562a42eec4f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42df38f0 msgr2=0x562a42ee8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562a42df38f0 0x562a42ee8de0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42eef780 msgr2=0x562a42ef1b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x562a42eef780 0x562a42ef1b70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cd0034650 msgr2=0x7f1cd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1cd0034650 0x7f1cd0036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1de00ad000 tx=0x7f1de00a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 msgr2=0x562a42ee1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 --2- 172.21.15.169:0/4148418512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562a42def570 0x562a42ee1ce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1de4014040 tx=0x7f1de4001260 comp rx=0 tx=0).stop 2024-09-13T06:29:24.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1dea0cd640 1 -- 172.21.15.169:0/4148418512 reap_dead start 2024-09-13T06:29:24.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 shutdown_connections 2024-09-13T06:29:24.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 >> 172.21.15.169:0/4148418512 conn(0x562a42deb090 msgr2=0x562a42ed50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 shutdown_connections 2024-09-13T06:29:24.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.409+0000 7f1debdbc980 1 -- 172.21.15.169:0/4148418512 wait complete. 2024-09-13T06:29:24.420 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:29:24.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:29:24.421 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T06:29:24.499 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:24.499 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:24.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b85285980 1 Processor -- start 2024-09-13T06:29:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b85285980 1 -- start start 2024-09-13T06:29:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b85285980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a57ee498b0 0x55a57ee4bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b85285980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a57ecceae0 con 0x55a57ee454e0 2024-09-13T06:29:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b85285980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55a57ecf2e30 con 0x55a57ee498b0 2024-09-13T06:29:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b7bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a57ee498b0 0x55a57ee4bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b82d95640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55a57ee454e0 0x55a57ee458c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45328/0 (socket says 172.21.15.169:45328) 2024-09-13T06:29:24.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b82d95640 1 -- 172.21.15.169:0/3193125341 learned_addr learned my addr 172.21.15.169:0/3193125341 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:24.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b7bfff640 1 -- 172.21.15.169:0/3193125341 >> v1:172.21.15.112:6789/0 conn(0x55a57ee454e0 legacy=0x55a57ee458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.497+0000 7f2b7bfff640 1 -- 172.21.15.169:0/3193125341 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a57ee4d1f0 con 0x55a57ee498b0 2024-09-13T06:29:24.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/3193125341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee498b0 0x55a57ee4bca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400a480 tx=0x7f2b7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a978b153c3611 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b82594640 1 -- 172.21.15.169:0/3193125341 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b740b0070 con 0x55a57ee498b0 2024-09-13T06:29:24.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b82594640 1 -- 172.21.15.169:0/3193125341 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b740ab540 con 0x55a57ee498b0 2024-09-13T06:29:24.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b82594640 1 -- 172.21.15.169:0/3193125341 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b740ab840 con 0x55a57ee498b0 2024-09-13T06:29:24.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 -- 172.21.15.169:0/3193125341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee498b0 msgr2=0x55a57ee4bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 --2- 172.21.15.169:0/3193125341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee498b0 0x55a57ee4bca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400a480 tx=0x7f2b7401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:24.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 -- 172.21.15.169:0/3193125341 shutdown_connections 2024-09-13T06:29:24.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 --2- 172.21.15.169:0/3193125341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee498b0 0x55a57ee4bca0 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400a480 tx=0x7f2b7401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:24.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 -- 172.21.15.169:0/3193125341 >> 172.21.15.169:0/3193125341 conn(0x55a57ee41000 msgr2=0x55a57ee43420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 -- 172.21.15.169:0/3193125341 shutdown_connections 2024-09-13T06:29:24.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.501+0000 7f2b85285980 1 -- 172.21.15.169:0/3193125341 wait complete. 2024-09-13T06:29:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b85285980 1 Processor -- start 2024-09-13T06:29:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b85285980 1 -- start start 2024-09-13T06:29:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b85285980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ef31c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b85285980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a57ecf4200 con 0x55a57ee454e0 2024-09-13T06:29:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ef31c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ef31c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37186/0 (socket says 172.21.15.169:37186) 2024-09-13T06:29:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b82d95640 1 -- 172.21.15.169:0/1110154197 learned_addr learned my addr 172.21.15.169:0/1110154197 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.513+0000 7f2b82d95640 1 -- 172.21.15.169:0/1110154197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a57ef32240 con 0x55a57ee454e0 2024-09-13T06:29:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b82d95640 1 --2- 172.21.15.169:0/1110154197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ef31c70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c001e20 tx=0x7f2b6c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b513bb97720950 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2a70e09640 1 -- 172.21.15.169:0/1110154197 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c012020 con 0x55a57ee454e0 2024-09-13T06:29:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2a70e09640 1 -- 172.21.15.169:0/1110154197 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00e7c0 con 0x55a57ee454e0 2024-09-13T06:29:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2a70e09640 1 -- 172.21.15.169:0/1110154197 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c00eb00 con 0x55a57ee454e0 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/1110154197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 msgr2=0x55a57ef31c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 --2- 172.21.15.169:0/1110154197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ef31c70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c001e20 tx=0x7f2b6c00b790 comp rx=0 tx=0).stop 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/1110154197 shutdown_connections 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 --2- 172.21.15.169:0/1110154197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ef31c70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/1110154197 >> 172.21.15.169:0/1110154197 conn(0x55a57ee41000 msgr2=0x55a57ef2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/1110154197 shutdown_connections 2024-09-13T06:29:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/1110154197 wait complete. 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 Processor -- start 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- start start 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ee4eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a57ee4ccf0 con 0x55a57ee454e0 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ee4eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ee4eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37200/0 (socket says 172.21.15.169:37200) 2024-09-13T06:29:24.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b82d95640 1 -- 172.21.15.169:0/952489370 learned_addr learned my addr 172.21.15.169:0/952489370 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b82d95640 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a57ee4d600 con 0x55a57ee454e0 2024-09-13T06:29:24.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b82d95640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ee4eee0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c001e20 tx=0x7f2b6c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2a6f606640 1 -- 172.21.15.169:0/952489370 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c012030 con 0x55a57ee454e0 2024-09-13T06:29:24.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a57ee4d890 con 0x55a57ee454e0 2024-09-13T06:29:24.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2a6f606640 1 -- 172.21.15.169:0/952489370 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c001480 con 0x55a57ee454e0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a57ee4dd80 con 0x55a57ee454e0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.517+0000 7f2a6f606640 1 -- 172.21.15.169:0/952489370 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c01a920 con 0x55a57ee454e0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2a6f606640 1 -- 172.21.15.169:0/952489370 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2b6c015020 con 0x55a57ee454e0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2a6f606640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a68034650 0x7f2a68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2a6f606640 1 -- 172.21.15.169:0/952489370 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2b6c020030 con 0x55a57ee454e0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a68034650 0x7f2a68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef40410 0x55a57ef42800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef42d40 con 0x55a57ef40410 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b83596640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef40410 0x55a57ef42800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a68034650 0x7f2a68036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ad000 tx=0x7f2b740a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b83596640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef40410 0x55a57ef42800 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b83596640 1 -- 172.21.15.169:0/952489370 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef40410 2024-09-13T06:29:24.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef437b0 0x55a57ef45c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef463b0 con 0x55a57ef437b0 2024-09-13T06:29:24.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b82d95640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef437b0 0x55a57ef45c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b82d95640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef437b0 0x55a57ef45c40 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b82d95640 1 -- 172.21.15.169:0/952489370 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b6c008030 con 0x55a57ef437b0 2024-09-13T06:29:24.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.521+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef47c60 con 0x55a57ef437b0 2024-09-13T06:29:24.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 -- 172.21.15.169:0/952489370 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b6c008030 con 0x55a57ef437b0 2024-09-13T06:29:24.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef46e90 con 0x55a57ef437b0 2024-09-13T06:29:24.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 -- 172.21.15.169:0/952489370 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b6c008030 con 0x55a57ef437b0 2024-09-13T06:29:24.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef49010 0x55a57ef4b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef4b940 con 0x55a57ef49010 2024-09-13T06:29:24.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef49010 0x55a57ef4b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef49010 0x55a57ef4b400 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b7bfff640 1 -- 172.21.15.169:0/952489370 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b740b3040 con 0x55a57ef49010 2024-09-13T06:29:24.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 Processor -- start 2024-09-13T06:29:24.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 -- start start 2024-09-13T06:29:24.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 0x55a57ef59740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a57ed4d800 con 0x55a57ef59320 2024-09-13T06:29:24.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 0x55a57ef59740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 0x55a57ef59740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37210/0 (socket says 172.21.15.169:37210) 2024-09-13T06:29:24.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 -- 172.21.15.169:0/3414470717 learned_addr learned my addr 172.21.15.169:0/3414470717 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 -- 172.21.15.169:0/3414470717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a57ef59c80 con 0x55a57ef59320 2024-09-13T06:29:24.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b82d95640 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 0x55a57ef59740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c016520 tx=0x7f2b6c00db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2a6ce01640 1 -- 172.21.15.169:0/3414470717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c047200 con 0x55a57ef59320 2024-09-13T06:29:24.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a57ef59eb0 con 0x55a57ef59320 2024-09-13T06:29:24.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2a6ce01640 1 -- 172.21.15.169:0/3414470717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c017c50 con 0x55a57ef59320 2024-09-13T06:29:24.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2a6ce01640 1 -- 172.21.15.169:0/3414470717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c041cd0 con 0x55a57ef59320 2024-09-13T06:29:24.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.525+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a57ef5cad0 con 0x55a57ef59320 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2a6ce01640 1 -- 172.21.15.169:0/3414470717 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2b6c009070 con 0x55a57ef59320 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2a6ce01640 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a5c034650 0x7f2a5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2a6ce01640 1 -- 172.21.15.169:0/3414470717 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2b6c005050 con 0x55a57ef59320 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a5c034650 0x7f2a5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 Processor -- start 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- start start 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a5c034650 0x7f2a5c036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ae040 tx=0x7f2b74005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef65d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a57ef325c0 con 0x55a57ef65950 2024-09-13T06:29:24.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef65d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef65d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37216/0 (socket says 172.21.15.169:37216) 2024-09-13T06:29:24.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b82d95640 1 -- 172.21.15.169:0/3721761985 learned_addr learned my addr 172.21.15.169:0/3721761985 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b82d95640 1 -- 172.21.15.169:0/3721761985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a57ef66320 con 0x55a57ef65950 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b82d95640 1 --2- 172.21.15.169:0/3721761985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef65d50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c02f080 tx=0x7f2b6c020ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932267c8a30ffbec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2a667fc640 1 -- 172.21.15.169:0/3721761985 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c060020 con 0x55a57ef65950 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2a667fc640 1 -- 172.21.15.169:0/3721761985 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c02d3f0 con 0x55a57ef65950 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2a667fc640 1 -- 172.21.15.169:0/3721761985 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c019cc0 con 0x55a57ef65950 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- 172.21.15.169:0/3721761985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 msgr2=0x55a57ef65d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 --2- 172.21.15.169:0/3721761985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef65d50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c02f080 tx=0x7f2b6c020ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- 172.21.15.169:0/3721761985 shutdown_connections 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 --2- 172.21.15.169:0/3721761985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef65d50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- 172.21.15.169:0/3721761985 >> 172.21.15.169:0/3721761985 conn(0x55a57ef61c80 msgr2=0x55a57ef5fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- 172.21.15.169:0/3721761985 shutdown_connections 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.529+0000 7f2b85285980 1 -- 172.21.15.169:0/3721761985 wait complete. 2024-09-13T06:29:24.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 Processor -- start 2024-09-13T06:29:24.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 -- start start 2024-09-13T06:29:24.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef6ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a57ef66810 con 0x55a57ef65950 2024-09-13T06:29:24.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef6ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b82d95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef6ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37224/0 (socket says 172.21.15.169:37224) 2024-09-13T06:29:24.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 learned_addr learned my addr 172.21.15.169:0/1068357826 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a57ef6cfa0 con 0x55a57ef65950 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b82d95640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef6ca60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0473c0 tx=0x7f2b6c016d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2a64ff9640 1 -- 172.21.15.169:0/1068357826 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c074070 con 0x55a57ef65950 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a57ef6cfa0 con 0x55a57ef65950 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2a64ff9640 1 -- 172.21.15.169:0/1068357826 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c033cc0 con 0x55a57ef65950 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2a64ff9640 1 -- 172.21.15.169:0/1068357826 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b6c041fa0 con 0x55a57ef65950 2024-09-13T06:29:24.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a57ef6d410 con 0x55a57ef65950 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2a64ff9640 1 -- 172.21.15.169:0/1068357826 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2b6c077070 con 0x55a57ef65950 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2a64ff9640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a4c034650 0x7f2a4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2a64ff9640 1 -- 172.21.15.169:0/1068357826 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2b6c06c050 con 0x55a57ef65950 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a4c034650 0x7f2a4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef77be0 0x55a57ef7a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7a7f0 con 0x55a57ef77be0 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b83596640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef77be0 0x55a57ef7a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a4c034650 0x7f2a4c036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ab510 tx=0x7f2b740b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.533+0000 7f2b83596640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef77be0 0x55a57ef7a0a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 realm 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef77010 con 0x55a57ef77be0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7b280 con 0x55a57ef77be0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef7c060 0x55a57ef7e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7eae0 con 0x55a57ef7c060 2024-09-13T06:29:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b82d95640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef7c060 0x55a57ef7e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b82d95640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef7c060 0x55a57ef7e450 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 20 searching for the correct realm 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef810a0 0x55a57ef83490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef83b10 con 0x55a57ef810a0 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef810a0 0x55a57ef83490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b7bfff640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef810a0 0x55a57ef83490 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.537+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef83b10 con 0x55a57ef7c060 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2b6c079060 0x7f2b6c03e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x7f2b6c079060 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2b6c079060 0x7f2b6c03e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2b6c079060 0x7f2b6c03e440 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef810a0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x7f2b6c079060 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.541+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x7f2b6c079060 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef810a0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef810a0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef810a0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x7f2b6c079060 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef77be0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.545+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x7f2b6c079060 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef810a0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x7f2b6c079060 2024-09-13T06:29:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef810a0 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7f330 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:24.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7fb80 con 0x55a57ef77be0 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.549+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7ff70 con 0x55a57ef7c060 2024-09-13T06:29:24.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef7ff70 con 0x55a57ef810a0 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 zone default found 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 4 Realm: () 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 zonegroup default 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef83f90 con 0x7f2b6c079060 2024-09-13T06:29:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef861c0 con 0x55a57ef810a0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef86560 con 0x55a57ef810a0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 started sync module instance, tier type = 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.553+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef85600 con 0x55a57ef7c060 2024-09-13T06:29:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94169288170016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef85600 con 0x55a57ef7c060 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef86db0 con 0x55a57ef77be0 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94169288173824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87600 con 0x55a57ef77be0 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87fc0 con 0x55a57ef7c060 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94169288173824] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94169288170016] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94169288178448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87600 con 0x55a57ef7c060 2024-09-13T06:29:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.557+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87f30 con 0x7f2b6c079060 2024-09-13T06:29:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94169288180656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87f30 con 0x7f2b6c079060 2024-09-13T06:29:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef892e0 con 0x55a57ef7c060 2024-09-13T06:29:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94169288180656] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94169288178448] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94169288175952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef88df0 con 0x55a57ef7c060 2024-09-13T06:29:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.561+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef89b80 con 0x55a57ef810a0 2024-09-13T06:29:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94169288185552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef88df0 con 0x55a57ef810a0 2024-09-13T06:29:24.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef8a9f0 con 0x55a57ef810a0 2024-09-13T06:29:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94169288185552] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94169288175952] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94169288187680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef8a9f0 con 0x55a57ef810a0 2024-09-13T06:29:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef8b280 con 0x7f2b6c079060 2024-09-13T06:29:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94169288190448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef8ae50 con 0x7f2b6c079060 2024-09-13T06:29:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=0 2024-09-13T06:29:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=1 2024-09-13T06:29:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=2 2024-09-13T06:29:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=3 2024-09-13T06:29:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=4 2024-09-13T06:29:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=5 2024-09-13T06:29:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94169288187680] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.565+0000 7f2b85285980 20 add_watcher() i=6 2024-09-13T06:29:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94169288190448] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 add_watcher() i=7 2024-09-13T06:29:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef8a540 con 0x55a57ef77be0 2024-09-13T06:29:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94169288189248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef8bd00 con 0x55a57ef77be0 2024-09-13T06:29:24.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94169288189248] v31'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2a397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 5 note: GC not initialized 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f29b3fff640 20 reqs_thread_entry: start 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 Filter name: none 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f29b1ffb640 20 reqs_thread_entry: start 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57efb20c0 con 0x55a57ef810a0 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T06:29:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.569+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57efb07b0 con 0x55a57ef810a0 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:29:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efb4dc0 con 0x55a57ef810a0 2024-09-13T06:29:24.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v31'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94169288361824 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57efb5910 con 0x7f2b6c079060 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== watch-notify(notify (1) cookie 94169288180656 notify 133143986184 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f2b7c0366c0 con 0x7f2b6c079060 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94169288180656 notifier 4533 bl.length()=610 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(65 notify.3 [notify cookie 94169288361824 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a667fc640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2a48003eb0 con 0x7f2b6c079060 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== watch-notify(notify_complete (2) cookie 94169288361824 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2b7c016510 con 0x7f2b6c079060 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efb4730 con 0x55a57ef810a0 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94169288361776 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a57efb3c50 con 0x55a57ef7c060 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94169288178448 notify 133143986201 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f2b6c033040 con 0x55a57ef7c060 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 94169288178448 notifier 4533 bl.length()=192 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:29:24.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a65ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:29:24.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2a65ffb640 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f29b8003410 con 0x55a57ef7c060 2024-09-13T06:29:24.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.573+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [notify cookie 94169288361776 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.577+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.577+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94169288361776 notify 133143986201 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2b6c033420 con 0x55a57ef7c060 2024-09-13T06:29:24.581 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:29:24.576805Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:24.576790Z","tags":[],"group_ids":[]} 2024-09-13T06:29:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.577+0000 7f2a397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.577+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94169288189248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efafcc0 con 0x55a57ef77be0 2024-09-13T06:29:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.577+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94169288189248] v31'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.577+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94169288170016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efafcc0 con 0x55a57ef7c060 2024-09-13T06:29:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94169288170016] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b85285980 20 remove_watcher() i=0 2024-09-13T06:29:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b85285980 2 removed watcher, disabling cache 2024-09-13T06:29:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94169288173824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efafcc0 con 0x55a57ef77be0 2024-09-13T06:29:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94169288173824] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x55a57ef77be0 2024-09-13T06:29:24.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b85285980 20 remove_watcher() i=1 2024-09-13T06:29:24.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.581+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94169288178448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef86900 con 0x55a57ef7c060 2024-09-13T06:29:24.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94169288178448] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b85285980 20 remove_watcher() i=2 2024-09-13T06:29:24.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94169288180656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efafcc0 con 0x7f2b6c079060 2024-09-13T06:29:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94169288180656] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b85285980 20 remove_watcher() i=3 2024-09-13T06:29:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94169288175952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87b10 con 0x55a57ef7c060 2024-09-13T06:29:24.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b82d95640 1 -- 172.21.15.169:0/1068357826 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94169288175952] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b6c076030 con 0x55a57ef7c060 2024-09-13T06:29:24.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b85285980 20 remove_watcher() i=4 2024-09-13T06:29:24.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.585+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94169288185552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef86900 con 0x55a57ef810a0 2024-09-13T06:29:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94169288185552] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 20 remove_watcher() i=5 2024-09-13T06:29:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94169288187680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57efafcc0 con 0x55a57ef810a0 2024-09-13T06:29:24.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b7bfff640 1 -- 172.21.15.169:0/1068357826 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94169288187680] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b740d8070 con 0x55a57ef810a0 2024-09-13T06:29:24.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 20 remove_watcher() i=6 2024-09-13T06:29:24.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94169288190448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a57ef87150 con 0x7f2b6c079060 2024-09-13T06:29:24.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94169288190448] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c00a4d0 con 0x7f2b6c079060 2024-09-13T06:29:24.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 20 remove_watcher() i=7 2024-09-13T06:29:24.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef7c060 msgr2=0x55a57ef7e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef7c060 0x55a57ef7e450 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef77be0 msgr2=0x55a57ef7a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef77be0 0x55a57ef7a0a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2b6c079060 msgr2=0x7f2b6c03e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2b6c079060 0x7f2b6c03e440 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef810a0 msgr2=0x55a57ef83490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef810a0 0x55a57ef83490 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a4c034650 msgr2=0x7f2a4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a4c034650 0x7f2a4c036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ab510 tx=0x7f2b740b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:24.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 msgr2=0x55a57ef6ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b83596640 1 -- 172.21.15.169:0/1068357826 reap_dead start 2024-09-13T06:29:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef6ca60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0473c0 tx=0x7f2b6c016d40 comp rx=0 tx=0).stop 2024-09-13T06:29:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 shutdown_connections 2024-09-13T06:29:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/1068357826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef65950 0x55a57ef6ca60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 >> 172.21.15.169:0/1068357826 conn(0x55a57ef61c80 msgr2=0x55a57ef5fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 shutdown_connections 2024-09-13T06:29:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/1068357826 wait complete. 2024-09-13T06:29:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a5c034650 msgr2=0x7f2a5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a5c034650 0x7f2a5c036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ae040 tx=0x7f2b74005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 msgr2=0x55a57ef59740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 0x55a57ef59740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c016520 tx=0x7f2b6c00db30 comp rx=0 tx=0).stop 2024-09-13T06:29:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 shutdown_connections 2024-09-13T06:29:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a5c034650 0x7f2a5c036b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/3414470717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ef59320 0x55a57ef59740 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 >> 172.21.15.169:0/3414470717 conn(0x55a57ef4e470 msgr2=0x55a57ef50ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 shutdown_connections 2024-09-13T06:29:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/3414470717 wait complete. 2024-09-13T06:29:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef437b0 msgr2=0x55a57ef45c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a57ef437b0 0x55a57ef45c40 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef40410 msgr2=0x55a57ef42800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a57ef40410 0x55a57ef42800 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef49010 msgr2=0x55a57ef4b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.589+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a57ef49010 0x55a57ef4b400 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a68034650 msgr2=0x7f2a68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2a68034650 0x7f2a68036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ad000 tx=0x7f2b740a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 msgr2=0x55a57ee4eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 --2- 172.21.15.169:0/952489370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a57ee454e0 0x55a57ee4eee0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c001e20 tx=0x7f2b6c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b83596640 1 -- 172.21.15.169:0/952489370 reap_dead start 2024-09-13T06:29:24.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 shutdown_connections 2024-09-13T06:29:24.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 >> 172.21.15.169:0/952489370 conn(0x55a57ee41000 msgr2=0x55a57ef2c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 shutdown_connections 2024-09-13T06:29:24.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.593+0000 7f2b85285980 1 -- 172.21.15.169:0/952489370 wait complete. 2024-09-13T06:29:24.609 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:29:24.576805Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:24.576790Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:24.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:29:24.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:29:24.610 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T06:29:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7dbec980 1 Processor -- start 2024-09-13T06:29:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7dbec980 1 -- start start 2024-09-13T06:29:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7dbec980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564064054c00 0x564064056ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7dbec980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564063ed6ae0 con 0x564064050880 2024-09-13T06:29:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7dbec980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x564063efae30 con 0x564064054c00 2024-09-13T06:29:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7aefb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564064054c00 0x564064056ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7b6fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x564064050880 0x564064050c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45338/0 (socket says 172.21.15.169:45338) 2024-09-13T06:29:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7aefb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564064054c00 0x564064056ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37226/0 (socket says 172.21.15.169:37226) 2024-09-13T06:29:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/2639350249 learned_addr learned my addr 172.21.15.169:0/2639350249 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7aefb640 1 -- 172.21.15.169:0/2639350249 >> v1:172.21.15.112:6789/0 conn(0x564064050880 legacy=0x564064050c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7aefb640 1 -- 172.21.15.169:0/2639350249 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564064058540 con 0x564064054c00 2024-09-13T06:29:24.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.685+0000 7fcd7a6fa640 1 -- 172.21.15.169:0/2639350249 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956485601 0 0) 0x564063ed6ae0 con 0x564064050880 2024-09-13T06:29:24.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/2639350249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064054c00 0x564064056ff0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000a420 tx=0x7fcd7001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e5acb079c5075e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7a6fa640 1 -- 172.21.15.169:0/2639350249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd700af070 con 0x564064054c00 2024-09-13T06:29:24.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7a6fa640 1 -- 172.21.15.169:0/2639350249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd700aa530 con 0x564064054c00 2024-09-13T06:29:24.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7a6fa640 1 -- 172.21.15.169:0/2639350249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd700aa810 con 0x564064054c00 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 -- 172.21.15.169:0/2639350249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064054c00 msgr2=0x564064056ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/2639350249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064054c00 0x564064056ff0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000a420 tx=0x7fcd7001afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 -- 172.21.15.169:0/2639350249 shutdown_connections 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/2639350249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064054c00 0x564064056ff0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 -- 172.21.15.169:0/2639350249 >> 172.21.15.169:0/2639350249 conn(0x564063fc41d0 msgr2=0x564063fc45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 -- 172.21.15.169:0/2639350249 shutdown_connections 2024-09-13T06:29:24.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.689+0000 7fcd7dbec980 1 -- 172.21.15.169:0/2639350249 wait complete. 2024-09-13T06:29:24.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 Processor -- start 2024-09-13T06:29:24.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- start start 2024-09-13T06:29:24.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x56406413b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564063efc200 con 0x564064050880 2024-09-13T06:29:24.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x56406413b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x56406413b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37242/0 (socket says 172.21.15.169:37242) 2024-09-13T06:29:24.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/426436888 learned_addr learned my addr 172.21.15.169:0/426436888 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/426436888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406413bfb0 con 0x564064050880 2024-09-13T06:29:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/426436888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x56406413b9e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00b250 tx=0x7fcd6c00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd60904b27d9fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcc6960a640 1 -- 172.21.15.169:0/426436888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c00d640 con 0x564064050880 2024-09-13T06:29:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcc6960a640 1 -- 172.21.15.169:0/426436888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c008070 con 0x564064050880 2024-09-13T06:29:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcc6960a640 1 -- 172.21.15.169:0/426436888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c00d990 con 0x564064050880 2024-09-13T06:29:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- 172.21.15.169:0/426436888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 msgr2=0x56406413b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/426436888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x56406413b9e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00b250 tx=0x7fcd6c00b710 comp rx=0 tx=0).stop 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- 172.21.15.169:0/426436888 shutdown_connections 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/426436888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x56406413b9e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- 172.21.15.169:0/426436888 >> 172.21.15.169:0/426436888 conn(0x564063fc41d0 msgr2=0x564064137610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- 172.21.15.169:0/426436888 shutdown_connections 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- 172.21.15.169:0/426436888 wait complete. 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 Processor -- start 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.705+0000 7fcd7dbec980 1 -- start start 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x564064142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564064058040 con 0x564064050880 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x564064142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x564064142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37248/0 (socket says 172.21.15.169:37248) 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/3525903269 learned_addr learned my addr 172.21.15.169:0/3525903269 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564064143390 con 0x564064050880 2024-09-13T06:29:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x564064142e50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c000c10 tx=0x7fcd6c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcc67e07640 1 -- 172.21.15.169:0/3525903269 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c01a7c0 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564064143620 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564064146300 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcc67e07640 1 -- 172.21.15.169:0/3525903269 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c01a960 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcc67e07640 1 -- 172.21.15.169:0/3525903269 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c01ac60 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcc67e07640 1 -- 172.21.15.169:0/3525903269 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcd6c017070 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcc67e07640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc60034630 0x7fcc60036af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcc67e07640 1 -- 172.21.15.169:0/3525903269 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fcd6c015020 con 0x564064050880 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc60034630 0x7fcc60036af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564064054c00 0x564064149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406414a4d0 con 0x564064054c00 2024-09-13T06:29:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7befd640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564064054c00 0x564064149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc60034630 0x7fcc60036af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ac000 tx=0x7fcd700a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7befd640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564064054c00 0x564064149f50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7befd640 1 -- 172.21.15.169:0/3525903269 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x564064054c00 2024-09-13T06:29:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56406414b2a0 0x56406414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.709+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406414dcd0 con 0x56406414b2a0 2024-09-13T06:29:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56406414b2a0 0x56406414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56406414b2a0 0x56406414d690 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/3525903269 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd6c02e070 con 0x56406414b2a0 2024-09-13T06:29:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406414f580 con 0x56406414b2a0 2024-09-13T06:29:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/3525903269 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd6c02e070 con 0x56406414b2a0 2024-09-13T06:29:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406414e7b0 con 0x56406414b2a0 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/3525903269 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd6c02e070 con 0x56406414b2a0 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064150930 0x564064152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064153260 con 0x564064150930 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064150930 0x564064152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.713+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064150930 0x564064152d20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7aefb640 1 -- 172.21.15.169:0/3525903269 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcd700b2070 con 0x564064150930 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7dbec980 1 Processor -- start 2024-09-13T06:29:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7dbec980 1 -- start start 2024-09-13T06:29:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7dbec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 0x564064161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7dbec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564063f55800 con 0x564064160c40 2024-09-13T06:29:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 0x564064161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 0x564064161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37262/0 (socket says 172.21.15.169:37262) 2024-09-13T06:29:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/1243059364 learned_addr learned my addr 172.21.15.169:0/1243059364 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/1243059364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640641615a0 con 0x564064160c40 2024-09-13T06:29:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 0x564064161060 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c001500 tx=0x7fcd6c04a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcc65602640 1 -- 172.21.15.169:0/1243059364 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c042070 con 0x564064160c40 2024-09-13T06:29:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcc65602640 1 -- 172.21.15.169:0/1243059364 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c042590 con 0x564064160c40 2024-09-13T06:29:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564064161830 con 0x564064160c40 2024-09-13T06:29:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcc65602640 1 -- 172.21.15.169:0/1243059364 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c042870 con 0x564064160c40 2024-09-13T06:29:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.717+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564064161830 con 0x564064160c40 2024-09-13T06:29:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcc65602640 1 -- 172.21.15.169:0/1243059364 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcd6c0470d0 con 0x564064160c40 2024-09-13T06:29:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcc65602640 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc54034650 0x7fcc54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcc65602640 1 -- 172.21.15.169:0/1243059364 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fcd6c032050 con 0x564064160c40 2024-09-13T06:29:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc54034650 0x7fcc54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 Processor -- start 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- start start 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc54034650 0x7fcc54036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd70017be0 tx=0x7fcd70005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x56406416d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56406413c330 con 0x56406416d450 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x56406416d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x56406416d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37278/0 (socket says 172.21.15.169:37278) 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/4243335616 learned_addr learned my addr 172.21.15.169:0/4243335616 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/4243335616 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406416de20 con 0x56406416d450 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/4243335616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x56406416d850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e540 tx=0x7fcd6c012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed06ee000fce9144 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcc5effd640 1 -- 172.21.15.169:0/4243335616 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c010dc0 con 0x56406416d450 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcc5effd640 1 -- 172.21.15.169:0/4243335616 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c03dd90 con 0x56406416d450 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcc5effd640 1 -- 172.21.15.169:0/4243335616 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c0473c0 con 0x56406416d450 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- 172.21.15.169:0/4243335616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 msgr2=0x56406416d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/4243335616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x56406416d850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e540 tx=0x7fcd6c012f90 comp rx=0 tx=0).stop 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- 172.21.15.169:0/4243335616 shutdown_connections 2024-09-13T06:29:24.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/4243335616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x56406416d850 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- 172.21.15.169:0/4243335616 >> 172.21.15.169:0/4243335616 conn(0x5640641697e0 msgr2=0x5640641678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- 172.21.15.169:0/4243335616 shutdown_connections 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 -- 172.21.15.169:0/4243335616 wait complete. 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.721+0000 7fcd7dbec980 1 Processor -- start 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 -- start start 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x5640641745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56406416e370 con 0x56406416d450 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x5640641745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x5640641745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37288/0 (socket says 172.21.15.169:37288) 2024-09-13T06:29:24.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 learned_addr learned my addr 172.21.15.169:0/519854103 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564064174b00 con 0x56406416d450 2024-09-13T06:29:24.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x5640641745c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e540 tx=0x7fcd6c03af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcc5d7fa640 1 -- 172.21.15.169:0/519854103 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c06d070 con 0x56406416d450 2024-09-13T06:29:24.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcc5d7fa640 1 -- 172.21.15.169:0/519854103 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0476a0 con 0x56406416d450 2024-09-13T06:29:24.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcc5d7fa640 1 -- 172.21.15.169:0/519854103 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd6c013130 con 0x56406416d450 2024-09-13T06:29:24.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564064174b00 con 0x56406416d450 2024-09-13T06:29:24.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564064174b00 con 0x56406416d450 2024-09-13T06:29:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcc5d7fa640 1 -- 172.21.15.169:0/519854103 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcd6c070070 con 0x56406416d450 2024-09-13T06:29:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcc5d7fa640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc440346a0 0x7fcc44036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcc5d7fa640 1 -- 172.21.15.169:0/519854103 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fcd6c065070 con 0x56406416d450 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc440346a0 0x7fcc44036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56406417f6c0 0x564064181b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641822d0 con 0x56406417f6c0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.725+0000 7fcd7befd640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56406417f6c0 0x564064181b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc440346a0 0x7fcc44036b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56406414f510 tx=0x7fcd700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7befd640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56406417f6c0 0x564064181b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 realm 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406417eaf0 con 0x56406417f6c0 2024-09-13T06:29:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064182d90 con 0x56406417f6c0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564064183b70 0x564064185f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641865f0 con 0x564064183b70 2024-09-13T06:29:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564064183b70 0x564064185f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564064183b70 0x564064185f60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 20 searching for the correct realm 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064188bb0 0x56406418afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56406418b620 con 0x564064188bb0 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064188bb0 0x56406418afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.729+0000 7fcd7aefb640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064188bb0 0x56406418afa0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56406418b620 con 0x564064183b70 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fcd6c072060 0x7fcd6c0197b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x7fcd6c072060 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fcd6c072060 0x7fcd6c0197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fcd6c072060 0x7fcd6c0197b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064188bb0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x7fcd6c072060 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.733+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x7fcd6c072060 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064188bb0 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064188bb0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064188bb0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x7fcd6c072060 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x56406417f6c0 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x7fcd6c072060 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.737+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064188bb0 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x7fcd6c072060 2024-09-13T06:29:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064188bb0 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564064186e40 con 0x564064183b70 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:24.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064187690 con 0x56406417f6c0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.741+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064187a80 con 0x564064183b70 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064187a80 con 0x564064188bb0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:24.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 zone default found 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 4 Realm: () 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 zonegroup default 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406418ba80 con 0x7fcd6c072060 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406418dcb0 con 0x564064188bb0 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56406418e050 con 0x564064188bb0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 started sync module instance, tier type = 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418d0f0 con 0x564064183b70 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94834557244640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418d900 con 0x564064183b70 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.745+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418e8a0 con 0x56406417f6c0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94834557250624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418f510 con 0x56406417f6c0 2024-09-13T06:29:24.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418fed0 con 0x564064183b70 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94834557244640] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94834557250624] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94834557251680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418f480 con 0x564064183b70 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064190380 con 0x7fcd6c072060 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94834557255376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641907a0 con 0x7fcd6c072060 2024-09-13T06:29:24.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.749+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641911e0 con 0x564064183b70 2024-09-13T06:29:24.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94834557251680] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94834557255376] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94834557258928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641902f0 con 0x564064183b70 2024-09-13T06:29:24.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064191ab0 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94834557261312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641902f0 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064192830 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94834557258928] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94834557261312] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.753+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94834557263440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064192c20 con 0x564064188bb0 2024-09-13T06:29:24.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064193470 con 0x7fcd6c072060 2024-09-13T06:29:24.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94834557263440] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94834557266976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064193860 con 0x7fcd6c072060 2024-09-13T06:29:24.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=0 2024-09-13T06:29:24.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=1 2024-09-13T06:29:24.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=2 2024-09-13T06:29:24.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=3 2024-09-13T06:29:24.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=4 2024-09-13T06:29:24.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=5 2024-09-13T06:29:24.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=6 2024-09-13T06:29:24.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94834557266976] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 20 add_watcher() i=7 2024-09-13T06:29:24.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:24.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564064196900 con 0x56406417f6c0 2024-09-13T06:29:24.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.757+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94834557268576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064193cc0 con 0x56406417f6c0 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94834557268576] v31'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcc31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 5 note: GC not initialized 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcc30fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 Filter name: none 2024-09-13T06:29:24.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T06:29:24.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcbaa7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:24.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641ba1b0 con 0x564064188bb0 2024-09-13T06:29:24.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T06:29:24.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641b9c00 con 0x7fcd6c072060 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641bd950 con 0x564064188bb0 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(64 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641c1ec0 con 0x7fcd6c072060 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(65 foo.buckets [call] v31'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.761+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 8.1d 8:ba86f921:root::.bucket.meta.testx%3amyfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641c57d0 con 0x56406417f6c0 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [create,call,writefull 0~412,setxattr (203)] v31'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x7 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94834557466112 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641c5260 con 0x564064183b70 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94834557258928 notify 133143986202 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5640641615a0 con 0x564064183b70 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcc5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 94834557258928 notifier 4540 bl.length()=847 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcc5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x7 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcc5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcc5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T06:29:24.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.4 [notify cookie 94834557466112 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcc5effd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcc40003eb0 con 0x564064183b70 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify_complete (2) cookie 94834557466112 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcd6c048e30 con 0x564064183b70 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 20 handle_bi_update(): bucket=testx:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_sources= new_sources= 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 20 handle_bi_update(): bucket=testx:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential sources added=[] removed=[] 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 20 handle_bi_update(): bucket=testx:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_dests= new_dests= 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 20 handle_bi_update(): bucket=testx:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential dests added=[] removed=[] 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641c53a0 con 0x56406417f6c0 2024-09-13T06:29:24.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.765+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641c53a0 con 0x56406417f6c0 2024-09-13T06:29:24.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7dbec980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T06:29:24.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7dbec980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T06:29:24.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7dbec980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T06:29:24.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94834557472496 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641c5310 con 0x564064183b70 2024-09-13T06:29:24.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 94834557258928 notify 133143986203 ret 0) ==== 390+0+0 (crc 0 0 0) 0x7fcd6c048e30 con 0x564064183b70 2024-09-13T06:29:24.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcc5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 94834557258928 notifier 4540 bl.length()=348 2024-09-13T06:29:24.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcc5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T06:29:24.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(71 notify.4 [notify cookie 94834557472496 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcc5effd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T06:29:24.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.769+0000 7fcc5effd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcc40003eb0 con 0x564064183b70 2024-09-13T06:29:24.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== watch-notify(notify_complete (2) cookie 94834557472496 notify 133143986203 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564064146300 con 0x564064183b70 2024-09-13T06:29:24.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641c53a0 con 0x7fcd6c072060 2024-09-13T06:29:24.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(73 myfoo [call,delete] v31'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7dbec980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T06:29:24.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7dbec980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:24.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94834557472496 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641c5310 con 0x564064188bb0 2024-09-13T06:29:24.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== watch-notify(notify (1) cookie 94834557263440 notify 133143986187 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5640641bdd40 con 0x564064188bb0 2024-09-13T06:29:24.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcc5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94834557263440 notifier 4540 bl.length()=149 2024-09-13T06:29:24.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcc5effd640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcc40003eb0 con 0x564064188bb0 2024-09-13T06:29:24.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(74 notify.6 [notify cookie 94834557472496 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== watch-notify(notify_complete (2) cookie 94834557472496 notify 133143986187 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640641bcf50 con 0x564064188bb0 2024-09-13T06:29:24.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.773+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641c53a0 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(76 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call,delete] v31'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7dbec980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 from cache 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7dbec980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94834557440544 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5640641c53a0 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== watch-notify(notify (1) cookie 94834557261312 notify 133143986188 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5640641bcf50 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcc5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94834557261312 notifier 4540 bl.length()=206 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(77 notify.5 [notify cookie 94834557440544 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcc5e7fc640 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcbb00032d0 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== watch-notify(notify_complete (2) cookie 94834557440544 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcd700bd1f0 con 0x564064188bb0 2024-09-13T06:29:24.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcc31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.777+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94834557268576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641b7e40 con 0x56406417f6c0 2024-09-13T06:29:24.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94834557268576] v31'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94834557244640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641b7e40 con 0x564064183b70 2024-09-13T06:29:24.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94834557244640] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7dbec980 20 remove_watcher() i=0 2024-09-13T06:29:24.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7dbec980 2 removed watcher, disabling cache 2024-09-13T06:29:24.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94834557250624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641b7e40 con 0x56406417f6c0 2024-09-13T06:29:24.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94834557250624] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x56406417f6c0 2024-09-13T06:29:24.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7dbec980 20 remove_watcher() i=1 2024-09-13T06:29:24.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.781+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94834557251680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418ec40 con 0x564064183b70 2024-09-13T06:29:24.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.785+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94834557251680] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.785+0000 7fcd7dbec980 20 remove_watcher() i=2 2024-09-13T06:29:24.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.785+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94834557255376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641b7e40 con 0x7fcd6c072060 2024-09-13T06:29:24.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.785+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94834557255376] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.785+0000 7fcd7dbec980 20 remove_watcher() i=3 2024-09-13T06:29:24.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.785+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94834557258928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418fed0 con 0x564064183b70 2024-09-13T06:29:24.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7b6fc640 1 -- 172.21.15.169:0/519854103 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94834557258928] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd6c06f030 con 0x564064183b70 2024-09-13T06:29:24.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 20 remove_watcher() i=4 2024-09-13T06:29:24.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94834557261312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5640641b7e40 con 0x564064188bb0 2024-09-13T06:29:24.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94834557261312] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 20 remove_watcher() i=5 2024-09-13T06:29:24.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94834557263440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564064190cb0 con 0x564064188bb0 2024-09-13T06:29:24.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7aefb640 1 -- 172.21.15.169:0/519854103 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94834557263440] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd700c9070 con 0x564064188bb0 2024-09-13T06:29:24.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 20 remove_watcher() i=6 2024-09-13T06:29:24.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94834557266976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56406418fed0 con 0x7fcd6c072060 2024-09-13T06:29:24.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94834557266976] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd740083f0 con 0x7fcd6c072060 2024-09-13T06:29:24.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.789+0000 7fcd7dbec980 20 remove_watcher() i=7 2024-09-13T06:29:24.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564064183b70 msgr2=0x564064185f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564064183b70 0x564064185f60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56406417f6c0 msgr2=0x564064181b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56406417f6c0 0x564064181b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fcd6c072060 msgr2=0x7fcd6c0197b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fcd6c072060 0x7fcd6c0197b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064188bb0 msgr2=0x56406418afa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064188bb0 0x56406418afa0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc440346a0 msgr2=0x7fcc44036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc440346a0 0x7fcc44036b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56406414f510 tx=0x7fcd700a7000 comp rx=0 tx=0).stop 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 msgr2=0x5640641745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7befd640 1 -- 172.21.15.169:0/519854103 reap_dead start 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x5640641745c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e540 tx=0x7fcd6c03af70 comp rx=0 tx=0).stop 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 shutdown_connections 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/519854103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56406416d450 0x5640641745c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 >> 172.21.15.169:0/519854103 conn(0x5640641697e0 msgr2=0x5640641678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 shutdown_connections 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/519854103 wait complete. 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc54034650 msgr2=0x7fcc54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc54034650 0x7fcc54036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd70017be0 tx=0x7fcd70005d90 comp rx=0 tx=0).stop 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 msgr2=0x564064161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 0x564064161060 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c001500 tx=0x7fcd6c04a170 comp rx=0 tx=0).stop 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 shutdown_connections 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc54034650 0x7fcc54036b10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/1243059364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064160c40 0x564064161060 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 >> 172.21.15.169:0/1243059364 conn(0x564064155d90 msgr2=0x564064158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 shutdown_connections 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/1243059364 wait complete. 2024-09-13T06:29:24.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56406414b2a0 msgr2=0x56406414d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56406414b2a0 0x56406414d690 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564064054c00 msgr2=0x564064149f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564064054c00 0x564064149f50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064150930 msgr2=0x564064152d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564064150930 0x564064152d20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc60034630 msgr2=0x7fcc60036af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcc60034630 0x7fcc60036af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ac000 tx=0x7fcd700a5000 comp rx=0 tx=0).stop 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 msgr2=0x564064142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 --2- 172.21.15.169:0/3525903269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564064050880 0x564064142e50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c000c10 tx=0x7fcd6c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7befd640 1 -- 172.21.15.169:0/3525903269 reap_dead start 2024-09-13T06:29:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 shutdown_connections 2024-09-13T06:29:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 >> 172.21.15.169:0/3525903269 conn(0x564063fc41d0 msgr2=0x564064136190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 shutdown_connections 2024-09-13T06:29:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.793+0000 7fcd7dbec980 1 -- 172.21.15.169:0/3525903269 wait complete. 2024-09-13T06:29:24.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T06:29:24.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T06:29:24.805 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T06:29:24.873 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:24.873 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:24.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.869+0000 7f6530b20980 1 Processor -- start 2024-09-13T06:29:24.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.869+0000 7f6530b20980 1 -- start start 2024-09-13T06:29:24.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f6530b20980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a4e69fa8f0 0x55a4e69fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f6530b20980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4e687fae0 con 0x55a4e69f6570 2024-09-13T06:29:24.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f6530b20980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55a4e68a3e30 con 0x55a4e69fa8f0 2024-09-13T06:29:24.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652de2f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a4e69fa8f0 0x55a4e69fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652e630640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55a4e69f6570 0x55a4e69f6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45352/0 (socket says 172.21.15.169:45352) 2024-09-13T06:29:24.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652e630640 1 -- 172.21.15.169:0/4204562836 learned_addr learned my addr 172.21.15.169:0/4204562836 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:24.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652de2f640 1 -- 172.21.15.169:0/4204562836 >> v1:172.21.15.112:6789/0 conn(0x55a4e69f6570 legacy=0x55a4e69f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652de2f640 1 -- 172.21.15.169:0/4204562836 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e69fe230 con 0x55a4e69fa8f0 2024-09-13T06:29:24.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652de2f640 1 --2- 172.21.15.169:0/4204562836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69fa8f0 0x55a4e69fcce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f651800a480 tx=0x7f651801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edab8dcc7d2a688a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652d62e640 1 -- 172.21.15.169:0/4204562836 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180b0070 con 0x55a4e69fa8f0 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652d62e640 1 -- 172.21.15.169:0/4204562836 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65180ab540 con 0x55a4e69fa8f0 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.873+0000 7f652d62e640 1 -- 172.21.15.169:0/4204562836 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180ab840 con 0x55a4e69fa8f0 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 -- 172.21.15.169:0/4204562836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69fa8f0 msgr2=0x55a4e69fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 --2- 172.21.15.169:0/4204562836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69fa8f0 0x55a4e69fcce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f651800a480 tx=0x7f651801b280 comp rx=0 tx=0).stop 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 -- 172.21.15.169:0/4204562836 shutdown_connections 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 --2- 172.21.15.169:0/4204562836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69fa8f0 0x55a4e69fcce0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 -- 172.21.15.169:0/4204562836 >> 172.21.15.169:0/4204562836 conn(0x55a4e69f2090 msgr2=0x55a4e69f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 -- 172.21.15.169:0/4204562836 shutdown_connections 2024-09-13T06:29:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.877+0000 7f6530b20980 1 -- 172.21.15.169:0/4204562836 wait complete. 2024-09-13T06:29:24.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 Processor -- start 2024-09-13T06:29:24.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- start start 2024-09-13T06:29:24.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e696bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a4e68a5200 con 0x55a4e69f6570 2024-09-13T06:29:24.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e696bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e696bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37304/0 (socket says 172.21.15.169:37304) 2024-09-13T06:29:24.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f652e630640 1 -- 172.21.15.169:0/2781759045 learned_addr learned my addr 172.21.15.169:0/2781759045 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f652e630640 1 -- 172.21.15.169:0/2781759045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e696c1d0 con 0x55a4e69f6570 2024-09-13T06:29:24.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f652e630640 1 --2- 172.21.15.169:0/2781759045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e696bc00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6520001d90 tx=0x7f6520001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e4631d26bdcdb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f641c608640 1 -- 172.21.15.169:0/2781759045 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6520013030 con 0x55a4e69f6570 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f641c608640 1 -- 172.21.15.169:0/2781759045 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652000e690 con 0x55a4e69f6570 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f641c608640 1 -- 172.21.15.169:0/2781759045 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f652000ea10 con 0x55a4e69f6570 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- 172.21.15.169:0/2781759045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 msgr2=0x55a4e696bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 --2- 172.21.15.169:0/2781759045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e696bc00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6520001d90 tx=0x7f6520001e80 comp rx=0 tx=0).stop 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- 172.21.15.169:0/2781759045 shutdown_connections 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 --2- 172.21.15.169:0/2781759045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e696bc00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- 172.21.15.169:0/2781759045 >> 172.21.15.169:0/2781759045 conn(0x55a4e69f2090 msgr2=0x55a4e6add5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- 172.21.15.169:0/2781759045 shutdown_connections 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- 172.21.15.169:0/2781759045 wait complete. 2024-09-13T06:29:24.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 Processor -- start 2024-09-13T06:29:24.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.889+0000 7f6530b20980 1 -- start start 2024-09-13T06:29:24.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e6ae3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a4e69fdd30 con 0x55a4e69f6570 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e6ae3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e6ae3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37316/0 (socket says 172.21.15.169:37316) 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652e630640 1 -- 172.21.15.169:0/4150100211 learned_addr learned my addr 172.21.15.169:0/4150100211 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652e630640 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e6ae3670 con 0x55a4e69f6570 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652e630640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e6ae3130 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55a4e6ae3c70 tx=0x7f6520000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f641ae05640 1 -- 172.21.15.169:0/4150100211 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6520027070 con 0x55a4e69f6570 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4e6ae1850 con 0x55a4e69f6570 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f641ae05640 1 -- 172.21.15.169:0/4150100211 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6520019900 con 0x55a4e69f6570 2024-09-13T06:29:24.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e6ae1d40 con 0x55a4e69f6570 2024-09-13T06:29:24.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f641ae05640 1 -- 172.21.15.169:0/4150100211 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6520019be0 con 0x55a4e69f6570 2024-09-13T06:29:24.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f641ae05640 1 -- 172.21.15.169:0/4150100211 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f652002a070 con 0x55a4e69f6570 2024-09-13T06:29:24.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f641ae05640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6414034650 0x7f6414036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f641ae05640 1 -- 172.21.15.169:0/4150100211 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f652001f070 con 0x55a4e69f6570 2024-09-13T06:29:24.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652de2f640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6414034650 0x7f6414036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e69fa8f0 0x55a4e6af3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6af3760 con 0x55a4e69fa8f0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652ee31640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e69fa8f0 0x55a4e6af3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652de2f640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6414034650 0x7f6414036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65180ad000 tx=0x7f65180a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652ee31640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e69fa8f0 0x55a4e6af3220 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f652ee31640 1 -- 172.21.15.169:0/4150100211 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e69fa8f0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6af4210 0x55a4e6af66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.893+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6af6e40 con 0x55a4e6af4210 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652e630640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6af4210 0x55a4e6af66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652e630640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6af4210 0x55a4e6af66d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652e630640 1 -- 172.21.15.169:0/4150100211 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6520029030 con 0x55a4e6af4210 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6af86f0 con 0x55a4e6af4210 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652e630640 1 -- 172.21.15.169:0/4150100211 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6520029030 con 0x55a4e6af4210 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6af7920 con 0x55a4e6af4210 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652e630640 1 -- 172.21.15.169:0/4150100211 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6520029030 con 0x55a4e6af4210 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6af9aa0 0x55a4e6afbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6afc3d0 con 0x55a4e6af9aa0 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652de2f640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6af9aa0 0x55a4e6afbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652de2f640 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6af9aa0 0x55a4e6afbe90 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f652de2f640 1 -- 172.21.15.169:0/4150100211 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65180b3040 con 0x55a4e6af9aa0 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 Processor -- start 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 -- start start 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.897+0000 7f6530b20980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 0x55a4e6b0a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a4e68fe800 con 0x55a4e6b09d90 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 0x55a4e6b0a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 0x55a4e6b0a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37322/0 (socket says 172.21.15.169:37322) 2024-09-13T06:29:24.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 -- 172.21.15.169:0/1589675958 learned_addr learned my addr 172.21.15.169:0/1589675958 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 -- 172.21.15.169:0/1589675958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e6b0a6f0 con 0x55a4e6b09d90 2024-09-13T06:29:24.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 0x55a4e6b0a1b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6520048440 tx=0x7f6520041e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6413fff640 1 -- 172.21.15.169:0/1589675958 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6520017900 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4e6b0a980 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6413fff640 1 -- 172.21.15.169:0/1589675958 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652002a360 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e6b0d600 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6413fff640 1 -- 172.21.15.169:0/1589675958 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6520022410 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6413fff640 1 -- 172.21.15.169:0/1589675958 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6520016070 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6413fff640 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64080346a0 0x7f6408036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6413fff640 1 -- 172.21.15.169:0/1589675958 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f6520014070 con 0x55a4e6b09d90 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652de2f640 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64080346a0 0x7f6408036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 Processor -- start 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 -- start start 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652de2f640 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64080346a0 0x7f6408036b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55a4e6ae2840 tx=0x7f6518005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b16aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f6530b20980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a4e696c550 con 0x55a4e6b166c0 2024-09-13T06:29:24.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b16aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b16aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37338/0 (socket says 172.21.15.169:37338) 2024-09-13T06:29:24.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.901+0000 7f652e630640 1 -- 172.21.15.169:0/206605700 learned_addr learned my addr 172.21.15.169:0/206605700 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 -- 172.21.15.169:0/206605700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e6b17070 con 0x55a4e6b166c0 2024-09-13T06:29:24.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 --2- 172.21.15.169:0/206605700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b16aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f652002b4a0 tx=0x7f6520004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6bb785b60eb8ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6411ffb640 1 -- 172.21.15.169:0/206605700 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65200225b0 con 0x55a4e6b166c0 2024-09-13T06:29:24.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6411ffb640 1 -- 172.21.15.169:0/206605700 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652002bc90 con 0x55a4e6b166c0 2024-09-13T06:29:24.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6411ffb640 1 -- 172.21.15.169:0/206605700 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6520016b30 con 0x55a4e6b166c0 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/206605700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 msgr2=0x55a4e6b16aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 --2- 172.21.15.169:0/206605700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b16aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f652002b4a0 tx=0x7f6520004f90 comp rx=0 tx=0).stop 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/206605700 shutdown_connections 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 --2- 172.21.15.169:0/206605700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b16aa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/206605700 >> 172.21.15.169:0/206605700 conn(0x55a4e6b12aa0 msgr2=0x55a4e6b10ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/206605700 shutdown_connections 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/206605700 wait complete. 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 Processor -- start 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- start start 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b1d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a4e6b17510 con 0x55a4e6b166c0 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b1d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b1d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37348/0 (socket says 172.21.15.169:37348) 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 learned_addr learned my addr 172.21.15.169:0/9920804 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e6b1dde0 con 0x55a4e6b166c0 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f652e630640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b1d8a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6520043ff0 tx=0x7f652003af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f63fffff640 1 -- 172.21.15.169:0/9920804 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f652002c440 con 0x55a4e6b166c0 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4e6b1dde0 con 0x55a4e6b166c0 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e6b1dde0 con 0x55a4e6b166c0 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f63fffff640 1 -- 172.21.15.169:0/9920804 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6520034a70 con 0x55a4e6b166c0 2024-09-13T06:29:24.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.905+0000 7f63fffff640 1 -- 172.21.15.169:0/9920804 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f652002c5e0 con 0x55a4e6b166c0 2024-09-13T06:29:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f63fffff640 1 -- 172.21.15.169:0/9920804 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6520063040 con 0x55a4e6b166c0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f63fffff640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63f8034650 0x7f63f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f63fffff640 1 -- 172.21.15.169:0/9920804 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f6520061020 con 0x55a4e6b166c0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652de2f640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63f8034650 0x7f63f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e6b28a10 0x55a4e6b2aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2b600 con 0x55a4e6b28a10 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652ee31640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e6b28a10 0x55a4e6b2aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652de2f640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63f8034650 0x7f63f8036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6518018eb0 tx=0x7f65180b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652ee31640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e6b28a10 0x55a4e6b2aeb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 realm 2024-09-13T06:29:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b27f00 con 0x55a4e6b28a10 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2c0c0 con 0x55a4e6b28a10 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6b2cea0 0x55a4e6b2f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652e630640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6b2cea0 0x55a4e6b2f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652e630640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6b2cea0 0x55a4e6b2f290 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b30190 con 0x55a4e6b2cea0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.909+0000 7f6530b20980 20 searching for the correct realm 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6b319c0 0x55a4e6b33e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b34550 con 0x55a4e6b319c0 2024-09-13T06:29:24.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652de2f640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6b319c0 0x55a4e6b33e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652de2f640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6b319c0 0x55a4e6b33e80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b34550 con 0x55a4e6b2cea0 2024-09-13T06:29:24.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652e630640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6520066050 0x7f652004da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x7f6520066050 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6520066050 0x7f652004da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6520066050 0x7f652004da40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b319c0 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.913+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x7f6520066050 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x7f6520066050 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b319c0 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b319c0 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.917+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b319c0 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x7f6520066050 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x7f6520066050 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b319c0 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x7f6520066050 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b319c0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.921+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b2f8f0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b302c0 con 0x55a4e6b28a10 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b306b0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b306b0 con 0x55a4e6b319c0 2024-09-13T06:29:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 zone default found 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 4 Realm: () 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 zonegroup default 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b349d0 con 0x7f6520066050 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b36750 con 0x55a4e6b319c0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b36af0 con 0x55a4e6b319c0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 started sync module instance, tier type = 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.925+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b35bf0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94166733512912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b35bf0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b374f0 con 0x55a4e6b28a10 2024-09-13T06:29:24.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94166733516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b37d90 con 0x55a4e6b28a10 2024-09-13T06:29:24.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b387b0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94166733512912] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94166733516800] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94166733521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b378e0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.929+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b39050 con 0x7f6520066050 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94166733523872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b378e0 con 0x7f6520066050 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b39ad0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94166733523872] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94166733521568] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94166733510464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b395e0 con 0x55a4e6b2cea0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3a370 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94166733528768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b395e0 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.933+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3b1e0 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94166733510464] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94166733528768] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94166733524928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3b1e0 con 0x55a4e6b319c0 2024-09-13T06:29:24.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3ba30 con 0x7f6520066050 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94166733524928] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94166733532944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3b900 con 0x7f6520066050 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=0 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=1 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=2 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=3 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=4 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=5 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=6 2024-09-13T06:29:24.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94166733532944] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 20 add_watcher() i=7 2024-09-13T06:29:24.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:24.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3eee0 con 0x55a4e6b28a10 2024-09-13T06:29:24.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.937+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94166733534128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b3c400 con 0x55a4e6b28a10 2024-09-13T06:29:24.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94166733534128] v31'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f63e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 5 note: GC not initialized 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f635f7fe640 20 reqs_thread_entry: start 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 20 Filter name: none 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f635d7fa640 20 reqs_thread_entry: start 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 20 rados->read ofs=0 len=0 2024-09-13T06:29:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b62010 con 0x55a4e6b28a10 2024-09-13T06:29:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T06:29:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f63e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.941+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94166733534128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b28a10 2024-09-13T06:29:24.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.945+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94166733534128] v31'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.945+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94166733512912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b2cea0 2024-09-13T06:29:24.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.945+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94166733512912] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.945+0000 7f6530b20980 20 remove_watcher() i=0 2024-09-13T06:29:24.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.945+0000 7f6530b20980 2 removed watcher, disabling cache 2024-09-13T06:29:24.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.945+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94166733516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b28a10 2024-09-13T06:29:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94166733516800] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x55a4e6b28a10 2024-09-13T06:29:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f6530b20980 20 remove_watcher() i=1 2024-09-13T06:29:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94166733521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b2cea0 2024-09-13T06:29:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94166733521568] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f6530b20980 20 remove_watcher() i=2 2024-09-13T06:29:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94166733523872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x7f6520066050 2024-09-13T06:29:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94166733523872] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f6530b20980 20 remove_watcher() i=3 2024-09-13T06:29:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.949+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94166733510464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b2cea0 2024-09-13T06:29:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.953+0000 7f652e630640 1 -- 172.21.15.169:0/9920804 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94166733510464] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6520076020 con 0x55a4e6b2cea0 2024-09-13T06:29:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.953+0000 7f6530b20980 20 remove_watcher() i=4 2024-09-13T06:29:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.953+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94166733528768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b319c0 2024-09-13T06:29:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.953+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94166733528768] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.953+0000 7f6530b20980 20 remove_watcher() i=5 2024-09-13T06:29:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.953+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94166733524928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x55a4e6b319c0 2024-09-13T06:29:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f652de2f640 1 -- 172.21.15.169:0/9920804 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94166733524928] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180c9030 con 0x55a4e6b319c0 2024-09-13T06:29:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 20 remove_watcher() i=6 2024-09-13T06:29:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94166733532944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4e6b5ff60 con 0x7f6520066050 2024-09-13T06:29:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94166733532944] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f652800a4d0 con 0x7f6520066050 2024-09-13T06:29:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 20 remove_watcher() i=7 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6b2cea0 msgr2=0x55a4e6b2f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6b2cea0 0x55a4e6b2f290 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e6b28a10 msgr2=0x55a4e6b2aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e6b28a10 0x55a4e6b2aeb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6520066050 msgr2=0x7f652004da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6520066050 0x7f652004da40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6b319c0 msgr2=0x55a4e6b33e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6b319c0 0x55a4e6b33e80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63f8034650 msgr2=0x7f63f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63f8034650 0x7f63f8036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6518018eb0 tx=0x7f65180b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 msgr2=0x55a4e6b1d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/9920804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b166c0 0x55a4e6b1d8a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6520043ff0 tx=0x7f652003af20 comp rx=0 tx=0).stop 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f652ee31640 1 -- 172.21.15.169:0/9920804 reap_dead start 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 shutdown_connections 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 >> 172.21.15.169:0/9920804 conn(0x55a4e6b12aa0 msgr2=0x55a4e6b10b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 shutdown_connections 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/9920804 wait complete. 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64080346a0 msgr2=0x7f6408036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64080346a0 0x7f6408036b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55a4e6ae2840 tx=0x7f6518005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 msgr2=0x55a4e6b0a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 0x55a4e6b0a1b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6520048440 tx=0x7f6520041e40 comp rx=0 tx=0).stop 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 shutdown_connections 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f64080346a0 0x7f6408036b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/1589675958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e6b09d90 0x55a4e6b0a1b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 >> 172.21.15.169:0/1589675958 conn(0x55a4e6afeee0 msgr2=0x55a4e6b01960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 shutdown_connections 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/1589675958 wait complete. 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6af4210 msgr2=0x55a4e6af66d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a4e6af4210 0x55a4e6af66d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e69fa8f0 msgr2=0x55a4e6af3220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a4e69fa8f0 0x55a4e6af3220 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6af9aa0 msgr2=0x55a4e6afbe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a4e6af9aa0 0x55a4e6afbe90 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6414034650 msgr2=0x7f6414036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6414034650 0x7f6414036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65180ad000 tx=0x7f65180a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 msgr2=0x55a4e6ae3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 --2- 172.21.15.169:0/4150100211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a4e69f6570 0x55a4e6ae3130 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55a4e6ae3c70 tx=0x7f6520000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f652ee31640 1 -- 172.21.15.169:0/4150100211 reap_dead start 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 shutdown_connections 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 >> 172.21.15.169:0/4150100211 conn(0x55a4e69f2090 msgr2=0x55a4e6adc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 shutdown_connections 2024-09-13T06:29:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:24.957+0000 7f6530b20980 1 -- 172.21.15.169:0/4150100211 wait complete. 2024-09-13T06:29:24.969 INFO:teuthology.orchestra.run.smithi169.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"rVVtq8KkACKLyLGXdh72soBj","ver":2},"mtime":"2024-09-13T06:29:24.772350Z","data":{"bucket":{"name":"myfoo","marker":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","bucket_id":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T06:29:21.659221Z","linked":true,"has_bucket_info":false}} 2024-09-13T06:29:24.969 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'rVVtq8KkACKLyLGXdh72soBj', 'ver': 2}, 'mtime': '2024-09-13T06:29:24.772350Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'bucket_id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T06:29:21.659221Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T06:29:24.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T06:29:24.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T06:29:24.970 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T06:29:25.042 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:25.042 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:25.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d50735980 1 Processor -- start 2024-09-13T06:29:25.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d50735980 1 -- start start 2024-09-13T06:29:25.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d50735980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55bede571920 0x55bede573d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d50735980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bede3f6ae0 con 0x55bede56d550 2024-09-13T06:29:25.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d50735980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55bede41ae30 con 0x55bede571920 2024-09-13T06:29:25.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d4da44640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55bede571920 0x55bede573d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d4da44640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55bede571920 0x55bede573d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37352/0 (socket says 172.21.15.169:37352) 2024-09-13T06:29:25.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d4da44640 1 -- 172.21.15.169:0/2731247440 learned_addr learned my addr 172.21.15.169:0/2731247440 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d4e245640 1 --1- 172.21.15.169:0/2731247440 >> v1:172.21.15.112:6789/0 conn(0x55bede56d550 0x55bede56d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45356/0 (socket says 172.21.15.169:45356) 2024-09-13T06:29:25.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d4da44640 1 -- 172.21.15.169:0/2731247440 >> v1:172.21.15.112:6789/0 conn(0x55bede56d550 legacy=0x55bede56d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.041+0000 7f3d4da44640 1 -- 172.21.15.169:0/2731247440 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede575260 con 0x55bede571920 2024-09-13T06:29:25.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d4da44640 1 --2- 172.21.15.169:0/2731247440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede571920 0x55bede573d10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400a750 tx=0x7f3d4401d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd7e2846f51f919 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d4d243640 1 -- 172.21.15.169:0/2731247440 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d440b1070 con 0x55bede571920 2024-09-13T06:29:25.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d4d243640 1 -- 172.21.15.169:0/2731247440 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4400a200 con 0x55bede571920 2024-09-13T06:29:25.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d4d243640 1 -- 172.21.15.169:0/2731247440 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d440085a0 con 0x55bede571920 2024-09-13T06:29:25.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 -- 172.21.15.169:0/2731247440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede571920 msgr2=0x55bede573d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 --2- 172.21.15.169:0/2731247440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede571920 0x55bede573d10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400a750 tx=0x7f3d4401d200 comp rx=0 tx=0).stop 2024-09-13T06:29:25.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 -- 172.21.15.169:0/2731247440 shutdown_connections 2024-09-13T06:29:25.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 --2- 172.21.15.169:0/2731247440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede571920 0x55bede573d10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 -- 172.21.15.169:0/2731247440 >> 172.21.15.169:0/2731247440 conn(0x55bede569070 msgr2=0x55bede56b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 -- 172.21.15.169:0/2731247440 shutdown_connections 2024-09-13T06:29:25.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.045+0000 7f3d50735980 1 -- 172.21.15.169:0/2731247440 wait complete. 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d50735980 1 Processor -- start 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d50735980 1 -- start start 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d50735980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede6578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d50735980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bede41c200 con 0x55bede56d550 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede6578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede6578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37362/0 (socket says 172.21.15.169:37362) 2024-09-13T06:29:25.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d4e245640 1 -- 172.21.15.169:0/2876568231 learned_addr learned my addr 172.21.15.169:0/2876568231 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.057+0000 7f3d4e245640 1 -- 172.21.15.169:0/2876568231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede657e80 con 0x55bede56d550 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d4e245640 1 --2- 172.21.15.169:0/2876568231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede6578b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3d48001690 tx=0x7f3d48001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dad8d9883a0a9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3c3c608640 1 -- 172.21.15.169:0/2876568231 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48003460 con 0x55bede56d550 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3c3c608640 1 -- 172.21.15.169:0/2876568231 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48003600 con 0x55bede56d550 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3c3c608640 1 -- 172.21.15.169:0/2876568231 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48003920 con 0x55bede56d550 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/2876568231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 msgr2=0x55bede6578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 --2- 172.21.15.169:0/2876568231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede6578b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3d48001690 tx=0x7f3d48001b50 comp rx=0 tx=0).stop 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/2876568231 shutdown_connections 2024-09-13T06:29:25.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 --2- 172.21.15.169:0/2876568231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede6578b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/2876568231 >> 172.21.15.169:0/2876568231 conn(0x55bede569070 msgr2=0x55bede6534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/2876568231 shutdown_connections 2024-09-13T06:29:25.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/2876568231 wait complete. 2024-09-13T06:29:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 Processor -- start 2024-09-13T06:29:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- start start 2024-09-13T06:29:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede662ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bede574d60 con 0x55bede56d550 2024-09-13T06:29:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede662ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede662ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37364/0 (socket says 172.21.15.169:37364) 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d4e245640 1 -- 172.21.15.169:0/4152133664 learned_addr learned my addr 172.21.15.169:0/4152133664 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d4e245640 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede663530 con 0x55bede56d550 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d4e245640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede662ff0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000f90 tx=0x7f3d48001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3c3ae05640 1 -- 172.21.15.169:0/4152133664 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48022020 con 0x55bede56d550 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bede6637c0 con 0x55bede56d550 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3c3ae05640 1 -- 172.21.15.169:0/4152133664 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48006720 con 0x55bede56d550 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede6664a0 con 0x55bede56d550 2024-09-13T06:29:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.061+0000 7f3c3ae05640 1 -- 172.21.15.169:0/4152133664 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d4801e7c0 con 0x55bede56d550 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3c3ae05640 1 -- 172.21.15.169:0/4152133664 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3d48025020 con 0x55bede56d550 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3c3ae05640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c340346a0 0x7f3c34036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3c3ae05640 1 -- 172.21.15.169:0/4152133664 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3d48049650 con 0x55bede56d550 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4da44640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c340346a0 0x7f3c34036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede571920 0x55bede66a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede66a630 con 0x55bede571920 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4ea46640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede571920 0x55bede66a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4da44640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c340346a0 0x7f3c34036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d440ae000 tx=0x7f3d440a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4ea46640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede571920 0x55bede66a0f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4ea46640 1 -- 172.21.15.169:0/4152133664 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede571920 2024-09-13T06:29:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede66b450 0x55bede66d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede66de70 con 0x55bede66b450 2024-09-13T06:29:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4e245640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede66b450 0x55bede66d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4e245640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede66b450 0x55bede66d840 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4e245640 1 -- 172.21.15.169:0/4152133664 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d4801b040 con 0x55bede66b450 2024-09-13T06:29:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede66f720 con 0x55bede66b450 2024-09-13T06:29:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d4e245640 1 -- 172.21.15.169:0/4152133664 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d4801b040 con 0x55bede66b450 2024-09-13T06:29:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.065+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede66e950 con 0x55bede66b450 2024-09-13T06:29:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4e245640 1 -- 172.21.15.169:0/4152133664 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d4801b040 con 0x55bede66b450 2024-09-13T06:29:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede670ad0 0x55bede672ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede673400 con 0x55bede670ad0 2024-09-13T06:29:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4da44640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede670ad0 0x55bede672ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4da44640 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede670ad0 0x55bede672ec0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4da44640 1 -- 172.21.15.169:0/4152133664 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d440aa070 con 0x55bede670ad0 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 Processor -- start 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 -- start start 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 0x55bede6811d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bede475800 con 0x55bede680db0 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 0x55bede6811d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 0x55bede6811d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37376/0 (socket says 172.21.15.169:37376) 2024-09-13T06:29:25.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4e245640 1 -- 172.21.15.169:0/1394756283 learned_addr learned my addr 172.21.15.169:0/1394756283 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4e245640 1 -- 172.21.15.169:0/1394756283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede681710 con 0x55bede680db0 2024-09-13T06:29:25.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d4e245640 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 0x55bede6811d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3d48047c50 tx=0x7f3d4801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3c33fff640 1 -- 172.21.15.169:0/1394756283 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48040070 con 0x55bede680db0 2024-09-13T06:29:25.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3c33fff640 1 -- 172.21.15.169:0/1394756283 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48049390 con 0x55bede680db0 2024-09-13T06:29:25.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bede6819a0 con 0x55bede680db0 2024-09-13T06:29:25.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3c33fff640 1 -- 172.21.15.169:0/1394756283 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48041b50 con 0x55bede680db0 2024-09-13T06:29:25.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.069+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede684620 con 0x55bede680db0 2024-09-13T06:29:25.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3c33fff640 1 -- 172.21.15.169:0/1394756283 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3d48041cf0 con 0x55bede680db0 2024-09-13T06:29:25.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3c33fff640 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c28034650 0x7f3c28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3c33fff640 1 -- 172.21.15.169:0/1394756283 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3d48005030 con 0x55bede680db0 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4da44640 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c28034650 0x7f3c28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 Processor -- start 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- start start 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4da44640 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c28034650 0x7f3c28036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55bede6675e0 tx=0x7f3d44005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede68db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bede6581a0 con 0x55bede68d720 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede68db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede68db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37390/0 (socket says 172.21.15.169:37390) 2024-09-13T06:29:25.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4e245640 1 -- 172.21.15.169:0/59710830 learned_addr learned my addr 172.21.15.169:0/59710830 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4e245640 1 -- 172.21.15.169:0/59710830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede68e0d0 con 0x55bede68d720 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d4e245640 1 --2- 172.21.15.169:0/59710830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede68db00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d480495c0 tx=0x7f3d4801dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faf9753a3333371 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3c31ffb640 1 -- 172.21.15.169:0/59710830 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48060070 con 0x55bede68d720 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3c31ffb640 1 -- 172.21.15.169:0/59710830 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4801d3e0 con 0x55bede68d720 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3c31ffb640 1 -- 172.21.15.169:0/59710830 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d480290d0 con 0x55bede68d720 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- 172.21.15.169:0/59710830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 msgr2=0x55bede68db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 --2- 172.21.15.169:0/59710830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede68db00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d480495c0 tx=0x7f3d4801dce0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- 172.21.15.169:0/59710830 shutdown_connections 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 --2- 172.21.15.169:0/59710830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede68db00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- 172.21.15.169:0/59710830 >> 172.21.15.169:0/59710830 conn(0x55bede689b00 msgr2=0x55bede687c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- 172.21.15.169:0/59710830 shutdown_connections 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- 172.21.15.169:0/59710830 wait complete. 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 Processor -- start 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- start start 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede694940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.073+0000 7f3d50735980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bede68e570 con 0x55bede68d720 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede694940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4e245640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede694940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37406/0 (socket says 172.21.15.169:37406) 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 learned_addr learned my addr 172.21.15.169:0/874135213 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede694e80 con 0x55bede68d720 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4e245640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede694940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3d480495c0 tx=0x7f3d4801ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3c1ffff640 1 -- 172.21.15.169:0/874135213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d4806a020 con 0x55bede68d720 2024-09-13T06:29:25.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bede694e80 con 0x55bede68d720 2024-09-13T06:29:25.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3c1ffff640 1 -- 172.21.15.169:0/874135213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d480499b0 con 0x55bede68d720 2024-09-13T06:29:25.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede6952f0 con 0x55bede68d720 2024-09-13T06:29:25.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3c1ffff640 1 -- 172.21.15.169:0/874135213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48060040 con 0x55bede68d720 2024-09-13T06:29:25.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3c1ffff640 1 -- 172.21.15.169:0/874135213 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3d4806d020 con 0x55bede68d720 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3c1ffff640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c18034650 0x7f3c18036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3c1ffff640 1 -- 172.21.15.169:0/874135213 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3d48021290 con 0x55bede68d720 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4da44640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c18034650 0x7f3c18036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede69f870 0x55bede6a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a2480 con 0x55bede69f870 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4ea46640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede69f870 0x55bede6a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4da44640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c18034650 0x7f3c18036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400a590 tx=0x7f3d440a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4ea46640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede69f870 0x55bede6a1d30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 realm 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede69ed20 con 0x55bede69f870 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a2f50 con 0x55bede69f870 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede6a3d00 0x55bede6a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.077+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a6770 con 0x55bede6a3d00 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede6a3d00 0x55bede6a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede6a3d00 0x55bede6a60f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a6fc0 con 0x55bede6a3d00 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 20 searching for the correct realm 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede6a8d30 0x55bede6ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4da44640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede6a8d30 0x55bede6ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4da44640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede6a8d30 0x55bede6ab120 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3d4806f020 0x7f3d48036920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x7f3d4806f020 2024-09-13T06:29:25.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4ea46640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3d4806f020 0x7f3d48036920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.081+0000 7f3d4ea46640 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3d4806f020 0x7f3d48036920 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x7f3d4806f020 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x7f3d4806f020 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.085+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x7f3d4806f020 2024-09-13T06:29:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede69f870 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x7f3d4806f020 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x7f3d4806f020 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.089+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a8d30 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ab7a0 con 0x55bede6a3d00 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:25.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a7940 con 0x55bede69f870 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a81e0 con 0x55bede6a3d00 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a7580 con 0x55bede6a8d30 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 zone default found 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 4 Realm: () 2024-09-13T06:29:25.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 zonegroup default 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.093+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6a81e0 con 0x7f3d4806f020 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6adfe0 con 0x55bede6a8d30 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ae380 con 0x55bede6a8d30 2024-09-13T06:29:25.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 started sync module instance, tier type = 2024-09-13T06:29:25.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:25.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ad420 con 0x55bede6a3d00 2024-09-13T06:29:25.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278263691552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ad420 con 0x55bede6a3d00 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6aed40 con 0x55bede69f870 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278263695504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6af590 con 0x55bede69f870 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.097+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6aff90 con 0x55bede6a3d00 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278263691552] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278263695504] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278263689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6af0e0 con 0x55bede6a3d00 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b0830 con 0x7f3d4806f020 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278263702400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6af0e0 con 0x7f3d4806f020 2024-09-13T06:29:25.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.101+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b1300 con 0x55bede6a3d00 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278263689072] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278263705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b12c0 con 0x55bede6a3d00 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b1d10 con 0x55bede6a8d30 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278263702400] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278263707744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b20b0 con 0x55bede6a8d30 2024-09-13T06:29:25.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b2980 con 0x55bede6a8d30 2024-09-13T06:29:25.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.105+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278263705072] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278263707744] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278263710800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b2d70 con 0x55bede6a8d30 2024-09-13T06:29:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b35c0 con 0x7f3d4806f020 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278263710800] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278263713136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b39b0 con 0x7f3d4806f020 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=0 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=1 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=2 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=3 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=4 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=5 2024-09-13T06:29:25.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=6 2024-09-13T06:29:25.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278263713136] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 20 add_watcher() i=7 2024-09-13T06:29:25.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:25.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b69e0 con 0x55bede69f870 2024-09-13T06:29:25.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.109+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278263714736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b3e80 con 0x55bede69f870 2024-09-13T06:29:25.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278263714736] v31'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3c04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 5 note: GC not initialized 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3b7f7fe640 20 reqs_thread_entry: start 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 Filter name: none 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3b7d7fa640 20 reqs_thread_entry: start 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6da0d0 con 0x55bede69f870 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6dc1b0 con 0x55bede69f870 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.1d 8:ba86f921:root::.bucket.meta.testx%3amyfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6dda60 con 0x55bede69f870 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T06:29:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.113+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e20c0 con 0x55bede69f870 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e59d0 con 0x55bede6a8d30 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(66 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [create,call,writefull 0~379,setxattr (123)] v31'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x7 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94278263912112 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e5370 con 0x55bede6a8d30 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== watch-notify(notify (1) cookie 94278263707744 notify 133143986189 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55bede6e5d70 con 0x55bede6a8d30 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3c31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94278263707744 notifier 4554 bl.length()=728 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3c31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x7 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3c31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(67 notify.5 [notify cookie 94278263912112 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3c31ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3c31ffb640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c14003eb0 con 0x55bede6a8d30 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== watch-notify(notify_complete (2) cookie 94278263912112 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede6e1af0 con 0x55bede6a8d30 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_sources= new_sources= 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential sources added=[] removed=[] 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_dests= new_dests= 2024-09-13T06:29:25.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential dests added=[] removed=[] 2024-09-13T06:29:25.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.117+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e5470 con 0x7f3d4806f020 2024-09-13T06:29:25.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(69 foo.buckets [call] v31'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e5470 con 0x7f3d4806f020 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d50735980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d50735980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d50735980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94278263918528 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e53e0 con 0x55bede6a8d30 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== watch-notify(notify (1) cookie 94278263710800 notify 133143986190 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f3d440dc040 con 0x55bede6a8d30 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3c31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94278263710800 notifier 4554 bl.length()=314 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3c31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3c31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(71 notify.6 [notify cookie 94278263918528 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3c31ffb640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c14003eb0 con 0x55bede6a8d30 2024-09-13T06:29:25.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== watch-notify(notify_complete (2) cookie 94278263918528 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede575260 con 0x55bede6a8d30 2024-09-13T06:29:25.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.121+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e5470 con 0x55bede69f870 2024-09-13T06:29:25.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(73 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T06:29:25.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T06:29:25.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94278263918528 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e53e0 con 0x55bede6a3d00 2024-09-13T06:29:25.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94278263705072 notify 133143986204 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55bede6819a0 con 0x55bede6a3d00 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3c31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 94278263705072 notifier 4554 bl.length()=155 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3c31ffb640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c14003eb0 con 0x55bede6a3d00 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(74 notify.4 [notify cookie 94278263918528 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94278263918528 notify 133143986204 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede681710 con 0x55bede6a3d00 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 8.1d 8:ba86f921:root::.bucket.meta.testx%3amyfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e5470 con 0x55bede69f870 2024-09-13T06:29:25.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call,delete] v31'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 from cache 2024-09-13T06:29:25.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:25.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.125+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94278263886608 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bede6e5470 con 0x55bede6a3d00 2024-09-13T06:29:25.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 94278263705072 notify 133143986205 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55bede681710 con 0x55bede6a3d00 2024-09-13T06:29:25.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3c317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 94278263705072 notifier 4554 bl.length()=212 2024-09-13T06:29:25.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3c317fa640 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3b84003340 con 0x55bede6a3d00 2024-09-13T06:29:25.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(77 notify.4 [notify cookie 94278263886608 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== watch-notify(notify_complete (2) cookie 94278263886608 notify 133143986205 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede6664a0 con 0x55bede6a3d00 2024-09-13T06:29:25.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3c04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.129+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278263714736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6d7f00 con 0x55bede69f870 2024-09-13T06:29:25.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94278263714736] v31'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278263691552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6d7f00 con 0x55bede6a3d00 2024-09-13T06:29:25.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94278263691552] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d50735980 20 remove_watcher() i=0 2024-09-13T06:29:25.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d50735980 2 removed watcher, disabling cache 2024-09-13T06:29:25.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278263695504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ad920 con 0x55bede69f870 2024-09-13T06:29:25.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94278263695504] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x55bede69f870 2024-09-13T06:29:25.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d50735980 20 remove_watcher() i=1 2024-09-13T06:29:25.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.133+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278263689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6d7f00 con 0x55bede6a3d00 2024-09-13T06:29:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.137+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94278263689072] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.137+0000 7f3d50735980 20 remove_watcher() i=2 2024-09-13T06:29:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.137+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278263702400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ae890 con 0x7f3d4806f020 2024-09-13T06:29:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.137+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94278263702400] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.137+0000 7f3d50735980 20 remove_watcher() i=3 2024-09-13T06:29:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.137+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278263705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ad920 con 0x55bede6a3d00 2024-09-13T06:29:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d4e245640 1 -- 172.21.15.169:0/874135213 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94278263705072] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d48050070 con 0x55bede6a3d00 2024-09-13T06:29:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d50735980 20 remove_watcher() i=4 2024-09-13T06:29:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278263707744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6d7f00 con 0x55bede6a8d30 2024-09-13T06:29:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94278263707744] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d50735980 20 remove_watcher() i=5 2024-09-13T06:29:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278263710800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6b0380 con 0x55bede6a8d30 2024-09-13T06:29:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d4da44640 1 -- 172.21.15.169:0/874135213 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94278263710800] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d440d0030 con 0x55bede6a8d30 2024-09-13T06:29:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d50735980 20 remove_watcher() i=6 2024-09-13T06:29:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.141+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278263713136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bede6ae890 con 0x7f3d4806f020 2024-09-13T06:29:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94278263713136] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d400083f0 con 0x7f3d4806f020 2024-09-13T06:29:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 20 remove_watcher() i=7 2024-09-13T06:29:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede6a3d00 msgr2=0x55bede6a60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede6a3d00 0x55bede6a60f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede69f870 msgr2=0x55bede6a1d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede69f870 0x55bede6a1d30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3d4806f020 msgr2=0x7f3d48036920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3d4806f020 0x7f3d48036920 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede6a8d30 msgr2=0x55bede6ab120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede6a8d30 0x55bede6ab120 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c18034650 msgr2=0x7f3c18036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c18034650 0x7f3c18036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400a590 tx=0x7f3d440a9000 comp rx=0 tx=0).stop 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 msgr2=0x55bede694940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d4ea46640 1 -- 172.21.15.169:0/874135213 reap_dead start 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede694940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3d480495c0 tx=0x7f3d4801ef60 comp rx=0 tx=0).stop 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 shutdown_connections 2024-09-13T06:29:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/874135213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede68d720 0x55bede694940 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 >> 172.21.15.169:0/874135213 conn(0x55bede689b00 msgr2=0x55bede687bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 shutdown_connections 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/874135213 wait complete. 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c28034650 msgr2=0x7f3c28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c28034650 0x7f3c28036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55bede6675e0 tx=0x7f3d44005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 msgr2=0x55bede6811d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 0x55bede6811d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3d48047c50 tx=0x7f3d4801ec00 comp rx=0 tx=0).stop 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 shutdown_connections 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c28034650 0x7f3c28036b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/1394756283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede680db0 0x55bede6811d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 >> 172.21.15.169:0/1394756283 conn(0x55bede675eb0 msgr2=0x55bede678980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 shutdown_connections 2024-09-13T06:29:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/1394756283 wait complete. 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede66b450 msgr2=0x55bede66d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55bede66b450 0x55bede66d840 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede571920 msgr2=0x55bede66a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55bede571920 0x55bede66a0f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede670ad0 msgr2=0x55bede672ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55bede670ad0 0x55bede672ec0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c340346a0 msgr2=0x7f3c34036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3c340346a0 0x7f3c34036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d440ae000 tx=0x7f3d440a7000 comp rx=0 tx=0).stop 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 msgr2=0x55bede662ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 --2- 172.21.15.169:0/4152133664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bede56d550 0x55bede662ff0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000f90 tx=0x7f3d48001260 comp rx=0 tx=0).stop 2024-09-13T06:29:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d4ea46640 1 -- 172.21.15.169:0/4152133664 reap_dead start 2024-09-13T06:29:25.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 shutdown_connections 2024-09-13T06:29:25.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 >> 172.21.15.169:0/4152133664 conn(0x55bede569070 msgr2=0x55bede652060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 shutdown_connections 2024-09-13T06:29:25.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.145+0000 7f3d50735980 1 -- 172.21.15.169:0/4152133664 wait complete. 2024-09-13T06:29:25.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:29:25.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:29:25.157 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T06:29:25.236 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:25.236 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:25.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.233+0000 7f292655a980 1 Processor -- start 2024-09-13T06:29:25.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.233+0000 7f292655a980 1 -- start start 2024-09-13T06:29:25.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.233+0000 7f292655a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55dc46ee4a90 0x55dc46ee6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.233+0000 7f292655a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc46d68ae0 con 0x55dc46e552e0 2024-09-13T06:29:25.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.233+0000 7f292655a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55dc46d8ce30 con 0x55dc46ee4a90 2024-09-13T06:29:25.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923869640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55dc46ee4a90 0x55dc46ee6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f292406a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55dc46e552e0 0x55dc46ee3370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45366/0 (socket says 172.21.15.169:45366) 2024-09-13T06:29:25.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923869640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55dc46ee4a90 0x55dc46ee6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37412/0 (socket says 172.21.15.169:37412) 2024-09-13T06:29:25.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f292406a640 1 -- 172.21.15.169:0/2650622865 learned_addr learned my addr 172.21.15.169:0/2650622865 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:25.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923869640 1 -- 172.21.15.169:0/2650622865 >> v1:172.21.15.112:6789/0 conn(0x55dc46e552e0 legacy=0x55dc46ee3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923869640 1 -- 172.21.15.169:0/2650622865 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc46ee83d0 con 0x55dc46ee4a90 2024-09-13T06:29:25.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923869640 1 --2- 172.21.15.169:0/2650622865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ee4a90 0x55dc46ee6e80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f290c00a480 tx=0x7f290c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a96c222d4ff1c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923068640 1 -- 172.21.15.169:0/2650622865 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c0b0070 con 0x55dc46ee4a90 2024-09-13T06:29:25.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923068640 1 -- 172.21.15.169:0/2650622865 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290c0ab540 con 0x55dc46ee4a90 2024-09-13T06:29:25.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.237+0000 7f2923068640 1 -- 172.21.15.169:0/2650622865 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c0ab840 con 0x55dc46ee4a90 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 -- 172.21.15.169:0/2650622865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ee4a90 msgr2=0x55dc46ee6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 --2- 172.21.15.169:0/2650622865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ee4a90 0x55dc46ee6e80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f290c00a480 tx=0x7f290c01b280 comp rx=0 tx=0).stop 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 -- 172.21.15.169:0/2650622865 shutdown_connections 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 --2- 172.21.15.169:0/2650622865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ee4a90 0x55dc46ee6e80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 -- 172.21.15.169:0/2650622865 >> 172.21.15.169:0/2650622865 conn(0x55dc46edb0a0 msgr2=0x55dc46edd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 -- 172.21.15.169:0/2650622865 shutdown_connections 2024-09-13T06:29:25.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.241+0000 7f292655a980 1 -- 172.21.15.169:0/2650622865 wait complete. 2024-09-13T06:29:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 Processor -- start 2024-09-13T06:29:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- start start 2024-09-13T06:29:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fcba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dc46d8e200 con 0x55dc46e552e0 2024-09-13T06:29:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fcba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fcba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37416/0 (socket says 172.21.15.169:37416) 2024-09-13T06:29:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292406a640 1 -- 172.21.15.169:0/1367109154 learned_addr learned my addr 172.21.15.169:0/1367109154 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292406a640 1 -- 172.21.15.169:0/1367109154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc46fcbfd0 con 0x55dc46e552e0 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292406a640 1 --2- 172.21.15.169:0/1367109154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fcba00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f291c0015f0 tx=0x7f291c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab656d8a72624689 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f281260c640 1 -- 172.21.15.169:0/1367109154 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c004530 con 0x55dc46e552e0 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f281260c640 1 -- 172.21.15.169:0/1367109154 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c0046f0 con 0x55dc46e552e0 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f281260c640 1 -- 172.21.15.169:0/1367109154 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c004a90 con 0x55dc46e552e0 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- 172.21.15.169:0/1367109154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 msgr2=0x55dc46fcba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 --2- 172.21.15.169:0/1367109154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fcba00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f291c0015f0 tx=0x7f291c001ab0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- 172.21.15.169:0/1367109154 shutdown_connections 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 --2- 172.21.15.169:0/1367109154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fcba00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- 172.21.15.169:0/1367109154 >> 172.21.15.169:0/1367109154 conn(0x55dc46edb0a0 msgr2=0x55dc46fc7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- 172.21.15.169:0/1367109154 shutdown_connections 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- 172.21.15.169:0/1367109154 wait complete. 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 Processor -- start 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 -- start start 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.253+0000 7f292655a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fd2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dc46ee7e40 con 0x55dc46e552e0 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fd2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fd2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37424/0 (socket says 172.21.15.169:37424) 2024-09-13T06:29:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292406a640 1 -- 172.21.15.169:0/537552462 learned_addr learned my addr 172.21.15.169:0/537552462 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292406a640 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc46fd3290 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292406a640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fd2d50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55dc46fccbe0 tx=0x7f291c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2810e09640 1 -- 172.21.15.169:0/537552462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c013760 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2810e09640 1 -- 172.21.15.169:0/537552462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c013900 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc46fd3520 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2810e09640 1 -- 172.21.15.169:0/537552462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c013be0 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc46fd6200 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2810e09640 1 -- 172.21.15.169:0/537552462 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f291c010070 con 0x55dc46e552e0 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2810e09640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f280c034650 0x7f280c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2810e09640 1 -- 172.21.15.169:0/537552462 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f291c018070 con 0x55dc46e552e0 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2923869640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f280c034650 0x7f280c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc46ee4a90 0x55dc46fd9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc46fda390 con 0x55dc46ee4a90 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292486b640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc46ee4a90 0x55dc46fd9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f2923869640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f280c034650 0x7f280c036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f290c0ad000 tx=0x7f290c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292486b640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc46ee4a90 0x55dc46fd9d20 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292486b640 1 -- 172.21.15.169:0/537552462 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc46ee4a90 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc46fdb180 0x55dc46fdd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.257+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc46fddbb0 con 0x55dc46fdb180 2024-09-13T06:29:25.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292406a640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc46fdb180 0x55dc46fdd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292406a640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc46fdb180 0x55dc46fdd570 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292406a640 1 -- 172.21.15.169:0/537552462 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f291c01b030 con 0x55dc46fdb180 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc46fdf460 con 0x55dc46fdb180 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292406a640 1 -- 172.21.15.169:0/537552462 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f291c01b030 con 0x55dc46fdb180 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc46fde690 con 0x55dc46fdb180 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292406a640 1 -- 172.21.15.169:0/537552462 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f291c01b030 con 0x55dc46fdb180 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc46fe0810 0x55dc46fe2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc46fe3140 con 0x55dc46fe0810 2024-09-13T06:29:25.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f2923869640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc46fe0810 0x55dc46fe2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f2923869640 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc46fe0810 0x55dc46fe2c00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f2923869640 1 -- 172.21.15.169:0/537552462 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f290c0b3040 con 0x55dc46fe0810 2024-09-13T06:29:25.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.261+0000 7f292655a980 1 Processor -- start 2024-09-13T06:29:25.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 -- start start 2024-09-13T06:29:25.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 0x55dc46ff0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dc46de7800 con 0x55dc46ff0b20 2024-09-13T06:29:25.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 0x55dc46ff0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 0x55dc46ff0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37432/0 (socket says 172.21.15.169:37432) 2024-09-13T06:29:25.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292406a640 1 -- 172.21.15.169:0/3581506336 learned_addr learned my addr 172.21.15.169:0/3581506336 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292406a640 1 -- 172.21.15.169:0/3581506336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc46ff1480 con 0x55dc46ff0b20 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292406a640 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 0x55dc46ff0f40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f291c0483e0 tx=0x7f291c012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2809ffb640 1 -- 172.21.15.169:0/3581506336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c04e070 con 0x55dc46ff0b20 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2809ffb640 1 -- 172.21.15.169:0/3581506336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c041470 con 0x55dc46ff0b20 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc46ff1710 con 0x55dc46ff0b20 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2809ffb640 1 -- 172.21.15.169:0/3581506336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c043040 con 0x55dc46ff0b20 2024-09-13T06:29:25.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc46ff4390 con 0x55dc46ff0b20 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2809ffb640 1 -- 172.21.15.169:0/3581506336 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f291c051070 con 0x55dc46ff0b20 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2809ffb640 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27fc034650 0x7f27fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2809ffb640 1 -- 172.21.15.169:0/3581506336 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f291c054af0 con 0x55dc46ff0b20 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2923869640 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27fc034650 0x7f27fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 Processor -- start 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 -- start start 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f2923869640 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27fc034650 0x7f27fc036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55dc46fd7340 tx=0x7f290c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc46edf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292655a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dc46fcc350 con 0x55dc46edf330 2024-09-13T06:29:25.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.265+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc46edf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc46edf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37434/0 (socket says 172.21.15.169:37434) 2024-09-13T06:29:25.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 -- 172.21.15.169:0/3035235672 learned_addr learned my addr 172.21.15.169:0/3035235672 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 -- 172.21.15.169:0/3035235672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc46edfd00 con 0x55dc46edf330 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 --2- 172.21.15.169:0/3035235672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc46edf730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f291c028fd0 tx=0x7f291c040f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c253bc4f059d6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f28037fe640 1 -- 172.21.15.169:0/3035235672 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c067070 con 0x55dc46edf330 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f28037fe640 1 -- 172.21.15.169:0/3035235672 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c011e00 con 0x55dc46edf330 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f28037fe640 1 -- 172.21.15.169:0/3035235672 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c05e040 con 0x55dc46edf330 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3035235672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 msgr2=0x55dc46edf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 --2- 172.21.15.169:0/3035235672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc46edf730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f291c028fd0 tx=0x7f291c040f90 comp rx=0 tx=0).stop 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3035235672 shutdown_connections 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 --2- 172.21.15.169:0/3035235672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc46edf730 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3035235672 >> 172.21.15.169:0/3035235672 conn(0x55dc46ff9850 msgr2=0x55dc46ff7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3035235672 shutdown_connections 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3035235672 wait complete. 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 Processor -- start 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- start start 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc47006860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dc46ee0330 con 0x55dc46edf330 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc47006860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc47006860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37450/0 (socket says 172.21.15.169:37450) 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 learned_addr learned my addr 172.21.15.169:0/3366738222 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc47006da0 con 0x55dc46edf330 2024-09-13T06:29:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292406a640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc47006860 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f291c028fd0 tx=0x7f291c01ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f2801ffb640 1 -- 172.21.15.169:0/3366738222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c070020 con 0x55dc46edf330 2024-09-13T06:29:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc47006da0 con 0x55dc46edf330 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc47006da0 con 0x55dc46edf330 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f2801ffb640 1 -- 172.21.15.169:0/3366738222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c02be30 con 0x55dc46edf330 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.269+0000 7f2801ffb640 1 -- 172.21.15.169:0/3366738222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c067040 con 0x55dc46edf330 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f2801ffb640 1 -- 172.21.15.169:0/3366738222 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f291c073020 con 0x55dc46edf330 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f2801ffb640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27f4034650 0x7f27f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f2801ffb640 1 -- 172.21.15.169:0/3366738222 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f291c079540 con 0x55dc46edf330 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f2923869640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27f4034650 0x7f27f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc47011990 0x55dc47013e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47014580 con 0x55dc47011990 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292486b640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc47011990 0x55dc47013e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f2923869640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27f4034650 0x7f27f4036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f290c018eb0 tx=0x7f290c0b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292486b640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc47011990 0x55dc47013e30 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 realm 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47010e80 con 0x55dc47011990 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47015050 con 0x55dc47011990 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc47015e30 0x55dc47018220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc470188a0 con 0x55dc47015e30 2024-09-13T06:29:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292406a640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc47015e30 0x55dc47018220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.273+0000 7f292406a640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc47015e30 0x55dc47018220 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47018de0 con 0x55dc47015e30 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 20 searching for the correct realm 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc4701a5c0 0x55dc4701ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701d150 con 0x55dc4701a5c0 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f2923869640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc4701a5c0 0x55dc4701ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f2923869640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc4701a5c0 0x55dc4701ca80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701d150 con 0x55dc47015e30 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292406a640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f291c075020 0x7f291c079810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x7f291c075020 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f291c075020 0x7f291c079810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f291c075020 0x7f291c079810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc4701a5c0 2024-09-13T06:29:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.277+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x7f291c075020 2024-09-13T06:29:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x7f291c075020 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc4701a5c0 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.281+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc4701a5c0 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc4701a5c0 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x7f291c075020 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47011990 2024-09-13T06:29:25.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x7f291c075020 2024-09-13T06:29:25.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc4701a5c0 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x7f291c075020 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.285+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc4701a5c0 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f291c06c070 con 0x55dc47015e30 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc470189f0 con 0x55dc47011990 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47018de0 con 0x55dc47015e30 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47018de0 con 0x55dc4701a5c0 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 zone default found 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 4 Realm: () 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 zonegroup default 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701d5d0 con 0x7f291c075020 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.289+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701f800 con 0x55dc4701a5c0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701fba0 con 0x55dc4701a5c0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 20 started sync module instance, tier type = 2024-09-13T06:29:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701ec40 con 0x55dc47015e30 2024-09-13T06:29:25.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94404572475488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701ec40 con 0x55dc47015e30 2024-09-13T06:29:25.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4701ec40 con 0x55dc47011990 2024-09-13T06:29:25.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94404572479568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47020aa0 con 0x55dc47011990 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.293+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470215a0 con 0x55dc47015e30 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94404572475488] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94404572479568] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94404572483728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47021560 con 0x55dc47015e30 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47021e70 con 0x7f291c075020 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94404572486080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47021560 con 0x7f291c075020 2024-09-13T06:29:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470228f0 con 0x55dc47015e30 2024-09-13T06:29:25.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94404572483728] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.297+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94404572486080] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94404572487136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47022400 con 0x55dc47015e30 2024-09-13T06:29:25.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47023190 con 0x55dc4701a5c0 2024-09-13T06:29:25.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94404572490976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47022400 con 0x55dc4701a5c0 2024-09-13T06:29:25.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47024000 con 0x55dc4701a5c0 2024-09-13T06:29:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94404572490976] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94404572494672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47024420 con 0x55dc4701a5c0 2024-09-13T06:29:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47024de0 con 0x7f291c075020 2024-09-13T06:29:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.301+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94404572487136] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94404572494672] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94404572473232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47024de0 con 0x7f291c075020 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=0 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=1 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=2 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=3 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=4 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=5 2024-09-13T06:29:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=6 2024-09-13T06:29:25.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94404572473232] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 add_watcher() i=7 2024-09-13T06:29:25.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:25.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47027e10 con 0x55dc47011990 2024-09-13T06:29:25.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94404572498224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47025200 con 0x55dc47011990 2024-09-13T06:29:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94404572498224] v31'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f27da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.305+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470306c0 con 0x55dc47015e30 2024-09-13T06:29:25.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.309+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.309+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470307a0 con 0x7f291c075020 2024-09-13T06:29:25.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.309+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.309+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47030ee0 con 0x55dc4701a5c0 2024-09-13T06:29:25.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.313+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.313+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47031390 con 0x55dc47011990 2024-09-13T06:29:25.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.313+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'135 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.313+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702e6b0 con 0x55dc47015e30 2024-09-13T06:29:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.317+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.317+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702e6b0 con 0x55dc4701a5c0 2024-09-13T06:29:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.317+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.317+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702e6b0 con 0x55dc47015e30 2024-09-13T06:29:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.317+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.317+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47031ef0 con 0x55dc47011990 2024-09-13T06:29:25.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.321+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.321+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470323a0 con 0x55dc47015e30 2024-09-13T06:29:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.321+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.321+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470323a0 con 0x55dc47015e30 2024-09-13T06:29:25.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.325+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.325+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470323a0 con 0x55dc47015e30 2024-09-13T06:29:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.325+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.325+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc470323a0 con 0x55dc4701a5c0 2024-09-13T06:29:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.329+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.329+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032570 con 0x55dc47015e30 2024-09-13T06:29:25.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.329+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.329+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032600 con 0x55dc47011990 2024-09-13T06:29:25.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.329+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.329+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032bf0 con 0x55dc47011990 2024-09-13T06:29:25.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.333+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.333+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032b40 con 0x55dc47015e30 2024-09-13T06:29:25.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.333+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.333+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032b40 con 0x55dc47015e30 2024-09-13T06:29:25.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.337+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.337+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032ab0 con 0x55dc4701a5c0 2024-09-13T06:29:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.341+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.341+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032ab0 con 0x55dc47015e30 2024-09-13T06:29:25.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.341+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.341+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032ab0 con 0x55dc47011990 2024-09-13T06:29:25.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.345+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.345+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a60 con 0x55dc47015e30 2024-09-13T06:29:25.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.345+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.345+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a60 con 0x55dc47015e30 2024-09-13T06:29:25.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.349+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.349+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a60 con 0x55dc4701a5c0 2024-09-13T06:29:25.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.349+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.349+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032af0 con 0x55dc47015e30 2024-09-13T06:29:25.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.353+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.353+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032af0 con 0x55dc4701a5c0 2024-09-13T06:29:25.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.353+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.353+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032af0 con 0x55dc4701a5c0 2024-09-13T06:29:25.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.353+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.353+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a60 con 0x55dc4701a5c0 2024-09-13T06:29:25.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.357+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.357+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a80 con 0x55dc47015e30 2024-09-13T06:29:25.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.361+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.361+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a80 con 0x55dc47011990 2024-09-13T06:29:25.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.361+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.361+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a80 con 0x55dc47015e30 2024-09-13T06:29:25.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.361+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.365+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a80 con 0x55dc47011990 2024-09-13T06:29:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.365+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.365+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47032a80 con 0x7f291c075020 2024-09-13T06:29:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.365+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.365+0000 7f27d97e2640 20 reqs_thread_entry: start 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 20 Filter name: none 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f274affd640 20 reqs_thread_entry: start 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc4704e270 con 0x55dc4701a5c0 2024-09-13T06:29:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47050740 con 0x55dc47011990 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T06:29:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4704e720 con 0x55dc4701a5c0 2024-09-13T06:29:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:29:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94404572672640 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47050ce0 con 0x55dc47015e30 2024-09-13T06:29:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== watch-notify(notify (1) cookie 94404572483728 notify 133143986206 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55dc47033070 con 0x55dc47015e30 2024-09-13T06:29:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f28037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 94404572483728 notifier 4561 bl.length()=170 2024-09-13T06:29:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f28037fe640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f27e8003d70 con 0x55dc47015e30 2024-09-13T06:29:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(97 notify.2 [notify cookie 94404572672640 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.369+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== watch-notify(notify_complete (2) cookie 94404572672640 notify 133143986206 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dc46ff1480 con 0x55dc47015e30 2024-09-13T06:29:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 10 removing email index: 2024-09-13T06:29:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 10 removing user buckets index 2024-09-13T06:29:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47050c60 con 0x55dc47011990 2024-09-13T06:29:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v31'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T06:29:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94404572677936 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc47050c60 con 0x55dc47015e30 2024-09-13T06:29:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== watch-notify(notify (1) cookie 94404572487136 notify 133143986207 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55dc46ff1480 con 0x55dc47015e30 2024-09-13T06:29:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f2802ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 94404572487136 notifier 4561 bl.length()=175 2024-09-13T06:29:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f2802ffd640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f27580032d0 con 0x55dc47015e30 2024-09-13T06:29:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(100 notify.4 [notify cookie 94404572677936 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== watch-notify(notify_complete (2) cookie 94404572677936 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dc46fd6200 con 0x55dc47015e30 2024-09-13T06:29:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 10 removing user index: testx$tenanteduser 2024-09-13T06:29:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc47050710 con 0x55dc4701a5c0 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v31'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.373+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94404572677904 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc4704f730 con 0x7f291c075020 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== watch-notify(notify (1) cookie 94404572486080 notify 133143986185 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55dc470320c0 con 0x7f291c075020 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f28037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94404572486080 notifier 4561 bl.length()=167 2024-09-13T06:29:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f28037fe640 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f27e8003d70 con 0x7f291c075020 2024-09-13T06:29:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(103 notify.3 [notify cookie 94404572677904 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== watch-notify(notify_complete (2) cookie 94404572677904 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dc4702e740 con 0x7f291c075020 2024-09-13T06:29:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f27da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94404572498224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc47011990 2024-09-13T06:29:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94404572498224] v31'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.377+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94404572475488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc47015e30 2024-09-13T06:29:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94404572475488] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292655a980 20 remove_watcher() i=0 2024-09-13T06:29:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292655a980 2 removed watcher, disabling cache 2024-09-13T06:29:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94404572479568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc47011990 2024-09-13T06:29:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94404572479568] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x55dc47011990 2024-09-13T06:29:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292655a980 20 remove_watcher() i=1 2024-09-13T06:29:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.381+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94404572483728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc47015e30 2024-09-13T06:29:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.385+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94404572483728] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.385+0000 7f292655a980 20 remove_watcher() i=2 2024-09-13T06:29:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.385+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94404572486080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x7f291c075020 2024-09-13T06:29:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.385+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94404572486080] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.385+0000 7f292655a980 20 remove_watcher() i=3 2024-09-13T06:29:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.385+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94404572487136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc47015e30 2024-09-13T06:29:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292406a640 1 -- 172.21.15.169:0/3366738222 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94404572487136] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c06a040 con 0x55dc47015e30 2024-09-13T06:29:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 20 remove_watcher() i=4 2024-09-13T06:29:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94404572490976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc4701a5c0 2024-09-13T06:29:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94404572490976] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 20 remove_watcher() i=5 2024-09-13T06:29:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94404572494672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x55dc4701a5c0 2024-09-13T06:29:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f2923869640 1 -- 172.21.15.169:0/3366738222 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94404572494672] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f290c0c9030 con 0x55dc4701a5c0 2024-09-13T06:29:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 20 remove_watcher() i=6 2024-09-13T06:29:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94404572473232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc4702f3f0 con 0x7f291c075020 2024-09-13T06:29:25.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94404572473232] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29140083f0 con 0x7f291c075020 2024-09-13T06:29:25.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.389+0000 7f292655a980 20 remove_watcher() i=7 2024-09-13T06:29:25.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc47015e30 msgr2=0x55dc47018220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc47015e30 0x55dc47018220 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc47011990 msgr2=0x55dc47013e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc47011990 0x55dc47013e30 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f291c075020 msgr2=0x7f291c079810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f291c075020 0x7f291c079810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc4701a5c0 msgr2=0x55dc4701ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc4701a5c0 0x55dc4701ca80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27f4034650 msgr2=0x7f27f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27f4034650 0x7f27f4036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f290c018eb0 tx=0x7f290c0b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292486b640 1 -- 172.21.15.169:0/3366738222 reap_dead start 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 msgr2=0x55dc47006860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc47006860 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f291c028fd0 tx=0x7f291c01ded0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 shutdown_connections 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3366738222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46edf330 0x55dc47006860 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 >> 172.21.15.169:0/3366738222 conn(0x55dc46ff9850 msgr2=0x55dc46ff7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 shutdown_connections 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3366738222 wait complete. 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27fc034650 msgr2=0x7f27fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27fc034650 0x7f27fc036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55dc46fd7340 tx=0x7f290c005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 msgr2=0x55dc46ff0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 0x55dc46ff0f40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f291c0483e0 tx=0x7f291c012ef0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 shutdown_connections 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f27fc034650 0x7f27fc036b10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/3581506336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46ff0b20 0x55dc46ff0f40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 >> 172.21.15.169:0/3581506336 conn(0x55dc46fe5c70 msgr2=0x55dc46fe86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 shutdown_connections 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/3581506336 wait complete. 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc46fdb180 msgr2=0x55dc46fdd570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55dc46fdb180 0x55dc46fdd570 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc46ee4a90 msgr2=0x55dc46fd9d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55dc46ee4a90 0x55dc46fd9d20 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc46fe0810 msgr2=0x55dc46fe2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55dc46fe0810 0x55dc46fe2c00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f280c034650 msgr2=0x7f280c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f280c034650 0x7f280c036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f290c0ad000 tx=0x7f290c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 msgr2=0x55dc46fd2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 --2- 172.21.15.169:0/537552462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dc46e552e0 0x55dc46fd2d50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55dc46fccbe0 tx=0x7f291c000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292486b640 1 -- 172.21.15.169:0/537552462 reap_dead start 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 shutdown_connections 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 >> 172.21.15.169:0/537552462 conn(0x55dc46edb0a0 msgr2=0x55dc46fc61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 shutdown_connections 2024-09-13T06:29:25.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.393+0000 7f292655a980 1 -- 172.21.15.169:0/537552462 wait complete. 2024-09-13T06:29:25.412 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T06:29:25.415 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T06:29:25.461 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:25.462 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T06:29:25.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T06:29:25.462 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T06:29:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.497+0000 7f2ed845b980 1 Processor -- start 2024-09-13T06:29:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.497+0000 7f2ed845b980 1 -- start start 2024-09-13T06:29:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed845b980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558d64c0d3c0 0x558d64c0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed845b980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d64b1eae0 con 0x558d64c0d7d0 2024-09-13T06:29:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed845b980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x558d64b42e30 con 0x558d64c0d3c0 2024-09-13T06:29:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed5f6b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558d64c0d3c0 0x558d64c0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed576a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x558d64c0d7d0 0x558d64c0c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45378/0 (socket says 172.21.15.169:45378) 2024-09-13T06:29:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed576a640 1 -- 172.21.15.169:0/1396609743 learned_addr learned my addr 172.21.15.169:0/1396609743 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/1396609743 >> v1:172.21.15.112:6789/0 conn(0x558d64c0d7d0 legacy=0x558d64c0c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.501+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/1396609743 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d64c0c8f0 con 0x558d64c0d3c0 2024-09-13T06:29:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/1396609743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64c0bb80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000a420 tx=0x7f2ed001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cd06f94bd71148 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed4f69640 1 -- 172.21.15.169:0/1396609743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00af070 con 0x558d64c0d3c0 2024-09-13T06:29:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed4f69640 1 -- 172.21.15.169:0/1396609743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed00aa530 con 0x558d64c0d3c0 2024-09-13T06:29:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed4f69640 1 -- 172.21.15.169:0/1396609743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00aa850 con 0x558d64c0d3c0 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 -- 172.21.15.169:0/1396609743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 msgr2=0x558d64c0bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 --2- 172.21.15.169:0/1396609743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64c0bb80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000a420 tx=0x7f2ed001afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 -- 172.21.15.169:0/1396609743 shutdown_connections 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 --2- 172.21.15.169:0/1396609743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64c0bb80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 -- 172.21.15.169:0/1396609743 >> 172.21.15.169:0/1396609743 conn(0x558d64c921c0 msgr2=0x558d64c945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 -- 172.21.15.169:0/1396609743 shutdown_connections 2024-09-13T06:29:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.505+0000 7f2ed845b980 1 -- 172.21.15.169:0/1396609743 wait complete. 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed845b980 1 Processor -- start 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed845b980 1 -- start start 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed845b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d83bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed845b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558d64b44200 con 0x558d64c0d3c0 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d83bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d83bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37468/0 (socket says 172.21.15.169:37468) 2024-09-13T06:29:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/2232931280 learned_addr learned my addr 172.21.15.169:0/2232931280 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.517+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/2232931280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d64d841a0 con 0x558d64c0d3c0 2024-09-13T06:29:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/2232931280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d83bd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00aa500 tx=0x7f2ed00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a40215f479f9bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2dc3e07640 1 -- 172.21.15.169:0/2232931280 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00af070 con 0x558d64c0d3c0 2024-09-13T06:29:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2dc3e07640 1 -- 172.21.15.169:0/2232931280 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed00b0040 con 0x558d64c0d3c0 2024-09-13T06:29:25.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2dc3e07640 1 -- 172.21.15.169:0/2232931280 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00aace0 con 0x558d64c0d3c0 2024-09-13T06:29:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/2232931280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 msgr2=0x558d64d83bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 --2- 172.21.15.169:0/2232931280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d83bd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00aa500 tx=0x7f2ed00033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/2232931280 shutdown_connections 2024-09-13T06:29:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 --2- 172.21.15.169:0/2232931280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d83bd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/2232931280 >> 172.21.15.169:0/2232931280 conn(0x558d64c921c0 msgr2=0x558d64d7f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/2232931280 shutdown_connections 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/2232931280 wait complete. 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 Processor -- start 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- start start 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d8ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558d64ca2210 con 0x558d64c0d3c0 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d8ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d8ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37472/0 (socket says 172.21.15.169:37472) 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4240272400 learned_addr learned my addr 172.21.15.169:0/4240272400 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d64d8b380 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d8ae40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0017be0 tx=0x7f2ed0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2dc2604640 1 -- 172.21.15.169:0/4240272400 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00b69c0 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d64d8b610 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2dc2604640 1 -- 172.21.15.169:0/4240272400 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed00c6070 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2dc2604640 1 -- 172.21.15.169:0/4240272400 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00b6cb0 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.521+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d64d8e2f0 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2dc2604640 1 -- 172.21.15.169:0/4240272400 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ed00c0440 con 0x558d64c0d3c0 2024-09-13T06:29:25.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2dc2604640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2dbc0346a0 0x7f2dbc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2dc2604640 1 -- 172.21.15.169:0/4240272400 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2ed00bb070 con 0x558d64c0d3c0 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2dbc0346a0 0x7f2dbc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64c0d7d0 0x558d64d91f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64d92480 con 0x558d64c0d7d0 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed676c640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64c0d7d0 0x558d64d91f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2dbc0346a0 0x7f2dbc036b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0001da0 tx=0x7f2ec0001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed676c640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64c0d7d0 0x558d64d91f40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed676c640 1 -- 172.21.15.169:0/4240272400 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64c0d7d0 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64d93210 0x558d64d95600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64d95c30 con 0x558d64d93210 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64d93210 0x558d64d95600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64d93210 0x558d64d95600 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4240272400 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ed00d2070 con 0x558d64d93210 2024-09-13T06:29:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.525+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64d974e0 con 0x558d64d93210 2024-09-13T06:29:25.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4240272400 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ed00d2070 con 0x558d64d93210 2024-09-13T06:29:25.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64d96650 con 0x558d64d93210 2024-09-13T06:29:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4240272400 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ed00d2070 con 0x558d64d93210 2024-09-13T06:29:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64d970c0 0x558d64d9a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64d9b090 con 0x558d64d970c0 2024-09-13T06:29:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64d970c0 0x558d64d9a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64d970c0 0x558d64d9a900 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed576a640 1 -- 172.21.15.169:0/4240272400 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64d970c0 2024-09-13T06:29:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 Processor -- start 2024-09-13T06:29:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 -- start start 2024-09-13T06:29:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 0x558d64da8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558d64b9d800 con 0x558d64da8b60 2024-09-13T06:29:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 0x558d64da8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 0x558d64da8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37480/0 (socket says 172.21.15.169:37480) 2024-09-13T06:29:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/1422980608 learned_addr learned my addr 172.21.15.169:0/1422980608 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/1422980608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d64da94c0 con 0x558d64da8b60 2024-09-13T06:29:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 0x558d64da8f80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00aa000 tx=0x7f2ed00a9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2dbb7fe640 1 -- 172.21.15.169:0/1422980608 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00c9de0 con 0x558d64da8b60 2024-09-13T06:29:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d64da9750 con 0x558d64da8b60 2024-09-13T06:29:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2dbb7fe640 1 -- 172.21.15.169:0/1422980608 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed00b4800 con 0x558d64da8b60 2024-09-13T06:29:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d64da9750 con 0x558d64da8b60 2024-09-13T06:29:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.529+0000 7f2dbb7fe640 1 -- 172.21.15.169:0/1422980608 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00b4ae0 con 0x558d64da8b60 2024-09-13T06:29:25.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2dbb7fe640 1 -- 172.21.15.169:0/1422980608 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ed00b4c80 con 0x558d64da8b60 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2dbb7fe640 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2db00346a0 0x7f2db0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2dbb7fe640 1 -- 172.21.15.169:0/1422980608 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2ed00f4aa0 con 0x558d64da8b60 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed576a640 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2db00346a0 0x7f2db0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 Processor -- start 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- start start 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed576a640 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2db00346a0 0x7f2db0036b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x558d64d8f430 tx=0x7f2ec000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64db5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558d64d844c0 con 0x558d64db5360 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64db5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64db5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37490/0 (socket says 172.21.15.169:37490) 2024-09-13T06:29:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/491926345 learned_addr learned my addr 172.21.15.169:0/491926345 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/491926345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d64db5d30 con 0x558d64db5360 2024-09-13T06:29:25.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/491926345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64db5760 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00d5e80 tx=0x7f2ed00d5d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9123addd3a1e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2db97fa640 1 -- 172.21.15.169:0/491926345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed0101020 con 0x558d64db5360 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2db97fa640 1 -- 172.21.15.169:0/491926345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed00cbac0 con 0x558d64db5360 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2db97fa640 1 -- 172.21.15.169:0/491926345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00cbd80 con 0x558d64db5360 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- 172.21.15.169:0/491926345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 msgr2=0x558d64db5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 --2- 172.21.15.169:0/491926345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64db5760 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00d5e80 tx=0x7f2ed00d5d80 comp rx=0 tx=0).stop 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- 172.21.15.169:0/491926345 shutdown_connections 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 --2- 172.21.15.169:0/491926345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64db5760 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- 172.21.15.169:0/491926345 >> 172.21.15.169:0/491926345 conn(0x558d64db1790 msgr2=0x558d64daf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- 172.21.15.169:0/491926345 shutdown_connections 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- 172.21.15.169:0/491926345 wait complete. 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 Processor -- start 2024-09-13T06:29:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- start start 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64dbc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.533+0000 7f2ed845b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558d64db6200 con 0x558d64db5360 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64dbc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed5f6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64dbc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37494/0 (socket says 172.21.15.169:37494) 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 learned_addr learned my addr 172.21.15.169:0/4077511884 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d64dbcad0 con 0x558d64db5360 2024-09-13T06:29:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64dbc590 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00d5e80 tx=0x7f2ed00a9440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2da77fe640 1 -- 172.21.15.169:0/4077511884 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed0115070 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d64dbcad0 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2da77fe640 1 -- 172.21.15.169:0/4077511884 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed00d55d0 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d64dbcad0 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2da77fe640 1 -- 172.21.15.169:0/4077511884 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed00d5780 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2da77fe640 1 -- 172.21.15.169:0/4077511884 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ed0118070 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2da77fe640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2da0034650 0x7f2da0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2da77fe640 1 -- 172.21.15.169:0/4077511884 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2ed010d050 con 0x558d64db5360 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2da0034650 0x7f2da0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64dc7730 0x558d64dc9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dca340 con 0x558d64dc7730 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed676c640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64dc7730 0x558d64dc9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2da0034650 0x7f2da0036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x558d64d9b490 tx=0x7f2ec0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed676c640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64dc7730 0x558d64dc9bf0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 20 realm 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dc6be0 con 0x558d64dc7730 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.537+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dcae10 con 0x558d64dc7730 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64dcbbc0 0x558d64dcdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dce630 con 0x558d64dcbbc0 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64dcbbc0 0x558d64dcdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64dcbbc0 0x558d64dcdfb0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dcee80 con 0x558d64dcbbc0 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 20 searching for the correct realm 2024-09-13T06:29:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64dd0bf0 0x558d64dd2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64dd0bf0 0x558d64dd2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed576a640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64dd0bf0 0x558d64dd2fe0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2ed011a060 0x7f2ed00c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x7f2ed011a060 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.541+0000 7f2ed676c640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2ed011a060 0x7f2ed00c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2ed011a060 0x7f2ed00c1070 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x7f2ed011a060 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x7f2ed011a060 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.545+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x7f2ed011a060 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dc7730 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x7f2ed011a060 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x7f2ed011a060 2024-09-13T06:29:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.549+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dd0bf0 2024-09-13T06:29:25.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd3660 con 0x558d64dcbbc0 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dcf800 con 0x558d64dc7730 2024-09-13T06:29:25.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.553+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dcf440 con 0x558d64dcbbc0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dcf450 con 0x558d64dd0bf0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 zone default found 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 4 Realm: () 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:25.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 zonegroup default 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd0310 con 0x7f2ed011a060 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd5ea0 con 0x558d64dd0bf0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd6240 con 0x558d64dd0bf0 2024-09-13T06:29:25.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 started sync module instance, tier type = 2024-09-13T06:29:25.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:25.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd52e0 con 0x558d64dcbbc0 2024-09-13T06:29:25.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94065770977216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd52e0 con 0x558d64dcbbc0 2024-09-13T06:29:25.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.557+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd6c00 con 0x558d64dc7730 2024-09-13T06:29:25.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94065770981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd74a0 con 0x558d64dc7730 2024-09-13T06:29:25.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd7ea0 con 0x558d64dcbbc0 2024-09-13T06:29:25.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94065770977216] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94065770981200] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94065770974768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd6ff0 con 0x558d64dcbbc0 2024-09-13T06:29:25.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd8740 con 0x7f2ed011a060 2024-09-13T06:29:25.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.561+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94065770988176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd6ff0 con 0x7f2ed011a060 2024-09-13T06:29:25.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd9230 con 0x558d64dcbbc0 2024-09-13T06:29:25.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94065770988176] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94065770974768] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94065770985904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd91f0 con 0x558d64dcbbc0 2024-09-13T06:29:25.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd9620 con 0x558d64dd0bf0 2024-09-13T06:29:25.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94065770989232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dd9ec0 con 0x558d64dd0bf0 2024-09-13T06:29:25.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dda8c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94065770985904] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94065770989232] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94065770990848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64ddace0 con 0x558d64dd0bf0 2024-09-13T06:29:25.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.565+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64ddb530 con 0x7f2ed011a060 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94065770990848] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94065770999008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64ddb5b0 con 0x7f2ed011a060 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=0 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=1 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=2 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=3 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=4 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=5 2024-09-13T06:29:25.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=6 2024-09-13T06:29:25.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94065770999008] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 20 add_watcher() i=7 2024-09-13T06:29:25.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:25.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64dde850 con 0x558d64dc7730 2024-09-13T06:29:25.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.569+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94065771000432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64ddbb40 con 0x558d64dc7730 2024-09-13T06:29:25.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94065771000432] v31'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2d877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2ed845b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:25.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2ed845b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:25.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dde050 con 0x558d64dcbbc0 2024-09-13T06:29:25.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.573+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64dde050 con 0x7f2ed011a060 2024-09-13T06:29:25.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.577+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.577+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de7910 con 0x558d64dd0bf0 2024-09-13T06:29:25.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.577+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.577+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de7910 con 0x558d64dc7730 2024-09-13T06:29:25.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.577+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'140 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.577+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de7910 con 0x558d64dcbbc0 2024-09-13T06:29:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.581+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.581+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de7910 con 0x558d64dd0bf0 2024-09-13T06:29:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.581+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.581+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de8880 con 0x558d64dcbbc0 2024-09-13T06:29:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.585+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.585+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de8910 con 0x558d64dc7730 2024-09-13T06:29:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.585+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.585+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de8cd0 con 0x558d64dcbbc0 2024-09-13T06:29:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.589+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.589+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9180 con 0x558d64dcbbc0 2024-09-13T06:29:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.589+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.593+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9180 con 0x558d64dcbbc0 2024-09-13T06:29:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.593+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.593+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de8790 con 0x558d64dd0bf0 2024-09-13T06:29:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.593+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.593+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9350 con 0x558d64dcbbc0 2024-09-13T06:29:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.597+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.597+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9350 con 0x558d64dc7730 2024-09-13T06:29:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.597+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.597+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9710 con 0x558d64dc7730 2024-09-13T06:29:25.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.601+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.601+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9680 con 0x558d64dcbbc0 2024-09-13T06:29:25.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.601+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.601+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9680 con 0x558d64dcbbc0 2024-09-13T06:29:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.605+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.605+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9680 con 0x558d64dd0bf0 2024-09-13T06:29:25.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.605+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.605+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dcbbc0 2024-09-13T06:29:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.609+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.609+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dc7730 2024-09-13T06:29:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.609+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.609+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dcbbc0 2024-09-13T06:29:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.613+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.613+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dcbbc0 2024-09-13T06:29:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.613+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.613+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dd0bf0 2024-09-13T06:29:25.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.613+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.613+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dcbbc0 2024-09-13T06:29:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.617+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.617+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dd0bf0 2024-09-13T06:29:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.617+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.617+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dd0bf0 2024-09-13T06:29:25.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.621+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.621+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dd0bf0 2024-09-13T06:29:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.621+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.621+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dcbbc0 2024-09-13T06:29:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.625+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.625+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dc7730 2024-09-13T06:29:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.625+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.625+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dcbbc0 2024-09-13T06:29:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.629+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.629+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x558d64dc7730 2024-09-13T06:29:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.629+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.629+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64de9b30 con 0x7f2ed011a060 2024-09-13T06:29:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2d867fc640 20 reqs_thread_entry: start 2024-09-13T06:29:25.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:25.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 Filter name: none 2024-09-13T06:29:25.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2cf7fff640 20 reqs_thread_entry: start 2024-09-13T06:29:25.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64e04cd0 con 0x7f2ed011a060 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:95 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64e067b0 con 0x558d64dd0bf0 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(95 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:25.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 get_obj_state: octx=0x7f2ed00d5ef0 obj=myfoo:four state=0x558d64e07568 s->prefetch_data=0 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 3.13 3:ca9efb39:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558d64e08600 con 0x558d64dd0bf0 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(96 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 10 manifest: total_size = 4 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.16381376804796218028 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 get_obj_state: octx=0x7f2ed00d5ef0 obj=myfoo:four state=0x558d64e07568 s->prefetch_data=0 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 prepare_atomic_modification: state is not atomic. state=0x558d64e07568 2024-09-13T06:29:25.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 2024-09-13T06:29:25.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:97 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e0d030 con 0x558d64dd0bf0 2024-09-13T06:29:25.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(97 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [stat,call,call] v31'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.633+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:98 3.13 3:ca9efb39:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e0d030 con 0x558d64dd0bf0 2024-09-13T06:29:25.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.637+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(98 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1_four [call] v31'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.637+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:99 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e0dac0 con 0x558d64dd0bf0 2024-09-13T06:29:25.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.637+0000 7f2d877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.637+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94065771000432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e0dac0 con 0x558d64dc7730 2024-09-13T06:29:25.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.637+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(99 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [stat,call,call] v31'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.637+0000 7f2db97fa640 20 handle_completion(): completion ok for obj=four 2024-09-13T06:29:25.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94065771000432] v31'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94065770977216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x558d64dcbbc0 2024-09-13T06:29:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94065770977216] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed845b980 20 remove_watcher() i=0 2024-09-13T06:29:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed845b980 2 removed watcher, disabling cache 2024-09-13T06:29:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94065770981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x558d64dc7730 2024-09-13T06:29:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94065770981200] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x558d64dc7730 2024-09-13T06:29:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed845b980 20 remove_watcher() i=1 2024-09-13T06:29:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.641+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94065770974768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x558d64dcbbc0 2024-09-13T06:29:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.645+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94065770974768] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.645+0000 7f2ed845b980 20 remove_watcher() i=2 2024-09-13T06:29:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.645+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94065770988176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x7f2ed011a060 2024-09-13T06:29:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.645+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94065770988176] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.645+0000 7f2ed845b980 20 remove_watcher() i=3 2024-09-13T06:29:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.645+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94065770985904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x558d64dcbbc0 2024-09-13T06:29:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed5f6b640 1 -- 172.21.15.169:0/4077511884 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94065770985904] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0117030 con 0x558d64dcbbc0 2024-09-13T06:29:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed845b980 20 remove_watcher() i=4 2024-09-13T06:29:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94065770989232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94065770989232] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed845b980 20 remove_watcher() i=5 2024-09-13T06:29:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94065770990848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed576a640 1 -- 172.21.15.169:0/4077511884 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94065770990848] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec000e6c0 con 0x558d64dd0bf0 2024-09-13T06:29:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed845b980 20 remove_watcher() i=6 2024-09-13T06:29:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.649+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94065770999008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558d64e084c0 con 0x7f2ed011a060 2024-09-13T06:29:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94065770999008] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec80083f0 con 0x7f2ed011a060 2024-09-13T06:29:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 20 remove_watcher() i=7 2024-09-13T06:29:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64dcbbc0 msgr2=0x558d64dcdfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64dcbbc0 0x558d64dcdfb0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64dc7730 msgr2=0x558d64dc9bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64dc7730 0x558d64dc9bf0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2ed011a060 msgr2=0x7f2ed00c1070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2ed011a060 0x7f2ed00c1070 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64dd0bf0 msgr2=0x558d64dd2fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64dd0bf0 0x558d64dd2fe0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2da0034650 msgr2=0x7f2da0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2da0034650 0x7f2da0036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x558d64d9b490 tx=0x7f2ec0010000 comp rx=0 tx=0).stop 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed676c640 1 -- 172.21.15.169:0/4077511884 reap_dead start 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 msgr2=0x558d64dbc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64dbc590 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00d5e80 tx=0x7f2ed00a9440 comp rx=0 tx=0).stop 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 shutdown_connections 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4077511884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64db5360 0x558d64dbc590 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 >> 172.21.15.169:0/4077511884 conn(0x558d64db1790 msgr2=0x558d64daf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 shutdown_connections 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4077511884 wait complete. 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2db00346a0 msgr2=0x7f2db0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2db00346a0 0x7f2db0036b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x558d64d8f430 tx=0x7f2ec000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 msgr2=0x558d64da8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 0x558d64da8f80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00aa000 tx=0x7f2ed00a9f20 comp rx=0 tx=0).stop 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 shutdown_connections 2024-09-13T06:29:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2db00346a0 0x7f2db0036b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/1422980608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64da8b60 0x558d64da8f80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 >> 172.21.15.169:0/1422980608 conn(0x558d64d9dcb0 msgr2=0x558d64da0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 shutdown_connections 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/1422980608 wait complete. 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64d93210 msgr2=0x558d64d95600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558d64d93210 0x558d64d95600 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64c0d7d0 msgr2=0x558d64d91f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558d64c0d7d0 0x558d64d91f40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64d970c0 msgr2=0x558d64d9a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558d64d970c0 0x558d64d9a900 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2dbc0346a0 msgr2=0x7f2dbc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2dbc0346a0 0x7f2dbc036b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0001da0 tx=0x7f2ec0001300 comp rx=0 tx=0).stop 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 msgr2=0x558d64d8ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 --2- 172.21.15.169:0/4240272400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558d64c0d3c0 0x558d64d8ae40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0017be0 tx=0x7f2ed0017d70 comp rx=0 tx=0).stop 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed676c640 1 -- 172.21.15.169:0/4240272400 reap_dead start 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 shutdown_connections 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 >> 172.21.15.169:0/4240272400 conn(0x558d64c921c0 msgr2=0x558d64d7e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 shutdown_connections 2024-09-13T06:29:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.653+0000 7f2ed845b980 1 -- 172.21.15.169:0/4240272400 wait complete. 2024-09-13T06:29:25.666 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:29:25.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:29:25.668 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T06:29:25.744 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:25.744 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:25.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faacc518980 1 Processor -- start 2024-09-13T06:29:25.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faacc518980 1 -- start start 2024-09-13T06:29:25.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faacc518980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b93f2888e0 0x55b93f288cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faacc518980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b93f10eae0 con 0x55b93f289230 2024-09-13T06:29:25.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faacc518980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55b93f132e30 con 0x55b93f2888e0 2024-09-13T06:29:25.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faaca028640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b93f2888e0 0x55b93f288cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faac9827640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55b93f289230 0x55b93f28dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45380/0 (socket says 172.21.15.169:45380) 2024-09-13T06:29:25.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.741+0000 7faac9827640 1 -- 172.21.15.169:0/2277718717 learned_addr learned my addr 172.21.15.169:0/2277718717 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:25.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faaca028640 1 -- 172.21.15.169:0/2277718717 >> v1:172.21.15.112:6789/0 conn(0x55b93f289230 legacy=0x55b93f28dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faaca028640 1 -- 172.21.15.169:0/2277718717 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93f2904b0 con 0x55b93f2888e0 2024-09-13T06:29:25.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faaca028640 1 --2- 172.21.15.169:0/2277718717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f288cc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faabc00a420 tx=0x7faabc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bf67ca23715e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faac9026640 1 -- 172.21.15.169:0/2277718717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0af070 con 0x55b93f2888e0 2024-09-13T06:29:25.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faac9026640 1 -- 172.21.15.169:0/2277718717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc0aa530 con 0x55b93f2888e0 2024-09-13T06:29:25.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faac9026640 1 -- 172.21.15.169:0/2277718717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0aa850 con 0x55b93f2888e0 2024-09-13T06:29:25.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 -- 172.21.15.169:0/2277718717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 msgr2=0x55b93f288cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 --2- 172.21.15.169:0/2277718717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f288cc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faabc00a420 tx=0x7faabc01afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 -- 172.21.15.169:0/2277718717 shutdown_connections 2024-09-13T06:29:25.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 --2- 172.21.15.169:0/2277718717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f288cc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 -- 172.21.15.169:0/2277718717 >> 172.21.15.169:0/2277718717 conn(0x55b93f1fc230 msgr2=0x55b93f1fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 -- 172.21.15.169:0/2277718717 shutdown_connections 2024-09-13T06:29:25.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.745+0000 7faacc518980 1 -- 172.21.15.169:0/2277718717 wait complete. 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faacc518980 1 Processor -- start 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faacc518980 1 -- start start 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faacc518980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f373bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faacc518980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b93f134200 con 0x55b93f2888e0 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f373bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f373bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37514/0 (socket says 172.21.15.169:37514) 2024-09-13T06:29:25.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faaca028640 1 -- 172.21.15.169:0/3161932351 learned_addr learned my addr 172.21.15.169:0/3161932351 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faaca028640 1 -- 172.21.15.169:0/3161932351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93f3741a0 con 0x55b93f2888e0 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faaca028640 1 --2- 172.21.15.169:0/3161932351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f373bd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faabc00a420 tx=0x7faabc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290957e1a4ac7913 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7fa9b8608640 1 -- 172.21.15.169:0/3161932351 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0af050 con 0x55b93f2888e0 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7fa9b8608640 1 -- 172.21.15.169:0/3161932351 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc0b0040 con 0x55b93f2888e0 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7fa9b8608640 1 -- 172.21.15.169:0/3161932351 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0aac60 con 0x55b93f2888e0 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faacc518980 1 -- 172.21.15.169:0/3161932351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 msgr2=0x55b93f373bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.761+0000 7faacc518980 1 --2- 172.21.15.169:0/3161932351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f373bd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faabc00a420 tx=0x7faabc0033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/3161932351 shutdown_connections 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 --2- 172.21.15.169:0/3161932351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f373bd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/3161932351 >> 172.21.15.169:0/3161932351 conn(0x55b93f1fc230 msgr2=0x55b93f36f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/3161932351 shutdown_connections 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/3161932351 wait complete. 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 Processor -- start 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- start start 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f37ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b93f28fef0 con 0x55b93f2888e0 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f37ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f37ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37528/0 (socket says 172.21.15.169:37528) 2024-09-13T06:29:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faaca028640 1 -- 172.21.15.169:0/286106097 learned_addr learned my addr 172.21.15.169:0/286106097 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faaca028640 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93f37b380 con 0x55b93f2888e0 2024-09-13T06:29:25.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faaca028640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f37ae40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faabc01b870 tx=0x7faabc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7fa9b6e05640 1 -- 172.21.15.169:0/286106097 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0c5020 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b93f37b610 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7fa9b6e05640 1 -- 172.21.15.169:0/286106097 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc0b6cb0 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7fa9b6e05640 1 -- 172.21.15.169:0/286106097 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0b6e60 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93f37e2f0 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7fa9b6e05640 1 -- 172.21.15.169:0/286106097 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faabc0b4400 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7fa9b6e05640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9b0034650 0x7fa9b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7fa9b6e05640 1 -- 172.21.15.169:0/286106097 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7faabc0bb070 con 0x55b93f2888e0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faac9827640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9b0034650 0x7fa9b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f289230 0x55b93f381f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3824d0 con 0x55b93f289230 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.765+0000 7faaca829640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f289230 0x55b93f381f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faac9827640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9b0034650 0x7fa9b0036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faac0000f70 tx=0x7faac00012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca829640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f289230 0x55b93f381f40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca829640 1 -- 172.21.15.169:0/286106097 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f289230 2024-09-13T06:29:25.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3832a0 0x55b93f385690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f385cd0 con 0x55b93f3832a0 2024-09-13T06:29:25.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca028640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3832a0 0x55b93f385690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca028640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3832a0 0x55b93f385690 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca028640 1 -- 172.21.15.169:0/286106097 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faabc0c7070 con 0x55b93f3832a0 2024-09-13T06:29:25.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f387580 con 0x55b93f3832a0 2024-09-13T06:29:25.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca028640 1 -- 172.21.15.169:0/286106097 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faabc0c7070 con 0x55b93f3832a0 2024-09-13T06:29:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3867b0 con 0x55b93f3832a0 2024-09-13T06:29:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faaca028640 1 -- 172.21.15.169:0/286106097 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faabc0c7070 con 0x55b93f3832a0 2024-09-13T06:29:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f388930 0x55b93f38ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f38b260 con 0x55b93f388930 2024-09-13T06:29:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.769+0000 7faac9827640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f388930 0x55b93f38ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faac9827640 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f388930 0x55b93f38ad20 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faac9827640 1 -- 172.21.15.169:0/286106097 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faac000e620 con 0x55b93f388930 2024-09-13T06:29:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faacc518980 1 Processor -- start 2024-09-13T06:29:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faacc518980 1 -- start start 2024-09-13T06:29:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faacc518980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 0x55b93f399150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faacc518980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b93f18d800 con 0x55b93f398d30 2024-09-13T06:29:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 0x55b93f399150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 0x55b93f399150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37544/0 (socket says 172.21.15.169:37544) 2024-09-13T06:29:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faaca028640 1 -- 172.21.15.169:0/154654249 learned_addr learned my addr 172.21.15.169:0/154654249 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faaca028640 1 -- 172.21.15.169:0/154654249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93f399690 con 0x55b93f398d30 2024-09-13T06:29:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faaca028640 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 0x55b93f399150 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faabc0e4010 tx=0x7faabc0c8bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7fa9affff640 1 -- 172.21.15.169:0/154654249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0a9a70 con 0x55b93f398d30 2024-09-13T06:29:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7fa9affff640 1 -- 172.21.15.169:0/154654249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc0050a0 con 0x55b93f398d30 2024-09-13T06:29:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b93f399920 con 0x55b93f398d30 2024-09-13T06:29:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7fa9affff640 1 -- 172.21.15.169:0/154654249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0053c0 con 0x55b93f398d30 2024-09-13T06:29:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93f39c5a0 con 0x55b93f398d30 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7fa9affff640 1 -- 172.21.15.169:0/154654249 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faabc0db030 con 0x55b93f398d30 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7fa9affff640 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9a4034650 0x7fa9a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7fa9affff640 1 -- 172.21.15.169:0/154654249 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7faabc0d9070 con 0x55b93f398d30 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.773+0000 7faac9827640 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9a4034650 0x7fa9a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 Processor -- start 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- start start 2024-09-13T06:29:25.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faac9827640 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9a4034650 0x7fa9a4036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faac000bf60 tx=0x7faac000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b93f374460 con 0x55b93f3a5700 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3a5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37560/0 (socket says 172.21.15.169:37560) 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 -- 172.21.15.169:0/1908835023 learned_addr learned my addr 172.21.15.169:0/1908835023 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 -- 172.21.15.169:0/1908835023 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93f3a60b0 con 0x55b93f3a5700 2024-09-13T06:29:25.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 --2- 172.21.15.169:0/1908835023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3a5ae0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faabc0b6940 tx=0x7faabc0e1560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb9e9e570707925 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7fa9adffb640 1 -- 172.21.15.169:0/1908835023 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0f6070 con 0x55b93f3a5700 2024-09-13T06:29:25.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7fa9adffb640 1 -- 172.21.15.169:0/1908835023 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc004cf0 con 0x55b93f3a5700 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7fa9adffb640 1 -- 172.21.15.169:0/1908835023 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0c1e60 con 0x55b93f3a5700 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- 172.21.15.169:0/1908835023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 msgr2=0x55b93f3a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 --2- 172.21.15.169:0/1908835023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3a5ae0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faabc0b6940 tx=0x7faabc0e1560 comp rx=0 tx=0).stop 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- 172.21.15.169:0/1908835023 shutdown_connections 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 --2- 172.21.15.169:0/1908835023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3a5ae0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- 172.21.15.169:0/1908835023 >> 172.21.15.169:0/1908835023 conn(0x55b93f3a1a30 msgr2=0x55b93f39fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- 172.21.15.169:0/1908835023 shutdown_connections 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- 172.21.15.169:0/1908835023 wait complete. 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 Processor -- start 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- start start 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faacc518980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b93f3a65c0 con 0x55b93f3a5700 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37566/0 (socket says 172.21.15.169:37566) 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 learned_addr learned my addr 172.21.15.169:0/2800882818 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.777+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93f3acd50 con 0x55b93f3a5700 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca028640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3ac810 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faabc0b8010 tx=0x7faabc0cb2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7fa99bfff640 1 -- 172.21.15.169:0/2800882818 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0f6040 con 0x55b93f3a5700 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b93f3acd50 con 0x55b93f3a5700 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93f3acd50 con 0x55b93f3a5700 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7fa99bfff640 1 -- 172.21.15.169:0/2800882818 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc0dc6a0 con 0x55b93f3a5700 2024-09-13T06:29:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7fa99bfff640 1 -- 172.21.15.169:0/2800882818 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0e5070 con 0x55b93f3a5700 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7fa99bfff640 1 -- 172.21.15.169:0/2800882818 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faabc0f9070 con 0x55b93f3a5700 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7fa99bfff640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa994034650 0x7fa994036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7fa99bfff640 1 -- 172.21.15.169:0/2800882818 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7faabc100800 con 0x55b93f3a5700 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faac9827640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa994034650 0x7fa994036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f3b7790 0x55b93f3b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3ba380 con 0x55b93f3b7790 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca829640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f3b7790 0x55b93f3b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faac9827640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa994034650 0x7fa994036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faabc0c8890 tx=0x7faac0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca829640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f3b7790 0x55b93f3b9c30 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 realm 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3b6c80 con 0x55b93f3b7790 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3bae50 con 0x55b93f3b7790 2024-09-13T06:29:25.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3bba30 0x55b93f3bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3be660 con 0x55b93f3bba30 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.781+0000 7faaca028640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3bba30 0x55b93f3bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca028640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3bba30 0x55b93f3bdef0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3bef00 con 0x55b93f3bba30 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 20 searching for the correct realm 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f3c0c70 0x55b93f3c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faac9827640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f3c0c70 0x55b93f3c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faac9827640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f3c0c70 0x55b93f3c3060 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca028640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7faabc0fb070 0x7faabc0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x7faabc0fb070 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7faabc0fb070 0x7faabc0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7faabc0fb070 0x7faabc0b5a50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.785+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x7faabc0fb070 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x7faabc0fb070 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.789+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x7faabc0fb070 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x7faabc0fb070 2024-09-13T06:29:25.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x7faabc0fb070 2024-09-13T06:29:25.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.793+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3c0c70 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c36e0 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3bf8b0 con 0x55b93f3b7790 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3bfd00 con 0x55b93f3bba30 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c0120 con 0x55b93f3c0c70 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 zone default found 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 4 Realm: () 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:25.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 zonegroup default 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c3b90 con 0x7faabc0fb070 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3bf4c0 con 0x55b93f3c0c70 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c5ef0 con 0x55b93f3c0c70 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.797+0000 7faacc518980 20 started sync module instance, tier type = 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faacc518980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c5250 con 0x55b93f3bba30 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254118229872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c5250 con 0x55b93f3bba30 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c6970 con 0x55b93f3b7790 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254118233280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c7210 con 0x55b93f3b7790 2024-09-13T06:29:25.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c7c50 con 0x55b93f3bba30 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.801+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254118229872] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254118233280] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254118237984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c6d60 con 0x55b93f3bba30 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c84f0 con 0x7faabc0fb070 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254118240320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c6d60 con 0x7faabc0fb070 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c8fb0 con 0x55b93f3bba30 2024-09-13T06:29:25.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254118237984] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254118240320] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254118241376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c8f70 con 0x55b93f3bba30 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.805+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c93a0 con 0x55b93f3c0c70 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254118227360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3c9c40 con 0x55b93f3c0c70 2024-09-13T06:29:25.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3ca600 con 0x55b93f3c0c70 2024-09-13T06:29:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254118241376] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254118227360] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254118242944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3ca600 con 0x55b93f3c0c70 2024-09-13T06:29:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3caea0 con 0x7faabc0fb070 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254118242944] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254118249264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3caea0 con 0x7faabc0fb070 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=0 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=1 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=2 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=3 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=4 2024-09-13T06:29:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=5 2024-09-13T06:29:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.809+0000 7faacc518980 20 add_watcher() i=6 2024-09-13T06:29:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254118249264] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 20 add_watcher() i=7 2024-09-13T06:29:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3ce2a0 con 0x55b93f3b7790 2024-09-13T06:29:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254118251456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3cb7f0 con 0x55b93f3b7790 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254118251456] v31'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7fa980fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 5 note: GC not initialized 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7fa8fb7fe640 20 reqs_thread_entry: start 2024-09-13T06:29:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 20 Filter name: none 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7fa8f97fa640 20 reqs_thread_entry: start 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.813+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f19a0 con 0x7faabc0fb070 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f2230 con 0x55b93f3c0c70 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0d40 con 0x7faabc0fb070 2024-09-13T06:29:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f3840 con 0x55b93f3c0c70 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(65 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 4.8 4:11cfe723:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f31d0 con 0x55b93f3c0c70 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 4.32 4:4cfee7b6:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f7e30 con 0x55b93f3bba30 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 4.1c 4:3a3f0fce:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3fa7f0 con 0x7faabc0fb070 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 4.6 4:6172e498:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3fd060 con 0x55b93f3c0c70 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 4.9 4:9013e599:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3ff8d0 con 0x55b93f3b7790 2024-09-13T06:29:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 4.23 4:c56c80ea:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f402220 con 0x55b93f3c0c70 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 4.17 4:e8bd2ec3:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f404c10 con 0x55b93f3c0c70 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 4.25 4:a7766a67:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f407ad0 con 0x55b93f3bba30 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 4.2 4:4033a47e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f40a940 con 0x55b93f3b7790 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 4.7 4:e3e717b4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f40d800 con 0x55b93f3b7790 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 4.13 4:cad017c4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93f4106c0 con 0x7faabc0fb070 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(66 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(69 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(68 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(71 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(72 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(74 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(67 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(76 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(73 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7fa980fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.817+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254118251456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f402220 con 0x55b93f3b7790 2024-09-13T06:29:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.821+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94254118251456] v31'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.821+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254118229872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x55b93f3bba30 2024-09-13T06:29:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.821+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94254118229872] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.821+0000 7faacc518980 20 remove_watcher() i=0 2024-09-13T06:29:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.821+0000 7faacc518980 2 removed watcher, disabling cache 2024-09-13T06:29:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.821+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254118233280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x55b93f3b7790 2024-09-13T06:29:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94254118233280] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x55b93f3b7790 2024-09-13T06:29:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faacc518980 20 remove_watcher() i=1 2024-09-13T06:29:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254118237984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x55b93f3bba30 2024-09-13T06:29:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94254118237984] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faacc518980 20 remove_watcher() i=2 2024-09-13T06:29:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254118240320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x7faabc0fb070 2024-09-13T06:29:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94254118240320] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faacc518980 20 remove_watcher() i=3 2024-09-13T06:29:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.825+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254118241376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x55b93f3bba30 2024-09-13T06:29:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faaca028640 1 -- 172.21.15.169:0/2800882818 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94254118241376] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faabc0f8030 con 0x55b93f3bba30 2024-09-13T06:29:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faacc518980 20 remove_watcher() i=4 2024-09-13T06:29:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254118227360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x55b93f3c0c70 2024-09-13T06:29:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94254118227360] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faacc518980 20 remove_watcher() i=5 2024-09-13T06:29:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254118242944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x55b93f3c0c70 2024-09-13T06:29:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faac9827640 1 -- 172.21.15.169:0/2800882818 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94254118242944] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac000e620 con 0x55b93f3c0c70 2024-09-13T06:29:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faacc518980 20 remove_watcher() i=6 2024-09-13T06:29:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.829+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254118249264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93f3f0ac0 con 0x7faabc0fb070 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94254118249264] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac40083f0 con 0x7faabc0fb070 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 20 remove_watcher() i=7 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3bba30 msgr2=0x55b93f3bdef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3bba30 0x55b93f3bdef0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f3b7790 msgr2=0x55b93f3b9c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f3b7790 0x55b93f3b9c30 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7faabc0fb070 msgr2=0x7faabc0b5a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7faabc0fb070 0x7faabc0b5a50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f3c0c70 msgr2=0x55b93f3c3060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f3c0c70 0x55b93f3c3060 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa994034650 msgr2=0x7fa994036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa994034650 0x7fa994036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faabc0c8890 tx=0x7faac0010000 comp rx=0 tx=0).stop 2024-09-13T06:29:25.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 msgr2=0x55b93f3ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faaca829640 1 -- 172.21.15.169:0/2800882818 reap_dead start 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3ac810 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faabc0b8010 tx=0x7faabc0cb2d0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 shutdown_connections 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/2800882818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f3a5700 0x55b93f3ac810 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 >> 172.21.15.169:0/2800882818 conn(0x55b93f3a1a30 msgr2=0x55b93f39fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 shutdown_connections 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/2800882818 wait complete. 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9a4034650 msgr2=0x7fa9a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9a4034650 0x7fa9a4036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faac000bf60 tx=0x7faac000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 msgr2=0x55b93f399150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 0x55b93f399150 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faabc0e4010 tx=0x7faabc0c8bf0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 shutdown_connections 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9a4034650 0x7fa9a4036b10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/154654249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f398d30 0x55b93f399150 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 >> 172.21.15.169:0/154654249 conn(0x55b93f38de80 msgr2=0x55b93f390900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 shutdown_connections 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/154654249 wait complete. 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3832a0 msgr2=0x55b93f385690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b93f3832a0 0x55b93f385690 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f289230 msgr2=0x55b93f381f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b93f289230 0x55b93f381f40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f388930 msgr2=0x55b93f38ad20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b93f388930 0x55b93f38ad20 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9b0034650 msgr2=0x7fa9b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa9b0034650 0x7fa9b0036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faac0000f70 tx=0x7faac00012c0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 msgr2=0x55b93f37ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 --2- 172.21.15.169:0/286106097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b93f2888e0 0x55b93f37ae40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faabc01b870 tx=0x7faabc019810 comp rx=0 tx=0).stop 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faaca829640 1 -- 172.21.15.169:0/286106097 reap_dead start 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 shutdown_connections 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 >> 172.21.15.169:0/286106097 conn(0x55b93f1fc230 msgr2=0x55b93f36e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 shutdown_connections 2024-09-13T06:29:25.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.833+0000 7faacc518980 1 -- 172.21.15.169:0/286106097 wait complete. 2024-09-13T06:29:25.844 INFO:teuthology.orchestra.run.smithi169.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7fd9ecda-6337-4ce7-ac46-f04193654c7b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","marker":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:29:25.121123Z","creation_time":"2024-09-13T06:29:21.659221Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T06:29:25.845 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:29:25.121123Z', 'creation_time': '2024-09-13T06:29:21.659221Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:29:25.845 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T06:29:25.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T06:29:25.845 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T06:29:25.911 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:25.911 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec793aa980 1 Processor -- start 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec793aa980 1 -- start start 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec793aa980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d673771eb0 0x55d6737742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec793aa980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6735f3ae0 con 0x55d6736e0280 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec793aa980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55d673617e30 con 0x55d673771eb0 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec766b9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d673771eb0 0x55d6737742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec76eba640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55d6736e0280 0x55d673770790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45390/0 (socket says 172.21.15.169:45390) 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec76eba640 1 -- 172.21.15.169:0/2289968356 learned_addr learned my addr 172.21.15.169:0/2289968356 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec766b9640 1 -- 172.21.15.169:0/2289968356 >> v1:172.21.15.112:6789/0 conn(0x55d6736e0280 legacy=0x55d673770790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.909+0000 7fec766b9640 1 -- 172.21.15.169:0/2289968356 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6736e0660 con 0x55d673771eb0 2024-09-13T06:29:25.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec766b9640 1 --2- 172.21.15.169:0/2289968356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d673771eb0 0x55d6737742a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00a480 tx=0x7fec6c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c26fad275c78e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec75eb8640 1 -- 172.21.15.169:0/2289968356 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6c0b0070 con 0x55d673771eb0 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec75eb8640 1 -- 172.21.15.169:0/2289968356 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6c0ab540 con 0x55d673771eb0 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec75eb8640 1 -- 172.21.15.169:0/2289968356 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6c0ab840 con 0x55d673771eb0 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 -- 172.21.15.169:0/2289968356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d673771eb0 msgr2=0x55d6737742a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 --2- 172.21.15.169:0/2289968356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d673771eb0 0x55d6737742a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00a480 tx=0x7fec6c01b280 comp rx=0 tx=0).stop 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 -- 172.21.15.169:0/2289968356 shutdown_connections 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 --2- 172.21.15.169:0/2289968356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d673771eb0 0x55d6737742a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 -- 172.21.15.169:0/2289968356 >> 172.21.15.169:0/2289968356 conn(0x55d673766080 msgr2=0x55d6737684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 -- 172.21.15.169:0/2289968356 shutdown_connections 2024-09-13T06:29:25.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.913+0000 7fec793aa980 1 -- 172.21.15.169:0/2289968356 wait complete. 2024-09-13T06:29:25.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec793aa980 1 Processor -- start 2024-09-13T06:29:25.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec793aa980 1 -- start start 2024-09-13T06:29:25.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec793aa980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d673858c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec793aa980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d673619200 con 0x55d6736e0280 2024-09-13T06:29:25.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d673858c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d673858c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37594/0 (socket says 172.21.15.169:37594) 2024-09-13T06:29:25.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.925+0000 7fec76eba640 1 -- 172.21.15.169:0/2400308441 learned_addr learned my addr 172.21.15.169:0/2400308441 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 -- 172.21.15.169:0/2400308441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d673859220 con 0x55d6736e0280 2024-09-13T06:29:25.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 --2- 172.21.15.169:0/2400308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d673858c50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec68001d90 tx=0x7fec68001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208edeeb055f55a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7feb64e09640 1 -- 172.21.15.169:0/2400308441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec68013030 con 0x55d6736e0280 2024-09-13T06:29:25.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7feb64e09640 1 -- 172.21.15.169:0/2400308441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6800e690 con 0x55d6736e0280 2024-09-13T06:29:25.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7feb64e09640 1 -- 172.21.15.169:0/2400308441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6800ea10 con 0x55d6736e0280 2024-09-13T06:29:25.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/2400308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 msgr2=0x55d673858c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 --2- 172.21.15.169:0/2400308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d673858c50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec68001d90 tx=0x7fec68001e80 comp rx=0 tx=0).stop 2024-09-13T06:29:25.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/2400308441 shutdown_connections 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 --2- 172.21.15.169:0/2400308441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d673858c50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/2400308441 >> 172.21.15.169:0/2400308441 conn(0x55d673766080 msgr2=0x55d673854880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/2400308441 shutdown_connections 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/2400308441 wait complete. 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 Processor -- start 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- start start 2024-09-13T06:29:25.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d67385ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d673777210 con 0x55d6736e0280 2024-09-13T06:29:25.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d67385ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d67385ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37600/0 (socket says 172.21.15.169:37600) 2024-09-13T06:29:25.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 -- 172.21.15.169:0/967181678 learned_addr learned my addr 172.21.15.169:0/967181678 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6738604c0 con 0x55d6736e0280 2024-09-13T06:29:25.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec76eba640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d67385ff80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55d673859e30 tx=0x7fec68000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7feb63606640 1 -- 172.21.15.169:0/967181678 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec68027070 con 0x55d6736e0280 2024-09-13T06:29:25.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d673860750 con 0x55d6736e0280 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7feb63606640 1 -- 172.21.15.169:0/967181678 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec68019900 con 0x55d6736e0280 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7feb63606640 1 -- 172.21.15.169:0/967181678 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec68019c20 con 0x55d6736e0280 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.929+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d673863430 con 0x55d6736e0280 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7feb63606640 1 -- 172.21.15.169:0/967181678 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec6802a070 con 0x55d6736e0280 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7feb63606640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb5c034650 0x7feb5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7feb63606640 1 -- 172.21.15.169:0/967181678 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fec6801f070 con 0x55d6736e0280 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec766b9640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb5c034650 0x7feb5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d673771eb0 0x55d673867080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d673867600 con 0x55d673771eb0 2024-09-13T06:29:25.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec776bb640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d673771eb0 0x55d673867080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec766b9640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb5c034650 0x7feb5c036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0ad000 tx=0x7fec6c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec776bb640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d673771eb0 0x55d673867080 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec776bb640 1 -- 172.21.15.169:0/967181678 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d673771eb0 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d673868390 0x55d67386a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d67386adc0 con 0x55d673868390 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec76eba640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d673868390 0x55d67386a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec76eba640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d673868390 0x55d67386a780 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec76eba640 1 -- 172.21.15.169:0/967181678 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec68029030 con 0x55d673868390 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d67386c670 con 0x55d673868390 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec76eba640 1 -- 172.21.15.169:0/967181678 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec68029030 con 0x55d673868390 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.933+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d67386b8a0 con 0x55d673868390 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec76eba640 1 -- 172.21.15.169:0/967181678 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec68029030 con 0x55d673868390 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d67386da20 0x55d67386fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d673870350 con 0x55d67386da20 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec766b9640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d67386da20 0x55d67386fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec766b9640 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d67386da20 0x55d67386fe10 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec766b9640 1 -- 172.21.15.169:0/967181678 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec6c0ab8f0 con 0x55d67386da20 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 Processor -- start 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 -- start start 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 0x55d67387e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d673672800 con 0x55d67387dde0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 0x55d67387e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 0x55d67387e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37604/0 (socket says 172.21.15.169:37604) 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec76eba640 1 -- 172.21.15.169:0/342538495 learned_addr learned my addr 172.21.15.169:0/342538495 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec76eba640 1 -- 172.21.15.169:0/342538495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67387e740 con 0x55d67387dde0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec76eba640 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 0x55d67387e200 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fec68048490 tx=0x7fec6800c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7feb60e01640 1 -- 172.21.15.169:0/342538495 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6802a8c0 con 0x55d67387dde0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d67387e9d0 con 0x55d67387dde0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7feb60e01640 1 -- 172.21.15.169:0/342538495 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6802aa60 con 0x55d67387dde0 2024-09-13T06:29:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7feb60e01640 1 -- 172.21.15.169:0/342538495 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec680411c0 con 0x55d67387dde0 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.937+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d673881650 con 0x55d67387dde0 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7feb60e01640 1 -- 172.21.15.169:0/342538495 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec68016070 con 0x55d67387dde0 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7feb60e01640 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb50034650 0x7feb50036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7feb60e01640 1 -- 172.21.15.169:0/342538495 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fec68014070 con 0x55d67387dde0 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec766b9640 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb50034650 0x7feb50036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 Processor -- start 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- start start 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec766b9640 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb50034650 0x7feb50036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec6c000c10 tx=0x7fec6c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d67388aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d6738595a0 con 0x55d67388a6b0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d67388aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d67388aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37616/0 (socket says 172.21.15.169:37616) 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 -- 172.21.15.169:0/1265811737 learned_addr learned my addr 172.21.15.169:0/1265811737 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 -- 172.21.15.169:0/1265811737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67388b060 con 0x55d67388a6b0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 --2- 172.21.15.169:0/1265811737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d67388aa90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fec68021f20 tx=0x7fec68041490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee8990d158e982c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7feb5a7fc640 1 -- 172.21.15.169:0/1265811737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6804d040 con 0x55d67388a6b0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7feb5a7fc640 1 -- 172.21.15.169:0/1265811737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec68032670 con 0x55d67388a6b0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7feb5a7fc640 1 -- 172.21.15.169:0/1265811737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec68041640 con 0x55d67388a6b0 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- 172.21.15.169:0/1265811737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 msgr2=0x55d67388aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 --2- 172.21.15.169:0/1265811737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d67388aa90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fec68021f20 tx=0x7fec68041490 comp rx=0 tx=0).stop 2024-09-13T06:29:25.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- 172.21.15.169:0/1265811737 shutdown_connections 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 --2- 172.21.15.169:0/1265811737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d67388aa90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- 172.21.15.169:0/1265811737 >> 172.21.15.169:0/1265811737 conn(0x55d673886a90 msgr2=0x55d673884b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- 172.21.15.169:0/1265811737 shutdown_connections 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- 172.21.15.169:0/1265811737 wait complete. 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 Processor -- start 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- start start 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d673891850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec793aa980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d67388b500 con 0x55d67388a6b0 2024-09-13T06:29:25.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d673891850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d673891850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37630/0 (socket says 172.21.15.169:37630) 2024-09-13T06:29:25.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.941+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 learned_addr learned my addr 172.21.15.169:0/1328292389 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:25.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d673891d90 con 0x55d67388a6b0 2024-09-13T06:29:25.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec76eba640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d673891850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fec68047300 tx=0x7fec68010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7feb58ff9640 1 -- 172.21.15.169:0/1328292389 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6806a020 con 0x55d67388a6b0 2024-09-13T06:29:25.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d673891d90 con 0x55d67388a6b0 2024-09-13T06:29:25.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d673892200 con 0x55d67388a6b0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7feb58ff9640 1 -- 172.21.15.169:0/1328292389 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6802ba30 con 0x55d67388a6b0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7feb58ff9640 1 -- 172.21.15.169:0/1328292389 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec68062040 con 0x55d67388a6b0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7feb58ff9640 1 -- 172.21.15.169:0/1328292389 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec6806d020 con 0x55d67388a6b0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7feb58ff9640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb40034600 0x7feb40036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7feb58ff9640 1 -- 172.21.15.169:0/1328292389 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fec68059070 con 0x55d67388a6b0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec766b9640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb40034600 0x7feb40036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d67389c960 0x55d67389ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d67389f570 con 0x55d67389c960 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec776bb640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d67389c960 0x55d67389ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec766b9640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb40034600 0x7feb40036ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec6c018eb0 tx=0x7fec6c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec776bb640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d67389c960 0x55d67389ee20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 realm 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d67389be10 con 0x55d67389c960 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:25.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a0030 con 0x55d67389c960 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d6738a0e10 0x55d6738a3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.945+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a3860 con 0x55d6738a0e10 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d6738a0e10 0x55d6738a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d6738a0e10 0x55d6738a3200 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec68065040 con 0x55d6738a0e10 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a3c50 con 0x55d6738a0e10 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec68065040 con 0x55d6738a0e10 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 20 searching for the correct realm 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d6738a55f0 0x55d6738a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a8130 con 0x55d6738a55f0 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec766b9640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d6738a55f0 0x55d6738a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec766b9640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d6738a55f0 0x55d6738a7a60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a8130 con 0x55d6738a0e10 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec68065040 con 0x55d6738a0e10 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fec6806f020 0x7fec68030980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:25.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec776bb640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fec6806f020 0x7fec68030980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec776bb640 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fec6806f020 0x7fec68030980 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.949+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68065040 con 0x55d6738a0e10 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68065040 con 0x55d6738a0e10 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.953+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.957+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a0e10 2024-09-13T06:29:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a3f60 con 0x55d67389c960 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a4350 con 0x55d6738a0e10 2024-09-13T06:29:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a4350 con 0x55d6738a55f0 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 zone default found 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 4 Realm: () 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 zonegroup default 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a85b0 con 0x7fec6806f020 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.961+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aa330 con 0x55d6738a55f0 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 20 rados->read ofs=0 len=0 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aa6d0 con 0x55d6738a55f0 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 20 started sync module instance, tier type = 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a97d0 con 0x55d6738a0e10 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94379549826256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a97d0 con 0x55d6738a0e10 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ab090 con 0x55d67389c960 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94379549830112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ab930 con 0x55d67389c960 2024-09-13T06:29:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.965+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ac350 con 0x55d6738a0e10 2024-09-13T06:29:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94379549826256] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94379549830112] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94379549834816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ab480 con 0x55d6738a0e10 2024-09-13T06:29:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738acbf0 con 0x7fec6806f020 2024-09-13T06:29:25.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94379549837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ab480 con 0x7fec6806f020 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ad690 con 0x55d6738a0e10 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.969+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94379549837120] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94379549834816] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94379549823776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ad650 con 0x55d6738a0e10 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ada80 con 0x55d6738a55f0 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94379549838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ae320 con 0x55d6738a55f0 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94379549823776] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94379549838176] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94379549839744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738af110 con 0x55d6738a55f0 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738af960 con 0x7fec6806f020 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94379549839744] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.973+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94379549847824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738af9e0 con 0x7fec6806f020 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=0 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=1 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=2 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=3 2024-09-13T06:29:25.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=4 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=5 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=6 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94379549847824] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 add_watcher() i=7 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6738b2c30 con 0x55d67389c960 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94379549849248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aff70 con 0x55d67389c960 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94379549849248] v31'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7feb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:25.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 5 note: GC not initialized 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7feb2cfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.977+0000 7fec793aa980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec793aa980 20 Filter name: none 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7feb25ffb640 20 reqs_thread_entry: start 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738d5930 con 0x55d67389c960 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ab090 con 0x55d67389c960 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'5 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ab090 con 0x55d6738a0e10 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d67389c960 2024-09-13T06:29:25.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x7fec6806f020 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fec6805c020 con 0x55d6738a55f0 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.981+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:25.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.985+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d67389c960 2024-09-13T06:29:26.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.989+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d67389c960 2024-09-13T06:29:26.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:26.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a0e10 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d67389c960 2024-09-13T06:29:26.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:26.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x7fec6806f020 2024-09-13T06:29:26.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:26.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aed20 con 0x55d6738a55f0 2024-09-13T06:29:26.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.993+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.005 INFO:teuthology.orchestra.run.smithi169.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.997+0000 7feb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.997+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94379549849248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738d3d30 con 0x55d67389c960 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.997+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94379549849248] v31'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:25.997+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94379549826256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738af6a0 con 0x55d6738a0e10 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94379549826256] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec793aa980 20 remove_watcher() i=0 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec793aa980 2 removed watcher, disabling cache 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94379549830112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738a9cd0 con 0x55d67389c960 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94379549830112] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x55d67389c960 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec793aa980 20 remove_watcher() i=1 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.001+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94379549834816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aabe0 con 0x55d6738a0e10 2024-09-13T06:29:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94379549834816] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec793aa980 20 remove_watcher() i=2 2024-09-13T06:29:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94379549837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aabe0 con 0x7fec6806f020 2024-09-13T06:29:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94379549837120] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec793aa980 20 remove_watcher() i=3 2024-09-13T06:29:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94379549823776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ac740 con 0x55d6738a0e10 2024-09-13T06:29:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec76eba640 1 -- 172.21.15.169:0/1328292389 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94379549823776] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec68089040 con 0x55d6738a0e10 2024-09-13T06:29:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec793aa980 20 remove_watcher() i=4 2024-09-13T06:29:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.005+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94379549838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aabe0 con 0x55d6738a55f0 2024-09-13T06:29:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94379549838176] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 20 remove_watcher() i=5 2024-09-13T06:29:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94379549839744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738aabe0 con 0x55d6738a55f0 2024-09-13T06:29:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec766b9640 1 -- 172.21.15.169:0/1328292389 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94379549839744] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec6c0da070 con 0x55d6738a55f0 2024-09-13T06:29:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 20 remove_watcher() i=6 2024-09-13T06:29:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94379549847824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6738ad180 con 0x7fec6806f020 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94379549847824] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec7000a4d0 con 0x7fec6806f020 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 20 remove_watcher() i=7 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d6738a0e10 msgr2=0x55d6738a3200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d6738a0e10 0x55d6738a3200 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d67389c960 msgr2=0x55d67389ee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d67389c960 0x55d67389ee20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fec6806f020 msgr2=0x7fec68030980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fec6806f020 0x7fec68030980 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d6738a55f0 msgr2=0x55d6738a7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d6738a55f0 0x55d6738a7a60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb40034600 msgr2=0x7feb40036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb40034600 0x7feb40036ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec6c018eb0 tx=0x7fec6c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 msgr2=0x55d673891850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec776bb640 1 -- 172.21.15.169:0/1328292389 reap_dead start 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d673891850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fec68047300 tx=0x7fec68010ef0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 shutdown_connections 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/1328292389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67388a6b0 0x55d673891850 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 >> 172.21.15.169:0/1328292389 conn(0x55d673886a90 msgr2=0x55d673884b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 shutdown_connections 2024-09-13T06:29:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/1328292389 wait complete. 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb50034650 msgr2=0x7feb50036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb50034650 0x7feb50036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec6c000c10 tx=0x7fec6c005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 msgr2=0x55d67387e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 0x55d67387e200 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fec68048490 tx=0x7fec6800c370 comp rx=0 tx=0).stop 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 shutdown_connections 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb50034650 0x7feb50036b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/342538495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d67387dde0 0x55d67387e200 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 >> 172.21.15.169:0/342538495 conn(0x55d673872f30 msgr2=0x55d6738759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 shutdown_connections 2024-09-13T06:29:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/342538495 wait complete. 2024-09-13T06:29:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d673868390 msgr2=0x55d67386a780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d673868390 0x55d67386a780 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d673771eb0 msgr2=0x55d673867080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d673771eb0 0x55d673867080 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d67386da20 msgr2=0x55d67386fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.009+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d67386da20 0x55d67386fe10 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb5c034650 msgr2=0x7feb5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feb5c034650 0x7feb5c036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0ad000 tx=0x7fec6c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:26.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 msgr2=0x55d67385ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 --2- 172.21.15.169:0/967181678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d6736e0280 0x55d67385ff80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55d673859e30 tx=0x7fec68000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec776bb640 1 -- 172.21.15.169:0/967181678 reap_dead start 2024-09-13T06:29:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 shutdown_connections 2024-09-13T06:29:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 >> 172.21.15.169:0/967181678 conn(0x55d673766080 msgr2=0x55d673853400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 shutdown_connections 2024-09-13T06:29:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.013+0000 7fec793aa980 1 -- 172.21.15.169:0/967181678 wait complete. 2024-09-13T06:29:26.023 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T06:29:26.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T06:29:26.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T06:29:26.024 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T06:29:26.094 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:26.094 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:26.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e556c7980 1 Processor -- start 2024-09-13T06:29:26.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e556c7980 1 -- start start 2024-09-13T06:29:26.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e556c7980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55598c393a10 0x55598c395e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e556c7980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55598c217ae0 con 0x55598c38f690 2024-09-13T06:29:26.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e556c7980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55598c23be30 con 0x55598c393a10 2024-09-13T06:29:26.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e529d6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55598c393a10 0x55598c395e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e529d6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55598c393a10 0x55598c395e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37644/0 (socket says 172.21.15.169:37644) 2024-09-13T06:29:26.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e529d6640 1 -- 172.21.15.169:0/1247929136 learned_addr learned my addr 172.21.15.169:0/1247929136 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e529d6640 1 -- 172.21.15.169:0/1247929136 >> v1:172.21.15.112:6789/0 conn(0x55598c38f690 legacy=0x55598c38fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.093+0000 7f5e529d6640 1 -- 172.21.15.169:0/1247929136 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598c397350 con 0x55598c393a10 2024-09-13T06:29:26.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e529d6640 1 --2- 172.21.15.169:0/1247929136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c393a10 0x55598c395e00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400a5c0 tx=0x7f5e4401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bb13cc0138ddd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e521d5640 1 -- 172.21.15.169:0/1247929136 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e440a6070 con 0x55598c393a10 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e521d5640 1 -- 172.21.15.169:0/1247929136 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e440af070 con 0x55598c393a10 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e521d5640 1 -- 172.21.15.169:0/1247929136 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e440aa5c0 con 0x55598c393a10 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 -- 172.21.15.169:0/1247929136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c393a10 msgr2=0x55598c395e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1247929136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c393a10 0x55598c395e00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400a5c0 tx=0x7f5e4401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 -- 172.21.15.169:0/1247929136 shutdown_connections 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1247929136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c393a10 0x55598c395e00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 -- 172.21.15.169:0/1247929136 >> 172.21.15.169:0/1247929136 conn(0x55598c38b1b0 msgr2=0x55598c38d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 -- 172.21.15.169:0/1247929136 shutdown_connections 2024-09-13T06:29:26.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.097+0000 7f5e556c7980 1 -- 172.21.15.169:0/1247929136 wait complete. 2024-09-13T06:29:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.109+0000 7f5e556c7980 1 Processor -- start 2024-09-13T06:29:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.109+0000 7f5e556c7980 1 -- start start 2024-09-13T06:29:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.109+0000 7f5e556c7980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c47a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.109+0000 7f5e556c7980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55598c23d200 con 0x55598c38f690 2024-09-13T06:29:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c47a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c47a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37654/0 (socket says 172.21.15.169:37654) 2024-09-13T06:29:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 -- 172.21.15.169:0/3328104901 learned_addr learned my addr 172.21.15.169:0/3328104901 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 -- 172.21.15.169:0/3328104901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598c47afc0 con 0x55598c38f690 2024-09-13T06:29:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 --2- 172.21.15.169:0/3328104901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c47a9f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5e48001ea0 tx=0x7f5e4800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4ff3b242d1dd5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5d4160a640 1 -- 172.21.15.169:0/3328104901 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4800a040 con 0x55598c38f690 2024-09-13T06:29:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5d4160a640 1 -- 172.21.15.169:0/3328104901 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4800f620 con 0x55598c38f690 2024-09-13T06:29:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5d4160a640 1 -- 172.21.15.169:0/3328104901 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4800f890 con 0x55598c38f690 2024-09-13T06:29:26.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- 172.21.15.169:0/3328104901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 msgr2=0x55598c47a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3328104901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c47a9f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5e48001ea0 tx=0x7f5e4800b680 comp rx=0 tx=0).stop 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- 172.21.15.169:0/3328104901 shutdown_connections 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3328104901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c47a9f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- 172.21.15.169:0/3328104901 >> 172.21.15.169:0/3328104901 conn(0x55598c38b1b0 msgr2=0x55598c476620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- 172.21.15.169:0/3328104901 shutdown_connections 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- 172.21.15.169:0/3328104901 wait complete. 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 Processor -- start 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- start start 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c481d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55598c396e50 con 0x55598c38f690 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c481d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c481d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37668/0 (socket says 172.21.15.169:37668) 2024-09-13T06:29:26.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 -- 172.21.15.169:0/1995632946 learned_addr learned my addr 172.21.15.169:0/1995632946 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598c4822b0 con 0x55598c38f690 2024-09-13T06:29:26.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e531d7640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c481d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5e48001fd0 tx=0x7f5e48000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5d3fe07640 1 -- 172.21.15.169:0/1995632946 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e48001520 con 0x55598c38f690 2024-09-13T06:29:26.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.113+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55598c482540 con 0x55598c38f690 2024-09-13T06:29:26.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5d3fe07640 1 -- 172.21.15.169:0/1995632946 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4801ca10 con 0x55598c38f690 2024-09-13T06:29:26.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5d3fe07640 1 -- 172.21.15.169:0/1995632946 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4801cd50 con 0x55598c38f690 2024-09-13T06:29:26.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55598c485220 con 0x55598c38f690 2024-09-13T06:29:26.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5d3fe07640 1 -- 172.21.15.169:0/1995632946 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5e48017050 con 0x55598c38f690 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5d3fe07640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d38034650 0x7f5d38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5d3fe07640 1 -- 172.21.15.169:0/1995632946 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5e48015020 con 0x55598c38f690 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e529d6640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d38034650 0x7f5d38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c393a10 0x55598c488e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4893f0 con 0x55598c393a10 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e539d8640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c393a10 0x55598c488e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e529d6640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d38034650 0x7f5d38036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e440ae000 tx=0x7f5e440a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e539d8640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c393a10 0x55598c488e70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e539d8640 1 -- 172.21.15.169:0/1995632946 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c393a10 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c48a210 0x55598c48c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c48cc30 con 0x55598c48a210 2024-09-13T06:29:26.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e531d7640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c48a210 0x55598c48c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.117+0000 7f5e531d7640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c48a210 0x55598c48c600 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 -- 172.21.15.169:0/1995632946 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c48a210 2024-09-13T06:29:26.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c48e4e0 con 0x55598c48a210 2024-09-13T06:29:26.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 -- 172.21.15.169:0/1995632946 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c48a210 2024-09-13T06:29:26.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c48d710 con 0x55598c48a210 2024-09-13T06:29:26.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 -- 172.21.15.169:0/1995632946 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c48a210 2024-09-13T06:29:26.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c48f890 0x55598c491c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4921c0 con 0x55598c48f890 2024-09-13T06:29:26.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e529d6640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c48f890 0x55598c491c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e529d6640 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c48f890 0x55598c491c80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e529d6640 1 -- 172.21.15.169:0/1995632946 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c48f890 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 Processor -- start 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 -- start start 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 0x55598c49ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e556c7980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55598c296800 con 0x55598c49fb70 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 0x55598c49ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 0x55598c49ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37676/0 (socket says 172.21.15.169:37676) 2024-09-13T06:29:26.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 -- 172.21.15.169:0/3509294731 learned_addr learned my addr 172.21.15.169:0/3509294731 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 -- 172.21.15.169:0/3509294731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598c4a04d0 con 0x55598c49fb70 2024-09-13T06:29:26.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.121+0000 7f5e531d7640 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 0x55598c49ff90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5e4801dfd0 tx=0x7f5e48018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d3d602640 1 -- 172.21.15.169:0/3509294731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4802f880 con 0x55598c49fb70 2024-09-13T06:29:26.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55598c4a0760 con 0x55598c49fb70 2024-09-13T06:29:26.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55598c4a0760 con 0x55598c49fb70 2024-09-13T06:29:26.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d3d602640 1 -- 172.21.15.169:0/3509294731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4804b030 con 0x55598c49fb70 2024-09-13T06:29:26.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d3d602640 1 -- 172.21.15.169:0/3509294731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e48013470 con 0x55598c49fb70 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d3d602640 1 -- 172.21.15.169:0/3509294731 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5e48041bd0 con 0x55598c49fb70 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d3d602640 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d2c034650 0x7f5d2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d3d602640 1 -- 172.21.15.169:0/3509294731 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5e48051ad0 con 0x55598c49fb70 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e529d6640 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d2c034650 0x7f5d2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 Processor -- start 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- start start 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55598c47b340 con 0x55598c4ae020 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e529d6640 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d2c034650 0x7f5d2c036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55598c486360 tx=0x7f5e44005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37684/0 (socket says 172.21.15.169:37684) 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e531d7640 1 -- 172.21.15.169:0/3495612674 learned_addr learned my addr 172.21.15.169:0/3495612674 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e531d7640 1 -- 172.21.15.169:0/3495612674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598c4ae9f0 con 0x55598c4ae020 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e531d7640 1 --2- 172.21.15.169:0/3495612674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4ae420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5e48029ee0 tx=0x7f5e48051df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84025e4ddef33dda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d36ffd640 1 -- 172.21.15.169:0/3495612674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e480138b0 con 0x55598c4ae020 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d36ffd640 1 -- 172.21.15.169:0/3495612674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4803e3c0 con 0x55598c4ae020 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5d36ffd640 1 -- 172.21.15.169:0/3495612674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e48013a50 con 0x55598c4ae020 2024-09-13T06:29:26.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- 172.21.15.169:0/3495612674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 msgr2=0x55598c4ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3495612674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4ae420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5e48029ee0 tx=0x7f5e48051df0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- 172.21.15.169:0/3495612674 shutdown_connections 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3495612674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4ae420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- 172.21.15.169:0/3495612674 >> 172.21.15.169:0/3495612674 conn(0x55598c304bb0 msgr2=0x55598c304f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.125+0000 7f5e556c7980 1 -- 172.21.15.169:0/3495612674 shutdown_connections 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 -- 172.21.15.169:0/3495612674 wait complete. 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 Processor -- start 2024-09-13T06:29:26.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 -- start start 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55598c4af420 con 0x55598c4ae020 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e531d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37698/0 (socket says 172.21.15.169:37698) 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 learned_addr learned my addr 172.21.15.169:0/2637833923 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55598c4b5bc0 con 0x55598c4ae020 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e531d7640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4b5680 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5e480473c0 tx=0x7f5e48039fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5d357fa640 1 -- 172.21.15.169:0/2637833923 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e48041ec0 con 0x55598c4ae020 2024-09-13T06:29:26.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55598c4b5bc0 con 0x55598c4ae020 2024-09-13T06:29:26.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5d357fa640 1 -- 172.21.15.169:0/2637833923 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e48042060 con 0x55598c4ae020 2024-09-13T06:29:26.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55598c4b6090 con 0x55598c4ae020 2024-09-13T06:29:26.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5d357fa640 1 -- 172.21.15.169:0/2637833923 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4802e430 con 0x55598c4ae020 2024-09-13T06:29:26.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5d357fa640 1 -- 172.21.15.169:0/2637833923 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5e48032680 con 0x55598c4ae020 2024-09-13T06:29:26.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5d357fa640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d1c034650 0x7f5d1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5d357fa640 1 -- 172.21.15.169:0/2637833923 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5e4806e030 con 0x55598c4ae020 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e529d6640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d1c034650 0x7f5d1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c4c07d0 0x55598c4c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c33e0 con 0x55598c4c07d0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.129+0000 7f5e539d8640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c4c07d0 0x55598c4c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e529d6640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d1c034650 0x7f5d1c036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e44000c10 tx=0x7f5e440c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e539d8640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c4c07d0 0x55598c4c2c90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 realm 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4bfc00 con 0x55598c4c07d0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:26.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c3e70 con 0x55598c4c07d0 2024-09-13T06:29:26.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c4c4c50 0x55598c4c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c76d0 con 0x55598c4c4c50 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e531d7640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c4c4c50 0x55598c4c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e531d7640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c4c4c50 0x55598c4c7040 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 20 searching for the correct realm 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c4c9c90 0x55598c4cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cc700 con 0x55598c4c9c90 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e529d6640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c4c9c90 0x55598c4cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e529d6640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c4c9c90 0x55598c4cc080 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.133+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cc700 con 0x55598c4c4c50 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5e48051050 0x7f5e48022640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x7f5e48051050 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5e48051050 0x7f5e48022640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5e48051050 0x7f5e48022640 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c9c90 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x7f5e48051050 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.137+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x7f5e48051050 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c9c90 2024-09-13T06:29:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c9c90 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c9c90 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x7f5e48051050 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.141+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x7f5e48051050 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c9c90 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x7f5e48051050 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c9c90 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c7f20 con 0x55598c4c4c50 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c8770 con 0x55598c4c07d0 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.145+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c8b60 con 0x55598c4c4c50 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4c8b60 con 0x55598c4c9c90 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 zone default found 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 4 Realm: () 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 zonegroup default 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4ccb80 con 0x7f5e48051050 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4ce990 con 0x55598c4c9c90 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cedd0 con 0x55598c4c9c90 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 started sync module instance, tier type = 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.149+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cdda0 con 0x55598c4c4c50 2024-09-13T06:29:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843094299328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cdda0 con 0x55598c4c4c50 2024-09-13T06:29:26.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cf880 con 0x55598c4c07d0 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843094303568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d0120 con 0x55598c4c07d0 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d0b60 con 0x55598c4c4c50 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843094299328] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843094303568] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843094308400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cfc70 con 0x55598c4c4c50 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.153+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d1400 con 0x7f5e48051050 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843094310736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4cfc70 con 0x7f5e48051050 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d1ec0 con 0x55598c4c4c50 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843094308400] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843094310736] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843094311792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d1e80 con 0x55598c4c4c50 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d22b0 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843094296816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d2b50 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.157+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d3570 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843094311792] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843094296816] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843094316704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d1990 con 0x55598c4c9c90 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d3e40 con 0x7f5e48051050 2024-09-13T06:29:26.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843094321552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d4260 con 0x7f5e48051050 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=0 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=1 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=2 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=3 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=4 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=5 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843094316704] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=6 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843094321552] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 20 add_watcher() i=7 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d4260 con 0x55598c4c07d0 2024-09-13T06:29:26.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.161+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843094322608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d41d0 con 0x55598c4c07d0 2024-09-13T06:29:26.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843094322608] v31'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5d0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:26.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:26.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 5 note: GC not initialized 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5d097e2640 20 reqs_thread_entry: start 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 Filter name: none 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5d027fc640 20 reqs_thread_entry: start 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4fa910 con 0x55598c4c07d0 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:26.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4fa3f0 con 0x7f5e48051050 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 disabling bucket name=myfoo 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4fa420 con 0x7f5e48051050 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.165+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c4fcf00 con 0x55598c4c9c90 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(65 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:26.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c505960 con 0x55598c4c9c90 2024-09-13T06:29:26.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(66 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 93843094490736 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c500fc0 con 0x55598c4c9c90 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== watch-notify(notify (1) cookie 93843094296816 notify 133143986191 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55598c4fe430 con 0x55598c4c9c90 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5d36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 93843094296816 notifier 4589 bl.length()=752 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5d36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5d36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5d36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(67 notify.5 [notify cookie 93843094490736 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5d36ffd640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5d18003eb0 con 0x55598c4c9c90 2024-09-13T06:29:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== watch-notify(notify_complete (2) cookie 93843094490736 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55598c4fc410 con 0x55598c4c9c90 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_sources= new_sources= 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential sources added=[] removed=[] 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_dests= new_dests= 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential dests added=[] removed=[] 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.169+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c505110 con 0x55598c4c07d0 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e556c7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e556c7980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e556c7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93843094490608 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55598c5031f0 con 0x55598c4c4c50 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 93843094311792 notify 133143986208 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55598c4a04d0 con 0x55598c4c4c50 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5d367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986208 cookie 93843094311792 notifier 4589 bl.length()=567 2024-09-13T06:29:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5d367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5d367fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5d367fc640 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5c7c003440 con 0x55598c4c4c50 2024-09-13T06:29:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(70 notify.4 [notify cookie 93843094490608 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 93843094490608 notify 133143986208 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5e48038070 con 0x55598c4c4c50 2024-09-13T06:29:26.179 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5d0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.173+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843094322608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4f8740 con 0x55598c4c07d0 2024-09-13T06:29:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.177+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93843094322608] v31'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.177+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843094299328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4f8740 con 0x55598c4c4c50 2024-09-13T06:29:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.177+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93843094299328] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.177+0000 7f5e556c7980 20 remove_watcher() i=0 2024-09-13T06:29:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.177+0000 7f5e556c7980 2 removed watcher, disabling cache 2024-09-13T06:29:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.177+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843094303568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4ce2c0 con 0x55598c4c07d0 2024-09-13T06:29:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93843094303568] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x55598c4c07d0 2024-09-13T06:29:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e556c7980 20 remove_watcher() i=1 2024-09-13T06:29:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843094308400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4f8740 con 0x55598c4c4c50 2024-09-13T06:29:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93843094308400] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e556c7980 20 remove_watcher() i=2 2024-09-13T06:29:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843094310736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4ce2c0 con 0x7f5e48051050 2024-09-13T06:29:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93843094310736] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e556c7980 20 remove_watcher() i=3 2024-09-13T06:29:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.181+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843094311792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d0630 con 0x55598c4c4c50 2024-09-13T06:29:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.185+0000 7f5e531d7640 1 -- 172.21.15.169:0/2637833923 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93843094311792] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4802e070 con 0x55598c4c4c50 2024-09-13T06:29:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.185+0000 7f5e556c7980 20 remove_watcher() i=4 2024-09-13T06:29:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.185+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843094296816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4f8740 con 0x55598c4c9c90 2024-09-13T06:29:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.185+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93843094296816] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.185+0000 7f5e556c7980 20 remove_watcher() i=5 2024-09-13T06:29:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.185+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843094316704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d13d0 con 0x55598c4c9c90 2024-09-13T06:29:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e529d6640 1 -- 172.21.15.169:0/2637833923 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93843094316704] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e440aaae0 con 0x55598c4c9c90 2024-09-13T06:29:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 20 remove_watcher() i=6 2024-09-13T06:29:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843094321552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55598c4d1380 con 0x7f5e48051050 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93843094321552] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4c00a4d0 con 0x7f5e48051050 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 20 remove_watcher() i=7 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c4c4c50 msgr2=0x55598c4c7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c4c4c50 0x55598c4c7040 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c4c07d0 msgr2=0x55598c4c2c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c4c07d0 0x55598c4c2c90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5e48051050 msgr2=0x7f5e48022640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5e48051050 0x7f5e48022640 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c4c9c90 msgr2=0x55598c4cc080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c4c9c90 0x55598c4cc080 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d1c034650 msgr2=0x7f5d1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d1c034650 0x7f5d1c036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e44000c10 tx=0x7f5e440c1040 comp rx=0 tx=0).stop 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 msgr2=0x55598c4b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e539d8640 1 -- 172.21.15.169:0/2637833923 reap_dead start 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4b5680 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5e480473c0 tx=0x7f5e48039fa0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 shutdown_connections 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/2637833923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c4ae020 0x55598c4b5680 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 >> 172.21.15.169:0/2637833923 conn(0x55598c304bb0 msgr2=0x55598c304f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 shutdown_connections 2024-09-13T06:29:26.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/2637833923 wait complete. 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d2c034650 msgr2=0x7f5d2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d2c034650 0x7f5d2c036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55598c486360 tx=0x7f5e44005ad0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 msgr2=0x55598c49ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 0x55598c49ff90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5e4801dfd0 tx=0x7f5e48018d50 comp rx=0 tx=0).stop 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 shutdown_connections 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d2c034650 0x7f5d2c036b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/3509294731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c49fb70 0x55598c49ff90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 >> 172.21.15.169:0/3509294731 conn(0x55598c494c70 msgr2=0x55598c497740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 shutdown_connections 2024-09-13T06:29:26.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/3509294731 wait complete. 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c48a210 msgr2=0x55598c48c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55598c48a210 0x55598c48c600 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c393a10 msgr2=0x55598c488e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55598c393a10 0x55598c488e70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c48f890 msgr2=0x55598c491c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55598c48f890 0x55598c491c80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d38034650 msgr2=0x7f5d38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5d38034650 0x7f5d38036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e440ae000 tx=0x7f5e440a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 msgr2=0x55598c481d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 --2- 172.21.15.169:0/1995632946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55598c38f690 0x55598c481d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5e48001fd0 tx=0x7f5e48000bd0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e539d8640 1 -- 172.21.15.169:0/1995632946 reap_dead start 2024-09-13T06:29:26.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 shutdown_connections 2024-09-13T06:29:26.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 >> 172.21.15.169:0/1995632946 conn(0x55598c38b1b0 msgr2=0x55598c4751a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 shutdown_connections 2024-09-13T06:29:26.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.189+0000 7f5e556c7980 1 -- 172.21.15.169:0/1995632946 wait complete. 2024-09-13T06:29:26.201 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:26.203 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T06:29:26.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T06:29:26.203 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T06:29:26.268 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:26.268 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:26.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54ba131980 1 Processor -- start 2024-09-13T06:29:26.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54ba131980 1 -- start start 2024-09-13T06:29:26.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54ba131980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55fafa0362d0 0x55fafa0c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54ba131980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55faf9f49ae0 con 0x55fafa0c6ca0 2024-09-13T06:29:26.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54ba131980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55faf9f6de30 con 0x55fafa0362d0 2024-09-13T06:29:26.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54b7c41640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55fafa0362d0 0x55fafa0c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54b7c41640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55fafa0362d0 0x55fafa0c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37706/0 (socket says 172.21.15.169:37706) 2024-09-13T06:29:26.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54b7c41640 1 -- 172.21.15.169:0/3090949472 learned_addr learned my addr 172.21.15.169:0/3090949472 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.265+0000 7f54b7440640 1 --1- 172.21.15.169:0/3090949472 >> v1:172.21.15.112:6789/0 conn(0x55fafa0c6ca0 0x55fafa0c9090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:45402/0 (socket says 172.21.15.169:45402) 2024-09-13T06:29:26.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54b7c41640 1 -- 172.21.15.169:0/3090949472 >> v1:172.21.15.112:6789/0 conn(0x55fafa0c6ca0 legacy=0x55fafa0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54b7c41640 1 -- 172.21.15.169:0/3090949472 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa0366b0 con 0x55fafa0362d0 2024-09-13T06:29:26.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3090949472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa0c6760 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f54a800a5c0 tx=0x7f54a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172947b1d19f28dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54b6c3f640 1 -- 172.21.15.169:0/3090949472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80a6070 con 0x55fafa0362d0 2024-09-13T06:29:26.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54b6c3f640 1 -- 172.21.15.169:0/3090949472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a80af070 con 0x55fafa0362d0 2024-09-13T06:29:26.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54b6c3f640 1 -- 172.21.15.169:0/3090949472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80aa5c0 con 0x55fafa0362d0 2024-09-13T06:29:26.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 -- 172.21.15.169:0/3090949472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 msgr2=0x55fafa0c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 --2- 172.21.15.169:0/3090949472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa0c6760 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f54a800a5c0 tx=0x7f54a801b340 comp rx=0 tx=0).stop 2024-09-13T06:29:26.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 -- 172.21.15.169:0/3090949472 shutdown_connections 2024-09-13T06:29:26.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 --2- 172.21.15.169:0/3090949472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa0c6760 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 -- 172.21.15.169:0/3090949472 >> 172.21.15.169:0/3090949472 conn(0x55fafa0bc090 msgr2=0x55fafa0be4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 -- 172.21.15.169:0/3090949472 shutdown_connections 2024-09-13T06:29:26.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.269+0000 7f54ba131980 1 -- 172.21.15.169:0/3090949472 wait complete. 2024-09-13T06:29:26.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.281+0000 7f54ba131980 1 Processor -- start 2024-09-13T06:29:26.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- start start 2024-09-13T06:29:26.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55faf9f6f200 con 0x55fafa0362d0 2024-09-13T06:29:26.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37710/0 (socket says 172.21.15.169:37710) 2024-09-13T06:29:26.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 -- 172.21.15.169:0/2829531954 learned_addr learned my addr 172.21.15.169:0/2829531954 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 -- 172.21.15.169:0/2829531954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa1af1a0 con 0x55fafa0362d0 2024-09-13T06:29:26.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 --2- 172.21.15.169:0/2829531954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1aebd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54a8018f70 tx=0x7f54a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e0176f92c52edf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f53a5e0b640 1 -- 172.21.15.169:0/2829531954 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80aaa00 con 0x55fafa0362d0 2024-09-13T06:29:26.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f53a5e0b640 1 -- 172.21.15.169:0/2829531954 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a80aaba0 con 0x55fafa0362d0 2024-09-13T06:29:26.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f53a5e0b640 1 -- 172.21.15.169:0/2829531954 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80bd3f0 con 0x55fafa0362d0 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- 172.21.15.169:0/2829531954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 msgr2=0x55fafa1aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 --2- 172.21.15.169:0/2829531954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1aebd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54a8018f70 tx=0x7f54a8003030 comp rx=0 tx=0).stop 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- 172.21.15.169:0/2829531954 shutdown_connections 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 --2- 172.21.15.169:0/2829531954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1aebd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- 172.21.15.169:0/2829531954 >> 172.21.15.169:0/2829531954 conn(0x55fafa0bc090 msgr2=0x55fafa1aa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- 172.21.15.169:0/2829531954 shutdown_connections 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- 172.21.15.169:0/2829531954 wait complete. 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 Processor -- start 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- start start 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54ba131980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fafa0cd210 con 0x55fafa0362d0 2024-09-13T06:29:26.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37714/0 (socket says 172.21.15.169:37714) 2024-09-13T06:29:26.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.285+0000 7f54b7c41640 1 -- 172.21.15.169:0/1494751855 learned_addr learned my addr 172.21.15.169:0/1494751855 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b7c41640 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa1b6380 con 0x55fafa0362d0 2024-09-13T06:29:26.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b7c41640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1b5e40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000c10 tx=0x7f54a80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f539ffff640 1 -- 172.21.15.169:0/1494751855 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80cb020 con 0x55fafa0362d0 2024-09-13T06:29:26.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fafa1b6610 con 0x55fafa0362d0 2024-09-13T06:29:26.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafa1b92f0 con 0x55fafa0362d0 2024-09-13T06:29:26.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f539ffff640 1 -- 172.21.15.169:0/1494751855 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a80c6710 con 0x55fafa0362d0 2024-09-13T06:29:26.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f539ffff640 1 -- 172.21.15.169:0/1494751855 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80c69f0 con 0x55fafa0362d0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f539ffff640 1 -- 172.21.15.169:0/1494751855 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54a80ce020 con 0x55fafa0362d0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f539ffff640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53a0034650 0x7f53a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f539ffff640 1 -- 172.21.15.169:0/1494751855 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f54a80e5260 con 0x55fafa0362d0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b7440640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53a0034650 0x7f53a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa0c6ca0 0x55fafa1bce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1bd480 con 0x55fafa0c6ca0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b8442640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa0c6ca0 0x55fafa1bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b7440640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53a0034650 0x7f53a0036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000f70 tx=0x7f54ac001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b8442640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa0c6ca0 0x55fafa1bce10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b8442640 1 -- 172.21.15.169:0/1494751855 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa0c6ca0 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1be250 0x55fafa1c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1c0c80 con 0x55fafa1be250 2024-09-13T06:29:26.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.289+0000 7f54b7c41640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1be250 0x55fafa1c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1be250 0x55fafa1c0640 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 -- 172.21.15.169:0/1494751855 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1be250 2024-09-13T06:29:26.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1c2530 con 0x55fafa1be250 2024-09-13T06:29:26.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 -- 172.21.15.169:0/1494751855 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1be250 2024-09-13T06:29:26.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1c1760 con 0x55fafa1be250 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 -- 172.21.15.169:0/1494751855 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1be250 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1c38e0 0x55fafa1c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1c6210 con 0x55fafa1c38e0 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7440640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1c38e0 0x55fafa1c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7440640 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1c38e0 0x55fafa1c5cd0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7440640 1 -- 172.21.15.169:0/1494751855 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54ac00f6a0 con 0x55fafa1c38e0 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 Processor -- start 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 -- start start 2024-09-13T06:29:26.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 0x55fafa1d3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54ba131980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55faf9fc8800 con 0x55fafa1d3bd0 2024-09-13T06:29:26.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 0x55fafa1d3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 0x55fafa1d3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37720/0 (socket says 172.21.15.169:37720) 2024-09-13T06:29:26.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.293+0000 7f54b7c41640 1 -- 172.21.15.169:0/3671469766 learned_addr learned my addr 172.21.15.169:0/3671469766 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 -- 172.21.15.169:0/3671469766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa1d4530 con 0x55fafa1d3bd0 2024-09-13T06:29:26.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 0x55fafa1d3ff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f54a80e38f0 tx=0x7f54a80bf3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f539d7fa640 1 -- 172.21.15.169:0/3671469766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80c5720 con 0x55fafa1d3bd0 2024-09-13T06:29:26.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fafa1d47c0 con 0x55fafa1d3bd0 2024-09-13T06:29:26.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafa1d7440 con 0x55fafa1d3bd0 2024-09-13T06:29:26.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f539d7fa640 1 -- 172.21.15.169:0/3671469766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a80c58c0 con 0x55fafa1d3bd0 2024-09-13T06:29:26.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f539d7fa640 1 -- 172.21.15.169:0/3671469766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80e31b0 con 0x55fafa1d3bd0 2024-09-13T06:29:26.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f539d7fa640 1 -- 172.21.15.169:0/3671469766 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54a80e3350 con 0x55fafa1d3bd0 2024-09-13T06:29:26.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f539d7fa640 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5390034650 0x7f5390036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f539d7fa640 1 -- 172.21.15.169:0/3671469766 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f54a80eb070 con 0x55fafa1d3bd0 2024-09-13T06:29:26.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7440640 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5390034650 0x7f5390036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54ba131980 1 Processor -- start 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54ba131980 1 -- start start 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7440640 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5390034650 0x7f5390036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55fafa1ba430 tx=0x7f54ac00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54ba131980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54ba131980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fafa1af460 con 0x55fafa1e05c0 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37732/0 (socket says 172.21.15.169:37732) 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 -- 172.21.15.169:0/3007528058 learned_addr learned my addr 172.21.15.169:0/3007528058 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 -- 172.21.15.169:0/3007528058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa1e0f70 con 0x55fafa1e05c0 2024-09-13T06:29:26.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.297+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3007528058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e09a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f54a80c5bc0 tx=0x7f54a80e3740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf4cfb17b0c8e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f5396ffd640 1 -- 172.21.15.169:0/3007528058 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80e8d40 con 0x55fafa1e05c0 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f5396ffd640 1 -- 172.21.15.169:0/3007528058 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a8108070 con 0x55fafa1e05c0 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f5396ffd640 1 -- 172.21.15.169:0/3007528058 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80bc5d0 con 0x55fafa1e05c0 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3007528058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 msgr2=0x55fafa1e09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 --2- 172.21.15.169:0/3007528058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e09a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f54a80c5bc0 tx=0x7f54a80e3740 comp rx=0 tx=0).stop 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3007528058 shutdown_connections 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 --2- 172.21.15.169:0/3007528058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e09a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3007528058 >> 172.21.15.169:0/3007528058 conn(0x55fafa1dc8f0 msgr2=0x55fafa1da9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3007528058 shutdown_connections 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3007528058 wait complete. 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 Processor -- start 2024-09-13T06:29:26.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- start start 2024-09-13T06:29:26.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fafa1e1300 con 0x55fafa1e05c0 2024-09-13T06:29:26.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54b7c41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:37744/0 (socket says 172.21.15.169:37744) 2024-09-13T06:29:26.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 learned_addr learned my addr 172.21.15.169:0/3705306932 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:26.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa1e7be0 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e76a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f54a80f3ff0 tx=0x7f54a80cdef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f53957fa640 1 -- 172.21.15.169:0/3705306932 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80e5df0 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fafa1e7be0 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafa1e7be0 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f53957fa640 1 -- 172.21.15.169:0/3705306932 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a8113070 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.301+0000 7f53957fa640 1 -- 172.21.15.169:0/3705306932 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a80bc700 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f53957fa640 1 -- 172.21.15.169:0/3705306932 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54a80cf9a0 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f53957fa640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5380034650 0x7f5380036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f53957fa640 1 -- 172.21.15.169:0/3705306932 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f54a80ff040 con 0x55fafa1e05c0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b7440640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5380034650 0x7f5380036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa1f2660 0x55fafa1f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f5270 con 0x55fafa1f2660 2024-09-13T06:29:26.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b8442640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa1f2660 0x55fafa1f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b7440640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5380034650 0x7f5380036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c010 tx=0x7f54ac010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b8442640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa1f2660 0x55fafa1f4b20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 realm 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f1a90 con 0x55fafa1f2660 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f5d30 con 0x55fafa1f2660 2024-09-13T06:29:26.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1f6b10 0x55fafa1f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9590 con 0x55fafa1f6b10 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1f6b10 0x55fafa1f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1f6b10 0x55fafa1f8f00 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:26.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.305+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:26.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54ba131980 20 searching for the correct realm 2024-09-13T06:29:26.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1fbb50 0x55fafa1fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1fe5c0 con 0x55fafa1fbb50 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7440640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1fbb50 0x55fafa1fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7440640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1fbb50 0x55fafa1fdf40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1fe5c0 con 0x55fafa1f6b10 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7c41640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f54a810f040 0x7f54a80e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x7f54a810f040 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f54a810f040 0x7f54a80e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f54a810f040 0x7f54a80e8400 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1fbb50 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.309+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x7f54a810f040 2024-09-13T06:29:26.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x7f54a810f040 2024-09-13T06:29:26.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1fbb50 2024-09-13T06:29:26.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1fbb50 2024-09-13T06:29:26.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.313+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1fbb50 2024-09-13T06:29:26.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x7f54a810f040 2024-09-13T06:29:26.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f2660 2024-09-13T06:29:26.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x7f54a810f040 2024-09-13T06:29:26.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1fbb50 2024-09-13T06:29:26.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x7f54a810f040 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1fbb50 2024-09-13T06:29:26.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.317+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1f9de0 con 0x55fafa1f6b10 2024-09-13T06:29:26.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1fa630 con 0x55fafa1f2660 2024-09-13T06:29:26.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1faa20 con 0x55fafa1f6b10 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1faa20 con 0x55fafa1fbb50 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 zone default found 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 4 Realm: () 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:26.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 zonegroup default 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1fea20 con 0x7f54a810f040 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa1faf90 con 0x55fafa1fbb50 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa200d90 con 0x55fafa1fbb50 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 started sync module instance, tier type = 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.321+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa2000e0 con 0x55fafa1f6b10 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94536426587616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa2000e0 con 0x55fafa1f6b10 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa201810 con 0x55fafa1f2660 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94536426591072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa202060 con 0x55fafa1f2660 2024-09-13T06:29:26.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa202ad0 con 0x55fafa1f6b10 2024-09-13T06:29:26.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94536426587616] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.325+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94536426591072] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94536426595744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa201bb0 con 0x55fafa1f6b10 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa203370 con 0x7f54a810f040 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94536426598080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa201bb0 con 0x7f54a810f040 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa203e30 con 0x55fafa1f6b10 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94536426598080] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94536426595744] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94536426585136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa203df0 con 0x55fafa1f6b10 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.329+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa204220 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.333+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.333+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94536426599136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa204ac0 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.333+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa2054c0 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.333+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94536426585136] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.333+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94536426599136] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94536426600704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa2058b0 con 0x55fafa1fbb50 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa206100 con 0x7f54a810f040 2024-09-13T06:29:26.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94536426609296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa206550 con 0x7f54a810f040 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=0 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=1 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=2 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=3 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=4 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=5 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94536426600704] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=6 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94536426609296] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 20 add_watcher() i=7 2024-09-13T06:29:26.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa204fd0 con 0x55fafa1f2660 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.337+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94536426606544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa206ad0 con 0x55fafa1f2660 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94536426606544] v31'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f536dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 5 note: GC not initialized 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f536cfe1640 20 reqs_thread_entry: start 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 Filter name: none 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f52e67fc640 20 reqs_thread_entry: start 2024-09-13T06:29:26.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22cc40 con 0x55fafa1f2660 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22f6d0 con 0x7f54a810f040 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 enabling bucket name=myfoo 2024-09-13T06:29:26.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.341+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22d6b0 con 0x7f54a810f040 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 : miss 2024-09-13T06:29:26.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 rados->read ofs=0 len=0 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22ff40 con 0x55fafa1fbb50 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(65 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 2024-09-13T06:29:26.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 8.1c 8:3da42d4a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa237920 con 0x55fafa1fbb50 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(66 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1, ofs0, ns] 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94536426780576 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa232fd0 con 0x55fafa1fbb50 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== watch-notify(notify (1) cookie 94536426599136 notify 133143986192 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55fafa230330 con 0x55fafa1fbb50 2024-09-13T06:29:26.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f5396ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94536426599136 notifier 4596 bl.length()=752 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f5396ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 info.flags=0x17 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f5396ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1 to cache LRU end 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f5396ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(67 notify.5 [notify cookie 94536426780576 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f5396ffd640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f537c003eb0 con 0x55fafa1fbb50 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== watch-notify(notify_complete (2) cookie 94536426780576 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fafa22f460 con 0x55fafa1fbb50 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_sources= new_sources= 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential sources added=[] removed=[] 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): orig_dests= new_dests= 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 20 handle_bi_update(): bucket=:myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1]): potential dests added=[] removed=[] 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.345+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa232ae0 con 0x55fafa1f2660 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54ba131980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54ba131980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:26.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54ba131980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:26.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94536426784576 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fafa232ae0 con 0x55fafa1f6b10 2024-09-13T06:29:26.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94536426585136 notify 133143986209 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55fafa1d47c0 con 0x55fafa1f6b10 2024-09-13T06:29:26.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f5396ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94536426585136 notifier 4596 bl.length()=567 2024-09-13T06:29:26.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f5396ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:26.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f5396ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:26.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(70 notify.4 [notify cookie 94536426784576 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f5396ffd640 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f537c003eb0 con 0x55fafa1f6b10 2024-09-13T06:29:26.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify_complete (2) cookie 94536426784576 notify 133143986209 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fafa1d4530 con 0x55fafa1f6b10 2024-09-13T06:29:26.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.361 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:26.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f536dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:26.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.349+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94536426606544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22aa70 con 0x55fafa1f2660 2024-09-13T06:29:26.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.353+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94536426606544] v31'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.353+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94536426587616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22aa70 con 0x55fafa1f6b10 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.353+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94536426587616] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.353+0000 7f54ba131980 20 remove_watcher() i=0 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.353+0000 7f54ba131980 2 removed watcher, disabling cache 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.353+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94536426591072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22aa70 con 0x55fafa1f2660 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94536426591072] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x55fafa1f2660 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54ba131980 20 remove_watcher() i=1 2024-09-13T06:29:26.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94536426595744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22aa70 con 0x55fafa1f6b10 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94536426595744] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54ba131980 20 remove_watcher() i=2 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94536426598080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa2025a0 con 0x7f54a810f040 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94536426598080] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54ba131980 20 remove_watcher() i=3 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.357+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94536426585136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa22aa70 con 0x55fafa1f6b10 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.361+0000 7f54b7c41640 1 -- 172.21.15.169:0/3705306932 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94536426585136] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a80bd9b0 con 0x55fafa1f6b10 2024-09-13T06:29:26.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.361+0000 7f54ba131980 20 remove_watcher() i=4 2024-09-13T06:29:26.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.361+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94536426599136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa202ec0 con 0x55fafa1fbb50 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.361+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94536426599136] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.361+0000 7f54ba131980 20 remove_watcher() i=5 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.361+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94536426600704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa203370 con 0x55fafa1fbb50 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54b7440640 1 -- 172.21.15.169:0/3705306932 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94536426600704] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac037040 con 0x55fafa1fbb50 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 20 remove_watcher() i=6 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94536426609296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fafa203370 con 0x7f54a810f040 2024-09-13T06:29:26.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94536426609296] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b000a4d0 con 0x7f54a810f040 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 20 remove_watcher() i=7 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1f6b10 msgr2=0x55fafa1f8f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1f6b10 0x55fafa1f8f00 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa1f2660 msgr2=0x55fafa1f4b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa1f2660 0x55fafa1f4b20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f54a810f040 msgr2=0x7f54a80e8400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f54a810f040 0x7f54a80e8400 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1fbb50 msgr2=0x55fafa1fdf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1fbb50 0x55fafa1fdf40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5380034650 msgr2=0x7f5380036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5380034650 0x7f5380036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c010 tx=0x7f54ac010000 comp rx=0 tx=0).stop 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 msgr2=0x55fafa1e76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54b8442640 1 -- 172.21.15.169:0/3705306932 reap_dead start 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e76a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f54a80f3ff0 tx=0x7f54a80cdef0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 shutdown_connections 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3705306932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1e05c0 0x55fafa1e76a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 >> 172.21.15.169:0/3705306932 conn(0x55fafa1dc8f0 msgr2=0x55fafa1da9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 shutdown_connections 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3705306932 wait complete. 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5390034650 msgr2=0x7f5390036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5390034650 0x7f5390036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55fafa1ba430 tx=0x7f54ac00f000 comp rx=0 tx=0).stop 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 msgr2=0x55fafa1d3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 0x55fafa1d3ff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f54a80e38f0 tx=0x7f54a80bf3b0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 shutdown_connections 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5390034650 0x7f5390036b10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/3671469766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa1d3bd0 0x55fafa1d3ff0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 >> 172.21.15.169:0/3671469766 conn(0x55fafa1c8d20 msgr2=0x55fafa1cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 shutdown_connections 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/3671469766 wait complete. 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1be250 msgr2=0x55fafa1c0640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55fafa1be250 0x55fafa1c0640 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa0c6ca0 msgr2=0x55fafa1bce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55fafa0c6ca0 0x55fafa1bce10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1c38e0 msgr2=0x55fafa1c5cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55fafa1c38e0 0x55fafa1c5cd0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53a0034650 msgr2=0x7f53a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f53a0034650 0x7f53a0036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000f70 tx=0x7f54ac001380 comp rx=0 tx=0).stop 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 msgr2=0x55fafa1b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 --2- 172.21.15.169:0/1494751855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fafa0362d0 0x55fafa1b5e40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000c10 tx=0x7f54a80180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54b8442640 1 -- 172.21.15.169:0/1494751855 reap_dead start 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 shutdown_connections 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 >> 172.21.15.169:0/1494751855 conn(0x55fafa0bc090 msgr2=0x55fafa1a9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 shutdown_connections 2024-09-13T06:29:26.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:26.365+0000 7f54ba131980 1 -- 172.21.15.169:0/1494751855 wait complete. 2024-09-13T06:29:26.378 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:26.410 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:29:26.747 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T06:29:26.764 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:41.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T06:29:41.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T06:29:41.765 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T06:29:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:41.804 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:41.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a5810980 1 Processor -- start 2024-09-13T06:29:41.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a5810980 1 -- start start 2024-09-13T06:29:41.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a5810980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x556fd3a18290 0x556fd3aa63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a5810980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556fd392bae0 con 0x556fd3aa68e0 2024-09-13T06:29:41.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a5810980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x556fd394fe30 con 0x556fd3a18290 2024-09-13T06:29:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a3320640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x556fd3a18290 0x556fd3aa63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a2b1f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x556fd3aa68e0 0x556fd3aa8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49704/0 (socket says 172.21.15.169:49704) 2024-09-13T06:29:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.801+0000 7f86a2b1f640 1 -- 172.21.15.169:0/3136686257 learned_addr learned my addr 172.21.15.169:0/3136686257 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a3320640 1 -- 172.21.15.169:0/3136686257 >> v1:172.21.15.112:6789/0 conn(0x556fd3aa68e0 legacy=0x556fd3aa8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a231e640 1 -- 172.21.15.169:0/3136686257 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930488529 0 0) 0x556fd392bae0 con 0x556fd3aa68e0 2024-09-13T06:29:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a3320640 1 -- 172.21.15.169:0/3136686257 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fd3a18820 con 0x556fd3a18290 2024-09-13T06:29:41.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a3320640 1 --2- 172.21.15.169:0/3136686257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa63a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f869400a480 tx=0x7f869401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9213d1eede2a5d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a231e640 1 -- 172.21.15.169:0/3136686257 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940b0070 con 0x556fd3a18290 2024-09-13T06:29:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a231e640 1 -- 172.21.15.169:0/3136686257 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86940ab540 con 0x556fd3a18290 2024-09-13T06:29:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a231e640 1 -- 172.21.15.169:0/3136686257 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940ab840 con 0x556fd3a18290 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a5810980 1 -- 172.21.15.169:0/3136686257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 msgr2=0x556fd3aa63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.805+0000 7f86a5810980 1 --2- 172.21.15.169:0/3136686257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa63a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f869400a480 tx=0x7f869401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.809+0000 7f86a5810980 1 -- 172.21.15.169:0/3136686257 shutdown_connections 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.809+0000 7f86a5810980 1 --2- 172.21.15.169:0/3136686257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa63a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.809+0000 7f86a5810980 1 -- 172.21.15.169:0/3136686257 >> 172.21.15.169:0/3136686257 conn(0x556fd3a9e090 msgr2=0x556fd3aa04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.809+0000 7f86a5810980 1 -- 172.21.15.169:0/3136686257 shutdown_connections 2024-09-13T06:29:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.809+0000 7f86a5810980 1 -- 172.21.15.169:0/3136686257 wait complete. 2024-09-13T06:29:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.821+0000 7f86a5810980 1 Processor -- start 2024-09-13T06:29:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.821+0000 7f86a5810980 1 -- start start 2024-09-13T06:29:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.821+0000 7f86a5810980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.821+0000 7f86a5810980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556fd3951200 con 0x556fd3a18290 2024-09-13T06:29:41.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56694/0 (socket says 172.21.15.169:56694) 2024-09-13T06:29:41.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 -- 172.21.15.169:0/1145809772 learned_addr learned my addr 172.21.15.169:0/1145809772 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 -- 172.21.15.169:0/1145809772 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fd3aa40d0 con 0x556fd3a18290 2024-09-13T06:29:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 --2- 172.21.15.169:0/1145809772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa3b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8694017e90 tx=0x7f8694003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a230904dbbf7d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f859160a640 1 -- 172.21.15.169:0/1145809772 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940b0070 con 0x556fd3a18290 2024-09-13T06:29:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f859160a640 1 -- 172.21.15.169:0/1145809772 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86940b1040 con 0x556fd3a18290 2024-09-13T06:29:41.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f859160a640 1 -- 172.21.15.169:0/1145809772 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940abc30 con 0x556fd3a18290 2024-09-13T06:29:41.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- 172.21.15.169:0/1145809772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 msgr2=0x556fd3aa3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:41.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 --2- 172.21.15.169:0/1145809772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa3b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8694017e90 tx=0x7f8694003030 comp rx=0 tx=0).stop 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- 172.21.15.169:0/1145809772 shutdown_connections 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 --2- 172.21.15.169:0/1145809772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3aa3b00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- 172.21.15.169:0/1145809772 >> 172.21.15.169:0/1145809772 conn(0x556fd3a9e090 msgr2=0x556fd3b8a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- 172.21.15.169:0/1145809772 shutdown_connections 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- 172.21.15.169:0/1145809772 wait complete. 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 Processor -- start 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- start start 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3b97c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a5810980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556fd3aaaf00 con 0x556fd3a18290 2024-09-13T06:29:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3b97c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3b97c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56702/0 (socket says 172.21.15.169:56702) 2024-09-13T06:29:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.825+0000 7f86a3320640 1 -- 172.21.15.169:0/409465529 learned_addr learned my addr 172.21.15.169:0/409465529 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a3320640 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fd3b98150 con 0x556fd3a18290 2024-09-13T06:29:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a3320640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3b97c10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8694017e90 tx=0x7f8694018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f858fe07640 1 -- 172.21.15.169:0/409465529 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940c6070 con 0x556fd3a18290 2024-09-13T06:29:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f858fe07640 1 -- 172.21.15.169:0/409465529 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86940b78c0 con 0x556fd3a18290 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f858fe07640 1 -- 172.21.15.169:0/409465529 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940b7ba0 con 0x556fd3a18290 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fd3b983e0 con 0x556fd3a18290 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fd3b9b0c0 con 0x556fd3a18290 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f858fe07640 1 -- 172.21.15.169:0/409465529 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86940c9070 con 0x556fd3a18290 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f858fe07640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8588034650 0x7f8588036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f858fe07640 1 -- 172.21.15.169:0/409465529 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f86940bc070 con 0x556fd3a18290 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8588034650 0x7f8588036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3aa68e0 0x556fd3b9eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3b9f210 con 0x556fd3aa68e0 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a3b21640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3aa68e0 0x556fd3b9eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8588034650 0x7f8588036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8698000f90 tx=0x7f8698006590 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a3b21640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3aa68e0 0x556fd3b9eba0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a3b21640 1 -- 172.21.15.169:0/409465529 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3aa68e0 2024-09-13T06:29:41.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3ba0010 0x556fd3ba2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.829+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3ba2a30 con 0x556fd3ba0010 2024-09-13T06:29:41.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a3320640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3ba0010 0x556fd3ba2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a3320640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3ba0010 0x556fd3ba2400 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a3320640 1 -- 172.21.15.169:0/409465529 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86940d2070 con 0x556fd3ba0010 2024-09-13T06:29:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3ba42e0 con 0x556fd3ba0010 2024-09-13T06:29:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a3320640 1 -- 172.21.15.169:0/409465529 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f86940d2070 con 0x556fd3ba0010 2024-09-13T06:29:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3ba3510 con 0x556fd3ba0010 2024-09-13T06:29:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a3320640 1 -- 172.21.15.169:0/409465529 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86940d2070 con 0x556fd3ba0010 2024-09-13T06:29:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3ba5690 0x556fd3ba7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3ba7fc0 con 0x556fd3ba5690 2024-09-13T06:29:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3ba5690 0x556fd3ba7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.833+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3ba5690 0x556fd3ba7a80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a2b1f640 1 -- 172.21.15.169:0/409465529 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f869800f070 con 0x556fd3ba5690 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a5810980 1 Processor -- start 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a5810980 1 -- start start 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a5810980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 0x556fd3bb5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a5810980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556fd39aa800 con 0x556fd3bb59c0 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 0x556fd3bb5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 0x556fd3bb5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56710/0 (socket says 172.21.15.169:56710) 2024-09-13T06:29:41.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a3320640 1 -- 172.21.15.169:0/1664017174 learned_addr learned my addr 172.21.15.169:0/1664017174 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a3320640 1 -- 172.21.15.169:0/1664017174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fd3bb6320 con 0x556fd3bb59c0 2024-09-13T06:29:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a3320640 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 0x556fd3bb5de0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f86940e5080 tx=0x7f86940dcd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f858d602640 1 -- 172.21.15.169:0/1664017174 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940ef020 con 0x556fd3bb59c0 2024-09-13T06:29:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fd3bb65b0 con 0x556fd3bb59c0 2024-09-13T06:29:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f858d602640 1 -- 172.21.15.169:0/1664017174 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86940aaaf0 con 0x556fd3bb59c0 2024-09-13T06:29:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f858d602640 1 -- 172.21.15.169:0/1664017174 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940e3510 con 0x556fd3bb59c0 2024-09-13T06:29:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fd3bb65b0 con 0x556fd3bb59c0 2024-09-13T06:29:41.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f858d602640 1 -- 172.21.15.169:0/1664017174 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86940e36b0 con 0x556fd3bb59c0 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f858d602640 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f857c034650 0x7f857c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.837+0000 7f858d602640 1 -- 172.21.15.169:0/1664017174 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f86940e8070 con 0x556fd3bb59c0 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f857c034650 0x7f857c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 Processor -- start 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- start start 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556fd3aa2230 con 0x556fd3bc2200 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f857c034650 0x7f857c036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86980062e0 tx=0x7f869800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56714/0 (socket says 172.21.15.169:56714) 2024-09-13T06:29:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 -- 172.21.15.169:0/1259885973 learned_addr learned my addr 172.21.15.169:0/1259885973 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 -- 172.21.15.169:0/1259885973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fd3bc2bd0 con 0x556fd3bc2200 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 --2- 172.21.15.169:0/1259885973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc2600 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f86940c2c60 tx=0x7f86940bfac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a5a8dc3b4c0f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f8586ffd640 1 -- 172.21.15.169:0/1259885973 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940d8e20 con 0x556fd3bc2200 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f8586ffd640 1 -- 172.21.15.169:0/1259885973 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86940cc7e0 con 0x556fd3bc2200 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f8586ffd640 1 -- 172.21.15.169:0/1259885973 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940bf370 con 0x556fd3bc2200 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- 172.21.15.169:0/1259885973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 msgr2=0x556fd3bc2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 --2- 172.21.15.169:0/1259885973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc2600 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f86940c2c60 tx=0x7f86940bfac0 comp rx=0 tx=0).stop 2024-09-13T06:29:41.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- 172.21.15.169:0/1259885973 shutdown_connections 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 --2- 172.21.15.169:0/1259885973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc2600 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- 172.21.15.169:0/1259885973 >> 172.21.15.169:0/1259885973 conn(0x556fd3bbe540 msgr2=0x556fd3bbc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- 172.21.15.169:0/1259885973 shutdown_connections 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- 172.21.15.169:0/1259885973 wait complete. 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 Processor -- start 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- start start 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a5810980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556fd3bc2fa0 con 0x556fd3bc2200 2024-09-13T06:29:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56716/0 (socket says 172.21.15.169:56716) 2024-09-13T06:29:41.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.841+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 learned_addr learned my addr 172.21.15.169:0/2628559388 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:41.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fd3bc98d0 con 0x556fd3bc2200 2024-09-13T06:29:41.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3320640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc9390 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f86940eefd0 tx=0x7f86940bee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f85857fa640 1 -- 172.21.15.169:0/2628559388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940bfc00 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f85857fa640 1 -- 172.21.15.169:0/2628559388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86940d8e20 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fd3bc98d0 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f85857fa640 1 -- 172.21.15.169:0/2628559388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86940e3bb0 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fd3bc98d0 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f85857fa640 1 -- 172.21.15.169:0/2628559388 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86940b55b0 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f85857fa640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f856c034650 0x7f856c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f85857fa640 1 -- 172.21.15.169:0/2628559388 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f8694110070 con 0x556fd3bc2200 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f856c034650 0x7f856c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3bd4490 0x556fd3bd6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bd7080 con 0x556fd3bd4490 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3b21640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3bd4490 0x556fd3bd6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f856c034650 0x7f856c036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x556fd3b9c200 tx=0x7f8698024000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3b21640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3bd4490 0x556fd3bd6930 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 realm 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bd3980 con 0x556fd3bd4490 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bd7b50 con 0x556fd3bd4490 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.845+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3bd8730 0x556fd3bdabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bdb360 con 0x556fd3bd8730 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a3320640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3bd8730 0x556fd3bdabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a3320640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3bd8730 0x556fd3bdabf0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:41.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bdbc00 con 0x556fd3bd8730 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 20 searching for the correct realm 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3bdd970 0x556fd3bdfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3bdd970 0x556fd3bdfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a2b1f640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3bdd970 0x556fd3bdfd60 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.849+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3320640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f8694113030 0x7f86940be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x7f8694113030 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f8694113030 0x7f86940be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f8694113030 0x7f86940be2f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.853+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x7f8694113030 2024-09-13T06:29:41.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x7f8694113030 2024-09-13T06:29:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.857+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x7f8694113030 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd4490 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x7f8694113030 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x7f8694113030 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.861+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bdd970 2024-09-13T06:29:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be0370 con 0x556fd3bd8730 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bdc580 con 0x556fd3bd4490 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bdca00 con 0x556fd3bd8730 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bdce20 con 0x556fd3bdd970 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 zone default found 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 4 Realm: () 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 zonegroup default 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be07d0 con 0x7f8694113030 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2a00 con 0x556fd3bdd970 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados->read ofs=0 len=0 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2da0 con 0x556fd3bdd970 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 started sync module instance, tier type = 2024-09-13T06:29:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.865+0000 7f86a5810980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be1e40 con 0x556fd3bd8730 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938782184256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be1e40 con 0x556fd3bd8730 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be3760 con 0x556fd3bd4490 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938782188208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be3fb0 con 0x556fd3bd4490 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.869+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be49b0 con 0x556fd3bd8730 2024-09-13T06:29:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938782184256] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938782188208] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938782181776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be3b00 con 0x556fd3bd8730 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be5250 con 0x7f8694113030 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938782195104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be3b00 con 0x7f8694113030 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be5cd0 con 0x556fd3bd8730 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.873+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938782181776] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938782195104] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938782196160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be57e0 con 0x556fd3bd8730 2024-09-13T06:29:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be6570 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938782200000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be57e0 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be73e0 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.877+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938782196160] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938782200000] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938782203696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be7780 con 0x556fd3bdd970 2024-09-13T06:29:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be7fd0 con 0x7f8694113030 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938782203696] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938782205824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be83c0 con 0x7f8694113030 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=0 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=1 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=2 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=3 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=4 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=5 2024-09-13T06:29:41.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.881+0000 7f86a5810980 20 add_watcher() i=6 2024-09-13T06:29:41.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938782205824] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 20 add_watcher() i=7 2024-09-13T06:29:41.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3beb430 con 0x556fd3bd4490 2024-09-13T06:29:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938782207424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be88c0 con 0x556fd3bd4490 2024-09-13T06:29:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938782207424] v33'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f8559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.885+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf3b60 con 0x556fd3bd8730 2024-09-13T06:29:41.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.889+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.889+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf3bf0 con 0x7f8694113030 2024-09-13T06:29:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.889+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.889+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf4160 con 0x556fd3bdd970 2024-09-13T06:29:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.893+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.893+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf46d0 con 0x556fd3bd4490 2024-09-13T06:29:41.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.893+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'153 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.893+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf4b80 con 0x556fd3bd8730 2024-09-13T06:29:41.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.897+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.897+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf4b80 con 0x556fd3bdd970 2024-09-13T06:29:41.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.897+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.897+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf50f0 con 0x556fd3bd8730 2024-09-13T06:29:41.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.901+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.901+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf50f0 con 0x556fd3bd4490 2024-09-13T06:29:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.901+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.901+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5660 con 0x556fd3bd8730 2024-09-13T06:29:41.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.905+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.905+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5660 con 0x556fd3bd8730 2024-09-13T06:29:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.905+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.905+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5660 con 0x556fd3bd8730 2024-09-13T06:29:41.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.909+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.909+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5660 con 0x556fd3bdd970 2024-09-13T06:29:41.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.909+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.909+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5b10 con 0x556fd3bd8730 2024-09-13T06:29:41.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.913+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.913+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5b10 con 0x556fd3bd4490 2024-09-13T06:29:41.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.913+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.913+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5b10 con 0x556fd3bd4490 2024-09-13T06:29:41.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.917+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.917+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5ba0 con 0x556fd3bd8730 2024-09-13T06:29:41.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.917+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.917+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5ba0 con 0x556fd3bd8730 2024-09-13T06:29:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.921+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.921+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5ba0 con 0x556fd3bdd970 2024-09-13T06:29:41.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.925+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.925+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bd8730 2024-09-13T06:29:41.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.925+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.925+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bd4490 2024-09-13T06:29:41.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.929+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.929+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bd8730 2024-09-13T06:29:41.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.929+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.929+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bd8730 2024-09-13T06:29:41.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.933+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.933+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bdd970 2024-09-13T06:29:41.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.937+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.937+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5d20 con 0x556fd3bd8730 2024-09-13T06:29:41.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.937+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.937+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5d20 con 0x556fd3bdd970 2024-09-13T06:29:41.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.941+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.941+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5cc0 con 0x556fd3bdd970 2024-09-13T06:29:41.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.941+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.941+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bdd970 2024-09-13T06:29:41.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.945+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'21 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.945+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bd8730 2024-09-13T06:29:41.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.949+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.949+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5c30 con 0x556fd3bd4490 2024-09-13T06:29:41.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.949+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.949+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5b10 con 0x556fd3bd8730 2024-09-13T06:29:41.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.953+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.953+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5b10 con 0x556fd3bd4490 2024-09-13T06:29:41.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf5b10 con 0x7f8694113030 2024-09-13T06:29:41.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f8558fe1640 20 reqs_thread_entry: start 2024-09-13T06:29:41.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f86a5810980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:41.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f86a5810980 20 Filter name: none 2024-09-13T06:29:41.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.957+0000 7f84d27fc640 20 reqs_thread_entry: start 2024-09-13T06:29:41.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x7f8694113030 2024-09-13T06:29:41.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x7f8694113030 2024-09-13T06:29:41.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.961+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x7f8694113030 2024-09-13T06:29:41.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:41.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:41.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:41.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:41.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:41.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:41.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:41.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.965+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:41.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:41.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:41.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.969+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.973+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.977+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:41.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:41.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:41.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.981+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:41.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:41.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:41.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.985+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:41.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:41.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:41.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:41.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.989+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:41.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:41.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.993+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:41.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:41.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:41.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:41.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:41.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:42.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd4490 2024-09-13T06:29:42.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:41.997+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd4490 2024-09-13T06:29:42.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:42.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:42.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.001+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:42.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bd8730 2024-09-13T06:29:42.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.005+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bd8730 2024-09-13T06:29:42.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:42.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 43 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 44 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.009+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf2730 con 0x556fd3bdd970 2024-09-13T06:29:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 45 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11940 con 0x556fd3bdd970 2024-09-13T06:29:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 46 ==== osd_op_reply(174 gc.26 [call out=1700b] v0'0 uv20 ondisk = 0) ==== 149+0+1700 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd8730 2024-09-13T06:29:42.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11490 con 0x556fd3bd8730 2024-09-13T06:29:42.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd8730 2024-09-13T06:29:42.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd4490 2024-09-13T06:29:42.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.013+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11490 con 0x556fd3bd4490 2024-09-13T06:29:42.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd4490 2024-09-13T06:29:42.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd8730 2024-09-13T06:29:42.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11490 con 0x556fd3bd8730 2024-09-13T06:29:42.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd8730 2024-09-13T06:29:42.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd4490 2024-09-13T06:29:42.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.017+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11490 con 0x556fd3bd4490 2024-09-13T06:29:42.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x556fd3bd4490 2024-09-13T06:29:42.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x7f8694113030 2024-09-13T06:29:42.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:42.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c11490 con 0x7f8694113030 2024-09-13T06:29:42.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:42.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fd3c124a0 con 0x7f8694113030 2024-09-13T06:29:42.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:42.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f8559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:42.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.021+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938782207424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3bf0dd0 con 0x556fd3bd4490 2024-09-13T06:29:42.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.025+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93938782207424] v33'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.025+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938782184256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be7dc0 con 0x556fd3bd8730 2024-09-13T06:29:42.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.025+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93938782184256] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.025+0000 7f86a5810980 20 remove_watcher() i=0 2024-09-13T06:29:42.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.025+0000 7f86a5810980 2 removed watcher, disabling cache 2024-09-13T06:29:42.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.025+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938782188208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2340 con 0x556fd3bd4490 2024-09-13T06:29:42.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.029+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.1 v2:172.21.15.169:6808/3492903297 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93938782188208] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x556fd3bd4490 2024-09-13T06:29:42.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.029+0000 7f86a5810980 20 remove_watcher() i=1 2024-09-13T06:29:42.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.029+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938782181776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2340 con 0x556fd3bd8730 2024-09-13T06:29:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.033+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93938782181776] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.033+0000 7f86a5810980 20 remove_watcher() i=2 2024-09-13T06:29:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.033+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938782195104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be1990 con 0x7f8694113030 2024-09-13T06:29:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.033+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93938782195104] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.033+0000 7f86a5810980 20 remove_watcher() i=3 2024-09-13T06:29:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.033+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938782196160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2340 con 0x556fd3bd8730 2024-09-13T06:29:42.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a3320640 1 -- 172.21.15.169:0/2628559388 <== osd.0 v2:172.21.15.112:6800/389376018 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93938782196160] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8694119020 con 0x556fd3bd8730 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a5810980 20 remove_watcher() i=4 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938782200000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2340 con 0x556fd3bdd970 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 47 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93938782200000] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a5810980 20 remove_watcher() i=5 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938782203696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be2340 con 0x556fd3bdd970 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a2b1f640 1 -- 172.21.15.169:0/2628559388 <== osd.3 v2:172.21.15.169:6800/747740583 48 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93938782203696] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869800f070 con 0x556fd3bdd970 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a5810980 20 remove_watcher() i=6 2024-09-13T06:29:42.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.037+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938782205824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fd3be6f30 con 0x7f8694113030 2024-09-13T06:29:42.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93938782205824] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f869c0083f0 con 0x7f8694113030 2024-09-13T06:29:42.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 20 remove_watcher() i=7 2024-09-13T06:29:42.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3bd8730 msgr2=0x556fd3bdabf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3bd8730 0x556fd3bdabf0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3bd4490 msgr2=0x556fd3bd6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3bd4490 0x556fd3bd6930 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f8694113030 msgr2=0x7f86940be2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f8694113030 0x7f86940be2f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3bdd970 msgr2=0x556fd3bdfd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3bdd970 0x556fd3bdfd60 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f856c034650 msgr2=0x7f856c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f856c034650 0x7f856c036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x556fd3b9c200 tx=0x7f8698024000 comp rx=0 tx=0).stop 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a3b21640 1 -- 172.21.15.169:0/2628559388 reap_dead start 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 msgr2=0x556fd3bc9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc9390 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f86940eefd0 tx=0x7f86940bee80 comp rx=0 tx=0).stop 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 shutdown_connections 2024-09-13T06:29:42.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/2628559388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bc2200 0x556fd3bc9390 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 >> 172.21.15.169:0/2628559388 conn(0x556fd3bbe540 msgr2=0x556fd3bbc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 shutdown_connections 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/2628559388 wait complete. 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f857c034650 msgr2=0x7f857c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f857c034650 0x7f857c036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86980062e0 tx=0x7f869800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 msgr2=0x556fd3bb5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 0x556fd3bb5de0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f86940e5080 tx=0x7f86940dcd20 comp rx=0 tx=0).stop 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 shutdown_connections 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f857c034650 0x7f857c036b10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/1664017174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3bb59c0 0x556fd3bb5de0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 >> 172.21.15.169:0/1664017174 conn(0x556fd3baab10 msgr2=0x556fd3bad590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 shutdown_connections 2024-09-13T06:29:42.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/1664017174 wait complete. 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3ba0010 msgr2=0x556fd3ba2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x556fd3ba0010 0x556fd3ba2400 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3aa68e0 msgr2=0x556fd3b9eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x556fd3aa68e0 0x556fd3b9eba0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3ba5690 msgr2=0x556fd3ba7a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x556fd3ba5690 0x556fd3ba7a80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8588034650 msgr2=0x7f8588036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8588034650 0x7f8588036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8698000f90 tx=0x7f8698006590 comp rx=0 tx=0).stop 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 msgr2=0x556fd3b97c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a5810980 1 --2- 172.21.15.169:0/409465529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556fd3a18290 0x556fd3b97c10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8694017e90 tx=0x7f8694018020 comp rx=0 tx=0).stop 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.041+0000 7f86a3b21640 1 -- 172.21.15.169:0/409465529 reap_dead start 2024-09-13T06:29:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.045+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 shutdown_connections 2024-09-13T06:29:42.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.045+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 >> 172.21.15.169:0/409465529 conn(0x556fd3a9e090 msgr2=0x556fd3aa2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.045+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 shutdown_connections 2024-09-13T06:29:42.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.045+0000 7f86a5810980 1 -- 172.21.15.169:0/409465529 wait complete. 2024-09-13T06:29:42.059 INFO:teuthology.orchestra.run.smithi169.stdout:[{"tag":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.672627640722241818\u0000","time":"2024-09-13T06:29:41.763300+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_7","key":"","instance":""}]}] 2024-09-13T06:29:42.059 DEBUG:tasks.util.rgw: json result: [{'tag': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.672627640722241818\x00', 'time': '2024-09-13T06:29:41.763300+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_7', 'key': '', 'instance': ''}]}] 2024-09-13T06:29:42.060 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T06:29:42.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T06:29:42.060 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T06:29:42.138 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:42.138 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376e41b980 1 Processor -- start 2024-09-13T06:29:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376e41b980 1 -- start start 2024-09-13T06:29:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376e41b980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x559cc3b1c8d0 0x559cc3b1ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376e41b980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cc39a2ae0 con 0x559cc3b1d220 2024-09-13T06:29:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376e41b980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x559cc39c6e30 con 0x559cc3b1c8d0 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376bf2b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x559cc3b1c8d0 0x559cc3b1ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376b72a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x559cc3b1d220 0x559cc3b21c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49718/0 (socket says 172.21.15.169:49718) 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376b72a640 1 -- 172.21.15.169:0/228211362 learned_addr learned my addr 172.21.15.169:0/228211362 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376af29640 1 -- 172.21.15.169:0/228211362 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173810293 0 0) 0x559cc39a2ae0 con 0x559cc3b1d220 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376af29640 1 -- 172.21.15.169:0/228211362 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f374c001e20 con 0x559cc3b1d220 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376bf2b640 1 -- 172.21.15.169:0/228211362 >> v1:172.21.15.112:6789/0 conn(0x559cc3b1d220 legacy=0x559cc3b21c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.137+0000 7f376bf2b640 1 -- 172.21.15.169:0/228211362 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc3b244a0 con 0x559cc3b1c8d0 2024-09-13T06:29:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376bf2b640 1 --2- 172.21.15.169:0/228211362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3b1ccb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a480 tx=0x7f375c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd729b9ee8df8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376af29640 1 -- 172.21.15.169:0/228211362 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b0070 con 0x559cc3b1c8d0 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376af29640 1 -- 172.21.15.169:0/228211362 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0ab540 con 0x559cc3b1c8d0 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376af29640 1 -- 172.21.15.169:0/228211362 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0ab840 con 0x559cc3b1c8d0 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 -- 172.21.15.169:0/228211362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 msgr2=0x559cc3b1ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 --2- 172.21.15.169:0/228211362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3b1ccb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a480 tx=0x7f375c01b280 comp rx=0 tx=0).stop 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 -- 172.21.15.169:0/228211362 shutdown_connections 2024-09-13T06:29:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 --2- 172.21.15.169:0/228211362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3b1ccb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 -- 172.21.15.169:0/228211362 >> 172.21.15.169:0/228211362 conn(0x559cc3a90220 msgr2=0x559cc3a90630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 -- 172.21.15.169:0/228211362 shutdown_connections 2024-09-13T06:29:42.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.141+0000 7f376e41b980 1 -- 172.21.15.169:0/228211362 wait complete. 2024-09-13T06:29:42.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376e41b980 1 Processor -- start 2024-09-13T06:29:42.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376e41b980 1 -- start start 2024-09-13T06:29:42.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376e41b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c07a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376e41b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559cc39c8200 con 0x559cc3b1c8d0 2024-09-13T06:29:42.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c07a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c07a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56734/0 (socket says 172.21.15.169:56734) 2024-09-13T06:29:42.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376bf2b640 1 -- 172.21.15.169:0/2609133173 learned_addr learned my addr 172.21.15.169:0/2609133173 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376bf2b640 1 -- 172.21.15.169:0/2609133173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc3c08010 con 0x559cc3b1c8d0 2024-09-13T06:29:42.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.157+0000 7f376bf2b640 1 --2- 172.21.15.169:0/2609133173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c07a40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ae040 tx=0x7f375c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8b2ea04519b3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f3658e19640 1 -- 172.21.15.169:0/2609133173 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b0040 con 0x559cc3b1c8d0 2024-09-13T06:29:42.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f3658e19640 1 -- 172.21.15.169:0/2609133173 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0ab9d0 con 0x559cc3b1c8d0 2024-09-13T06:29:42.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f3658e19640 1 -- 172.21.15.169:0/2609133173 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0abcd0 con 0x559cc3b1c8d0 2024-09-13T06:29:42.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/2609133173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 msgr2=0x559cc3c07a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 --2- 172.21.15.169:0/2609133173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c07a40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ae040 tx=0x7f375c003030 comp rx=0 tx=0).stop 2024-09-13T06:29:42.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/2609133173 shutdown_connections 2024-09-13T06:29:42.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 --2- 172.21.15.169:0/2609133173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c07a40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/2609133173 >> 172.21.15.169:0/2609133173 conn(0x559cc3a90220 msgr2=0x559cc3c03670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/2609133173 shutdown_connections 2024-09-13T06:29:42.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/2609133173 wait complete. 2024-09-13T06:29:42.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 Processor -- start 2024-09-13T06:29:42.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- start start 2024-09-13T06:29:42.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c0ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559cc3b23ee0 con 0x559cc3b1c8d0 2024-09-13T06:29:42.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c0ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c0ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56750/0 (socket says 172.21.15.169:56750) 2024-09-13T06:29:42.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376bf2b640 1 -- 172.21.15.169:0/549626673 learned_addr learned my addr 172.21.15.169:0/549626673 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376bf2b640 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc3c0f1b0 con 0x559cc3b1c8d0 2024-09-13T06:29:42.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376bf2b640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c0ec70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f375c018eb0 tx=0x7f375c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f3657616640 1 -- 172.21.15.169:0/549626673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b0070 con 0x559cc3b1c8d0 2024-09-13T06:29:42.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cc3c0f440 con 0x559cc3b1c8d0 2024-09-13T06:29:42.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f3657616640 1 -- 172.21.15.169:0/549626673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0b6870 con 0x559cc3b1c8d0 2024-09-13T06:29:42.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f3657616640 1 -- 172.21.15.169:0/549626673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b6b90 con 0x559cc3b1c8d0 2024-09-13T06:29:42.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.161+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cc3c12120 con 0x559cc3b1c8d0 2024-09-13T06:29:42.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f3657616640 1 -- 172.21.15.169:0/549626673 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f375c0bf3f0 con 0x559cc3b1c8d0 2024-09-13T06:29:42.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f3657616640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f3657616640 1 -- 172.21.15.169:0/549626673 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f375c0bc070 con 0x559cc3b1c8d0 2024-09-13T06:29:42.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376b72a640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3b1d220 0x559cc3c15c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c16250 con 0x559cc3b1d220 2024-09-13T06:29:42.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376c72c640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3b1d220 0x559cc3c15c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376b72a640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3754001dc0 tx=0x7f3754001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376c72c640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3b1d220 0x559cc3c15c00 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376c72c640 1 -- 172.21.15.169:0/549626673 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3b1d220 2024-09-13T06:29:42.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c17040 0x559cc3c19430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c19a60 con 0x559cc3c17040 2024-09-13T06:29:42.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376bf2b640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c17040 0x559cc3c19430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376bf2b640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c17040 0x559cc3c19430 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376bf2b640 1 -- 172.21.15.169:0/549626673 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f375c0b3040 con 0x559cc3c17040 2024-09-13T06:29:42.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.165+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c1b310 con 0x559cc3c17040 2024-09-13T06:29:42.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376bf2b640 1 -- 172.21.15.169:0/549626673 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f375c0b3040 con 0x559cc3c17040 2024-09-13T06:29:42.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c1a540 con 0x559cc3c17040 2024-09-13T06:29:42.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376bf2b640 1 -- 172.21.15.169:0/549626673 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f375c0b3040 con 0x559cc3c17040 2024-09-13T06:29:42.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c1c6c0 0x559cc3c1eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c1eff0 con 0x559cc3c1c6c0 2024-09-13T06:29:42.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376b72a640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c1c6c0 0x559cc3c1eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376b72a640 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c1c6c0 0x559cc3c1eab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376b72a640 1 -- 172.21.15.169:0/549626673 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c1c6c0 2024-09-13T06:29:42.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 Processor -- start 2024-09-13T06:29:42.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 -- start start 2024-09-13T06:29:42.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 0x559cc3c2cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376e41b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559cc3a21800 con 0x559cc3c2c9b0 2024-09-13T06:29:42.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 0x559cc3c2cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 0x559cc3c2cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56762/0 (socket says 172.21.15.169:56762) 2024-09-13T06:29:42.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376bf2b640 1 -- 172.21.15.169:0/3256186471 learned_addr learned my addr 172.21.15.169:0/3256186471 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.169+0000 7f376bf2b640 1 -- 172.21.15.169:0/3256186471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc3c2d310 con 0x559cc3c2c9b0 2024-09-13T06:29:42.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376bf2b640 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 0x559cc3c2cdd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f375c0e4010 tx=0x7f375c0e4170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f3654e11640 1 -- 172.21.15.169:0/3256186471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0e1130 con 0x559cc3c2c9b0 2024-09-13T06:29:42.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f3654e11640 1 -- 172.21.15.169:0/3256186471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0e12d0 con 0x559cc3c2c9b0 2024-09-13T06:29:42.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f3654e11640 1 -- 172.21.15.169:0/3256186471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b4a50 con 0x559cc3c2c9b0 2024-09-13T06:29:42.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cc3c2d5a0 con 0x559cc3c2c9b0 2024-09-13T06:29:42.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cc3c30220 con 0x559cc3c2c9b0 2024-09-13T06:29:42.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f3654e11640 1 -- 172.21.15.169:0/3256186471 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f375c0eb060 con 0x559cc3c2c9b0 2024-09-13T06:29:42.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f3654e11640 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3644034650 0x7f3644036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f3654e11640 1 -- 172.21.15.169:0/3256186471 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f375c0a8070 con 0x559cc3c2c9b0 2024-09-13T06:29:42.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376b72a640 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3644034650 0x7f3644036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376e41b980 1 Processor -- start 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376e41b980 1 -- start start 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376e41b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c39770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376e41b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559cc3c082d0 con 0x559cc3c39390 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376b72a640 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3644034650 0x7f3644036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f375400bfe0 tx=0x7f375400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c39770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c39770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56772/0 (socket says 172.21.15.169:56772) 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376bf2b640 1 -- 172.21.15.169:0/553677039 learned_addr learned my addr 172.21.15.169:0/553677039 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376bf2b640 1 -- 172.21.15.169:0/553677039 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc3c39d40 con 0x559cc3c39390 2024-09-13T06:29:42.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.173+0000 7f376bf2b640 1 --2- 172.21.15.169:0/553677039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c39770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f375c0db9d0 tx=0x7f375c0db5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06f88f9b3589a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f364e7fc640 1 -- 172.21.15.169:0/553677039 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0fb020 con 0x559cc3c39390 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f364e7fc640 1 -- 172.21.15.169:0/553677039 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0b5920 con 0x559cc3c39390 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f364e7fc640 1 -- 172.21.15.169:0/553677039 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b5b80 con 0x559cc3c39390 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/553677039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 msgr2=0x559cc3c39770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 --2- 172.21.15.169:0/553677039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c39770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f375c0db9d0 tx=0x7f375c0db5e0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/553677039 shutdown_connections 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 --2- 172.21.15.169:0/553677039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c39770 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/553677039 >> 172.21.15.169:0/553677039 conn(0x559cc3c356d0 msgr2=0x559cc3c33820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/553677039 shutdown_connections 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/553677039 wait complete. 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 Processor -- start 2024-09-13T06:29:42.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- start start 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559cc3c3a130 con 0x559cc3c39390 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376bf2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56782/0 (socket says 172.21.15.169:56782) 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 learned_addr learned my addr 172.21.15.169:0/4195780699 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc3c409e0 con 0x559cc3c39390 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376bf2b640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c404a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ebfa0 tx=0x7f375c0d2f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f364cff9640 1 -- 172.21.15.169:0/4195780699 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c106070 con 0x559cc3c39390 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f364cff9640 1 -- 172.21.15.169:0/4195780699 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0dba40 con 0x559cc3c39390 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cc3c409e0 con 0x559cc3c39390 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f364cff9640 1 -- 172.21.15.169:0/4195780699 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0fb040 con 0x559cc3c39390 2024-09-13T06:29:42.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.177+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cc3c409e0 con 0x559cc3c39390 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f364cff9640 1 -- 172.21.15.169:0/4195780699 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f375c0f6070 con 0x559cc3c39390 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f364cff9640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3634034650 0x7f3634036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f364cff9640 1 -- 172.21.15.169:0/4195780699 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f375c10bbd0 con 0x559cc3c39390 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376b72a640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3634034650 0x7f3634036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3c4b4d0 0x559cc3c4d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c4e0e0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376c72c640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3c4b4d0 0x559cc3c4d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376b72a640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3634034650 0x7f3634036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x559cc3c13260 tx=0x7f3754010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376c72c640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3c4b4d0 0x559cc3c4d990 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 realm 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c4a900 con 0x559cc3c4b4d0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c4eba0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c4f980 0x559cc3c51d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c52400 con 0x559cc3c4f980 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376bf2b640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c4f980 0x559cc3c51d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.181+0000 7f376bf2b640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c4f980 0x559cc3c51d70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c52c50 con 0x559cc3c4f980 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 20 searching for the correct realm 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c549c0 0x559cc3c56db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376b72a640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c549c0 0x559cc3c56db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376b72a640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c549c0 0x559cc3c56db0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376bf2b640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f375c0ed070 0x7f375c0eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x7f375c0ed070 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376c72c640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f375c0ed070 0x7f375c0eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376c72c640 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f375c0ed070 0x7f375c0eb7b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.185+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x7f375c0ed070 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x7f375c0ed070 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.189+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x7f375c0ed070 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4b4d0 2024-09-13T06:29:42.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x7f375c0ed070 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x7f375c0ed070 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.193+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c549c0 2024-09-13T06:29:42.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57430 con 0x559cc3c4f980 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c535a0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c53e40 con 0x559cc3c4f980 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.197+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c531e0 con 0x559cc3c549c0 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 zone default found 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 4 Realm: () 2024-09-13T06:29:42.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 zonegroup default 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c57d40 con 0x7f375c0ed070 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c59ac0 con 0x559cc3c549c0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c59f40 con 0x559cc3c549c0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 started sync module instance, tier type = 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c58f60 con 0x559cc3c4f980 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94131787764832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c58f60 con 0x559cc3c4f980 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.201+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5a9c0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94131787769104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5b260 con 0x559cc3c4b4d0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5bc60 con 0x559cc3c4f980 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94131787769104] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94131787764832] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94131787762352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5adb0 con 0x559cc3c4f980 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.205+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5c500 con 0x7f375c0ed070 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94131787776080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5adb0 con 0x7f375c0ed070 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5cfa0 con 0x559cc3c4f980 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94131787762352] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94131787776080] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94131787777136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5cf60 con 0x559cc3c4f980 2024-09-13T06:29:42.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d3c0 con 0x559cc3c549c0 2024-09-13T06:29:42.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94131787773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5dc60 con 0x559cc3c549c0 2024-09-13T06:29:42.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5e620 con 0x559cc3c549c0 2024-09-13T06:29:42.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.209+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94131787777136] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94131787784560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5e590 con 0x559cc3c549c0 2024-09-13T06:29:42.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5f4e0 con 0x7f375c0ed070 2024-09-13T06:29:42.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94131787773808] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94131787784560] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94131787786768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5f030 con 0x7f375c0ed070 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=0 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=1 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=2 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=3 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=4 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=5 2024-09-13T06:29:42.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=6 2024-09-13T06:29:42.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94131787786768] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 20 add_watcher() i=7 2024-09-13T06:29:42.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:42.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5f030 con 0x559cc3c4b4d0 2024-09-13T06:29:42.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.213+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94131787782064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5fbe0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94131787782064] v33'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f36217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:42.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f376e41b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:42.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f376e41b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:42.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6ad40 con 0x559cc3c4f980 2024-09-13T06:29:42.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.217+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6adc0 con 0x7f375c0ed070 2024-09-13T06:29:42.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.221+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.221+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6b4b0 con 0x559cc3c549c0 2024-09-13T06:29:42.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.221+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.221+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6ba20 con 0x559cc3c4b4d0 2024-09-13T06:29:42.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.225+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'158 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.225+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6bde0 con 0x559cc3c4f980 2024-09-13T06:29:42.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.225+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.225+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6a780 con 0x559cc3c549c0 2024-09-13T06:29:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.229+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.229+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c460 con 0x559cc3c4f980 2024-09-13T06:29:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.229+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.229+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c460 con 0x559cc3c4b4d0 2024-09-13T06:29:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.229+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.229+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x559cc3c4f980 2024-09-13T06:29:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.233+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.233+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x559cc3c4f980 2024-09-13T06:29:42.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.237+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.237+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x559cc3c4f980 2024-09-13T06:29:42.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.237+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.237+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x559cc3c549c0 2024-09-13T06:29:42.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.241+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.241+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6cfc0 con 0x559cc3c4f980 2024-09-13T06:29:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.241+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.241+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6cfc0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.241+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.241+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d050 con 0x559cc3c4b4d0 2024-09-13T06:29:42.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.245+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.245+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d0e0 con 0x559cc3c4f980 2024-09-13T06:29:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.249+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.249+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d0e0 con 0x559cc3c4f980 2024-09-13T06:29:42.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.249+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.249+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d0e0 con 0x559cc3c549c0 2024-09-13T06:29:42.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.253+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.253+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d170 con 0x559cc3c4f980 2024-09-13T06:29:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.253+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.253+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d170 con 0x559cc3c4b4d0 2024-09-13T06:29:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.257+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.257+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d170 con 0x559cc3c4f980 2024-09-13T06:29:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.257+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.257+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d170 con 0x559cc3c4f980 2024-09-13T06:29:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.261+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.261+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d170 con 0x559cc3c549c0 2024-09-13T06:29:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.261+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.261+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d240 con 0x559cc3c4f980 2024-09-13T06:29:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.265+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.265+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d240 con 0x559cc3c549c0 2024-09-13T06:29:42.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.265+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.265+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d240 con 0x559cc3c549c0 2024-09-13T06:29:42.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.269+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.269+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d240 con 0x559cc3c549c0 2024-09-13T06:29:42.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.269+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'22 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.269+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d240 con 0x559cc3c4f980 2024-09-13T06:29:42.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.273+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.273+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6d240 con 0x559cc3c4b4d0 2024-09-13T06:29:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.273+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.273+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x559cc3c4f980 2024-09-13T06:29:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.277+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.277+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.277+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.277+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c6c9f0 con 0x7f375c0ed070 2024-09-13T06:29:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f359bfff640 20 reqs_thread_entry: start 2024-09-13T06:29:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376e41b980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376e41b980 20 Filter name: none 2024-09-13T06:29:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f3599ffb640 20 reqs_thread_entry: start 2024-09-13T06:29:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T06:29:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:94 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(94 gc.2 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.281+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:95 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(95 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(96 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:97 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(97 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:98 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(98 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:99 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(99 gc.2 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T06:29:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.285+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:100 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(100 gc.3 [call] v33'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:101 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(101 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:102 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(102 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(104 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.289+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(105 gc.3 [call] v33'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T06:29:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(106 gc.4 [call] v33'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(107 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.293+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(108 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:109 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(109 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:110 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(110 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.297+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:111 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(111 gc.4 [call] v33'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T06:29:42.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:112 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(112 gc.5 [call] v33'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:113 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(113 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:114 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(114 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:115 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(115 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:116 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(116 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.301+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:117 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(117 gc.5 [call] v33'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T06:29:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:118 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(118 gc.6 [call] v33'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:119 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(119 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.305+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:120 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(120 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:121 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(121 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:122 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(122 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.309+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:123 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(123 gc.6 [call] v33'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T06:29:42.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:124 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(124 gc.7 [call] v33'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:125 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(125 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:126 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(126 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:127 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(127 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:128 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(128 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.313+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:129 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.317+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(129 gc.7 [call] v33'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.317+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T06:29:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.317+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:130 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.317+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(130 gc.8 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.317+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:131 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(131 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:132 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(132 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:133 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(133 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:134 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== osd_op_reply(134 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.321+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:135 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(135 gc.8 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T06:29:42.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:136 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== osd_op_reply(136 gc.9 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:137 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(137 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.325+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:138 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(138 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:139 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 55 ==== osd_op_reply(139 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:140 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 56 ==== osd_op_reply(140 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.329+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:141 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.333+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 57 ==== osd_op_reply(141 gc.9 [call] v33'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.333+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T06:29:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.333+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.333+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 58 ==== osd_op_reply(142 gc.10 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.333+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:143 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 59 ==== osd_op_reply(143 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:144 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 60 ==== osd_op_reply(144 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:145 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 61 ==== osd_op_reply(145 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:146 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 62 ==== osd_op_reply(146 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.337+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:147 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 63 ==== osd_op_reply(147 gc.10 [call] v33'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T06:29:42.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:148 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(148 gc.11 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:149 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== osd_op_reply(149 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:150 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(150 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:151 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== osd_op_reply(151 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:152 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(152 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.341+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:153 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.345+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== osd_op_reply(153 gc.11 [call] v33'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.345+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T06:29:42.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.345+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:154 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.345+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 64 ==== osd_op_reply(154 gc.12 [call] v33'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:155 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 65 ==== osd_op_reply(155 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:156 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 66 ==== osd_op_reply(156 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:157 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 67 ==== osd_op_reply(157 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:158 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 68 ==== osd_op_reply(158 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.349+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:159 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.353+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 69 ==== osd_op_reply(159 gc.12 [call] v33'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.353+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T06:29:42.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.353+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:160 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.353+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(160 gc.13 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.353+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:161 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(161 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:162 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== osd_op_reply(162 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:163 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(163 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:164 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== osd_op_reply(164 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:165 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(165 gc.13 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T06:29:42.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.357+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:166 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(166 gc.14 [call] v33'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:167 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(167 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:168 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(168 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:169 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 47 ==== osd_op_reply(169 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:170 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 48 ==== osd_op_reply(170 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.361+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:171 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.365+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 49 ==== osd_op_reply(171 gc.14 [call] v33'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.365+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T06:29:42.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.365+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:172 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 70 ==== osd_op_reply(172 gc.15 [call] v33'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:173 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 71 ==== osd_op_reply(173 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:174 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 72 ==== osd_op_reply(174 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:175 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 73 ==== osd_op_reply(175 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:176 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 74 ==== osd_op_reply(176 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.369+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:177 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.373+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 75 ==== osd_op_reply(177 gc.15 [call] v33'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.373+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T06:29:42.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.373+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:178 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.373+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 76 ==== osd_op_reply(178 gc.16 [call] v33'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.373+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:179 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 77 ==== osd_op_reply(179 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:180 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 78 ==== osd_op_reply(180 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:181 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 79 ==== osd_op_reply(181 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:182 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 80 ==== osd_op_reply(182 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.377+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:183 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.381+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 81 ==== osd_op_reply(183 gc.16 [call] v33'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.381+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T06:29:42.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.381+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:184 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.381+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(184 gc.17 [call] v33'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.381+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:185 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(185 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:186 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 43 ==== osd_op_reply(186 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:187 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 44 ==== osd_op_reply(187 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:188 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 45 ==== osd_op_reply(188 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:189 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 46 ==== osd_op_reply(189 gc.17 [call] v33'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T06:29:42.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.385+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:190 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 82 ==== osd_op_reply(190 gc.18 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:191 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 83 ==== osd_op_reply(191 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:192 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 84 ==== osd_op_reply(192 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.389+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:193 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.393+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 85 ==== osd_op_reply(193 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.393+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.393+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:194 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.393+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 86 ==== osd_op_reply(194 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.393+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.393+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:195 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 87 ==== osd_op_reply(195 gc.18 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T06:29:42.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:196 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 50 ==== osd_op_reply(196 gc.19 [call] v33'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:197 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 51 ==== osd_op_reply(197 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:198 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 52 ==== osd_op_reply(198 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:199 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 53 ==== osd_op_reply(199 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:200 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 54 ==== osd_op_reply(200 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.397+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:201 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.401+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 55 ==== osd_op_reply(201 gc.19 [call] v33'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.401+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T06:29:42.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.401+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:202 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 88 ==== osd_op_reply(202 gc.20 [call] v33'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:203 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 89 ==== osd_op_reply(203 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:204 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 90 ==== osd_op_reply(204 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:205 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 91 ==== osd_op_reply(205 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.405+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:206 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.409+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 92 ==== osd_op_reply(206 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.409+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.409+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:207 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.409+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 93 ==== osd_op_reply(207 gc.20 [call] v33'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.409+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T06:29:42.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.409+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:208 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 94 ==== osd_op_reply(208 gc.21 [call] v33'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:209 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 95 ==== osd_op_reply(209 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:210 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 96 ==== osd_op_reply(210 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:211 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 97 ==== osd_op_reply(211 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:212 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 98 ==== osd_op_reply(212 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.413+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:213 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.417+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 99 ==== osd_op_reply(213 gc.21 [call] v33'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.417+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T06:29:42.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.417+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:214 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.417+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 47 ==== osd_op_reply(214 gc.22 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.417+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:215 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.417+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 48 ==== osd_op_reply(215 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:216 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 49 ==== osd_op_reply(216 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:217 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 50 ==== osd_op_reply(217 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:218 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 51 ==== osd_op_reply(218 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:219 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 52 ==== osd_op_reply(219 gc.22 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T06:29:42.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.421+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:220 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 100 ==== osd_op_reply(220 gc.23 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:221 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 101 ==== osd_op_reply(221 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:222 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 102 ==== osd_op_reply(222 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:223 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.425+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 103 ==== osd_op_reply(223 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:224 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 104 ==== osd_op_reply(224 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:225 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 105 ==== osd_op_reply(225 gc.23 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T06:29:42.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.429+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:226 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 53 ==== osd_op_reply(226 gc.24 [call] v33'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:227 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 54 ==== osd_op_reply(227 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:228 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 55 ==== osd_op_reply(228 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.433+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:229 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 56 ==== osd_op_reply(229 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:230 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 57 ==== osd_op_reply(230 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:231 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 58 ==== osd_op_reply(231 gc.24 [call] v33'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T06:29:42.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.437+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:232 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 59 ==== osd_op_reply(232 gc.25 [call] v33'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:233 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 60 ==== osd_op_reply(233 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:234 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 61 ==== osd_op_reply(234 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:235 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 62 ==== osd_op_reply(235 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.441+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:236 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.445+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 63 ==== osd_op_reply(236 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.445+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.445+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:237 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.445+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 64 ==== osd_op_reply(237 gc.25 [call] v33'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.445+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T06:29:42.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.445+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:238 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 65 ==== osd_op_reply(238 gc.26 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:239 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 66 ==== osd_op_reply(239 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:240 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c549c0 2024-09-13T06:29:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 67 ==== osd_op_reply(240 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:241 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 68 ==== osd_op_reply(241 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:242 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 69 ==== osd_op_reply(242 gc.26 [call out=1700b] v0'0 uv23 ondisk = 0) ==== 149+0+1700 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 20 garbage collection: RGWGC::process iterating over entry tag='8744f35f-8918-4410-a77e-3a3ac7b40446.4225.672627640722241818', time=2024-09-13T06:29:41.763300+0000, chain.objs.size()=7 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_1 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:243 3.22 3:47652e03:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89e40 con 0x559cc3c549c0 2024-09-13T06:29:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_2 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:244 3.11 3:882301aa:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c8ca80 con 0x559cc3c4f980 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_3 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:245 3.31 3:8d611725:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c8f3e0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_4 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:246 3.20 3:04daecfe:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c91ca0 con 0x7f375c0ed070 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_5 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:247 3.27 3:e4f5b6ed:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c94510 con 0x559cc3c549c0 2024-09-13T06:29:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_6 2024-09-13T06:29:42.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:248 3.2f 3:f64714eb:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c91ca0 con 0x559cc3c549c0 2024-09-13T06:29:42.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_7 2024-09-13T06:29:42.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.449+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:249 3.28 3:14dc5570:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c91ca0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.457+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 70 ==== osd_op_reply(248 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_6 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.457+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 71 ==== osd_op_reply(243 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_1 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.457+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 56 ==== osd_op_reply(245 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_3 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.461+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(246 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_4 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.461+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 72 ==== osd_op_reply(247 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_5 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.461+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 57 ==== osd_op_reply(249 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_7 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.461+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 106 ==== osd_op_reply(244 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.1__shadow_.Zz3uGN7ByoFC-sBaZ65_DudRUtrx5Fq_2 [call] v33'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.461+0000 7f376e41b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T06:29:42.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.461+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:250 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.465+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 73 ==== osd_op_reply(250 gc.26 [call] v33'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.465+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:251 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c549c0 2024-09-13T06:29:42.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.465+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 74 ==== osd_op_reply(251 gc.26 [call] v33'25 uv25 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.465+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T06:29:42.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.465+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:252 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 107 ==== osd_op_reply(252 gc.27 [call] v33'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:253 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 108 ==== osd_op_reply(253 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:254 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 109 ==== osd_op_reply(254 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:255 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 110 ==== osd_op_reply(255 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.469+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:256 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.473+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 111 ==== osd_op_reply(256 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.473+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.473+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:257 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.473+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 112 ==== osd_op_reply(257 gc.27 [call] v33'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.473+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T06:29:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.473+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:258 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 58 ==== osd_op_reply(258 gc.28 [call] v33'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:259 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 59 ==== osd_op_reply(259 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:260 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 60 ==== osd_op_reply(260 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:261 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 61 ==== osd_op_reply(261 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:262 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 62 ==== osd_op_reply(262 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.477+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:263 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 63 ==== osd_op_reply(263 gc.28 [call] v33'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T06:29:42.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:264 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 113 ==== osd_op_reply(264 gc.29 [call] v33'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:265 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 114 ==== osd_op_reply(265 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.481+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:266 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 115 ==== osd_op_reply(266 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:267 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 116 ==== osd_op_reply(267 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:268 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 117 ==== osd_op_reply(268 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.485+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:269 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 118 ==== osd_op_reply(269 gc.29 [call] v33'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T06:29:42.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:270 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 64 ==== osd_op_reply(270 gc.30 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:271 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 65 ==== osd_op_reply(271 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:272 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4b4d0 2024-09-13T06:29:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 66 ==== osd_op_reply(272 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.489+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:273 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 67 ==== osd_op_reply(273 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:274 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 68 ==== osd_op_reply(274 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:275 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 69 ==== osd_op_reply(275 gc.30 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T06:29:42.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.493+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:276 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(276 gc.31 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:277 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(277 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:278 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x7f375c0ed070 2024-09-13T06:29:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(278 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:279 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(279 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:280 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(280 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:281 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(281 gc.31 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T06:29:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.497+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:282 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 119 ==== osd_op_reply(282 gc.0 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:283 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 120 ==== osd_op_reply(283 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:284 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x559cc3c4f980 2024-09-13T06:29:42.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 121 ==== osd_op_reply(284 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.501+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:285 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 122 ==== osd_op_reply(285 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:286 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 123 ==== osd_op_reply(286 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:287 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x559cc3c4f980 2024-09-13T06:29:42.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 124 ==== osd_op_reply(287 gc.0 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376e41b980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T06:29:42.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.505+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:288 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(288 gc.1 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:289 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== osd_op_reply(289 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:290 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c88980 con 0x7f375c0ed070 2024-09-13T06:29:42.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== osd_op_reply(290 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.509+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:291 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 24 ==== osd_op_reply(291 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:29:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:292 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 25 ==== osd_op_reply(292 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376e41b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:29:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:293 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c89990 con 0x7f375c0ed070 2024-09-13T06:29:42.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.513+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 26 ==== osd_op_reply(293 gc.1 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.517+0000 7f36217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:42.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.517+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94131787782064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c48990 con 0x559cc3c4b4d0 2024-09-13T06:29:42.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.517+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 70 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94131787782064] v33'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.517+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94131787764832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d7b0 con 0x559cc3c4f980 2024-09-13T06:29:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 125 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94131787764832] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376e41b980 20 remove_watcher() i=0 2024-09-13T06:29:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376e41b980 2 removed watcher, disabling cache 2024-09-13T06:29:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94131787769104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d7b0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.1 v2:172.21.15.169:6808/3492903297 71 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94131787769104] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x559cc3c4b4d0 2024-09-13T06:29:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376e41b980 20 remove_watcher() i=1 2024-09-13T06:29:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.521+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94131787762352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d7b0 con 0x559cc3c4f980 2024-09-13T06:29:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.525+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 126 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94131787762352] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.525+0000 7f376e41b980 20 remove_watcher() i=2 2024-09-13T06:29:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.525+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94131787776080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c58ab0 con 0x7f375c0ed070 2024-09-13T06:29:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.525+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 27 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94131787776080] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.525+0000 7f376e41b980 20 remove_watcher() i=3 2024-09-13T06:29:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.525+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94131787777136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d7b0 con 0x559cc3c4f980 2024-09-13T06:29:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.529+0000 7f376bf2b640 1 -- 172.21.15.169:0/4195780699 <== osd.0 v2:172.21.15.112:6800/389376018 127 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94131787777136] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c111070 con 0x559cc3c4f980 2024-09-13T06:29:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.529+0000 7f376e41b980 20 remove_watcher() i=4 2024-09-13T06:29:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.529+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94131787773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d7b0 con 0x559cc3c549c0 2024-09-13T06:29:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.533+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 75 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94131787773808] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.533+0000 7f376e41b980 20 remove_watcher() i=5 2024-09-13T06:29:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.533+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94131787784560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5d7b0 con 0x559cc3c549c0 2024-09-13T06:29:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.533+0000 7f376b72a640 1 -- 172.21.15.169:0/4195780699 <== osd.3 v2:172.21.15.169:6800/747740583 76 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94131787784560] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375400e6e0 con 0x559cc3c549c0 2024-09-13T06:29:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.533+0000 7f376e41b980 20 remove_watcher() i=6 2024-09-13T06:29:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.533+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94131787786768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559cc3c5e170 con 0x7f375c0ed070 2024-09-13T06:29:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 <== osd.2 v2:172.21.15.169:6816/1749135367 28 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94131787786768] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376400a4d0 con 0x7f375c0ed070 2024-09-13T06:29:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 20 remove_watcher() i=7 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c4f980 msgr2=0x559cc3c51d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c4f980 0x559cc3c51d70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3c4b4d0 msgr2=0x559cc3c4d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3c4b4d0 0x559cc3c4d990 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f375c0ed070 msgr2=0x7f375c0eb7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f375c0ed070 0x7f375c0eb7b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c549c0 msgr2=0x559cc3c56db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c549c0 0x559cc3c56db0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3634034650 msgr2=0x7f3634036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3634034650 0x7f3634036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x559cc3c13260 tx=0x7f3754010000 comp rx=0 tx=0).stop 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376c72c640 1 -- 172.21.15.169:0/4195780699 reap_dead start 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 msgr2=0x559cc3c404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c404a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ebfa0 tx=0x7f375c0d2f00 comp rx=0 tx=0).stop 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 shutdown_connections 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/4195780699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c39390 0x559cc3c404a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 >> 172.21.15.169:0/4195780699 conn(0x559cc3c356d0 msgr2=0x559cc3c33790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 shutdown_connections 2024-09-13T06:29:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/4195780699 wait complete. 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3644034650 msgr2=0x7f3644036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3644034650 0x7f3644036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f375400bfe0 tx=0x7f375400f000 comp rx=0 tx=0).stop 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 msgr2=0x559cc3c2cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 0x559cc3c2cdd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f375c0e4010 tx=0x7f375c0e4170 comp rx=0 tx=0).stop 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 shutdown_connections 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3644034650 0x7f3644036b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/3256186471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3c2c9b0 0x559cc3c2cdd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 >> 172.21.15.169:0/3256186471 conn(0x559cc3c21b00 msgr2=0x559cc3c24580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 shutdown_connections 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/3256186471 wait complete. 2024-09-13T06:29:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c17040 msgr2=0x559cc3c19430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559cc3c17040 0x559cc3c19430 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3b1d220 msgr2=0x559cc3c15c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559cc3b1d220 0x559cc3c15c00 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c1c6c0 msgr2=0x559cc3c1eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559cc3c1c6c0 0x559cc3c1eab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 msgr2=0x7f3650036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3754001dc0 tx=0x7f3754001360 comp rx=0 tx=0).stop 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 msgr2=0x559cc3c0ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 --2- 172.21.15.169:0/549626673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559cc3b1c8d0 0x559cc3c0ec70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f375c018eb0 tx=0x7f375c018020 comp rx=0 tx=0).stop 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376c72c640 1 -- 172.21.15.169:0/549626673 reap_dead start 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 shutdown_connections 2024-09-13T06:29:42.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 >> 172.21.15.169:0/549626673 conn(0x559cc3a90220 msgr2=0x559cc3c021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 shutdown_connections 2024-09-13T06:29:42.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.537+0000 7f376e41b980 1 -- 172.21.15.169:0/549626673 wait complete. 2024-09-13T06:29:42.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T06:29:42.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T06:29:42.561 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T06:29:42.638 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:42.638 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:42.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb27e3a980 1 Processor -- start 2024-09-13T06:29:42.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb27e3a980 1 -- start start 2024-09-13T06:29:42.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb27e3a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f152b6e9d0 0x55f152b70dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb27e3a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1529f2ae0 con 0x55f152b6a650 2024-09-13T06:29:42.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb27e3a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55f152a16e30 con 0x55f152b6e9d0 2024-09-13T06:29:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb25149640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f152b6e9d0 0x55f152b70dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb2594a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55f152b6a650 0x55f152b6aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49728/0 (socket says 172.21.15.169:49728) 2024-09-13T06:29:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb2594a640 1 -- 172.21.15.169:0/1411852714 learned_addr learned my addr 172.21.15.169:0/1411852714 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb24948640 1 -- 172.21.15.169:0/1411852714 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228620198 0 0) 0x55f1529f2ae0 con 0x55f152b6a650 2024-09-13T06:29:42.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb24948640 1 -- 172.21.15.169:0/1411852714 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb10001e20 con 0x55f152b6a650 2024-09-13T06:29:42.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb25149640 1 -- 172.21.15.169:0/1411852714 >> v1:172.21.15.112:6789/0 conn(0x55f152b6a650 legacy=0x55f152b6aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.637+0000 7fdb25149640 1 -- 172.21.15.169:0/1411852714 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f152b72310 con 0x55f152b6e9d0 2024-09-13T06:29:42.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb25149640 1 --2- 172.21.15.169:0/1411852714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6e9d0 0x55f152b70dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a480 tx=0x7fdb1c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719c5633d74f43d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb24948640 1 -- 172.21.15.169:0/1411852714 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0b0070 con 0x55f152b6e9d0 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb24948640 1 -- 172.21.15.169:0/1411852714 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0ab540 con 0x55f152b6e9d0 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb24948640 1 -- 172.21.15.169:0/1411852714 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0ab820 con 0x55f152b6e9d0 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1411852714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6e9d0 msgr2=0x55f152b70dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1411852714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6e9d0 0x55f152b70dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a480 tx=0x7fdb1c01b280 comp rx=0 tx=0).stop 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1411852714 shutdown_connections 2024-09-13T06:29:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1411852714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6e9d0 0x55f152b70dc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1411852714 >> 172.21.15.169:0/1411852714 conn(0x55f152b66170 msgr2=0x55f152b68590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1411852714 shutdown_connections 2024-09-13T06:29:42.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.641+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1411852714 wait complete. 2024-09-13T06:29:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb27e3a980 1 Processor -- start 2024-09-13T06:29:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb27e3a980 1 -- start start 2024-09-13T06:29:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb27e3a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c55830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb27e3a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f152a18200 con 0x55f152b6a650 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c55830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c55830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56798/0 (socket says 172.21.15.169:56798) 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.657+0000 7fdb2594a640 1 -- 172.21.15.169:0/2262275676 learned_addr learned my addr 172.21.15.169:0/2262275676 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 -- 172.21.15.169:0/2262275676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f152c55e00 con 0x55f152b6a650 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 --2- 172.21.15.169:0/2262275676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c55830 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdb20006fc0 tx=0x7fdb20001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd38bde13b9bc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fda13e07640 1 -- 172.21.15.169:0/2262275676 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20004530 con 0x55f152b6a650 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fda13e07640 1 -- 172.21.15.169:0/2262275676 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb200046d0 con 0x55f152b6a650 2024-09-13T06:29:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fda13e07640 1 -- 172.21.15.169:0/2262275676 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20004a70 con 0x55f152b6a650 2024-09-13T06:29:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2262275676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 msgr2=0x55f152c55830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2262275676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c55830 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdb20006fc0 tx=0x7fdb20001af0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2262275676 shutdown_connections 2024-09-13T06:29:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2262275676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c55830 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2262275676 >> 172.21.15.169:0/2262275676 conn(0x55f152b66170 msgr2=0x55f152c51460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2262275676 shutdown_connections 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2262275676 wait complete. 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 Processor -- start 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- start start 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c5cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb27e3a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f152b71e10 con 0x55f152b6a650 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c5cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c5cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56804/0 (socket says 172.21.15.169:56804) 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 -- 172.21.15.169:0/1077850777 learned_addr learned my addr 172.21.15.169:0/1077850777 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f152c5d120 con 0x55f152b6a650 2024-09-13T06:29:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.661+0000 7fdb2594a640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c5cbe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdb20002260 tx=0x7fdb20000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fda12604640 1 -- 172.21.15.169:0/1077850777 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20013760 con 0x55f152b6a650 2024-09-13T06:29:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fda12604640 1 -- 172.21.15.169:0/1077850777 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20013900 con 0x55f152b6a650 2024-09-13T06:29:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f152c5d3b0 con 0x55f152b6a650 2024-09-13T06:29:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fda12604640 1 -- 172.21.15.169:0/1077850777 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20013c00 con 0x55f152b6a650 2024-09-13T06:29:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f152c60090 con 0x55f152b6a650 2024-09-13T06:29:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fda12604640 1 -- 172.21.15.169:0/1077850777 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb20010070 con 0x55f152b6a650 2024-09-13T06:29:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fda12604640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda0c034650 0x7fda0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fda12604640 1 -- 172.21.15.169:0/1077850777 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fdb20018070 con 0x55f152b6a650 2024-09-13T06:29:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb25149640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda0c034650 0x7fda0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152b6e9d0 0x55f152c63b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c641b0 con 0x55f152b6e9d0 2024-09-13T06:29:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb2614b640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152b6e9d0 0x55f152c63b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb25149640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda0c034650 0x7fda0c036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0ad000 tx=0x7fdb1c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb2614b640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152b6e9d0 0x55f152c63b70 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb2614b640 1 -- 172.21.15.169:0/1077850777 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152b6e9d0 2024-09-13T06:29:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c64f80 0x55f152c67370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c679b0 con 0x55f152c64f80 2024-09-13T06:29:42.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.665+0000 7fdb2594a640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c64f80 0x55f152c67370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb2594a640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c64f80 0x55f152c67370 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb2594a640 1 -- 172.21.15.169:0/1077850777 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb2001b030 con 0x55f152c64f80 2024-09-13T06:29:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c69260 con 0x55f152c64f80 2024-09-13T06:29:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb2594a640 1 -- 172.21.15.169:0/1077850777 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb2001b030 con 0x55f152c64f80 2024-09-13T06:29:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c68490 con 0x55f152c64f80 2024-09-13T06:29:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb2594a640 1 -- 172.21.15.169:0/1077850777 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb2001b030 con 0x55f152c64f80 2024-09-13T06:29:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152c6a610 0x55f152c6ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c6cf40 con 0x55f152c6a610 2024-09-13T06:29:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb25149640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152c6a610 0x55f152c6ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb25149640 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152c6a610 0x55f152c6ca00 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb25149640 1 -- 172.21.15.169:0/1077850777 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb1c0b3040 con 0x55f152c6a610 2024-09-13T06:29:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 Processor -- start 2024-09-13T06:29:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 -- start start 2024-09-13T06:29:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 0x55f152c7ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.669+0000 7fdb27e3a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f152a71800 con 0x55f152c7a960 2024-09-13T06:29:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 0x55f152c7ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 0x55f152c7ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56816/0 (socket says 172.21.15.169:56816) 2024-09-13T06:29:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb2594a640 1 -- 172.21.15.169:0/165782920 learned_addr learned my addr 172.21.15.169:0/165782920 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb2594a640 1 -- 172.21.15.169:0/165782920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f152c7b2c0 con 0x55f152c7a960 2024-09-13T06:29:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb2594a640 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 0x55f152c7ad80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdb200484a0 tx=0x7fdb20010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fda0b7fe640 1 -- 172.21.15.169:0/165782920 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20041460 con 0x55f152c7a960 2024-09-13T06:29:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fda0b7fe640 1 -- 172.21.15.169:0/165782920 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20041600 con 0x55f152c7a960 2024-09-13T06:29:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fda0b7fe640 1 -- 172.21.15.169:0/165782920 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20041ad0 con 0x55f152c7a960 2024-09-13T06:29:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f152c7b550 con 0x55f152c7a960 2024-09-13T06:29:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f152c7b550 con 0x55f152c7a960 2024-09-13T06:29:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fda0b7fe640 1 -- 172.21.15.169:0/165782920 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb20029d10 con 0x55f152c7a960 2024-09-13T06:29:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fda0b7fe640 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda000346a0 0x7fda00036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fda0b7fe640 1 -- 172.21.15.169:0/165782920 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fdb2003ead0 con 0x55f152c7a960 2024-09-13T06:29:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb25149640 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda000346a0 0x7fda00036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb27e3a980 1 Processor -- start 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.673+0000 7fdb27e3a980 1 -- start start 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb25149640 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda000346a0 0x7fda00036b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55f152c611d0 tx=0x7fdb1c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c89270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f152c56180 con 0x55f152c88e90 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c89270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c89270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56824/0 (socket says 172.21.15.169:56824) 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 -- 172.21.15.169:0/1987341708 learned_addr learned my addr 172.21.15.169:0/1987341708 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 -- 172.21.15.169:0/1987341708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f152c89840 con 0x55f152c88e90 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 --2- 172.21.15.169:0/1987341708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c89270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb20020fd0 tx=0x7fdb20050f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce134a3f7097245 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fda097fa640 1 -- 172.21.15.169:0/1987341708 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20033610 con 0x55f152c88e90 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fda097fa640 1 -- 172.21.15.169:0/1987341708 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20048580 con 0x55f152c88e90 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fda097fa640 1 -- 172.21.15.169:0/1987341708 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20050430 con 0x55f152c88e90 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1987341708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 msgr2=0x55f152c89270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1987341708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c89270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb20020fd0 tx=0x7fdb20050f50 comp rx=0 tx=0).stop 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1987341708 shutdown_connections 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1987341708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c89270 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1987341708 >> 172.21.15.169:0/1987341708 conn(0x55f152adf370 msgr2=0x55f152adf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1987341708 shutdown_connections 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1987341708 wait complete. 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 Processor -- start 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- start start 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c904e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb27e3a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f152c8a110 con 0x55f152c88e90 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c904e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c904e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56838/0 (socket says 172.21.15.169:56838) 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 learned_addr learned my addr 172.21.15.169:0/2257726246 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f152c90a20 con 0x55f152c88e90 2024-09-13T06:29:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.677+0000 7fdb2594a640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c904e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb20048730 tx=0x7fdb20011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fd9f77fe640 1 -- 172.21.15.169:0/2257726246 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20033430 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f152c90a20 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fd9f77fe640 1 -- 172.21.15.169:0/2257726246 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2004f3e0 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fd9f77fe640 1 -- 172.21.15.169:0/2257726246 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20050430 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f152c90a20 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fd9f77fe640 1 -- 172.21.15.169:0/2257726246 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb20041e50 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fd9f77fe640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd9f0034600 0x7fd9f0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fd9f77fe640 1 -- 172.21.15.169:0/2257726246 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fdb2006f030 con 0x55f152c88e90 2024-09-13T06:29:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb25149640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd9f0034600 0x7fd9f0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152c9b580 0x55f152c9da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c9e170 con 0x55f152c9b580 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb2614b640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152c9b580 0x55f152c9da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb25149640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd9f0034600 0x7fd9f0036ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c018eb0 tx=0x7fdb1c0b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb2614b640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152c9b580 0x55f152c9da20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 realm 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c9aa70 con 0x55f152c9b580 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152c9ec30 con 0x55f152c9b580 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c9fa10 0x55f152ca1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2490 con 0x55f152c9fa10 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.681+0000 7fdb2594a640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c9fa10 0x55f152ca1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2594a640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c9fa10 0x55f152ca1e00 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb2003d070 con 0x55f152c9fa10 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb2003d070 con 0x55f152c9fa10 2024-09-13T06:29:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 20 searching for the correct realm 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152ca4aa0 0x55f152ca6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca7510 con 0x55f152ca4aa0 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb25149640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152ca4aa0 0x55f152ca6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb25149640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152ca4aa0 0x55f152ca6e90 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca7510 con 0x55f152c9fa10 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb2003d070 con 0x55f152c9fa10 2024-09-13T06:29:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2594a640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdb2005a070 0x7fdb2000b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x7fdb2005a070 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.685+0000 7fdb2614b640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdb2005a070 0x7fdb2000b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdb2005a070 0x7fdb2000b370 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152ca4aa0 2024-09-13T06:29:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2003d070 con 0x55f152c9fa10 2024-09-13T06:29:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2003d070 con 0x55f152c9fa10 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x7fdb2005a070 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.689+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x7fdb2005a070 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152ca4aa0 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152ca4aa0 2024-09-13T06:29:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152ca4aa0 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.693+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x7fdb2005a070 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9b580 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x7fdb2005a070 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152ca4aa0 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x7fdb2005a070 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152ca4aa0 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.697+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca2d30 con 0x55f152c9fa10 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca3580 con 0x55f152c9b580 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca3970 con 0x55f152c9fa10 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca3970 con 0x55f152ca4aa0 2024-09-13T06:29:42.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 zone default found 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 4 Realm: () 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 zonegroup default 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca79c0 con 0x7fdb2005a070 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca9740 con 0x55f152ca4aa0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados->read ofs=0 len=0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca9ae0 con 0x55f152ca4aa0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 started sync module instance, tier type = 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.701+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca8be0 con 0x55f152c9fa10 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94494964486416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca8be0 con 0x55f152c9fa10 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152caa4a0 con 0x55f152c9b580 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94494964490224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152caacf0 con 0x55f152c9b580 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cab6b0 con 0x55f152c9fa10 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.705+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94494964486416] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94494964490224] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94494964494848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152caacf0 con 0x55f152c9fa10 2024-09-13T06:29:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cab620 con 0x7fdb2005a070 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94494964497056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cab620 con 0x7fdb2005a070 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152caca40 con 0x55f152c9fa10 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.709+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94494964494848] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94494964497056] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94494964498112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152caca00 con 0x55f152c9fa10 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cace70 con 0x55f152ca4aa0 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94494964492352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cad710 con 0x55f152ca4aa0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cae0d0 con 0x55f152ca4aa0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94494964498112] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.713+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94494964492352] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94494964499728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cae0d0 con 0x55f152ca4aa0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cae9b0 con 0x7fdb2005a070 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94494964499728] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94494964507840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cae0d0 con 0x7fdb2005a070 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=0 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=1 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=2 2024-09-13T06:29:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=3 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=4 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=5 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=6 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94494964507840] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 20 add_watcher() i=7 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb1e60 con 0x55f152c9b580 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.717+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94494964506096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152caf380 con 0x55f152c9b580 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94494964506096] v33'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fd9d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fdb27e3a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fdb27e3a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cba520 con 0x55f152c9fa10 2024-09-13T06:29:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.721+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cba5b0 con 0x7fdb2005a070 2024-09-13T06:29:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.725+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.725+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbab20 con 0x55f152ca4aa0 2024-09-13T06:29:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.725+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.725+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbafd0 con 0x55f152c9b580 2024-09-13T06:29:42.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.729+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.729+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb85f0 con 0x55f152c9fa10 2024-09-13T06:29:42.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.729+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.729+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb85f0 con 0x55f152ca4aa0 2024-09-13T06:29:42.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.729+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.729+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb8590 con 0x55f152c9fa10 2024-09-13T06:29:42.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.733+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.733+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbbb30 con 0x55f152c9b580 2024-09-13T06:29:42.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.733+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.733+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbbf50 con 0x55f152c9fa10 2024-09-13T06:29:42.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.737+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.737+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbbf50 con 0x55f152c9fa10 2024-09-13T06:29:42.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.737+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.737+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbbf50 con 0x55f152c9fa10 2024-09-13T06:29:42.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.741+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.741+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbbf50 con 0x55f152ca4aa0 2024-09-13T06:29:42.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.741+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.741+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbc400 con 0x55f152c9fa10 2024-09-13T06:29:42.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.741+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.745+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbc400 con 0x55f152c9b580 2024-09-13T06:29:42.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.745+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.745+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbc490 con 0x55f152c9b580 2024-09-13T06:29:42.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.745+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.745+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbc520 con 0x55f152c9fa10 2024-09-13T06:29:42.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.749+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.749+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbcb10 con 0x55f152c9fa10 2024-09-13T06:29:42.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.753+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.753+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152ca4aa0 2024-09-13T06:29:42.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.753+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.753+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9fa10 2024-09-13T06:29:42.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.757+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.757+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9b580 2024-09-13T06:29:42.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.757+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.757+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9fa10 2024-09-13T06:29:42.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.761+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.761+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9fa10 2024-09-13T06:29:42.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.765+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.765+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152ca4aa0 2024-09-13T06:29:42.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.765+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.765+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9fa10 2024-09-13T06:29:42.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.769+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.769+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152ca4aa0 2024-09-13T06:29:42.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.769+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.769+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152ca4aa0 2024-09-13T06:29:42.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.773+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.773+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152ca4aa0 2024-09-13T06:29:42.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.773+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.773+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9fa10 2024-09-13T06:29:42.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.777+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.777+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9b580 2024-09-13T06:29:42.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.777+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.777+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9fa10 2024-09-13T06:29:42.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.781+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.781+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x55f152c9b580 2024-09-13T06:29:42.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cbca30 con 0x7fdb2005a070 2024-09-13T06:29:42.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fd9d67fc640 20 reqs_thread_entry: start 2024-09-13T06:29:42.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fdb27e3a980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:42.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fdb27e3a980 20 Filter name: none 2024-09-13T06:29:42.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fd947fff640 20 reqs_thread_entry: start 2024-09-13T06:29:42.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.785+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb180083f0 con 0x7fdb2005a070 2024-09-13T06:29:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.789+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.793+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.797+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb180083f0 con 0x55f152c9b580 2024-09-13T06:29:42.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.801+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.805+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.809+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.813+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.817+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.821+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.825+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.829+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.833+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 43 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 44 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 45 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv25 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 46 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.837+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.841+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x7fdb2005a070 2024-09-13T06:29:42.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.845+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.849+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fdb1803f040 con 0x7fdb2005a070 2024-09-13T06:29:42.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.849+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.849+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fdb1803f040 con 0x7fdb2005a070 2024-09-13T06:29:42.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.849+0000 7fd9d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:42.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.849+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94494964506096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.853+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94494964506096] v33'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.853+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94494964486416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.853+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94494964486416] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.853+0000 7fdb27e3a980 20 remove_watcher() i=0 2024-09-13T06:29:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.853+0000 7fdb27e3a980 2 removed watcher, disabling cache 2024-09-13T06:29:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.853+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94494964490224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9b580 2024-09-13T06:29:42.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.857+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.1 v2:172.21.15.169:6808/3492903297 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94494964490224] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1803f040 con 0x55f152c9b580 2024-09-13T06:29:42.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.857+0000 7fdb27e3a980 20 remove_watcher() i=1 2024-09-13T06:29:42.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.857+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94494964494848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.857+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94494964494848] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.857+0000 7fdb27e3a980 20 remove_watcher() i=2 2024-09-13T06:29:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.857+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94494964497056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x7fdb2005a070 2024-09-13T06:29:42.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.861+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94494964497056] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1803f040 con 0x7fdb2005a070 2024-09-13T06:29:42.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.861+0000 7fdb27e3a980 20 remove_watcher() i=3 2024-09-13T06:29:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.861+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94494964498112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152c9fa10 2024-09-13T06:29:42.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb2594a640 1 -- 172.21.15.169:0/2257726246 <== osd.0 v2:172.21.15.112:6800/389376018 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94494964498112] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20092040 con 0x55f152c9fa10 2024-09-13T06:29:42.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb27e3a980 20 remove_watcher() i=4 2024-09-13T06:29:42.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94494964492352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 47 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94494964492352] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb27e3a980 20 remove_watcher() i=5 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94494964499728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152cb7380 con 0x55f152ca4aa0 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb25149640 1 -- 172.21.15.169:0/2257726246 <== osd.3 v2:172.21.15.169:6800/747740583 48 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94494964499728] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0c9030 con 0x55f152ca4aa0 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb27e3a980 20 remove_watcher() i=6 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.865+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94494964507840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f152ca9ff0 con 0x7fdb2005a070 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94494964507840] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1803f040 con 0x7fdb2005a070 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 20 remove_watcher() i=7 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c9fa10 msgr2=0x55f152ca1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c9fa10 0x55f152ca1e00 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152c9b580 msgr2=0x55f152c9da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152c9b580 0x55f152c9da20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdb2005a070 msgr2=0x7fdb2000b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdb2005a070 0x7fdb2000b370 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152ca4aa0 msgr2=0x55f152ca6e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152ca4aa0 0x55f152ca6e90 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd9f0034600 msgr2=0x7fd9f0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd9f0034600 0x7fd9f0036ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c018eb0 tx=0x7fdb1c0b9040 comp rx=0 tx=0).stop 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 msgr2=0x55f152c904e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/2257726246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c88e90 0x55f152c904e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb20048730 tx=0x7fdb20011f10 comp rx=0 tx=0).stop 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 reap_dead start 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb2614b640 1 -- 172.21.15.169:0/2257726246 reap_dead start 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 shutdown_connections 2024-09-13T06:29:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 >> 172.21.15.169:0/2257726246 conn(0x55f152adf370 msgr2=0x55f152adf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 shutdown_connections 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/2257726246 wait complete. 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda000346a0 msgr2=0x7fda00036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda000346a0 0x7fda00036b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55f152c611d0 tx=0x7fdb1c005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 msgr2=0x55f152c7ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 0x55f152c7ad80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdb200484a0 tx=0x7fdb20010d50 comp rx=0 tx=0).stop 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 shutdown_connections 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda000346a0 0x7fda00036b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/165782920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152c7a960 0x55f152c7ad80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 >> 172.21.15.169:0/165782920 conn(0x55f152c6fab0 msgr2=0x55f152c72530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 shutdown_connections 2024-09-13T06:29:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/165782920 wait complete. 2024-09-13T06:29:42.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c64f80 msgr2=0x55f152c67370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f152c64f80 0x55f152c67370 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152b6e9d0 msgr2=0x55f152c63b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f152b6e9d0 0x55f152c63b70 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152c6a610 msgr2=0x55f152c6ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f152c6a610 0x55f152c6ca00 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda0c034650 msgr2=0x7fda0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fda0c034650 0x7fda0c036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0ad000 tx=0x7fdb1c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 msgr2=0x55f152c5cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 --2- 172.21.15.169:0/1077850777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f152b6a650 0x55f152c5cbe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdb20002260 tx=0x7fdb20000f50 comp rx=0 tx=0).stop 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb2614b640 1 -- 172.21.15.169:0/1077850777 reap_dead start 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 shutdown_connections 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 >> 172.21.15.169:0/1077850777 conn(0x55f152b66170 msgr2=0x55f152c4ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 shutdown_connections 2024-09-13T06:29:42.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.869+0000 7fdb27e3a980 1 -- 172.21.15.169:0/1077850777 wait complete. 2024-09-13T06:29:42.885 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-09-13T06:29:42.885 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:29:42.885 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T06:29:42.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T06:29:42.886 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T06:29:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefcc0a9980 1 Processor -- start 2024-09-13T06:29:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefcc0a9980 1 -- start start 2024-09-13T06:29:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefcc0a9980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d709fbfa90 0x55d709fc1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefcc0a9980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d709e43ae0 con 0x55d709f2fac0 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefcc0a9980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55d709e67e30 con 0x55d709fbfa90 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefc93b8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d709fbfa90 0x55d709fc1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefc9bb9640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55d709f2fac0 0x55d709fbe370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49732/0 (socket says 172.21.15.169:49732) 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefc93b8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d709fbfa90 0x55d709fc1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56850/0 (socket says 172.21.15.169:56850) 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.961+0000 7fefc9bb9640 1 -- 172.21.15.169:0/1943562261 learned_addr learned my addr 172.21.15.169:0/1943562261 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.965+0000 7fefc93b8640 1 -- 172.21.15.169:0/1943562261 >> v1:172.21.15.112:6789/0 conn(0x55d709f2fac0 legacy=0x55d709fbe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.965+0000 7fefc93b8640 1 -- 172.21.15.169:0/1943562261 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d709fc33d0 con 0x55d709fbfa90 2024-09-13T06:29:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.965+0000 7fefc93b8640 1 --2- 172.21.15.169:0/1943562261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709fbfa90 0x55d709fc1e80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00a420 tx=0x7fefbc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf298e9f863c636 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.965+0000 7fefc8bb7640 1 -- 172.21.15.169:0/1943562261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc0af070 con 0x55d709fbfa90 2024-09-13T06:29:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.965+0000 7fefc8bb7640 1 -- 172.21.15.169:0/1943562261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc0aa530 con 0x55d709fbfa90 2024-09-13T06:29:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.965+0000 7fefc8bb7640 1 -- 172.21.15.169:0/1943562261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc0aa850 con 0x55d709fbfa90 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 -- 172.21.15.169:0/1943562261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709fbfa90 msgr2=0x55d709fc1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/1943562261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709fbfa90 0x55d709fc1e80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00a420 tx=0x7fefbc01afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 -- 172.21.15.169:0/1943562261 shutdown_connections 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/1943562261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709fbfa90 0x55d709fc1e80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 -- 172.21.15.169:0/1943562261 >> 172.21.15.169:0/1943562261 conn(0x55d709fb6060 msgr2=0x55d709fb8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 -- 172.21.15.169:0/1943562261 shutdown_connections 2024-09-13T06:29:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.969+0000 7fefcc0a9980 1 -- 172.21.15.169:0/1943562261 wait complete. 2024-09-13T06:29:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 Processor -- start 2024-09-13T06:29:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- start start 2024-09-13T06:29:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d709fbbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d709e69200 con 0x55d709f2fac0 2024-09-13T06:29:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d709fbbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d709fbbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56864/0 (socket says 172.21.15.169:56864) 2024-09-13T06:29:42.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 -- 172.21.15.169:0/2585241810 learned_addr learned my addr 172.21.15.169:0/2585241810 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 -- 172.21.15.169:0/2585241810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d709fbc0a0 con 0x55d709f2fac0 2024-09-13T06:29:42.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/2585241810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d709fbbad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fefb4001e20 tx=0x7fefb400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a94634abdbc338 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7feeb7e07640 1 -- 172.21.15.169:0/2585241810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb4012020 con 0x55d709f2fac0 2024-09-13T06:29:42.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7feeb7e07640 1 -- 172.21.15.169:0/2585241810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb400e7c0 con 0x55d709f2fac0 2024-09-13T06:29:42.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7feeb7e07640 1 -- 172.21.15.169:0/2585241810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb400eb00 con 0x55d709f2fac0 2024-09-13T06:29:42.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2585241810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 msgr2=0x55d709fbbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:42.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/2585241810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d709fbbad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fefb4001e20 tx=0x7fefb400b790 comp rx=0 tx=0).stop 2024-09-13T06:29:42.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2585241810 shutdown_connections 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/2585241810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d709fbbad0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2585241810 >> 172.21.15.169:0/2585241810 conn(0x55d709fb6060 msgr2=0x55d70a0a2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2585241810 shutdown_connections 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2585241810 wait complete. 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 Processor -- start 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- start start 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d70a0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefcc0a9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d709fc2e10 con 0x55d709f2fac0 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d70a0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d70a0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56876/0 (socket says 172.21.15.169:56876) 2024-09-13T06:29:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.985+0000 7fefc9bb9640 1 -- 172.21.15.169:0/517688848 learned_addr learned my addr 172.21.15.169:0/517688848 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefc9bb9640 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70a0b05b0 con 0x55d709f2fac0 2024-09-13T06:29:42.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d70a0b0070 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fefb4001e20 tx=0x7fefb4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7feeb6604640 1 -- 172.21.15.169:0/517688848 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb4012030 con 0x55d709f2fac0 2024-09-13T06:29:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70a0b0840 con 0x55d709f2fac0 2024-09-13T06:29:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7feeb6604640 1 -- 172.21.15.169:0/517688848 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb4001480 con 0x55d709f2fac0 2024-09-13T06:29:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7feeb6604640 1 -- 172.21.15.169:0/517688848 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb401a940 con 0x55d709f2fac0 2024-09-13T06:29:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70a0b3520 con 0x55d709f2fac0 2024-09-13T06:29:42.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7feeb6604640 1 -- 172.21.15.169:0/517688848 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fefb4015020 con 0x55d709f2fac0 2024-09-13T06:29:42.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7feeb6604640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feeb0034650 0x7feeb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7feeb6604640 1 -- 172.21.15.169:0/517688848 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fefb4020030 con 0x55d709f2fac0 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefc93b8640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feeb0034650 0x7feeb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d709fbfa90 0x55d70a0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0b76b0 con 0x55d709fbfa90 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefca3ba640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d709fbfa90 0x55d70a0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefc93b8640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feeb0034650 0x7feeb0036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0ac000 tx=0x7fefbc0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefca3ba640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d709fbfa90 0x55d70a0b7040 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefca3ba640 1 -- 172.21.15.169:0/517688848 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d709fbfa90 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0b84a0 0x55d70a0ba890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.989+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0baec0 con 0x55d70a0b84a0 2024-09-13T06:29:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0b84a0 0x55d70a0ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0b84a0 0x55d70a0ba890 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc9bb9640 1 -- 172.21.15.169:0/517688848 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefb4008030 con 0x55d70a0b84a0 2024-09-13T06:29:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0bc770 con 0x55d70a0b84a0 2024-09-13T06:29:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc9bb9640 1 -- 172.21.15.169:0/517688848 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefb4008030 con 0x55d70a0b84a0 2024-09-13T06:29:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0bb9a0 con 0x55d70a0b84a0 2024-09-13T06:29:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc9bb9640 1 -- 172.21.15.169:0/517688848 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefb4008030 con 0x55d70a0b84a0 2024-09-13T06:29:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0bdb20 0x55d70a0bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0c0450 con 0x55d70a0bdb20 2024-09-13T06:29:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc93b8640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0bdb20 0x55d70a0bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc93b8640 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0bdb20 0x55d70a0bff10 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.993+0000 7fefc93b8640 1 -- 172.21.15.169:0/517688848 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fefbc0b2070 con 0x55d70a0bdb20 2024-09-13T06:29:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefcc0a9980 1 Processor -- start 2024-09-13T06:29:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefcc0a9980 1 -- start start 2024-09-13T06:29:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefcc0a9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 0x55d70a0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefcc0a9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d709ec2800 con 0x55d70a0cde30 2024-09-13T06:29:42.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 0x55d70a0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:42.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 0x55d70a0ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56892/0 (socket says 172.21.15.169:56892) 2024-09-13T06:29:42.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefc9bb9640 1 -- 172.21.15.169:0/2124650922 learned_addr learned my addr 172.21.15.169:0/2124650922 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:42.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefc9bb9640 1 -- 172.21.15.169:0/2124650922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70a0ce790 con 0x55d70a0cde30 2024-09-13T06:29:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 0x55d70a0ce250 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c510 tx=0x7fefb4016680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7feeaf7fe640 1 -- 172.21.15.169:0/2124650922 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb400c580 con 0x55d70a0cde30 2024-09-13T06:29:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70a0cea20 con 0x55d70a0cde30 2024-09-13T06:29:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7feeaf7fe640 1 -- 172.21.15.169:0/2124650922 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb400c720 con 0x55d70a0cde30 2024-09-13T06:29:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70a0d16a0 con 0x55d70a0cde30 2024-09-13T06:29:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7feeaf7fe640 1 -- 172.21.15.169:0/2124650922 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb4041020 con 0x55d70a0cde30 2024-09-13T06:29:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7feeaf7fe640 1 -- 172.21.15.169:0/2124650922 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fefb4009070 con 0x55d70a0cde30 2024-09-13T06:29:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7feeaf7fe640 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feea4034650 0x7feea4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7feeaf7fe640 1 -- 172.21.15.169:0/2124650922 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fefb4005050 con 0x55d70a0cde30 2024-09-13T06:29:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:42.997+0000 7fefc93b8640 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feea4034650 0x7feea4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 Processor -- start 2024-09-13T06:29:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- start start 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0dac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d709fba2c0 con 0x55d70a0da810 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc93b8640 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feea4034650 0x7feea4036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fefbc017be0 tx=0x7fefbc005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0dac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56906/0 (socket says 172.21.15.169:56906) 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3464860572 learned_addr learned my addr 172.21.15.169:0/3464860572 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3464860572 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70a0db1e0 con 0x55d70a0da810 2024-09-13T06:29:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/3464860572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0dac10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fefb403efd0 tx=0x7fefb402ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e7e7cddeaada87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7feead7fa640 1 -- 172.21.15.169:0/3464860572 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb4032c40 con 0x55d70a0da810 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7feead7fa640 1 -- 172.21.15.169:0/3464860572 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb4053040 con 0x55d70a0da810 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7feead7fa640 1 -- 172.21.15.169:0/3464860572 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb400d550 con 0x55d70a0da810 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3464860572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 msgr2=0x55d70a0dac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3464860572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0dac10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fefb403efd0 tx=0x7fefb402ddb0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3464860572 shutdown_connections 2024-09-13T06:29:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3464860572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0dac10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3464860572 >> 172.21.15.169:0/3464860572 conn(0x55d70a0d6b40 msgr2=0x55d70a0d4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3464860572 shutdown_connections 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3464860572 wait complete. 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 Processor -- start 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- start start 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefcc0a9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d70a0db6d0 con 0x55d70a0da810 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56920/0 (socket says 172.21.15.169:56920) 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 learned_addr learned my addr 172.21.15.169:0/3816598078 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.001+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70a0e1e80 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0e1940 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fefb403efd0 tx=0x7fefb4011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fee9b7fe640 1 -- 172.21.15.169:0/3816598078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb404ecf0 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fee9b7fe640 1 -- 172.21.15.169:0/3816598078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb4068070 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70a0e1e80 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fee9b7fe640 1 -- 172.21.15.169:0/3816598078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb400ca00 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70a0e2350 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fee9b7fe640 1 -- 172.21.15.169:0/3816598078 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fefb405f040 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fee9b7fe640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fee94034650 0x7fee94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fee9b7fe640 1 -- 172.21.15.169:0/3816598078 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fefb405d020 con 0x55d70a0da810 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d70a0eca90 0x55d70a0eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ef6a0 con 0x55d70a0eca90 2024-09-13T06:29:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefca3ba640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d70a0eca90 0x55d70a0eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefca3ba640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d70a0eca90 0x55d70a0eef50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 realm 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ebec0 con 0x55d70a0eca90 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f0130 con 0x55d70a0eca90 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0f0f10 0x55d70a0f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.005+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f3990 con 0x55d70a0f0f10 2024-09-13T06:29:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0f0f10 0x55d70a0f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0f0f10 0x55d70a0f3300 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f3ed0 con 0x55d70a0f0f10 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 20 searching for the correct realm 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0f56b0 0x55d70a0f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f8240 con 0x55d70a0f56b0 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc93b8640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0f56b0 0x55d70a0f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc93b8640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0f56b0 0x55d70a0f7b70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f8240 con 0x55d70a0f0f10 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fefb40325e0 0x7fefb4003280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.009+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x7fefb40325e0 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fefb40325e0 0x7fefb4003280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fefb40325e0 0x7fefb4003280 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f56b0 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x7fefb40325e0 2024-09-13T06:29:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.013+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x7fefb40325e0 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f56b0 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f56b0 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.017+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f56b0 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x7fefb40325e0 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0eca90 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x7fefb40325e0 2024-09-13T06:29:43.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f56b0 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x7fefb40325e0 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f56b0 2024-09-13T06:29:43.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.021+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fefb406c030 con 0x55d70a0f0f10 2024-09-13T06:29:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f3ae0 con 0x55d70a0eca90 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f3ed0 con 0x55d70a0f0f10 2024-09-13T06:29:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f3ed0 con 0x55d70a0f56b0 2024-09-13T06:29:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 zone default found 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 4 Realm: () 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 zonegroup default 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f86c0 con 0x7fefb40325e0 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f4410 con 0x55d70a0f56b0 2024-09-13T06:29:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fa9c0 con 0x55d70a0f56b0 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 started sync module instance, tier type = 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.025+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f9d80 con 0x55d70a0f0f10 2024-09-13T06:29:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.029+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.029+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382075126400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0f9d80 con 0x55d70a0f0f10 2024-09-13T06:29:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.029+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fb440 con 0x55d70a0eca90 2024-09-13T06:29:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.029+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.029+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382075129744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fbc90 con 0x55d70a0eca90 2024-09-13T06:29:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.029+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fc6b0 con 0x55d70a0f0f10 2024-09-13T06:29:43.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382075126400] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382075129744] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382075134368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fb7e0 con 0x55d70a0f0f10 2024-09-13T06:29:43.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fcf50 con 0x7fefb40325e0 2024-09-13T06:29:43.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382075136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fb7e0 con 0x7fefb40325e0 2024-09-13T06:29:43.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fd9f0 con 0x55d70a0f0f10 2024-09-13T06:29:43.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.033+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382075134368] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382075136672] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382075137728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fd9b0 con 0x55d70a0f0f10 2024-09-13T06:29:43.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fdde0 con 0x55d70a0f56b0 2024-09-13T06:29:43.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382075123920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fe630 con 0x55d70a0f56b0 2024-09-13T06:29:43.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ff050 con 0x55d70a0f56b0 2024-09-13T06:29:43.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382075137728] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.037+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382075123920] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382075145024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ff440 con 0x55d70a0f56b0 2024-09-13T06:29:43.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ffcd0 con 0x7fefb40325e0 2024-09-13T06:29:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382075147328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ff8a0 con 0x7fefb40325e0 2024-09-13T06:29:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=0 2024-09-13T06:29:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=1 2024-09-13T06:29:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=2 2024-09-13T06:29:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=3 2024-09-13T06:29:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=4 2024-09-13T06:29:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=5 2024-09-13T06:29:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382075145024] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=6 2024-09-13T06:29:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382075147328] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 20 add_watcher() i=7 2024-09-13T06:29:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fd4e0 con 0x55d70a0eca90 2024-09-13T06:29:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.041+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382075150448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fd4e0 con 0x55d70a0eca90 2024-09-13T06:29:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382075150448] v33'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fee7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fefcc0a9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fefcc0a9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10bb30 con 0x55d70a0f0f10 2024-09-13T06:29:43.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.045+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10bc20 con 0x7fefb40325e0 2024-09-13T06:29:43.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.049+0000 7fefc93b8640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fee94034650 0x7fee94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.049+0000 7fefc93b8640 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fee94034650 0x7fee94036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55d70a0bc700 tx=0x7fefbc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.049+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.049+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10c3d0 con 0x55d70a0f56b0 2024-09-13T06:29:43.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.049+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.049+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10c880 con 0x55d70a0eca90 2024-09-13T06:29:43.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.053+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.053+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a109960 con 0x55d70a0f0f10 2024-09-13T06:29:43.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.053+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.053+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a109960 con 0x55d70a0f56b0 2024-09-13T06:29:43.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.057+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.057+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a109960 con 0x55d70a0f0f10 2024-09-13T06:29:43.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.057+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.057+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a1098a0 con 0x55d70a0eca90 2024-09-13T06:29:43.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.061+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.061+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d800 con 0x55d70a0f0f10 2024-09-13T06:29:43.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.061+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.061+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d800 con 0x55d70a0f0f10 2024-09-13T06:29:43.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.065+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.065+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d800 con 0x55d70a0f0f10 2024-09-13T06:29:43.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.065+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.065+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d800 con 0x55d70a0f56b0 2024-09-13T06:29:43.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.069+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.069+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d890 con 0x55d70a0f0f10 2024-09-13T06:29:43.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.069+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.069+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d890 con 0x55d70a0eca90 2024-09-13T06:29:43.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.069+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.069+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10dd40 con 0x55d70a0eca90 2024-09-13T06:29:43.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.073+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.073+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10dd40 con 0x55d70a0f0f10 2024-09-13T06:29:43.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.073+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.073+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10dd40 con 0x55d70a0f0f10 2024-09-13T06:29:43.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.077+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.077+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10dd40 con 0x55d70a0f56b0 2024-09-13T06:29:43.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.081+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.081+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10ddd0 con 0x55d70a0f0f10 2024-09-13T06:29:43.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.081+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.081+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10ddd0 con 0x55d70a0eca90 2024-09-13T06:29:43.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.085+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.085+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e280 con 0x55d70a0f0f10 2024-09-13T06:29:43.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.085+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.085+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e280 con 0x55d70a0f0f10 2024-09-13T06:29:43.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.089+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.089+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10d940 con 0x55d70a0f56b0 2024-09-13T06:29:43.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.089+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.089+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e310 con 0x55d70a0f0f10 2024-09-13T06:29:43.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.093+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.093+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e310 con 0x55d70a0f56b0 2024-09-13T06:29:43.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.093+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.093+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x55d70a0f56b0 2024-09-13T06:29:43.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.093+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.093+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x55d70a0f56b0 2024-09-13T06:29:43.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.097+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.097+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x55d70a0f0f10 2024-09-13T06:29:43.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.101+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.101+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x55d70a0eca90 2024-09-13T06:29:43.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.101+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.101+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x55d70a0f0f10 2024-09-13T06:29:43.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x55d70a0eca90 2024-09-13T06:29:43.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a10e3a0 con 0x7fefb40325e0 2024-09-13T06:29:43.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fee7a7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:43.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefcc0a9980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefcc0a9980 20 Filter name: none 2024-09-13T06:29:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fedebfff640 20 reqs_thread_entry: start 2024-09-13T06:29:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefcc0a9980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.105+0000 7fefcc0a9980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a1293d0 con 0x55d70a0eca90 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d70a12be10 con 0x7fefb40325e0 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T06:29:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fee7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.109+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382075150448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0ea200 con 0x55d70a0eca90 2024-09-13T06:29:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.113+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94382075150448] v33'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.113+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382075126400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a100070 con 0x55d70a0f0f10 2024-09-13T06:29:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.113+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94382075126400] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.113+0000 7fefcc0a9980 20 remove_watcher() i=0 2024-09-13T06:29:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.113+0000 7fefcc0a9980 2 removed watcher, disabling cache 2024-09-13T06:29:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.113+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382075129744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fa280 con 0x55d70a0eca90 2024-09-13T06:29:43.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.117+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94382075129744] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x55d70a0eca90 2024-09-13T06:29:43.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.117+0000 7fefcc0a9980 20 remove_watcher() i=1 2024-09-13T06:29:43.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.117+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382075134368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fa280 con 0x55d70a0f0f10 2024-09-13T06:29:43.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.117+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94382075134368] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.117+0000 7fefcc0a9980 20 remove_watcher() i=2 2024-09-13T06:29:43.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.117+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382075136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fa280 con 0x7fefb40325e0 2024-09-13T06:29:43.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.121+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94382075136672] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.121+0000 7fefcc0a9980 20 remove_watcher() i=3 2024-09-13T06:29:43.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.121+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382075137728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fcaa0 con 0x55d70a0f0f10 2024-09-13T06:29:43.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.121+0000 7fefc9bb9640 1 -- 172.21.15.169:0/3816598078 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94382075137728] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb403b070 con 0x55d70a0f0f10 2024-09-13T06:29:43.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.121+0000 7fefcc0a9980 20 remove_watcher() i=4 2024-09-13T06:29:43.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.121+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382075123920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fa280 con 0x55d70a0f56b0 2024-09-13T06:29:43.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94382075123920] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 20 remove_watcher() i=5 2024-09-13T06:29:43.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382075145024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fa280 con 0x55d70a0f56b0 2024-09-13T06:29:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefc93b8640 1 -- 172.21.15.169:0/3816598078 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94382075145024] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc0c9070 con 0x55d70a0f56b0 2024-09-13T06:29:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 20 remove_watcher() i=6 2024-09-13T06:29:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382075147328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d70a0fcf00 con 0x7fefb40325e0 2024-09-13T06:29:43.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94382075147328] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc40083f0 con 0x7fefb40325e0 2024-09-13T06:29:43.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 20 remove_watcher() i=7 2024-09-13T06:29:43.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0f0f10 msgr2=0x55d70a0f3300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0f0f10 0x55d70a0f3300 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d70a0eca90 msgr2=0x55d70a0eef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d70a0eca90 0x55d70a0eef50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fefb40325e0 msgr2=0x7fefb4003280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fefb40325e0 0x7fefb4003280 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0f56b0 msgr2=0x55d70a0f7b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0f56b0 0x55d70a0f7b70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fee94034650 msgr2=0x7fee94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fee94034650 0x7fee94036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55d70a0bc700 tx=0x7fefbc0a7000 comp rx=0 tx=0).stop 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefca3ba640 1 -- 172.21.15.169:0/3816598078 reap_dead start 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 msgr2=0x55d70a0e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0e1940 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fefb403efd0 tx=0x7fefb4011f30 comp rx=0 tx=0).stop 2024-09-13T06:29:43.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 shutdown_connections 2024-09-13T06:29:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/3816598078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0da810 0x55d70a0e1940 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 >> 172.21.15.169:0/3816598078 conn(0x55d70a0d6b40 msgr2=0x55d70a0d4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 shutdown_connections 2024-09-13T06:29:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.125+0000 7fefcc0a9980 1 -- 172.21.15.169:0/3816598078 wait complete. 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feea4034650 msgr2=0x7feea4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feea4034650 0x7feea4036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fefbc017be0 tx=0x7fefbc005d90 comp rx=0 tx=0).stop 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 msgr2=0x55d70a0ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 0x55d70a0ce250 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c510 tx=0x7fefb4016680 comp rx=0 tx=0).stop 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 shutdown_connections 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feea4034650 0x7feea4036b10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/2124650922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d70a0cde30 0x55d70a0ce250 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 >> 172.21.15.169:0/2124650922 conn(0x55d70a0c2f80 msgr2=0x55d70a0c5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 shutdown_connections 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/2124650922 wait complete. 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0b84a0 msgr2=0x55d70a0ba890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d70a0b84a0 0x55d70a0ba890 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d709fbfa90 msgr2=0x55d70a0b7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d709fbfa90 0x55d70a0b7040 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0bdb20 msgr2=0x55d70a0bff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d70a0bdb20 0x55d70a0bff10 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feeb0034650 msgr2=0x7feeb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7feeb0034650 0x7feeb0036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0ac000 tx=0x7fefbc0a5000 comp rx=0 tx=0).stop 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 msgr2=0x55d70a0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 --2- 172.21.15.169:0/517688848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d709f2fac0 0x55d70a0b0070 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fefb4001e20 tx=0x7fefb4000ee0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefca3ba640 1 -- 172.21.15.169:0/517688848 reap_dead start 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 shutdown_connections 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 >> 172.21.15.169:0/517688848 conn(0x55d709fb6060 msgr2=0x55d70a0a2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 shutdown_connections 2024-09-13T06:29:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.129+0000 7fefcc0a9980 1 -- 172.21.15.169:0/517688848 wait complete. 2024-09-13T06:29:43.146 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:29:43.158 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T06:29:43.165 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:43.217 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:43.238 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:43.281 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T06:29:43.292 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:43.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:29:43.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:29:43.293 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:29:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.328+0000 7f3ecbd37980 1 Processor -- start 2024-09-13T06:29:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.328+0000 7f3ecbd37980 1 -- start start 2024-09-13T06:29:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ecbd37980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d8ae7e5e60 0x55d8ae7e8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ecbd37980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8ae667ae0 con 0x55d8ae753b10 2024-09-13T06:29:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ecbd37980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55d8ae68be30 con 0x55d8ae7e5e60 2024-09-13T06:29:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec9046640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55d8ae7e5e60 0x55d8ae7e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec9847640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55d8ae753b10 0x55d8ae7e4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49740/0 (socket says 172.21.15.169:49740) 2024-09-13T06:29:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec9847640 1 -- 172.21.15.169:0/1163535908 learned_addr learned my addr 172.21.15.169:0/1163535908 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec9046640 1 -- 172.21.15.169:0/1163535908 >> v1:172.21.15.112:6789/0 conn(0x55d8ae753b10 legacy=0x55d8ae7e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec9046640 1 -- 172.21.15.169:0/1163535908 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ae753ef0 con 0x55d8ae7e5e60 2024-09-13T06:29:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1163535908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae7e5e60 0x55d8ae7e8250 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400a480 tx=0x7f3eb401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55ade1ccbef808a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec8845640 1 -- 172.21.15.169:0/1163535908 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb40b0070 con 0x55d8ae7e5e60 2024-09-13T06:29:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec8845640 1 -- 172.21.15.169:0/1163535908 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb40ab540 con 0x55d8ae7e5e60 2024-09-13T06:29:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.332+0000 7f3ec8845640 1 -- 172.21.15.169:0/1163535908 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb40ab840 con 0x55d8ae7e5e60 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1163535908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae7e5e60 msgr2=0x55d8ae7e8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1163535908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae7e5e60 0x55d8ae7e8250 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400a480 tx=0x7f3eb401b280 comp rx=0 tx=0).stop 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1163535908 shutdown_connections 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1163535908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae7e5e60 0x55d8ae7e8250 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1163535908 >> 172.21.15.169:0/1163535908 conn(0x55d8ae7da070 msgr2=0x55d8ae7dc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1163535908 shutdown_connections 2024-09-13T06:29:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.336+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1163535908 wait complete. 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 Processor -- start 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- start start 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d8ae68d200 con 0x55d8ae753b10 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56942/0 (socket says 172.21.15.169:56942) 2024-09-13T06:29:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ec9847640 1 -- 172.21.15.169:0/2397018267 learned_addr learned my addr 172.21.15.169:0/2397018267 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ec9847640 1 -- 172.21.15.169:0/2397018267 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ae8cd2c0 con 0x55d8ae753b10 2024-09-13T06:29:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ec9847640 1 --2- 172.21.15.169:0/2397018267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8cccf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0017b0 tx=0x7f3ebc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ba4cb4491e55d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3db7e07640 1 -- 172.21.15.169:0/2397018267 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc016070 con 0x55d8ae753b10 2024-09-13T06:29:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3db7e07640 1 -- 172.21.15.169:0/2397018267 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc004530 con 0x55d8ae753b10 2024-09-13T06:29:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3db7e07640 1 -- 172.21.15.169:0/2397018267 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc004870 con 0x55d8ae753b10 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- 172.21.15.169:0/2397018267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 msgr2=0x55d8ae8cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/2397018267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8cccf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0017b0 tx=0x7f3ebc001c70 comp rx=0 tx=0).stop 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- 172.21.15.169:0/2397018267 shutdown_connections 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/2397018267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8cccf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- 172.21.15.169:0/2397018267 >> 172.21.15.169:0/2397018267 conn(0x55d8ae7da070 msgr2=0x55d8ae8c8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- 172.21.15.169:0/2397018267 shutdown_connections 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- 172.21.15.169:0/2397018267 wait complete. 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 Processor -- start 2024-09-13T06:29:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.352+0000 7f3ecbd37980 1 -- start start 2024-09-13T06:29:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ecbd37980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ecbd37980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d8ae7eb220 con 0x55d8ae753b10 2024-09-13T06:29:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8d40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56948/0 (socket says 172.21.15.169:56948) 2024-09-13T06:29:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9847640 1 -- 172.21.15.169:0/1454606868 learned_addr learned my addr 172.21.15.169:0/1454606868 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9847640 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ae8d45e0 con 0x55d8ae753b10 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9847640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8d40a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc000f90 tx=0x7f3ebc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3db6604640 1 -- 172.21.15.169:0/1454606868 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc020070 con 0x55d8ae753b10 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3db6604640 1 -- 172.21.15.169:0/1454606868 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc011400 con 0x55d8ae753b10 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3db6604640 1 -- 172.21.15.169:0/1454606868 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc016040 con 0x55d8ae753b10 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8ae8d4870 con 0x55d8ae753b10 2024-09-13T06:29:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ae8d7550 con 0x55d8ae753b10 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3db6604640 1 -- 172.21.15.169:0/1454606868 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ebc023070 con 0x55d8ae753b10 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3db6604640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3db0034650 0x7f3db0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3db6604640 1 -- 172.21.15.169:0/1454606868 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f3ebc0491a0 con 0x55d8ae753b10 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3db0034650 0x7f3db0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae7e5e60 0x55d8ae8db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae8db6e0 con 0x55d8ae7e5e60 2024-09-13T06:29:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3eca048640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae7e5e60 0x55d8ae8db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3db0034650 0x7f3db0036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40ad000 tx=0x7f3eb40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.356+0000 7f3eca048640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae7e5e60 0x55d8ae8db1a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3eca048640 1 -- 172.21.15.169:0/1454606868 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae7e5e60 2024-09-13T06:29:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae8dc4c0 0x55d8ae8de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae8deee0 con 0x55d8ae8dc4c0 2024-09-13T06:29:43.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ec9847640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae8dc4c0 0x55d8ae8de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ec9847640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae8dc4c0 0x55d8ae8de8b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ec9847640 1 -- 172.21.15.169:0/1454606868 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ebc02c070 con 0x55d8ae8dc4c0 2024-09-13T06:29:43.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae8e0790 con 0x55d8ae8dc4c0 2024-09-13T06:29:43.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ec9847640 1 -- 172.21.15.169:0/1454606868 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ebc02c070 con 0x55d8ae8dc4c0 2024-09-13T06:29:43.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae8df9c0 con 0x55d8ae8dc4c0 2024-09-13T06:29:43.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ec9847640 1 -- 172.21.15.169:0/1454606868 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ebc02c070 con 0x55d8ae8dc4c0 2024-09-13T06:29:43.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae8e1b40 0x55d8ae8e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.360+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae8e4470 con 0x55d8ae8e1b40 2024-09-13T06:29:43.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae8e1b40 0x55d8ae8e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae8e1b40 0x55d8ae8e3f30 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9046640 1 -- 172.21.15.169:0/1454606868 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3eb40b3040 con 0x55d8ae8e1b40 2024-09-13T06:29:43.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ecbd37980 1 Processor -- start 2024-09-13T06:29:43.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ecbd37980 1 -- start start 2024-09-13T06:29:43.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ecbd37980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 0x55d8ae8f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ecbd37980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d8ae6e6800 con 0x55d8ae8f1df0 2024-09-13T06:29:43.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 0x55d8ae8f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 0x55d8ae8f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56962/0 (socket says 172.21.15.169:56962) 2024-09-13T06:29:43.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9847640 1 -- 172.21.15.169:0/1398092448 learned_addr learned my addr 172.21.15.169:0/1398092448 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9847640 1 -- 172.21.15.169:0/1398092448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ae8f2750 con 0x55d8ae8f1df0 2024-09-13T06:29:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ec9847640 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 0x55d8ae8f2210 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc024b60 tx=0x7f3ebc023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3daf7fe640 1 -- 172.21.15.169:0/1398092448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc040070 con 0x55d8ae8f1df0 2024-09-13T06:29:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8ae8f29e0 con 0x55d8ae8f1df0 2024-09-13T06:29:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3daf7fe640 1 -- 172.21.15.169:0/1398092448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0116e0 con 0x55d8ae8f1df0 2024-09-13T06:29:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3daf7fe640 1 -- 172.21.15.169:0/1398092448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc02a040 con 0x55d8ae8f1df0 2024-09-13T06:29:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.364+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ae8f5660 con 0x55d8ae8f1df0 2024-09-13T06:29:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3daf7fe640 1 -- 172.21.15.169:0/1398092448 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ebc0119c0 con 0x55d8ae8f1df0 2024-09-13T06:29:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3daf7fe640 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3da40346a0 0x7f3da4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3daf7fe640 1 -- 172.21.15.169:0/1398092448 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f3ebc038040 con 0x55d8ae8f1df0 2024-09-13T06:29:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3da40346a0 0x7f3da4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 Processor -- start 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- start start 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9046640 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3da40346a0 0x7f3da4036b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55d8ae8d8690 tx=0x7f3eb4005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae8feb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d8ae8cd640 con 0x55d8ae8fe730 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae8feb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae8feb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56978/0 (socket says 172.21.15.169:56978) 2024-09-13T06:29:43.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9847640 1 -- 172.21.15.169:0/1732189417 learned_addr learned my addr 172.21.15.169:0/1732189417 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9847640 1 -- 172.21.15.169:0/1732189417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ae8ff100 con 0x55d8ae8fe730 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ec9847640 1 --2- 172.21.15.169:0/1732189417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae8feb30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc01efd0 tx=0x7f3ebc044800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b387b0a8d4a25132 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3dad7fa640 1 -- 172.21.15.169:0/1732189417 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc04e030 con 0x55d8ae8fe730 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3dad7fa640 1 -- 172.21.15.169:0/1732189417 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc040bf0 con 0x55d8ae8fe730 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3dad7fa640 1 -- 172.21.15.169:0/1732189417 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc047c00 con 0x55d8ae8fe730 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1732189417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 msgr2=0x55d8ae8feb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1732189417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae8feb30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc01efd0 tx=0x7f3ebc044800 comp rx=0 tx=0).stop 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1732189417 shutdown_connections 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1732189417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae8feb30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1732189417 >> 172.21.15.169:0/1732189417 conn(0x55d8ae8faac0 msgr2=0x55d8ae8f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1732189417 shutdown_connections 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1732189417 wait complete. 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 Processor -- start 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.368+0000 7f3ecbd37980 1 -- start start 2024-09-13T06:29:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae9058f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d8ae8ff650 con 0x55d8ae8fe730 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae9058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ec9847640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae9058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56982/0 (socket says 172.21.15.169:56982) 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 learned_addr learned my addr 172.21.15.169:0/4249995864 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ae905e30 con 0x55d8ae8fe730 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ec9847640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae9058f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0463e0 tx=0x7f3ebc01d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3d9b7fe640 1 -- 172.21.15.169:0/4249995864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc06d070 con 0x55d8ae8fe730 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3d9b7fe640 1 -- 172.21.15.169:0/4249995864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc03e0f0 con 0x55d8ae8fe730 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8ae905e30 con 0x55d8ae8fe730 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3d9b7fe640 1 -- 172.21.15.169:0/4249995864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc044440 con 0x55d8ae8fe730 2024-09-13T06:29:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ae9062a0 con 0x55d8ae8fe730 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3d9b7fe640 1 -- 172.21.15.169:0/4249995864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ebc070070 con 0x55d8ae8fe730 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3d9b7fe640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3d94034650 0x7f3d94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3d9b7fe640 1 -- 172.21.15.169:0/4249995864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f3ebc065070 con 0x55d8ae8fe730 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ec9046640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3d94034650 0x7f3d94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae910860 0x55d8ae912d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae913470 con 0x55d8ae910860 2024-09-13T06:29:43.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.372+0000 7f3eca048640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae910860 0x55d8ae912d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ec9046640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3d94034650 0x7f3d94036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4000c10 tx=0x7f3eb40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3eca048640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae910860 0x55d8ae912d20 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 realm 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae90fc90 con 0x55d8ae910860 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae913f00 con 0x55d8ae910860 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae914ce0 0x55d8ae9170d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae917760 con 0x55d8ae914ce0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ec9847640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae914ce0 0x55d8ae9170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ec9847640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae914ce0 0x55d8ae9170d0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae917fb0 con 0x55d8ae914ce0 2024-09-13T06:29:43.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 20 searching for the correct realm 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae919d20 0x55d8ae91c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.376+0000 7f3ec9046640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae919d20 0x55d8ae91c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9046640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae919d20 0x55d8ae91c110 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9847640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ebc072060 0x7f3ebc0270d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x7f3ebc072060 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ebc072060 0x7f3ebc0270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ebc072060 0x7f3ebc0270d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.380+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x7f3ebc072060 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x7f3ebc072060 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.384+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x7f3ebc072060 2024-09-13T06:29:43.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae910860 2024-09-13T06:29:43.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x7f3ebc072060 2024-09-13T06:29:43.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x7f3ebc072060 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.388+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae919d20 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91c790 con 0x55d8ae914ce0 2024-09-13T06:29:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae918930 con 0x55d8ae910860 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae918570 con 0x55d8ae914ce0 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.392+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae919250 con 0x55d8ae919d20 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 zone default found 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 4 Realm: () 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 zonegroup default 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae918e60 con 0x7f3ebc072060 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91efd0 con 0x55d8ae919d20 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91f370 con 0x55d8ae919d20 2024-09-13T06:29:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 started sync module instance, tier type = 2024-09-13T06:29:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91e410 con 0x55d8ae914ce0 2024-09-13T06:29:43.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389130094864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91e410 con 0x55d8ae914ce0 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.396+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae91fd30 con 0x55d8ae910860 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389130098816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae920580 con 0x55d8ae910860 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae920f80 con 0x55d8ae914ce0 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389130094864] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389130098816] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389130092384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae9200d0 con 0x55d8ae914ce0 2024-09-13T06:29:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.400+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae921820 con 0x7f3ebc072060 2024-09-13T06:29:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389130105712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae9200d0 con 0x7f3ebc072060 2024-09-13T06:29:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae9222f0 con 0x55d8ae914ce0 2024-09-13T06:29:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389130092384] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389130105712] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389130106768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae9222b0 con 0x55d8ae914ce0 2024-09-13T06:29:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.404+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae9226e0 con 0x55d8ae919d20 2024-09-13T06:29:43.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389130103440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae922f80 con 0x55d8ae919d20 2024-09-13T06:29:43.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae9239a0 con 0x55d8ae919d20 2024-09-13T06:29:43.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389130106768] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389130108384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae924270 con 0x55d8ae919d20 2024-09-13T06:29:43.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae924b40 con 0x7f3ebc072060 2024-09-13T06:29:43.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389130103440] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389130111696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae924720 con 0x7f3ebc072060 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389130108384] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=0 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=1 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=2 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=3 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=4 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=5 2024-09-13T06:29:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.408+0000 7f3ecbd37980 20 add_watcher() i=6 2024-09-13T06:29:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389130111696] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 20 add_watcher() i=7 2024-09-13T06:29:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae924550 con 0x55d8ae910860 2024-09-13T06:29:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389130118432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae924f20 con 0x55d8ae910860 2024-09-13T06:29:43.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389130118432] v33'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3d7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 5 note: GC not initialized 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3d7a7fc640 20 reqs_thread_entry: start 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 20 Filter name: none 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3cebfff640 20 reqs_thread_entry: start 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.412+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae94b740 con 0x7f3ebc072060 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 : miss 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.1f 8:fe1f924a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae94d1a0 con 0x7f3ebc072060 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(63 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 info.flags=0x17 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 to cache LRU end 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 20 get_obj_state: octx=0x7f3ebc02f6b0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d8ae94f868 s->prefetch_data=0 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 3.2e 3:7442f694:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x7f3ebc072060 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(64 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f3ec40083f0 con 0x7f3ebc072060 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 10 manifest: total_size = 5 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 20 get_obj_state: setting s->obj_tag to _7bOZbPAXdd9GDQba0ssAgQGXS0Yu_js 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3d7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.416+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389130118432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae910860 2024-09-13T06:29:43.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94389130118432] v33'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ec40083f0 con 0x55d8ae910860 2024-09-13T06:29:43.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389130094864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae914ce0 2024-09-13T06:29:43.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94389130094864] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ecbd37980 20 remove_watcher() i=0 2024-09-13T06:29:43.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ecbd37980 2 removed watcher, disabling cache 2024-09-13T06:29:43.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389130098816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae910860 2024-09-13T06:29:43.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94389130098816] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec403f040 con 0x55d8ae910860 2024-09-13T06:29:43.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ecbd37980 20 remove_watcher() i=1 2024-09-13T06:29:43.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.420+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389130092384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae914ce0 2024-09-13T06:29:43.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.424+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94389130092384] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.424+0000 7f3ecbd37980 20 remove_watcher() i=2 2024-09-13T06:29:43.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.424+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389130105712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x7f3ebc072060 2024-09-13T06:29:43.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.424+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94389130105712] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec403f040 con 0x7f3ebc072060 2024-09-13T06:29:43.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.424+0000 7f3ecbd37980 20 remove_watcher() i=3 2024-09-13T06:29:43.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.424+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389130106768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae914ce0 2024-09-13T06:29:43.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ec9847640 1 -- 172.21.15.169:0/4249995864 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94389130106768] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc06f030 con 0x55d8ae914ce0 2024-09-13T06:29:43.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ecbd37980 20 remove_watcher() i=4 2024-09-13T06:29:43.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389130103440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae919d20 2024-09-13T06:29:43.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94389130103440] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ecbd37980 20 remove_watcher() i=5 2024-09-13T06:29:43.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389130108384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x55d8ae919d20 2024-09-13T06:29:43.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ec9046640 1 -- 172.21.15.169:0/4249995864 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94389130108384] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb40c9030 con 0x55d8ae919d20 2024-09-13T06:29:43.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ecbd37980 20 remove_watcher() i=6 2024-09-13T06:29:43.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.428+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389130111696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8ae950770 con 0x7f3ebc072060 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94389130111696] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec403f040 con 0x7f3ebc072060 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 20 remove_watcher() i=7 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae914ce0 msgr2=0x55d8ae9170d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae914ce0 0x55d8ae9170d0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae910860 msgr2=0x55d8ae912d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae910860 0x55d8ae912d20 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ebc072060 msgr2=0x7f3ebc0270d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ebc072060 0x7f3ebc0270d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae919d20 msgr2=0x55d8ae91c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae919d20 0x55d8ae91c110 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3d94034650 msgr2=0x7f3d94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3d94034650 0x7f3d94036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4000c10 tx=0x7f3eb40a6000 comp rx=0 tx=0).stop 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3eca048640 1 -- 172.21.15.169:0/4249995864 reap_dead start 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 msgr2=0x55d8ae9058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae9058f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0463e0 tx=0x7f3ebc01d400 comp rx=0 tx=0).stop 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 shutdown_connections 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/4249995864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8fe730 0x55d8ae9058f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 >> 172.21.15.169:0/4249995864 conn(0x55d8ae8faac0 msgr2=0x55d8ae8f8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 shutdown_connections 2024-09-13T06:29:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/4249995864 wait complete. 2024-09-13T06:29:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3da40346a0 msgr2=0x7f3da4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3da40346a0 0x7f3da4036b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55d8ae8d8690 tx=0x7f3eb4005a10 comp rx=0 tx=0).stop 2024-09-13T06:29:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 msgr2=0x55d8ae8f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 0x55d8ae8f2210 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc024b60 tx=0x7f3ebc023ac0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 shutdown_connections 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3da40346a0 0x7f3da4036b60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1398092448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae8f1df0 0x55d8ae8f2210 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 >> 172.21.15.169:0/1398092448 conn(0x55d8ae8e6f40 msgr2=0x55d8ae8e99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 shutdown_connections 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1398092448 wait complete. 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae8dc4c0 msgr2=0x55d8ae8de8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55d8ae8dc4c0 0x55d8ae8de8b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae7e5e60 msgr2=0x55d8ae8db1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55d8ae7e5e60 0x55d8ae8db1a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae8e1b40 msgr2=0x55d8ae8e3f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55d8ae8e1b40 0x55d8ae8e3f30 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3db0034650 msgr2=0x7f3db0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3db0034650 0x7f3db0036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40ad000 tx=0x7f3eb40a5040 comp rx=0 tx=0).stop 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 msgr2=0x55d8ae8d40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 --2- 172.21.15.169:0/1454606868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d8ae753b10 0x55d8ae8d40a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc000f90 tx=0x7f3ebc001260 comp rx=0 tx=0).stop 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3eca048640 1 -- 172.21.15.169:0/1454606868 reap_dead start 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 shutdown_connections 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 >> 172.21.15.169:0/1454606868 conn(0x55d8ae7da070 msgr2=0x55d8ae8c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 shutdown_connections 2024-09-13T06:29:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.432+0000 7f3ecbd37980 1 -- 172.21.15.169:0/1454606868 wait complete. 2024-09-13T06:29:43.447 INFO:teuthology.orchestra.run.smithi169.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T06:29:43.447 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T06:29:43.450 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T06:29:43.456 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:43.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:29:43.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:29:43.457 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:29:43.522 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:43.522 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0224300980 1 Processor -- start 2024-09-13T06:29:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0224300980 1 -- start start 2024-09-13T06:29:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0224300980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b86916d2a0 0x55b8691fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0224300980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b869080ae0 con 0x55b8691fdcf0 2024-09-13T06:29:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0224300980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55b8690a4e30 con 0x55b86916d2a0 2024-09-13T06:29:43.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0221e10640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b86916d2a0 0x55b8691fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0221e10640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b86916d2a0 0x55b8691fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56984/0 (socket says 172.21.15.169:56984) 2024-09-13T06:29:43.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f022160f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55b8691fdcf0 0x55b8692000e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49746/0 (socket says 172.21.15.169:49746) 2024-09-13T06:29:43.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0221e10640 1 -- 172.21.15.169:0/2290543857 learned_addr learned my addr 172.21.15.169:0/2290543857 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0221e10640 1 -- 172.21.15.169:0/2290543857 >> v1:172.21.15.112:6789/0 conn(0x55b8691fdcf0 legacy=0x55b8692000e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.520+0000 7f0221e10640 1 -- 172.21.15.169:0/2290543857 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86916d680 con 0x55b86916d2a0 2024-09-13T06:29:43.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0221e10640 1 --2- 172.21.15.169:0/2290543857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8691fd7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f021400a5c0 tx=0x7f021401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff93027a9ac780d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0220e0e640 1 -- 172.21.15.169:0/2290543857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140a6070 con 0x55b86916d2a0 2024-09-13T06:29:43.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0220e0e640 1 -- 172.21.15.169:0/2290543857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02140af070 con 0x55b86916d2a0 2024-09-13T06:29:43.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0220e0e640 1 -- 172.21.15.169:0/2290543857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140aa5c0 con 0x55b86916d2a0 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 -- 172.21.15.169:0/2290543857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 msgr2=0x55b8691fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 --2- 172.21.15.169:0/2290543857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8691fd7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f021400a5c0 tx=0x7f021401b340 comp rx=0 tx=0).stop 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 -- 172.21.15.169:0/2290543857 shutdown_connections 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 --2- 172.21.15.169:0/2290543857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8691fd7b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 -- 172.21.15.169:0/2290543857 >> 172.21.15.169:0/2290543857 conn(0x55b8691f30a0 msgr2=0x55b8691f54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 -- 172.21.15.169:0/2290543857 shutdown_connections 2024-09-13T06:29:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.524+0000 7f0224300980 1 -- 172.21.15.169:0/2290543857 wait complete. 2024-09-13T06:29:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0224300980 1 Processor -- start 2024-09-13T06:29:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0224300980 1 -- start start 2024-09-13T06:29:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0224300980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0224300980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b8690a6200 con 0x55b86916d2a0 2024-09-13T06:29:43.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692e5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:56996/0 (socket says 172.21.15.169:56996) 2024-09-13T06:29:43.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0221e10640 1 -- 172.21.15.169:0/1152569900 learned_addr learned my addr 172.21.15.169:0/1152569900 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0221e10640 1 -- 172.21.15.169:0/1152569900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8692e62f0 con 0x55b86916d2a0 2024-09-13T06:29:43.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f0221e10640 1 --2- 172.21.15.169:0/1152569900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692e5d20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f021401b380 tx=0x7f0214003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff439a8d61ada57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f010fe07640 1 -- 172.21.15.169:0/1152569900 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140aa9d0 con 0x55b86916d2a0 2024-09-13T06:29:43.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f010fe07640 1 -- 172.21.15.169:0/1152569900 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02140aab90 con 0x55b86916d2a0 2024-09-13T06:29:43.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.540+0000 7f010fe07640 1 -- 172.21.15.169:0/1152569900 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140bd3f0 con 0x55b86916d2a0 2024-09-13T06:29:43.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1152569900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 msgr2=0x55b8692e5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 --2- 172.21.15.169:0/1152569900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692e5d20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f021401b380 tx=0x7f0214003030 comp rx=0 tx=0).stop 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1152569900 shutdown_connections 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 --2- 172.21.15.169:0/1152569900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692e5d20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1152569900 >> 172.21.15.169:0/1152569900 conn(0x55b8691f30a0 msgr2=0x55b8692e1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1152569900 shutdown_connections 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1152569900 wait complete. 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 Processor -- start 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- start start 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b869204230 con 0x55b86916d2a0 2024-09-13T06:29:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692ecf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57000/0 (socket says 172.21.15.169:57000) 2024-09-13T06:29:43.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0221e10640 1 -- 172.21.15.169:0/1854933279 learned_addr learned my addr 172.21.15.169:0/1854933279 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0221e10640 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8692ed450 con 0x55b86916d2a0 2024-09-13T06:29:43.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0221e10640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692ecf10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f021401b380 tx=0x7f02140180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f010e604640 1 -- 172.21.15.169:0/1854933279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140c6690 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8692ed6e0 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f010e604640 1 -- 172.21.15.169:0/1854933279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02140cc070 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f010e604640 1 -- 172.21.15.169:0/1854933279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140c6960 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8692f03c0 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f010e604640 1 -- 172.21.15.169:0/1854933279 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f02140c6b90 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f010e604640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108034650 0x7f0108036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f010e604640 1 -- 172.21.15.169:0/1854933279 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f02140e5400 con 0x55b86916d2a0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f022160f640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108034650 0x7f0108036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b8691fdcf0 0x55b8692f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.544+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8692f4530 con 0x55b8691fdcf0 2024-09-13T06:29:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0222611640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b8691fdcf0 0x55b8692f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f022160f640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108034650 0x7f0108036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0218000f70 tx=0x7f0218001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0222611640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b8691fdcf0 0x55b8692f3ec0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0222611640 1 -- 172.21.15.169:0/1854933279 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b8691fdcf0 2024-09-13T06:29:43.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b8692f5300 0x55b8692f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8692f7d30 con 0x55b8692f5300 2024-09-13T06:29:43.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0221e10640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b8692f5300 0x55b8692f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0221e10640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b8692f5300 0x55b8692f76f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0221e10640 1 -- 172.21.15.169:0/1854933279 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02140e5130 con 0x55b8692f5300 2024-09-13T06:29:43.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8692f95e0 con 0x55b8692f5300 2024-09-13T06:29:43.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0221e10640 1 -- 172.21.15.169:0/1854933279 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f02140e5130 con 0x55b8692f5300 2024-09-13T06:29:43.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8692f8810 con 0x55b8692f5300 2024-09-13T06:29:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0221e10640 1 -- 172.21.15.169:0/1854933279 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02140e5130 con 0x55b8692f5300 2024-09-13T06:29:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b8692fa990 0x55b8692fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.548+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8692fd2c0 con 0x55b8692fa990 2024-09-13T06:29:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f022160f640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b8692fa990 0x55b8692fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f022160f640 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b8692fa990 0x55b8692fcd80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f022160f640 1 -- 172.21.15.169:0/1854933279 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f021800f6a0 con 0x55b8692fa990 2024-09-13T06:29:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0224300980 1 Processor -- start 2024-09-13T06:29:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0224300980 1 -- start start 2024-09-13T06:29:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0224300980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 0x55b86930b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0224300980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b8690ff800 con 0x55b86930acc0 2024-09-13T06:29:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 0x55b86930b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 0x55b86930b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57012/0 (socket says 172.21.15.169:57012) 2024-09-13T06:29:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0221e10640 1 -- 172.21.15.169:0/849227849 learned_addr learned my addr 172.21.15.169:0/849227849 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0221e10640 1 -- 172.21.15.169:0/849227849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86930b620 con 0x55b86930acc0 2024-09-13T06:29:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0221e10640 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 0x55b86930b0e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f02140bc6f0 tx=0x7f02140c5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f01077fe640 1 -- 172.21.15.169:0/849227849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140bcbf0 con 0x55b86930acc0 2024-09-13T06:29:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b86930b8b0 con 0x55b86930acc0 2024-09-13T06:29:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f01077fe640 1 -- 172.21.15.169:0/849227849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02140bcd90 con 0x55b86930acc0 2024-09-13T06:29:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f01077fe640 1 -- 172.21.15.169:0/849227849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140e3130 con 0x55b86930acc0 2024-09-13T06:29:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.552+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86930e530 con 0x55b86930acc0 2024-09-13T06:29:43.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f01077fe640 1 -- 172.21.15.169:0/849227849 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f02140e32d0 con 0x55b86930acc0 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f01077fe640 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00fc034650 0x7f00fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f01077fe640 1 -- 172.21.15.169:0/849227849 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f02140ec070 con 0x55b86930acc0 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f022160f640 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00fc034650 0x7f00fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 Processor -- start 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- start start 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b8693179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b8692e65b0 con 0x55b869317600 2024-09-13T06:29:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f022160f640 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00fc034650 0x7f00fc036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b8692f1500 tx=0x7f021800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b8693179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b8693179e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57020/0 (socket says 172.21.15.169:57020) 2024-09-13T06:29:43.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 -- 172.21.15.169:0/319935309 learned_addr learned my addr 172.21.15.169:0/319935309 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 -- 172.21.15.169:0/319935309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b869317fb0 con 0x55b869317600 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 --2- 172.21.15.169:0/319935309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b8693179e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f02140b5f90 tx=0x7f02140c6b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804fc04e6677cfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f01057fa640 1 -- 172.21.15.169:0/319935309 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0214108020 con 0x55b869317600 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f01057fa640 1 -- 172.21.15.169:0/319935309 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02140e35c0 con 0x55b869317600 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f01057fa640 1 -- 172.21.15.169:0/319935309 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140c75c0 con 0x55b869317600 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- 172.21.15.169:0/319935309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 msgr2=0x55b8693179e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 --2- 172.21.15.169:0/319935309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b8693179e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f02140b5f90 tx=0x7f02140c6b20 comp rx=0 tx=0).stop 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- 172.21.15.169:0/319935309 shutdown_connections 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 --2- 172.21.15.169:0/319935309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b8693179e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- 172.21.15.169:0/319935309 >> 172.21.15.169:0/319935309 conn(0x55b8693139e0 msgr2=0x55b869311ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- 172.21.15.169:0/319935309 shutdown_connections 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- 172.21.15.169:0/319935309 wait complete. 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 Processor -- start 2024-09-13T06:29:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- start start 2024-09-13T06:29:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b86931e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0224300980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b869318450 con 0x55b869317600 2024-09-13T06:29:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b86931e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b86931e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57034/0 (socket says 172.21.15.169:57034) 2024-09-13T06:29:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.556+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 learned_addr learned my addr 172.21.15.169:0/3040070898 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86931ed20 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0221e10640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b86931e7e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f02140e0dd0 tx=0x7f02140eded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f00f37fe640 1 -- 172.21.15.169:0/3040070898 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140c75c0 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f00f37fe640 1 -- 172.21.15.169:0/3040070898 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02140d2c40 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b86931ed20 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f00f37fe640 1 -- 172.21.15.169:0/3040070898 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02140e0e40 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86931ed20 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f00f37fe640 1 -- 172.21.15.169:0/3040070898 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f021410b020 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f00f37fe640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00ec0346a0 0x7f00ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f00f37fe640 1 -- 172.21.15.169:0/3040070898 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f0214118be0 con 0x55b869317600 2024-09-13T06:29:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f022160f640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00ec0346a0 0x7f00ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b869329710 0x55b86932bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b86932c320 con 0x55b869329710 2024-09-13T06:29:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0222611640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b869329710 0x55b86932bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f022160f640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00ec0346a0 0x7f00ec036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f021800c010 tx=0x7f0218010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0222611640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b869329710 0x55b86932bbd0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 20 realm 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.560+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869328b40 con 0x55b869329710 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b86932cdb0 con 0x55b869329710 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b86932db90 0x55b86932ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869330610 con 0x55b86932db90 2024-09-13T06:29:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0221e10640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b86932db90 0x55b86932ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0221e10640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b86932db90 0x55b86932ff80 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 20 searching for the correct realm 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b869332bd0 0x55b869334fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869335640 con 0x55b869332bd0 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f022160f640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b869332bd0 0x55b869334fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f022160f640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b869332bd0 0x55b869334fc0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.564+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869335640 con 0x55b86932db90 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f021410d070 0x7f02140d2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x7f021410d070 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f021410d070 0x7f02140d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f021410d070 0x7f02140d2240 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869332bd0 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.568+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x7f021410d070 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x7f021410d070 2024-09-13T06:29:43.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869332bd0 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869332bd0 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.572+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869332bd0 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x7f021410d070 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869329710 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x7f021410d070 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869332bd0 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x7f021410d070 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b869332bd0 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.576+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b869330e60 con 0x55b86932db90 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8693316b0 con 0x55b869329710 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869331aa0 con 0x55b86932db90 2024-09-13T06:29:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869331aa0 con 0x55b869332bd0 2024-09-13T06:29:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 zone default found 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 4 Realm: () 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 zonegroup default 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869335aa0 con 0x7f021410d070 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869331fe0 con 0x55b869332bd0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869337e10 con 0x55b869332bd0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 started sync module instance, tier type = 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.580+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869337160 con 0x55b86932db90 2024-09-13T06:29:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250527323744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869337160 con 0x55b86932db90 2024-09-13T06:29:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869338890 con 0x55b869329710 2024-09-13T06:29:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250527327200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869339130 con 0x55b869329710 2024-09-13T06:29:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869339b30 con 0x55b86932db90 2024-09-13T06:29:43.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.584+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250527323744] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250527327200] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250527321264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869338c80 con 0x55b86932db90 2024-09-13T06:29:43.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933a3d0 con 0x7f021410d070 2024-09-13T06:29:43.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250527334176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869338c80 con 0x7f021410d070 2024-09-13T06:29:43.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933ae90 con 0x55b86932db90 2024-09-13T06:29:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.588+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250527334176] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250527321264] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250527331904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933ae50 con 0x55b86932db90 2024-09-13T06:29:43.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933b280 con 0x55b869332bd0 2024-09-13T06:29:43.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250527335232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933bb20 con 0x55b869332bd0 2024-09-13T06:29:43.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933c4e0 con 0x55b869332bd0 2024-09-13T06:29:43.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250527331904] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250527335232] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250527342640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933c900 con 0x55b869332bd0 2024-09-13T06:29:43.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.592+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933d150 con 0x7f021410d070 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250527342640] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250527344976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933d220 con 0x7f021410d070 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=0 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=1 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=2 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=3 2024-09-13T06:29:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=4 2024-09-13T06:29:43.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=5 2024-09-13T06:29:43.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=6 2024-09-13T06:29:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250527344976] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 20 add_watcher() i=7 2024-09-13T06:29:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869340560 con 0x55b869329710 2024-09-13T06:29:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.596+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250527358848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b86933d390 con 0x55b869329710 2024-09-13T06:29:43.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250527358848] v33'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f00d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 5 note: GC not initialized 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f00d27fc640 20 reqs_thread_entry: start 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 Filter name: none 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0043fff640 20 reqs_thread_entry: start 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8693642f0 con 0x7f021410d070 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 : miss 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.1f 8:fe1f924a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869365d50 con 0x7f021410d070 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(63 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 info.flags=0x17 2024-09-13T06:29:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 to cache LRU end 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 get_obj_state: octx=0x7f02140e3f10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b869368418 s->prefetch_data=0 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 3.2e 3:7442f694:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x7f021410d070 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(64 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 10 manifest: total_size = 5 2024-09-13T06:29:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.600+0000 7f0224300980 20 get_obj_state: setting s->obj_tag to _NrCElYBTzp8T0pwYNlJ1ZZ75gMIrrqY 2024-09-13T06:29:43.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.604+0000 7f00d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.604+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250527358848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b869329710 2024-09-13T06:29:43.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.604+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94250527358848] v33'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.604+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250527323744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b86932db90 2024-09-13T06:29:43.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94250527323744] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0224300980 20 remove_watcher() i=0 2024-09-13T06:29:43.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0224300980 2 removed watcher, disabling cache 2024-09-13T06:29:43.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250527327200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b869329710 2024-09-13T06:29:43.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94250527327200] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x55b869329710 2024-09-13T06:29:43.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0224300980 20 remove_watcher() i=1 2024-09-13T06:29:43.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.608+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250527321264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b86932db90 2024-09-13T06:29:43.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94250527321264] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0224300980 20 remove_watcher() i=2 2024-09-13T06:29:43.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250527334176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x7f021410d070 2024-09-13T06:29:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94250527334176] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0224300980 20 remove_watcher() i=3 2024-09-13T06:29:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250527331904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b86932db90 2024-09-13T06:29:43.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0221e10640 1 -- 172.21.15.169:0/3040070898 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94250527331904] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02140e5130 con 0x55b86932db90 2024-09-13T06:29:43.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0224300980 20 remove_watcher() i=4 2024-09-13T06:29:43.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.612+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250527335232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b869332bd0 2024-09-13T06:29:43.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94250527335232] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 20 remove_watcher() i=5 2024-09-13T06:29:43.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250527342640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x55b869332bd0 2024-09-13T06:29:43.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f022160f640 1 -- 172.21.15.169:0/3040070898 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94250527342640] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0218037040 con 0x55b869332bd0 2024-09-13T06:29:43.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 20 remove_watcher() i=6 2024-09-13T06:29:43.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250527344976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b869369320 con 0x7f021410d070 2024-09-13T06:29:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94250527344976] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c00a4d0 con 0x7f021410d070 2024-09-13T06:29:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 20 remove_watcher() i=7 2024-09-13T06:29:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b86932db90 msgr2=0x55b86932ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b86932db90 0x55b86932ff80 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b869329710 msgr2=0x55b86932bbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b869329710 0x55b86932bbd0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f021410d070 msgr2=0x7f02140d2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f021410d070 0x7f02140d2240 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b869332bd0 msgr2=0x55b869334fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b869332bd0 0x55b869334fc0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00ec0346a0 msgr2=0x7f00ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00ec0346a0 0x7f00ec036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f021800c010 tx=0x7f0218010000 comp rx=0 tx=0).stop 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 msgr2=0x55b86931e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 --2- 172.21.15.169:0/3040070898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b869317600 0x55b86931e7e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f02140e0dd0 tx=0x7f02140eded0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 reap_dead start 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0222611640 1 -- 172.21.15.169:0/3040070898 reap_dead start 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 shutdown_connections 2024-09-13T06:29:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 >> 172.21.15.169:0/3040070898 conn(0x55b8693139e0 msgr2=0x55b869311ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 shutdown_connections 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.616+0000 7f0224300980 1 -- 172.21.15.169:0/3040070898 wait complete. 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00fc034650 msgr2=0x7f00fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00fc034650 0x7f00fc036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b8692f1500 tx=0x7f021800f000 comp rx=0 tx=0).stop 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 msgr2=0x55b86930b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 0x55b86930b0e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f02140bc6f0 tx=0x7f02140c5890 comp rx=0 tx=0).stop 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 shutdown_connections 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f00fc034650 0x7f00fc036b10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/849227849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86930acc0 0x55b86930b0e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 >> 172.21.15.169:0/849227849 conn(0x55b8692ffe10 msgr2=0x55b869302890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 shutdown_connections 2024-09-13T06:29:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/849227849 wait complete. 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b8692f5300 msgr2=0x55b8692f76f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b8692f5300 0x55b8692f76f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b8691fdcf0 msgr2=0x55b8692f3ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b8691fdcf0 0x55b8692f3ec0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b8692fa990 msgr2=0x55b8692fcd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b8692fa990 0x55b8692fcd80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108034650 msgr2=0x7f0108036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108034650 0x7f0108036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0218000f70 tx=0x7f0218001380 comp rx=0 tx=0).stop 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 msgr2=0x55b8692ecf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 --2- 172.21.15.169:0/1854933279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b86916d2a0 0x55b8692ecf10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f021401b380 tx=0x7f02140180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0222611640 1 -- 172.21.15.169:0/1854933279 reap_dead start 2024-09-13T06:29:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 shutdown_connections 2024-09-13T06:29:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 >> 172.21.15.169:0/1854933279 conn(0x55b8691f30a0 msgr2=0x55b8692e04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 shutdown_connections 2024-09-13T06:29:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.620+0000 7f0224300980 1 -- 172.21.15.169:0/1854933279 wait complete. 2024-09-13T06:29:43.633 INFO:teuthology.orchestra.run.smithi169.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T06:29:43.634 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T06:29:43.636 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T06:29:43.653 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:43.761 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T06:29:43.761 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T06:29:43.762 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:29:43.762 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T06:29:43.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T06:29:43.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T06:29:43.762 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T06:29:43.802 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:43.802 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89f967980 1 Processor -- start 2024-09-13T06:29:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89f967980 1 -- start start 2024-09-13T06:29:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89f967980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561a30dbe8f0 0x561a30dbecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89f967980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a30c44ae0 con 0x561a30dbf240 2024-09-13T06:29:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89f967980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x561a30c68e30 con 0x561a30dbe8f0 2024-09-13T06:29:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89d477640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561a30dbe8f0 0x561a30dbecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89d477640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561a30dbe8f0 0x561a30dbecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57042/0 (socket says 172.21.15.169:57042) 2024-09-13T06:29:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89cc76640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x561a30dbf240 0x561a30dc3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49756/0 (socket says 172.21.15.169:49756) 2024-09-13T06:29:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89d477640 1 -- 172.21.15.169:0/2378892248 learned_addr learned my addr 172.21.15.169:0/2378892248 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89d477640 1 -- 172.21.15.169:0/2378892248 >> v1:172.21.15.112:6789/0 conn(0x561a30dbf240 legacy=0x561a30dc3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.800+0000 7fb89d477640 1 -- 172.21.15.169:0/2378892248 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a30dc64c0 con 0x561a30dbe8f0 2024-09-13T06:29:43.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89d477640 1 --2- 172.21.15.169:0/2378892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30dbecd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb89001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ecbb5150494196 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb88ffff640 1 -- 172.21.15.169:0/2378892248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900a6070 con 0x561a30dbe8f0 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb88ffff640 1 -- 172.21.15.169:0/2378892248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900af070 con 0x561a30dbe8f0 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb88ffff640 1 -- 172.21.15.169:0/2378892248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900aa5c0 con 0x561a30dbe8f0 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 -- 172.21.15.169:0/2378892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 msgr2=0x561a30dbecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 --2- 172.21.15.169:0/2378892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30dbecd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb89001b340 comp rx=0 tx=0).stop 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 -- 172.21.15.169:0/2378892248 shutdown_connections 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 --2- 172.21.15.169:0/2378892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30dbecd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 -- 172.21.15.169:0/2378892248 >> 172.21.15.169:0/2378892248 conn(0x561a30d32240 msgr2=0x561a30d32650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 -- 172.21.15.169:0/2378892248 shutdown_connections 2024-09-13T06:29:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.804+0000 7fb89f967980 1 -- 172.21.15.169:0/2378892248 wait complete. 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89f967980 1 Processor -- start 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89f967980 1 -- start start 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89f967980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30ea9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89f967980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a30c6a200 con 0x561a30dbe8f0 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30ea9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30ea9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57052/0 (socket says 172.21.15.169:57052) 2024-09-13T06:29:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89d477640 1 -- 172.21.15.169:0/2016127189 learned_addr learned my addr 172.21.15.169:0/2016127189 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.820+0000 7fb89d477640 1 -- 172.21.15.169:0/2016127189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a30eaa1b0 con 0x561a30dbe8f0 2024-09-13T06:29:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89d477640 1 --2- 172.21.15.169:0/2016127189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30ea9be0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb890003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d477ef38ca18bbe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb78b606640 1 -- 172.21.15.169:0/2016127189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900aa9b0 con 0x561a30dbe8f0 2024-09-13T06:29:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb78b606640 1 -- 172.21.15.169:0/2016127189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900aab50 con 0x561a30dbe8f0 2024-09-13T06:29:43.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb78b606640 1 -- 172.21.15.169:0/2016127189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900aae50 con 0x561a30dbe8f0 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/2016127189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 msgr2=0x561a30ea9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 --2- 172.21.15.169:0/2016127189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30ea9be0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb890003030 comp rx=0 tx=0).stop 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/2016127189 shutdown_connections 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 --2- 172.21.15.169:0/2016127189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30ea9be0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/2016127189 >> 172.21.15.169:0/2016127189 conn(0x561a30d32240 msgr2=0x561a30ea5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/2016127189 shutdown_connections 2024-09-13T06:29:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/2016127189 wait complete. 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 Processor -- start 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- start start 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30eb0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a30dc5f00 con 0x561a30dbe8f0 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30eb0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30eb0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57058/0 (socket says 172.21.15.169:57058) 2024-09-13T06:29:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89d477640 1 -- 172.21.15.169:0/1973222025 learned_addr learned my addr 172.21.15.169:0/1973222025 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89d477640 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a30eb13f0 con 0x561a30dbe8f0 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89d477640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30eb0eb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb8900180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb789e03640 1 -- 172.21.15.169:0/1973222025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900cb020 con 0x561a30dbe8f0 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a30eb1680 con 0x561a30dbe8f0 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb789e03640 1 -- 172.21.15.169:0/1973222025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900c6710 con 0x561a30dbe8f0 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb789e03640 1 -- 172.21.15.169:0/1973222025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900c69f0 con 0x561a30dbe8f0 2024-09-13T06:29:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.824+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a30eb4360 con 0x561a30dbe8f0 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb789e03640 1 -- 172.21.15.169:0/1973222025 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8900ce020 con 0x561a30dbe8f0 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb789e03640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb784034650 0x7fb784036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb789e03640 1 -- 172.21.15.169:0/1973222025 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb8900e5460 con 0x561a30dbe8f0 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89cc76640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb784034650 0x7fb784036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30dbf240 0x561a30eb7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30eb84f0 con 0x561a30dbf240 2024-09-13T06:29:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89dc78640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30dbf240 0x561a30eb7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89cc76640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb784034650 0x7fb784036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8940012f0 tx=0x7fb894006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89dc78640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30dbf240 0x561a30eb7e80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89dc78640 1 -- 172.21.15.169:0/1973222025 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30dbf240 2024-09-13T06:29:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30eb92c0 0x561a30ebb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ebbcf0 con 0x561a30eb92c0 2024-09-13T06:29:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89d477640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30eb92c0 0x561a30ebb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.828+0000 7fb89d477640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30eb92c0 0x561a30ebb6b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 -- 172.21.15.169:0/1973222025 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8900bd8c0 con 0x561a30eb92c0 2024-09-13T06:29:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ebd5a0 con 0x561a30eb92c0 2024-09-13T06:29:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 -- 172.21.15.169:0/1973222025 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8900bd8c0 con 0x561a30eb92c0 2024-09-13T06:29:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ebc7d0 con 0x561a30eb92c0 2024-09-13T06:29:43.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 -- 172.21.15.169:0/1973222025 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8900bd8c0 con 0x561a30eb92c0 2024-09-13T06:29:43.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ebe950 0x561a30ec0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ec1280 con 0x561a30ebe950 2024-09-13T06:29:43.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89cc76640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ebe950 0x561a30ec0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89cc76640 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ebe950 0x561a30ec0d40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89cc76640 1 -- 172.21.15.169:0/1973222025 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ebe950 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 Processor -- start 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 -- start start 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 0x561a30ecf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89f967980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a30cc3800 con 0x561a30ecec40 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 0x561a30ecf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 0x561a30ecf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57074/0 (socket says 172.21.15.169:57074) 2024-09-13T06:29:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 -- 172.21.15.169:0/3068386868 learned_addr learned my addr 172.21.15.169:0/3068386868 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.832+0000 7fb89d477640 1 -- 172.21.15.169:0/3068386868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a30ecf5a0 con 0x561a30ecec40 2024-09-13T06:29:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89d477640 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 0x561a30ecf060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb8900aaad0 tx=0x7fb8900b53a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb782ffd640 1 -- 172.21.15.169:0/3068386868 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900c6d50 con 0x561a30ecec40 2024-09-13T06:29:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb782ffd640 1 -- 172.21.15.169:0/3068386868 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900c7c10 con 0x561a30ecec40 2024-09-13T06:29:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a30ecf830 con 0x561a30ecec40 2024-09-13T06:29:43.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb782ffd640 1 -- 172.21.15.169:0/3068386868 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900cf730 con 0x561a30ecec40 2024-09-13T06:29:43.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a30ed24b0 con 0x561a30ecec40 2024-09-13T06:29:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb782ffd640 1 -- 172.21.15.169:0/3068386868 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8900cf8d0 con 0x561a30ecec40 2024-09-13T06:29:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb782ffd640 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb774034650 0x7fb774036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb782ffd640 1 -- 172.21.15.169:0/3068386868 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb8900f0c00 con 0x561a30ecec40 2024-09-13T06:29:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89cc76640 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb774034650 0x7fb774036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89f967980 1 Processor -- start 2024-09-13T06:29:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89f967980 1 -- start start 2024-09-13T06:29:43.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89cc76640 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb774034650 0x7fb774036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb894006300 tx=0x7fb89400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89f967980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30edb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89f967980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a30eaa470 con 0x561a30edb5c0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30edb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30edb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57088/0 (socket says 172.21.15.169:57088) 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89d477640 1 -- 172.21.15.169:0/529929558 learned_addr learned my addr 172.21.15.169:0/529929558 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89d477640 1 -- 172.21.15.169:0/529929558 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a30edbf70 con 0x561a30edb5c0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.836+0000 7fb89d477640 1 --2- 172.21.15.169:0/529929558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30edb9a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb8900c6bf0 tx=0x7fb8900b5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44907427bd5e6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb780ff9640 1 -- 172.21.15.169:0/529929558 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900dc430 con 0x561a30edb5c0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb780ff9640 1 -- 172.21.15.169:0/529929558 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900b5bf0 con 0x561a30edb5c0 2024-09-13T06:29:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb780ff9640 1 -- 172.21.15.169:0/529929558 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900dfd90 con 0x561a30edb5c0 2024-09-13T06:29:43.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/529929558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 msgr2=0x561a30edb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 --2- 172.21.15.169:0/529929558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30edb9a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb8900c6bf0 tx=0x7fb8900b5f70 comp rx=0 tx=0).stop 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/529929558 shutdown_connections 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 --2- 172.21.15.169:0/529929558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30edb9a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/529929558 >> 172.21.15.169:0/529929558 conn(0x561a30ed79a0 msgr2=0x561a30ed5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/529929558 shutdown_connections 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/529929558 wait complete. 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 Processor -- start 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- start start 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30ee2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a30edbf70 con 0x561a30edb5c0 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30ee2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89d477640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30ee2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57096/0 (socket says 172.21.15.169:57096) 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 learned_addr learned my addr 172.21.15.169:0/3511640297 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a30ee2b60 con 0x561a30edb5c0 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89d477640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30ee2620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb8900b5ba0 tx=0x7fb8900a5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb772ffd640 1 -- 172.21.15.169:0/3511640297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900dc610 con 0x561a30edb5c0 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a30ee2b60 con 0x561a30edb5c0 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb772ffd640 1 -- 172.21.15.169:0/3511640297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89010d070 con 0x561a30edb5c0 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb772ffd640 1 -- 172.21.15.169:0/3511640297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900dc430 con 0x561a30edb5c0 2024-09-13T06:29:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a30ee2fd0 con 0x561a30edb5c0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.840+0000 7fb772ffd640 1 -- 172.21.15.169:0/3511640297 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8900c5810 con 0x561a30edb5c0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb772ffd640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb768034650 0x7fb768036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb772ffd640 1 -- 172.21.15.169:0/3511640297 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb8900f3170 con 0x561a30edb5c0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89cc76640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb768034650 0x7fb768036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30eed470 0x561a30eef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef0080 con 0x561a30eed470 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89dc78640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30eed470 0x561a30eef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89cc76640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb768034650 0x7fb768036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x561a30eb54a0 tx=0x7fb894010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89dc78640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30eed470 0x561a30eef930 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 realm 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30eec8a0 con 0x561a30eed470 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef0b10 con 0x561a30eed470 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30ef18f0 0x561a30ef3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4370 con 0x561a30ef18f0 2024-09-13T06:29:43.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89d477640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30ef18f0 0x561a30ef3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89d477640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30ef18f0 0x561a30ef3ce0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.844+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89f967980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89f967980 20 searching for the correct realm 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ef6930 0x561a30ef8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef93a0 con 0x561a30ef6930 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89cc76640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ef6930 0x561a30ef8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89cc76640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ef6930 0x561a30ef8d20 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef93a0 con 0x561a30ef18f0 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89d477640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb8900db040 0x7fb8900d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x7fb8900db040 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb8900db040 0x7fb8900d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb8900db040 0x7fb8900d0690 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef6930 2024-09-13T06:29:43.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.848+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x7fb8900db040 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x7fb8900db040 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef6930 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.852+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef6930 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef6930 2024-09-13T06:29:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x7fb8900db040 2024-09-13T06:29:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30eed470 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x7fb8900db040 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef6930 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x7fb8900db040 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.856+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef6930 2024-09-13T06:29:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef4bc0 con 0x561a30ef18f0 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef5410 con 0x561a30eed470 2024-09-13T06:29:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef5800 con 0x561a30ef18f0 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef5800 con 0x561a30ef6930 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 zone default found 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 4 Realm: () 2024-09-13T06:29:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 zonegroup default 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.860+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30ef9800 con 0x7fb8900db040 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30efba30 con 0x561a30ef6930 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30efbdd0 con 0x561a30ef6930 2024-09-13T06:29:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 started sync module instance, tier type = 2024-09-13T06:29:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efae70 con 0x561a30ef18f0 2024-09-13T06:29:43.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94670490153616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efae70 con 0x561a30ef18f0 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.864+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efc660 con 0x561a30eed470 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94670490157424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efcf00 con 0x561a30eed470 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efd900 con 0x561a30ef18f0 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94670490153616] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94670490157424] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94670490151360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efca50 con 0x561a30ef18f0 2024-09-13T06:29:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efe1a0 con 0x7fb8900db040 2024-09-13T06:29:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94670490164464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efca50 con 0x7fb8900db040 2024-09-13T06:29:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.868+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efec70 con 0x561a30ef18f0 2024-09-13T06:29:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94670490151360] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94670490164464] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94670490165520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efec30 con 0x561a30ef18f0 2024-09-13T06:29:43.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30eff0a0 con 0x561a30ef6930 2024-09-13T06:29:43.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94670490162192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30eff940 con 0x561a30ef6930 2024-09-13T06:29:43.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f00300 con 0x561a30ef6930 2024-09-13T06:29:43.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.872+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94670490165520] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94670490162192] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94670490173008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f006f0 con 0x561a30ef6930 2024-09-13T06:29:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f00f40 con 0x7fb8900db040 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94670490175696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f013b0 con 0x7fb8900db040 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94670490173008] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=0 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=1 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=2 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=3 2024-09-13T06:29:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=4 2024-09-13T06:29:43.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=5 2024-09-13T06:29:43.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=6 2024-09-13T06:29:43.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94670490175696] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 20 add_watcher() i=7 2024-09-13T06:29:43.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:43.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30efe7f0 con 0x561a30eed470 2024-09-13T06:29:43.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.876+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94670490177008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f01cb0 con 0x561a30eed470 2024-09-13T06:29:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.880+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94670490177008] v33'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.880+0000 7fb7537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.880+0000 7fb89f967980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.880+0000 7fb89f967980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.880+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0cd90 con 0x561a30ef18f0 2024-09-13T06:29:43.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.884+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.884+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ce50 con 0x7fb8900db040 2024-09-13T06:29:43.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.884+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.884+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0d4e0 con 0x561a30ef6930 2024-09-13T06:29:43.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.884+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.884+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0da50 con 0x561a30eed470 2024-09-13T06:29:43.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.888+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.888+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0df00 con 0x561a30ef18f0 2024-09-13T06:29:43.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.892+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.892+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0df00 con 0x561a30ef6930 2024-09-13T06:29:43.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.892+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.892+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0bcc0 con 0x561a30ef18f0 2024-09-13T06:29:43.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.896+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.896+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0bcc0 con 0x561a30eed470 2024-09-13T06:29:43.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.896+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.896+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0bc60 con 0x561a30ef18f0 2024-09-13T06:29:43.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.896+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.896+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ea60 con 0x561a30ef18f0 2024-09-13T06:29:43.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.900+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.900+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ea60 con 0x561a30ef18f0 2024-09-13T06:29:43.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.904+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.904+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ea60 con 0x561a30ef6930 2024-09-13T06:29:43.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.904+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.904+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ea60 con 0x561a30ef18f0 2024-09-13T06:29:43.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.908+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.908+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ea60 con 0x561a30eed470 2024-09-13T06:29:43.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.908+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.908+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30eed470 2024-09-13T06:29:43.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.912+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.912+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30ef18f0 2024-09-13T06:29:43.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.912+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.912+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30ef18f0 2024-09-13T06:29:43.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.916+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.916+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30ef6930 2024-09-13T06:29:43.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.920+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.920+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30ef18f0 2024-09-13T06:29:43.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.920+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.920+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30eed470 2024-09-13T06:29:43.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.924+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.924+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30ef18f0 2024-09-13T06:29:43.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.924+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.924+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0ef10 con 0x561a30ef18f0 2024-09-13T06:29:43.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.928+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.928+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0efa0 con 0x561a30ef6930 2024-09-13T06:29:43.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.928+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.928+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f030 con 0x561a30ef18f0 2024-09-13T06:29:43.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.932+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.932+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f030 con 0x561a30ef6930 2024-09-13T06:29:43.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.936+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.936+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f640 con 0x561a30ef6930 2024-09-13T06:29:43.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.936+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.936+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f620 con 0x561a30ef6930 2024-09-13T06:29:43.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.940+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.940+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f5e0 con 0x561a30ef18f0 2024-09-13T06:29:43.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.940+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.940+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f5e0 con 0x561a30eed470 2024-09-13T06:29:43.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.944+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.944+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f5e0 con 0x561a30ef18f0 2024-09-13T06:29:43.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.944+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.944+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f5e0 con 0x561a30eed470 2024-09-13T06:29:43.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0f5e0 con 0x7fb8900db040 2024-09-13T06:29:43.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb7527e4640 20 reqs_thread_entry: start 2024-09-13T06:29:43.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89f967980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89f967980 20 Filter name: none 2024-09-13T06:29:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb6c3fff640 20 reqs_thread_entry: start 2024-09-13T06:29:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89f967980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:29:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.948+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2a610 con 0x7fb8900db040 2024-09-13T06:29:43.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 : miss 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:95 8.1f 8:fe1f924a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2be20 con 0x7fb8900db040 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(95 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 info.flags=0x17 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 to cache LRU end 2024-09-13T06:29:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:29:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 2024-09-13T06:29:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 4.22 4:4637c9e2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa92f0 con 0x561a30eed470 2024-09-13T06:29:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(96 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:97 4.19 4:9aa0d745:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9330 con 0x561a30ef6930 2024-09-13T06:29:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(97 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 4.9 4:920c1710:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9330 con 0x561a30eed470 2024-09-13T06:29:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(98 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 [call out=425b] v0'0 uv13 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T06:29:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.952+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 4.28 4:17cd14a9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30ef18f0 2024-09-13T06:29:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(99 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 4.5 4:a1e97af5:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30ef18f0 2024-09-13T06:29:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(100 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 4.11 4:89e42713:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30ef6930 2024-09-13T06:29:43.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(101 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:102 4.20 4:072f8302:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30ef18f0 2024-09-13T06:29:43.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(102 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T06:29:43.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 4.9 4:923136d9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30eed470 2024-09-13T06:29:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(103 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:104 4.27 4:e403583d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30eed470 2024-09-13T06:29:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(104 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T06:29:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.956+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 4.9 4:92f279fc:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30eed470 2024-09-13T06:29:43.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(105 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:106 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa9870 con 0x561a30eed470 2024-09-13T06:29:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(106 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [call out=698b] v0'0 uv9 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T06:29:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:29:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:107 3.0 3:01f3319d:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa6e70 con 0x561a30eed470 2024-09-13T06:29:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(107 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 10 manifest: total_size = 6 2024-09-13T06:29:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5324890255006529540 2024-09-13T06:29:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 20 prepare_atomic_modification: state is not atomic. state=0x561a30f2c688 2024-09-13T06:29:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 2024-09-13T06:29:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:108 4.9 4:920c1710:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f314f0 con 0x561a30eed470 2024-09-13T06:29:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(108 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 [stat,call,call] v33'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.960+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:109 3.0 3:01f3319d:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2f4d0 con 0x561a30eed470 2024-09-13T06:29:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(109 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:110 4.9 4:920c1710:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f31520 con 0x561a30eed470 2024-09-13T06:29:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:111 3.4 3:216672b8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f325a0 con 0x561a30eed470 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(111 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 10 manifest: total_size = 3 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.16336196968703095636 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 20 prepare_atomic_modification: state is not atomic. state=0x561a30f2c688 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 4.20 4:072f8302:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f36a10 con 0x561a30ef18f0 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(110 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 [stat,call,call] v33'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.964+0000 7fb780ff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T06:29:43.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(112 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:113 3.4 3:216672b8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32250 con 0x561a30eed470 2024-09-13T06:29:43.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(113 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:114 4.20 4:072f8302:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30ef18f0 2024-09-13T06:29:43.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:115 3.16 3:6bc49c57:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f31c30 con 0x561a30ef18f0 2024-09-13T06:29:43.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(115 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 10 manifest: total_size = 4 2024-09-13T06:29:43.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.2729318223967504358 2024-09-13T06:29:43.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 20 prepare_atomic_modification: state is not atomic. state=0x561a30f2c688 2024-09-13T06:29:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 2024-09-13T06:29:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.968+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:116 4.27 4:e403583d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(114 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb773fff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T06:29:43.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(116 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:117 3.16 3:6bc49c57:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f31c30 con 0x561a30ef18f0 2024-09-13T06:29:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(117 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:118 4.27 4:e403583d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f31c30 con 0x561a30eed470 2024-09-13T06:29:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:119 3.1f 3:fa0e41b3:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(119 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 10 manifest: total_size = 5 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10063777222138904428 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 20 prepare_atomic_modification: state is not atomic. state=0x561a30f2c688 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 2024-09-13T06:29:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.972+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:120 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== osd_op_reply(118 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb780ff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T06:29:43.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(120 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [stat,call,call] v33'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:121 3.1f 3:fa0e41b3:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== osd_op_reply(121 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:122 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.976+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:123 3.2e 3:7442f694:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f30b70 con 0x7fb8900db040 2024-09-13T06:29:43.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(123 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 10 manifest: total_size = 5 2024-09-13T06:29:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 20 get_obj_state: setting s->obj_tag to _NrCElYBTzp8T0pwYNlJ1ZZ75gMIrrqY 2024-09-13T06:29:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 20 get_obj_state: octx=0x7fb8900d2380 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561a30f2c688 s->prefetch_data=0 2024-09-13T06:29:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 20 prepare_atomic_modification: state is not atomic. state=0x561a30f2c688 2024-09-13T06:29:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 2024-09-13T06:29:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:124 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(122 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [stat,call,call] v33'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb773fff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T06:29:43.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(124 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [stat,call,call] v33'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.980+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:125 3.2e 3:7442f694:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f329d0 con 0x7fb8900db040 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(125 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:126 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:127 4.22 4:4637c9e2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:128 4.19 4:9aa0d745:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2c4a0 con 0x561a30ef6930 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:129 4.9 4:920c1710:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f32e80 con 0x561a30eed470 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:130 4.28 4:17cd14a9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2c4a0 con 0x561a30ef18f0 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:131 4.5 4:a1e97af5:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f3fb40 con 0x561a30ef18f0 2024-09-13T06:29:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:132 4.11 4:89e42713:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f424a0 con 0x561a30ef6930 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:133 4.20 4:072f8302:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f44dc0 con 0x561a30ef18f0 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:134 4.9 4:923136d9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f47790 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(127 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(128 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:135 4.27 4:e403583d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f47790 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(129 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 [call out=124b] v0'0 uv15 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:136 4.9 4:92f279fc:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2e010 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(132 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb89400f070 con 0x561a30ef6930 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 47 ==== osd_op_reply(134 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:137 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2f540 con 0x561a30eed470 2024-09-13T06:29:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(133 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(130 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(131 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 48 ==== osd_op_reply(136 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 49 ==== osd_op_reply(135 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 50 ==== osd_op_reply(126 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [stat,call,call] v33'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.984+0000 7fb773fff640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 51 ==== osd_op_reply(137 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:29:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5])"; uploads.size()=0; is_truncated=0 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:138 4.22 4:4637c9e2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f47790 con 0x561a30eed470 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:139 4.19 4:9aa0d745:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2f540 con 0x561a30ef6930 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:140 4.9 4:920c1710:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2dfc0 con 0x561a30eed470 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:141 4.28 4:17cd14a9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f471e0 con 0x561a30ef18f0 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 4.5 4:a1e97af5:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f448f0 con 0x561a30ef18f0 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:143 4.11 4:89e42713:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f47790 con 0x561a30ef6930 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:144 4.20 4:072f8302:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2dfc0 con 0x561a30ef18f0 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:145 4.9 4:923136d9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f471e0 con 0x561a30eed470 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:146 4.27 4:e403583d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2dfc0 con 0x561a30eed470 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:147 4.9 4:92f279fc:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f47790 con 0x561a30eed470 2024-09-13T06:29:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:148 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f471e0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(139 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(143 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 52 ==== osd_op_reply(138 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 53 ==== osd_op_reply(140 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 [call out=124b] v0'0 uv15 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 54 ==== osd_op_reply(146 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 55 ==== osd_op_reply(145 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(144 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 56 ==== osd_op_reply(148 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(142 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(141 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 57 ==== osd_op_reply(147 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2dfc0 con 0x7fb8900db040 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(149 foo.buckets [call] v33'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.988+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2dfc0 con 0x7fb8900db040 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(150 myfoo [call,call,delete] v33'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94670490857440 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2df40 con 0x561a30ef6930 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== watch-notify(notify (1) cookie 94670490173008 notify 141733920791 ret 0) ==== 191+0+0 (crc 0 0 0) 0x561a30f0bc60 con 0x561a30ef6930 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb780ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94670490173008 notifier 4645 bl.length()=149 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(151 notify.6 [notify cookie 94670490857440 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb780ff9640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb760003d70 con 0x561a30ef6930 2024-09-13T06:29:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:43.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== watch-notify(notify_complete (2) cookie 94670490857440 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a30f0c560 con 0x561a30ef6930 2024-09-13T06:29:43.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:153 8.1f 8:fe1f924a:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2df40 con 0x7fb8900db040 2024-09-13T06:29:44.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(153 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 [call,call,delete] v33'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 from cache 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5, ofs0, ns] 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.992+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94670490353040 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2c700 con 0x561a30ef6930 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== watch-notify(notify (1) cookie 94670490162192 notify 141733920792 ret 0) ==== 248+0+0 (crc 0 0 0) 0x561a30f0c560 con 0x561a30ef6930 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb773fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94670490162192 notifier 4645 bl.length()=206 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(154 notify.5 [notify cookie 94670490353040 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb773fff640 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb6d0003330 con 0x561a30ef6930 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== watch-notify(notify_complete (2) cookie 94670490353040 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a30f0c900 con 0x561a30ef6930 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:156 4.22 4:4637c9e2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30fa6fe0 con 0x561a30eed470 2024-09-13T06:29:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:157 4.19 4:9aa0d745:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2c700 con 0x561a30ef6930 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:158 4.9 4:920c1710:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2caa0 con 0x561a30eed470 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:159 4.28 4:17cd14a9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f09fb0 con 0x561a30ef18f0 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:160 4.5 4:a1e97af5:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0a390 con 0x561a30ef18f0 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:161 4.11 4:89e42713:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0a730 con 0x561a30ef6930 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:162 4.20 4:072f8302:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f09fb0 con 0x561a30ef18f0 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:163 4.9 4:923136d9:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0a390 con 0x561a30eed470 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:164 4.27 4:e403583d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f09fb0 con 0x561a30eed470 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:165 4.9 4:92f279fc:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f0a730 con 0x561a30eed470 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:166 4.2c 4:35aa6fc4:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2d890 con 0x561a30eed470 2024-09-13T06:29:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(157 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.1 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:43.996+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 58 ==== osd_op_reply(158 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.2 [delete] v33'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 59 ==== osd_op_reply(163 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.7 [delete] v33'17 uv17 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(160 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.4 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(159 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.3 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 60 ==== osd_op_reply(156 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.0 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 61 ==== osd_op_reply(164 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.8 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(162 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.6 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 62 ==== osd_op_reply(166 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.10 [delete] v33'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 63 ==== osd_op_reply(165 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.9 [delete] v33'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== osd_op_reply(161 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5.5 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 : miss 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:167 6.2 6:406e8d9a:::pubsub..bucket.myfoo%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2bd90 con 0x561a30ef6930 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(167 pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 info.flags=0x0 2024-09-13T06:29:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 10 adding default.rgw.log++pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 to cache LRU end 2024-09-13T06:29:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:168 6.2 6:406e8d9a:::pubsub..bucket.myfoo%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2bd90 con 0x561a30ef6930 2024-09-13T06:29:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== osd_op_reply(168 pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.5 [delete] v33'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2bd90 con 0x7fb8900db040 2024-09-13T06:29:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.000+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(169 foo.buckets [call] v33'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:44.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.004+0000 7fb7537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.004+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94670490177008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f2bd60 con 0x561a30eed470 2024-09-13T06:29:44.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.004+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 64 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94670490177008] v33'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.004+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94670490153616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f00db0 con 0x561a30ef18f0 2024-09-13T06:29:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94670490153616] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89f967980 20 remove_watcher() i=0 2024-09-13T06:29:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89f967980 2 removed watcher, disabling cache 2024-09-13T06:29:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94670490157424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30f00db0 con 0x561a30eed470 2024-09-13T06:29:44.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.1 v2:172.21.15.169:6808/3492903297 65 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94670490157424] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x561a30eed470 2024-09-13T06:29:44.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89f967980 20 remove_watcher() i=1 2024-09-13T06:29:44.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.008+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94670490151360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efc170 con 0x561a30ef18f0 2024-09-13T06:29:44.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.012+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94670490151360] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:44.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.012+0000 7fb89f967980 20 remove_watcher() i=2 2024-09-13T06:29:44.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.012+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94670490164464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efa9c0 con 0x7fb8900db040 2024-09-13T06:29:44.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.012+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94670490164464] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:44.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.012+0000 7fb89f967980 20 remove_watcher() i=3 2024-09-13T06:29:44.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.012+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94670490165520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efa9c0 con 0x561a30ef18f0 2024-09-13T06:29:44.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89d477640 1 -- 172.21.15.169:0/3511640297 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94670490165520] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900f6070 con 0x561a30ef18f0 2024-09-13T06:29:44.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89f967980 20 remove_watcher() i=4 2024-09-13T06:29:44.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94670490162192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efa9c0 con 0x561a30ef6930 2024-09-13T06:29:44.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94670490162192] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89f967980 20 remove_watcher() i=5 2024-09-13T06:29:44.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94670490173008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30efa9c0 con 0x561a30ef6930 2024-09-13T06:29:44.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89cc76640 1 -- 172.21.15.169:0/3511640297 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94670490173008] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89404e040 con 0x561a30ef6930 2024-09-13T06:29:44.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89f967980 20 remove_watcher() i=6 2024-09-13T06:29:44.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.016+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94670490175696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561a30effe50 con 0x7fb8900db040 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94670490175696] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8980083f0 con 0x7fb8900db040 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 20 remove_watcher() i=7 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30ef18f0 msgr2=0x561a30ef3ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30ef18f0 0x561a30ef3ce0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30eed470 msgr2=0x561a30eef930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30eed470 0x561a30eef930 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb8900db040 msgr2=0x7fb8900d0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb8900db040 0x7fb8900d0690 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ef6930 msgr2=0x561a30ef8d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ef6930 0x561a30ef8d20 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb768034650 msgr2=0x7fb768036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb768034650 0x7fb768036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x561a30eb54a0 tx=0x7fb894010000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89dc78640 1 -- 172.21.15.169:0/3511640297 reap_dead start 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 msgr2=0x561a30ee2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30ee2620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb8900b5ba0 tx=0x7fb8900a5f10 comp rx=0 tx=0).stop 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 shutdown_connections 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3511640297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30edb5c0 0x561a30ee2620 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 >> 172.21.15.169:0/3511640297 conn(0x561a30ed79a0 msgr2=0x561a30ed5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 shutdown_connections 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3511640297 wait complete. 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb774034650 msgr2=0x7fb774036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb774034650 0x7fb774036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb894006300 tx=0x7fb89400f000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 msgr2=0x561a30ecf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 0x561a30ecf060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb8900aaad0 tx=0x7fb8900b53a0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 shutdown_connections 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb774034650 0x7fb774036b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/3068386868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30ecec40 0x561a30ecf060 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 >> 172.21.15.169:0/3068386868 conn(0x561a30ec3d90 msgr2=0x561a30ec6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 shutdown_connections 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/3068386868 wait complete. 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30eb92c0 msgr2=0x561a30ebb6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a30eb92c0 0x561a30ebb6b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30dbf240 msgr2=0x561a30eb7e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a30dbf240 0x561a30eb7e80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ebe950 msgr2=0x561a30ec0d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a30ebe950 0x561a30ec0d40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb784034650 msgr2=0x7fb784036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb784034650 0x7fb784036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8940012f0 tx=0x7fb894006700 comp rx=0 tx=0).stop 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 msgr2=0x561a30eb0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 --2- 172.21.15.169:0/1973222025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a30dbe8f0 0x561a30eb0eb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb8900180e0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89dc78640 1 -- 172.21.15.169:0/1973222025 reap_dead start 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 shutdown_connections 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 >> 172.21.15.169:0/1973222025 conn(0x561a30d32240 msgr2=0x561a30ea4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 shutdown_connections 2024-09-13T06:29:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.020+0000 7fb89f967980 1 -- 172.21.15.169:0/1973222025 wait complete. 2024-09-13T06:29:44.036 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:29:44.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:29:44.037 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T06:29:44.116 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:44.116 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:44.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.112+0000 7f7c00ad3980 1 Processor -- start 2024-09-13T06:29:44.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.112+0000 7f7c00ad3980 1 -- start start 2024-09-13T06:29:44.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.112+0000 7f7c00ad3980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5598b429dad0 0x5598b429deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.112+0000 7f7c00ad3980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598b4127ae0 con 0x5598b429e3f0 2024-09-13T06:29:44.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.112+0000 7f7c00ad3980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5598b414be30 con 0x5598b429dad0 2024-09-13T06:29:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.112+0000 7f7bfe5e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5598b429dad0 0x5598b429deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfe5e3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5598b429dad0 0x5598b429deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57106/0 (socket says 172.21.15.169:57106) 2024-09-13T06:29:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfdde2640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5598b429e3f0 0x5598b42a4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49758/0 (socket says 172.21.15.169:49758) 2024-09-13T06:29:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/3085134289 learned_addr learned my addr 172.21.15.169:0/3085134289 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/3085134289 >> v1:172.21.15.112:6789/0 conn(0x5598b429e3f0 legacy=0x5598b42a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/3085134289 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b42a72d0 con 0x5598b429dad0 2024-09-13T06:29:44.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/3085134289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b429deb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7be800a4e0 tx=0x7f7be801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd90a67c5104a520 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfd5e1640 1 -- 172.21.15.169:0/3085134289 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80aa540 con 0x5598b429dad0 2024-09-13T06:29:44.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfd5e1640 1 -- 172.21.15.169:0/3085134289 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80aa6e0 con 0x5598b429dad0 2024-09-13T06:29:44.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7bfd5e1640 1 -- 172.21.15.169:0/3085134289 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80aaa40 con 0x5598b429dad0 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 -- 172.21.15.169:0/3085134289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 msgr2=0x5598b429deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/3085134289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b429deb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7be800a4e0 tx=0x7f7be801b090 comp rx=0 tx=0).stop 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 -- 172.21.15.169:0/3085134289 shutdown_connections 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/3085134289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b429deb0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 -- 172.21.15.169:0/3085134289 >> 172.21.15.169:0/3085134289 conn(0x5598b42997b0 msgr2=0x5598b429bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 -- 172.21.15.169:0/3085134289 shutdown_connections 2024-09-13T06:29:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.116+0000 7f7c00ad3980 1 -- 172.21.15.169:0/3085134289 wait complete. 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.132+0000 7f7c00ad3980 1 Processor -- start 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.132+0000 7f7c00ad3980 1 -- start start 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.132+0000 7f7c00ad3980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b42a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.132+0000 7f7c00ad3980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598b414d200 con 0x5598b429dad0 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b42a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b42a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57108/0 (socket says 172.21.15.169:57108) 2024-09-13T06:29:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/4125655012 learned_addr learned my addr 172.21.15.169:0/4125655012 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/4125655012 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b42a08c0 con 0x5598b429dad0 2024-09-13T06:29:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/4125655012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b42a02f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7be8017ca0 tx=0x7f7be80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65504c97e0695a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7aeb616640 1 -- 172.21.15.169:0/4125655012 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80b9030 con 0x5598b429dad0 2024-09-13T06:29:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7aeb616640 1 -- 172.21.15.169:0/4125655012 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80aaac0 con 0x5598b429dad0 2024-09-13T06:29:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7aeb616640 1 -- 172.21.15.169:0/4125655012 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80aada0 con 0x5598b429dad0 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- 172.21.15.169:0/4125655012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 msgr2=0x5598b42a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/4125655012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b42a02f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7be8017ca0 tx=0x7f7be80033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- 172.21.15.169:0/4125655012 shutdown_connections 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/4125655012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b42a02f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- 172.21.15.169:0/4125655012 >> 172.21.15.169:0/4125655012 conn(0x5598b42997b0 msgr2=0x5598b4386680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- 172.21.15.169:0/4125655012 shutdown_connections 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- 172.21.15.169:0/4125655012 wait complete. 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 Processor -- start 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- start start 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b4393ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7c00ad3980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598b42a6dd0 con 0x5598b429dad0 2024-09-13T06:29:44.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b4393ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b4393ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57124/0 (socket says 172.21.15.169:57124) 2024-09-13T06:29:44.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/684137653 learned_addr learned my addr 172.21.15.169:0/684137653 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b43943e0 con 0x5598b429dad0 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.136+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b4393ea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7be8005cc0 tx=0x7f7be8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7ae9e13640 1 -- 172.21.15.169:0/684137653 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80b9030 con 0x5598b429dad0 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7ae9e13640 1 -- 172.21.15.169:0/684137653 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80c3070 con 0x5598b429dad0 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598b4394670 con 0x5598b429dad0 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7ae9e13640 1 -- 172.21.15.169:0/684137653 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80bf750 con 0x5598b429dad0 2024-09-13T06:29:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b4397350 con 0x5598b429dad0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7ae9e13640 1 -- 172.21.15.169:0/684137653 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7be80c5030 con 0x5598b429dad0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7ae9e13640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ae40346a0 0x7f7ae4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7ae9e13640 1 -- 172.21.15.169:0/684137653 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f7be80ba070 con 0x5598b429dad0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ae40346a0 0x7f7ae4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b429e3f0 0x5598b439ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b439b480 con 0x5598b429e3f0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfede4640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b429e3f0 0x5598b439ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ae40346a0 0x7f7ae4036b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0000f70 tx=0x7f7bf0001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfede4640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b429e3f0 0x5598b439ae30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfede4640 1 -- 172.21.15.169:0/684137653 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b429e3f0 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b439c2c0 0x5598b439e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b439ecf0 con 0x5598b439c2c0 2024-09-13T06:29:44.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b439c2c0 0x5598b439e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.140+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b439c2c0 0x5598b439e6b0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/684137653 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7be80ce070 con 0x5598b439c2c0 2024-09-13T06:29:44.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43a05a0 con 0x5598b439c2c0 2024-09-13T06:29:44.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/684137653 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7be80ce070 con 0x5598b439c2c0 2024-09-13T06:29:44.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b439f710 con 0x5598b439c2c0 2024-09-13T06:29:44.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/684137653 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7be80ce070 con 0x5598b439c2c0 2024-09-13T06:29:44.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43a1950 0x5598b43a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43a4280 con 0x5598b43a1950 2024-09-13T06:29:44.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43a1950 0x5598b43a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43a1950 0x5598b43a3d40 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7bfdde2640 1 -- 172.21.15.169:0/684137653 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7bf000f6a0 con 0x5598b43a1950 2024-09-13T06:29:44.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 Processor -- start 2024-09-13T06:29:44.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 -- start start 2024-09-13T06:29:44.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 0x5598b43b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.144+0000 7f7c00ad3980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598b41a6800 con 0x5598b43b1c60 2024-09-13T06:29:44.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 0x5598b43b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 0x5598b43b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57126/0 (socket says 172.21.15.169:57126) 2024-09-13T06:29:44.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/2740660867 learned_addr learned my addr 172.21.15.169:0/2740660867 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/2740660867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b43b25c0 con 0x5598b43b1c60 2024-09-13T06:29:44.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 0x5598b43b2080 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7be80d13f0 tx=0x7f7be80a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7ae2ffd640 1 -- 172.21.15.169:0/2740660867 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80c63c0 con 0x5598b43b1c60 2024-09-13T06:29:44.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7ae2ffd640 1 -- 172.21.15.169:0/2740660867 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80c6560 con 0x5598b43b1c60 2024-09-13T06:29:44.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598b43b2850 con 0x5598b43b1c60 2024-09-13T06:29:44.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7ae2ffd640 1 -- 172.21.15.169:0/2740660867 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80b4a20 con 0x5598b43b1c60 2024-09-13T06:29:44.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b43b2850 con 0x5598b43b1c60 2024-09-13T06:29:44.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7ae2ffd640 1 -- 172.21.15.169:0/2740660867 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7be80b3040 con 0x5598b43b1c60 2024-09-13T06:29:44.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7ae2ffd640 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ad4034650 0x7f7ad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7ae2ffd640 1 -- 172.21.15.169:0/2740660867 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f7be80eabd0 con 0x5598b43b1c60 2024-09-13T06:29:44.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ad4034650 0x7f7ad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7c00ad3980 1 Processor -- start 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7c00ad3980 1 -- start start 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ad4034650 0x7f7ad4036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5598b4398490 tx=0x7f7bf000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7c00ad3980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7c00ad3980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598b429ea20 con 0x5598b43be4c0 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.148+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43be8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57132/0 (socket says 172.21.15.169:57132) 2024-09-13T06:29:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/365154136 learned_addr learned my addr 172.21.15.169:0/365154136 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/365154136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b43bee70 con 0x5598b43be4c0 2024-09-13T06:29:44.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/365154136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43be8a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7be80d9660 tx=0x7f7be80eafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d5442b8f88b4ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7ae0ff9640 1 -- 172.21.15.169:0/365154136 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be8100070 con 0x5598b43be4c0 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7ae0ff9640 1 -- 172.21.15.169:0/365154136 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80c7d10 con 0x5598b43be4c0 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7ae0ff9640 1 -- 172.21.15.169:0/365154136 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be80dc3f0 con 0x5598b43be4c0 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/365154136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 msgr2=0x5598b43be8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/365154136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43be8a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7be80d9660 tx=0x7f7be80eafa0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/365154136 shutdown_connections 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/365154136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43be8a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/365154136 >> 172.21.15.169:0/365154136 conn(0x5598b43ba7f0 msgr2=0x5598b43b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/365154136 shutdown_connections 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/365154136 wait complete. 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 Processor -- start 2024-09-13T06:29:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- start start 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598b43bf200 con 0x5598b43be4c0 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57148/0 (socket says 172.21.15.169:57148) 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 learned_addr learned my addr 172.21.15.169:0/1680794831 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b43c5b70 con 0x5598b43be4c0 2024-09-13T06:29:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43c5630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7be80e0c20 tx=0x7f7be80b4f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7ad2ffd640 1 -- 172.21.15.169:0/1680794831 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be810a070 con 0x5598b43be4c0 2024-09-13T06:29:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7ad2ffd640 1 -- 172.21.15.169:0/1680794831 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80b4bc0 con 0x5598b43be4c0 2024-09-13T06:29:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598b43c5b70 con 0x5598b43be4c0 2024-09-13T06:29:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7ad2ffd640 1 -- 172.21.15.169:0/1680794831 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be8100040 con 0x5598b43be4c0 2024-09-13T06:29:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.152+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b43c5b70 con 0x5598b43be4c0 2024-09-13T06:29:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7ad2ffd640 1 -- 172.21.15.169:0/1680794831 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7be810d070 con 0x5598b43be4c0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7ad2ffd640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ac8034650 0x7f7ac8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7ad2ffd640 1 -- 172.21.15.169:0/1680794831 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f7be8110c20 con 0x5598b43be4c0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ac8034650 0x7f7ac8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b43d0760 0x5598b43d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d3370 con 0x5598b43d0760 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfede4640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b43d0760 0x5598b43d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ac8034650 0x7f7ac8036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000ffd0 tx=0x7f7bf0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfede4640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b43d0760 0x5598b43d2c20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 realm 2024-09-13T06:29:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43cfb90 con 0x5598b43d0760 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d3e00 con 0x5598b43d0760 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b43d4be0 0x5598b43d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d7660 con 0x5598b43d4be0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b43d4be0 0x5598b43d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.156+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b43d4be0 0x5598b43d6fd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d7eb0 con 0x5598b43d4be0 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 20 searching for the correct realm 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43d9c20 0x5598b43dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43d9c20 0x5598b43dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfdde2640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43d9c20 0x5598b43dc010 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfe5e3640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7be810f070 0x7f7be80ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x7f7be810f070 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfede4640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7be810f070 0x7f7be80ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfede4640 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7be810f070 0x7f7be80ef260 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.160+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x7f7be810f070 2024-09-13T06:29:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x7f7be810f070 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.164+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x7f7be810f070 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d0760 2024-09-13T06:29:44.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x7f7be810f070 2024-09-13T06:29:44.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.168+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x7f7be810f070 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d9c20 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dc690 con 0x5598b43d4be0 2024-09-13T06:29:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d8830 con 0x5598b43d0760 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.172+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d8470 con 0x5598b43d4be0 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43d8480 con 0x5598b43d9c20 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 zone default found 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 4 Realm: () 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 zonegroup default 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dcfa0 con 0x7f7be810f070 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43ded20 con 0x5598b43d9c20 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43df210 con 0x5598b43d9c20 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 started sync module instance, tier type = 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43de1c0 con 0x5598b43d4be0 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114347345600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43de1c0 con 0x5598b43d4be0 2024-09-13T06:29:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.176+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43dfcd0 con 0x5598b43d0760 2024-09-13T06:29:44.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114347349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e0570 con 0x5598b43d0760 2024-09-13T06:29:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e0fb0 con 0x5598b43d4be0 2024-09-13T06:29:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114347345600] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114347349984] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114347354752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e00c0 con 0x5598b43d4be0 2024-09-13T06:29:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.180+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e1850 con 0x7f7be810f070 2024-09-13T06:29:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114347357088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e00c0 con 0x7f7be810f070 2024-09-13T06:29:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e22d0 con 0x5598b43d4be0 2024-09-13T06:29:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114347354752] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114347357088] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114347358144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e1de0 con 0x5598b43d4be0 2024-09-13T06:29:44.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.184+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e2b70 con 0x5598b43d9c20 2024-09-13T06:29:44.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114347361984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e1de0 con 0x5598b43d9c20 2024-09-13T06:29:44.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e39e0 con 0x5598b43d9c20 2024-09-13T06:29:44.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114347358144] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114347343120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e4230 con 0x5598b43d9c20 2024-09-13T06:29:44.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e4b00 con 0x7f7be810f070 2024-09-13T06:29:44.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114347361984] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114347343120] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114347367808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e2f10 con 0x7f7be810f070 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=0 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=1 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=2 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=3 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=4 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=5 2024-09-13T06:29:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.188+0000 7f7c00ad3980 20 add_watcher() i=6 2024-09-13T06:29:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114347367808] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 20 add_watcher() i=7 2024-09-13T06:29:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e7f20 con 0x5598b43d0760 2024-09-13T06:29:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114347369936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e5350 con 0x5598b43d0760 2024-09-13T06:29:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114347369936] v33'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7ab37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 5 note: GC not initialized 2024-09-13T06:29:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7ab27e4640 20 reqs_thread_entry: start 2024-09-13T06:29:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 20 Filter name: none 2024-09-13T06:29:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7a23fff640 20 reqs_thread_entry: start 2024-09-13T06:29:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.192+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b440b480 con 0x5598b43d0760 2024-09-13T06:29:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b4411630 con 0x5598b43d0760 2024-09-13T06:29:44.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v33'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:44.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94114347552928 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5598b440cf00 con 0x5598b43d4be0 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94114347358144 notify 141733920802 ret 0) ==== 621+0+0 (crc 0 0 0) 0x5598b43b25c0 con 0x5598b43d4be0 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7ae0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94114347358144 notifier 4652 bl.length()=579 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7ae0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7ae0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7ae0ff9640 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7ac0003eb0 con 0x5598b43d4be0 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94114347552928 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.196+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94114347552928 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7be80d7070 con 0x5598b43d4be0 2024-09-13T06:29:44.202 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:44.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.200+0000 7f7ab37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.200+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114347369936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b44092b0 con 0x5598b43d0760 2024-09-13T06:29:44.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.200+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94114347369936] v33'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.200+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114347345600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b44092b0 con 0x5598b43d4be0 2024-09-13T06:29:44.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94114347345600] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7c00ad3980 20 remove_watcher() i=0 2024-09-13T06:29:44.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7c00ad3980 2 removed watcher, disabling cache 2024-09-13T06:29:44.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114347349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b44092b0 con 0x5598b43d0760 2024-09-13T06:29:44.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94114347349984] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x5598b43d0760 2024-09-13T06:29:44.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7c00ad3980 20 remove_watcher() i=1 2024-09-13T06:29:44.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.204+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114347354752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b44092b0 con 0x5598b43d4be0 2024-09-13T06:29:44.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94114347354752] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7c00ad3980 20 remove_watcher() i=2 2024-09-13T06:29:44.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114347357088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e0a80 con 0x7f7be810f070 2024-09-13T06:29:44.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94114347357088] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7c00ad3980 20 remove_watcher() i=3 2024-09-13T06:29:44.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114347358144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b44092b0 con 0x5598b43d4be0 2024-09-13T06:29:44.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7bfe5e3640 1 -- 172.21.15.169:0/1680794831 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94114347358144] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7be8116070 con 0x5598b43d4be0 2024-09-13T06:29:44.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7c00ad3980 20 remove_watcher() i=4 2024-09-13T06:29:44.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.208+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114347361984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e0a80 con 0x5598b43d9c20 2024-09-13T06:29:44.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94114347361984] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 20 remove_watcher() i=5 2024-09-13T06:29:44.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114347343120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e0a80 con 0x5598b43d9c20 2024-09-13T06:29:44.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7bfdde2640 1 -- 172.21.15.169:0/1680794831 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94114347343120] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf0037040 con 0x5598b43d9c20 2024-09-13T06:29:44.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 20 remove_watcher() i=6 2024-09-13T06:29:44.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114347367808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5598b43e0a80 con 0x7f7be810f070 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94114347367808] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bf80083f0 con 0x7f7be810f070 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 20 remove_watcher() i=7 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b43d4be0 msgr2=0x5598b43d6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b43d4be0 0x5598b43d6fd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b43d0760 msgr2=0x5598b43d2c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b43d0760 0x5598b43d2c20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7be810f070 msgr2=0x7f7be80ef260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7be810f070 0x7f7be80ef260 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43d9c20 msgr2=0x5598b43dc010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43d9c20 0x5598b43dc010 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ac8034650 msgr2=0x7f7ac8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ac8034650 0x7f7ac8036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000ffd0 tx=0x7f7bf0010000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 msgr2=0x5598b43c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/1680794831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43be4c0 0x5598b43c5630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7be80e0c20 tx=0x7f7be80b4f00 comp rx=0 tx=0).stop 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7bfede4640 1 -- 172.21.15.169:0/1680794831 reap_dead start 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 shutdown_connections 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 >> 172.21.15.169:0/1680794831 conn(0x5598b43ba7f0 msgr2=0x5598b43b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 shutdown_connections 2024-09-13T06:29:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.212+0000 7f7c00ad3980 1 -- 172.21.15.169:0/1680794831 wait complete. 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ad4034650 msgr2=0x7f7ad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ad4034650 0x7f7ad4036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5598b4398490 tx=0x7f7bf000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 msgr2=0x5598b43b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 0x5598b43b2080 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7be80d13f0 tx=0x7f7be80a9f70 comp rx=0 tx=0).stop 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 shutdown_connections 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ad4034650 0x7f7ad4036b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/2740660867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b43b1c60 0x5598b43b2080 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 >> 172.21.15.169:0/2740660867 conn(0x5598b43a6db0 msgr2=0x5598b43a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 shutdown_connections 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/2740660867 wait complete. 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b439c2c0 msgr2=0x5598b439e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5598b439c2c0 0x5598b439e6b0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b429e3f0 msgr2=0x5598b439ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5598b429e3f0 0x5598b439ae30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43a1950 msgr2=0x5598b43a3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5598b43a1950 0x5598b43a3d40 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ae40346a0 msgr2=0x7f7ae4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7ae40346a0 0x7f7ae4036b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0000f70 tx=0x7f7bf0001380 comp rx=0 tx=0).stop 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 msgr2=0x5598b4393ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 --2- 172.21.15.169:0/684137653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598b429dad0 0x5598b4393ea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7be8005cc0 tx=0x7f7be8017e30 comp rx=0 tx=0).stop 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7bfede4640 1 -- 172.21.15.169:0/684137653 reap_dead start 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 shutdown_connections 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 >> 172.21.15.169:0/684137653 conn(0x5598b42997b0 msgr2=0x5598b429ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 shutdown_connections 2024-09-13T06:29:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.216+0000 7f7c00ad3980 1 -- 172.21.15.169:0/684137653 wait complete. 2024-09-13T06:29:44.229 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:44.230 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:29:44.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:29:44.230 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T06:29:44.312 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:44.312 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc14bfb980 1 Processor -- start 2024-09-13T06:29:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc14bfb980 1 -- start start 2024-09-13T06:29:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc14bfb980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5567c63fb8f0 0x5567c63fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc14bfb980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567c6281ae0 con 0x5567c63fc240 2024-09-13T06:29:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc14bfb980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5567c62a5e30 con 0x5567c63fb8f0 2024-09-13T06:29:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc1270b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5567c63fb8f0 0x5567c63fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc1270b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5567c63fb8f0 0x5567c63fbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57156/0 (socket says 172.21.15.169:57156) 2024-09-13T06:29:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc11f0a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5567c63fc240 0x5567c6400c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49760/0 (socket says 172.21.15.169:49760) 2024-09-13T06:29:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.308+0000 7fbc1270b640 1 -- 172.21.15.169:0/296192951 learned_addr learned my addr 172.21.15.169:0/296192951 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc1270b640 1 -- 172.21.15.169:0/296192951 >> v1:172.21.15.112:6789/0 conn(0x5567c63fc240 legacy=0x5567c6400c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc1270b640 1 -- 172.21.15.169:0/296192951 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c64034c0 con 0x5567c63fb8f0 2024-09-13T06:29:44.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc1270b640 1 --2- 172.21.15.169:0/296192951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c63fbcd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00a4e0 tx=0x7fbc0c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219a66fab95499ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc11709640 1 -- 172.21.15.169:0/296192951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0aa540 con 0x5567c63fb8f0 2024-09-13T06:29:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc11709640 1 -- 172.21.15.169:0/296192951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0aa6e0 con 0x5567c63fb8f0 2024-09-13T06:29:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc11709640 1 -- 172.21.15.169:0/296192951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0aaa40 con 0x5567c63fb8f0 2024-09-13T06:29:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 -- 172.21.15.169:0/296192951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 msgr2=0x5567c63fbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/296192951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c63fbcd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00a4e0 tx=0x7fbc0c01b090 comp rx=0 tx=0).stop 2024-09-13T06:29:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 -- 172.21.15.169:0/296192951 shutdown_connections 2024-09-13T06:29:44.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/296192951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c63fbcd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 -- 172.21.15.169:0/296192951 >> 172.21.15.169:0/296192951 conn(0x5567c636f240 msgr2=0x5567c636f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 -- 172.21.15.169:0/296192951 shutdown_connections 2024-09-13T06:29:44.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.312+0000 7fbc14bfb980 1 -- 172.21.15.169:0/296192951 wait complete. 2024-09-13T06:29:44.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc14bfb980 1 Processor -- start 2024-09-13T06:29:44.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc14bfb980 1 -- start start 2024-09-13T06:29:44.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc14bfb980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc14bfb980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5567c62a7200 con 0x5567c63fb8f0 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64e6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57164/0 (socket says 172.21.15.169:57164) 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc1270b640 1 -- 172.21.15.169:0/846594057 learned_addr learned my addr 172.21.15.169:0/846594057 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.328+0000 7fbc1270b640 1 -- 172.21.15.169:0/846594057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c64e71b0 con 0x5567c63fb8f0 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc1270b640 1 --2- 172.21.15.169:0/846594057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64e6be0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c017ca0 tx=0x7fbc0c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9332ae137c6465 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbb00608640 1 -- 172.21.15.169:0/846594057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0b9030 con 0x5567c63fb8f0 2024-09-13T06:29:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbb00608640 1 -- 172.21.15.169:0/846594057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0aaac0 con 0x5567c63fb8f0 2024-09-13T06:29:44.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbb00608640 1 -- 172.21.15.169:0/846594057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0aada0 con 0x5567c63fb8f0 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/846594057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 msgr2=0x5567c64e6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/846594057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64e6be0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c017ca0 tx=0x7fbc0c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/846594057 shutdown_connections 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/846594057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64e6be0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/846594057 >> 172.21.15.169:0/846594057 conn(0x5567c636f240 msgr2=0x5567c64e2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/846594057 shutdown_connections 2024-09-13T06:29:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/846594057 wait complete. 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 Processor -- start 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- start start 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5567c6402f00 con 0x5567c63fb8f0 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64ede10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57166/0 (socket says 172.21.15.169:57166) 2024-09-13T06:29:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc1270b640 1 -- 172.21.15.169:0/3118747573 learned_addr learned my addr 172.21.15.169:0/3118747573 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc1270b640 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c64ee350 con 0x5567c63fb8f0 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc1270b640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64ede10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c005cc0 tx=0x7fbc0c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbafee05640 1 -- 172.21.15.169:0/3118747573 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0b9030 con 0x5567c63fb8f0 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbafee05640 1 -- 172.21.15.169:0/3118747573 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0c3070 con 0x5567c63fb8f0 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567c64ee5e0 con 0x5567c63fb8f0 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbafee05640 1 -- 172.21.15.169:0/3118747573 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0bf750 con 0x5567c63fb8f0 2024-09-13T06:29:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.332+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c64f12c0 con 0x5567c63fb8f0 2024-09-13T06:29:44.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbafee05640 1 -- 172.21.15.169:0/3118747573 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc0c0c5030 con 0x5567c63fb8f0 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbafee05640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf80346a0 0x7fbaf8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbafee05640 1 -- 172.21.15.169:0/3118747573 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fbc0c0ba070 con 0x5567c63fb8f0 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c63fc240 0x5567c64f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf80346a0 0x7fbaf8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c64f53e0 con 0x5567c63fc240 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc12f0c640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c63fc240 0x5567c64f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf80346a0 0x7fbaf8036b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc000f70 tx=0x7fbbfc001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc12f0c640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c63fc240 0x5567c64f4da0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc12f0c640 1 -- 172.21.15.169:0/3118747573 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c63fc240 2024-09-13T06:29:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c64f61d0 0x5567c64f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c64f8bf0 con 0x5567c64f61d0 2024-09-13T06:29:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc1270b640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c64f61d0 0x5567c64f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.336+0000 7fbc1270b640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c64f61d0 0x5567c64f85c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc1270b640 1 -- 172.21.15.169:0/3118747573 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc0c0ce070 con 0x5567c64f61d0 2024-09-13T06:29:44.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c64fa4a0 con 0x5567c64f61d0 2024-09-13T06:29:44.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc1270b640 1 -- 172.21.15.169:0/3118747573 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc0c0ce070 con 0x5567c64f61d0 2024-09-13T06:29:44.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c64f9610 con 0x5567c64f61d0 2024-09-13T06:29:44.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc1270b640 1 -- 172.21.15.169:0/3118747573 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc0c0ce070 con 0x5567c64f61d0 2024-09-13T06:29:44.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c64fb850 0x5567c64fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c64fe180 con 0x5567c64fb850 2024-09-13T06:29:44.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c64fb850 0x5567c64fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c64fb850 0x5567c64fdc40 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc11f0a640 1 -- 172.21.15.169:0/3118747573 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbfc00f6a0 con 0x5567c64fb850 2024-09-13T06:29:44.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 Processor -- start 2024-09-13T06:29:44.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 -- start start 2024-09-13T06:29:44.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 0x5567c650bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.340+0000 7fbc14bfb980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5567c6300800 con 0x5567c650bb30 2024-09-13T06:29:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 0x5567c650bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 0x5567c650bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57182/0 (socket says 172.21.15.169:57182) 2024-09-13T06:29:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 -- 172.21.15.169:0/3547552278 learned_addr learned my addr 172.21.15.169:0/3547552278 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 -- 172.21.15.169:0/3547552278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c650c490 con 0x5567c650bb30 2024-09-13T06:29:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 0x5567c650bf50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0b7010 tx=0x7fbc0c0bdc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbaf7fff640 1 -- 172.21.15.169:0/3547552278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0cc040 con 0x5567c650bb30 2024-09-13T06:29:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbaf7fff640 1 -- 172.21.15.169:0/3547552278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0c6de0 con 0x5567c650bb30 2024-09-13T06:29:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567c650c720 con 0x5567c650bb30 2024-09-13T06:29:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbaf7fff640 1 -- 172.21.15.169:0/3547552278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0a9880 con 0x5567c650bb30 2024-09-13T06:29:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c650c720 con 0x5567c650bb30 2024-09-13T06:29:44.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbaf7fff640 1 -- 172.21.15.169:0/3547552278 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc0c0b3040 con 0x5567c650bb30 2024-09-13T06:29:44.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbaf7fff640 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaec034650 0x7fbaec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbaf7fff640 1 -- 172.21.15.169:0/3547552278 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fbc0c0f0970 con 0x5567c650bb30 2024-09-13T06:29:44.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaec034650 0x7fbaec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc14bfb980 1 Processor -- start 2024-09-13T06:29:44.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc14bfb980 1 -- start start 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaec034650 0x7fbaec036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5567c64f2400 tx=0x7fbbfc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc14bfb980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c65186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc14bfb980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5567c64e7470 con 0x5567c6518310 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c65186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c65186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57198/0 (socket says 172.21.15.169:57198) 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.344+0000 7fbc1270b640 1 -- 172.21.15.169:0/3099762897 learned_addr learned my addr 172.21.15.169:0/3099762897 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 -- 172.21.15.169:0/3099762897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c6518cc0 con 0x5567c6518310 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 --2- 172.21.15.169:0/3099762897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c65186f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0ac010 tx=0x7fbc0c0d1f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc782fb7fb4ea1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbaf5ffb640 1 -- 172.21.15.169:0/3099762897 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0fd070 con 0x5567c6518310 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbaf5ffb640 1 -- 172.21.15.169:0/3099762897 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0bfa40 con 0x5567c6518310 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbaf5ffb640 1 -- 172.21.15.169:0/3099762897 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c009240 con 0x5567c6518310 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3099762897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 msgr2=0x5567c65186f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3099762897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c65186f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0ac010 tx=0x7fbc0c0d1f90 comp rx=0 tx=0).stop 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3099762897 shutdown_connections 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3099762897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c65186f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3099762897 >> 172.21.15.169:0/3099762897 conn(0x5567c65146f0 msgr2=0x5567c65127f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3099762897 shutdown_connections 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3099762897 wait complete. 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 Processor -- start 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- start start 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c651f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5567c6519160 con 0x5567c6518310 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c651f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c651f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57208/0 (socket says 172.21.15.169:57208) 2024-09-13T06:29:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 learned_addr learned my addr 172.21.15.169:0/2537927882 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c651fa70 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc1270b640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c651f530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0ac010 tx=0x7fbc0c0f8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbae3fff640 1 -- 172.21.15.169:0/2537927882 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0dce00 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbae3fff640 1 -- 172.21.15.169:0/2537927882 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0dcfa0 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567c651fa70 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbae3fff640 1 -- 172.21.15.169:0/2537927882 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc0c0d1960 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.348+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c651fa70 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbae3fff640 1 -- 172.21.15.169:0/2537927882 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc0c10f020 con 0x5567c6518310 2024-09-13T06:29:44.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbae3fff640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbadc034650 0x7fbadc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbae3fff640 1 -- 172.21.15.169:0/2537927882 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fbc0c1071a0 con 0x5567c6518310 2024-09-13T06:29:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbadc034650 0x7fbadc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c652a580 0x5567c652ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c652d190 con 0x5567c652a580 2024-09-13T06:29:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc12f0c640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c652a580 0x5567c652ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbadc034650 0x7fbadc036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c010 tx=0x7fbbfc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc12f0c640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c652a580 0x5567c652ca40 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 realm 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c65299b0 con 0x5567c652a580 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c652dc50 con 0x5567c652a580 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c652ea30 0x5567c6530e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c65314d0 con 0x5567c652ea30 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc1270b640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c652ea30 0x5567c6530e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.352+0000 7fbc1270b640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c652ea30 0x5567c6530e20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:44.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c6531d20 con 0x5567c652ea30 2024-09-13T06:29:44.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:44.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 20 searching for the correct realm 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c6533a90 0x5567c6535e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c6533a90 0x5567c6535e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc11f0a640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c6533a90 0x5567c6535e80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc1270b640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc0c102070 0x7fbc0c1028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x7fbc0c102070 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc0c102070 0x7fbc0c1028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc0c102070 0x7fbc0c1028b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.356+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x7fbc0c102070 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x7fbc0c102070 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.360+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x7fbc0c102070 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652a580 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x7fbc0c102070 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.364+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x7fbc0c102070 2024-09-13T06:29:44.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c6533a90 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536500 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c65326a0 con 0x5567c652a580 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.368+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c65322e0 con 0x5567c652ea30 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:44.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c65322f0 con 0x5567c6533a90 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 zone default found 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 4 Realm: () 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 zonegroup default 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c6536e10 con 0x7fbc0c102070 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c6538b90 con 0x5567c6533a90 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c6539050 con 0x5567c6533a90 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 started sync module instance, tier type = 2024-09-13T06:29:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6538030 con 0x5567c652ea30 2024-09-13T06:29:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93904197354832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6538030 con 0x5567c652ea30 2024-09-13T06:29:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.372+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6539b10 con 0x5567c652a580 2024-09-13T06:29:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.376+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.376+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93904197359136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653a3b0 con 0x5567c652a580 2024-09-13T06:29:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.376+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653add0 con 0x5567c652ea30 2024-09-13T06:29:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.376+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93904197354832] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.376+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93904197359136] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93904197363904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6539f00 con 0x5567c652ea30 2024-09-13T06:29:44.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653b670 con 0x7fbc0c102070 2024-09-13T06:29:44.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93904197366208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6539f00 con 0x7fbc0c102070 2024-09-13T06:29:44.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653c0f0 con 0x5567c652ea30 2024-09-13T06:29:44.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93904197363904] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93904197366208] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93904197367264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653bc00 con 0x5567c652ea30 2024-09-13T06:29:44.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.380+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653c990 con 0x5567c6533a90 2024-09-13T06:29:44.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93904197371104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653bc00 con 0x5567c6533a90 2024-09-13T06:29:44.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653d710 con 0x5567c6533a90 2024-09-13T06:29:44.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93904197367264] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93904197371104] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93904197373232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653db00 con 0x5567c6533a90 2024-09-13T06:29:44.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653e350 con 0x7fbc0c102070 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93904197378208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653ebf0 con 0x7fbc0c102070 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=0 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=1 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=2 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=3 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=4 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=5 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93904197373232] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.384+0000 7fbc14bfb980 20 add_watcher() i=6 2024-09-13T06:29:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93904197378208] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 20 add_watcher() i=7 2024-09-13T06:29:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c653ebf0 con 0x5567c652a580 2024-09-13T06:29:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93904197379824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653eb40 con 0x5567c652a580 2024-09-13T06:29:44.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93904197379824] v33'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:44.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:44.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.388+0000 7fbc14bfb980 5 note: GC not initialized 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fba437fe640 20 reqs_thread_entry: start 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 20 Filter name: none 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fba417fa640 20 reqs_thread_entry: start 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c65652a0 con 0x5567c652a580 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T06:29:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c656b460 con 0x5567c652a580 2024-09-13T06:29:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:29:44.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93904197562064 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5567c6566d20 con 0x5567c652ea30 2024-09-13T06:29:44.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 93904197367264 notify 141733920803 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5567c650c490 con 0x5567c652ea30 2024-09-13T06:29:44.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbaf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 93904197367264 notifier 4659 bl.length()=567 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbaf5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbaf5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbaf5ffb640 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fbad8003eb0 con 0x5567c652ea30 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.392+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 93904197562064 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.396+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.396+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 93904197562064 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbc0c120040 con 0x5567c652ea30 2024-09-13T06:29:44.398 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:29:18.031551Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:29:18.031533Z","tags":[],"group_ids":[]} 2024-09-13T06:29:44.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.396+0000 7fbac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.396+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93904197379824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c65630d0 con 0x5567c652a580 2024-09-13T06:29:44.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.396+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93904197379824] v33'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.396+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93904197354832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c65630d0 con 0x5567c652ea30 2024-09-13T06:29:44.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93904197354832] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc14bfb980 20 remove_watcher() i=0 2024-09-13T06:29:44.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc14bfb980 2 removed watcher, disabling cache 2024-09-13T06:29:44.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93904197359136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6538550 con 0x5567c652a580 2024-09-13T06:29:44.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93904197359136] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x5567c652a580 2024-09-13T06:29:44.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc14bfb980 20 remove_watcher() i=1 2024-09-13T06:29:44.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.400+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93904197363904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c65630d0 con 0x5567c652ea30 2024-09-13T06:29:44.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.404+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93904197363904] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.404+0000 7fbc14bfb980 20 remove_watcher() i=2 2024-09-13T06:29:44.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.404+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93904197366208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c6538550 con 0x7fbc0c102070 2024-09-13T06:29:44.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.404+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93904197366208] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.404+0000 7fbc14bfb980 20 remove_watcher() i=3 2024-09-13T06:29:44.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.404+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93904197367264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653a8c0 con 0x5567c652ea30 2024-09-13T06:29:44.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc1270b640 1 -- 172.21.15.169:0/2537927882 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93904197367264] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc0c0ff030 con 0x5567c652ea30 2024-09-13T06:29:44.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc14bfb980 20 remove_watcher() i=4 2024-09-13T06:29:44.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93904197371104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c65630d0 con 0x5567c6533a90 2024-09-13T06:29:44.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93904197371104] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc14bfb980 20 remove_watcher() i=5 2024-09-13T06:29:44.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93904197373232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653b640 con 0x5567c6533a90 2024-09-13T06:29:44.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc11f0a640 1 -- 172.21.15.169:0/2537927882 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93904197373232] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbfc037040 con 0x5567c6533a90 2024-09-13T06:29:44.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc14bfb980 20 remove_watcher() i=6 2024-09-13T06:29:44.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.408+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93904197378208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5567c653b5f0 con 0x7fbc0c102070 2024-09-13T06:29:44.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93904197378208] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc040083f0 con 0x7fbc0c102070 2024-09-13T06:29:44.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 20 remove_watcher() i=7 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c652ea30 msgr2=0x5567c6530e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c652ea30 0x5567c6530e20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c652a580 msgr2=0x5567c652ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c652a580 0x5567c652ca40 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc0c102070 msgr2=0x7fbc0c1028b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbc0c102070 0x7fbc0c1028b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c6533a90 msgr2=0x5567c6535e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c6533a90 0x5567c6535e80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbadc034650 msgr2=0x7fbadc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbadc034650 0x7fbadc036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c010 tx=0x7fbbfc010000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 msgr2=0x5567c651f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc12f0c640 1 -- 172.21.15.169:0/2537927882 reap_dead start 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c651f530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0ac010 tx=0x7fbc0c0f8000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 shutdown_connections 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/2537927882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c6518310 0x5567c651f530 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 >> 172.21.15.169:0/2537927882 conn(0x5567c65146f0 msgr2=0x5567c65127c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 shutdown_connections 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/2537927882 wait complete. 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaec034650 msgr2=0x7fbaec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaec034650 0x7fbaec036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5567c64f2400 tx=0x7fbbfc00f000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 msgr2=0x5567c650bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 0x5567c650bf50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0b7010 tx=0x7fbc0c0bdc70 comp rx=0 tx=0).stop 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 shutdown_connections 2024-09-13T06:29:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaec034650 0x7fbaec036b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3547552278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c650bb30 0x5567c650bf50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 >> 172.21.15.169:0/3547552278 conn(0x5567c6500c80 msgr2=0x5567c6503700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 shutdown_connections 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3547552278 wait complete. 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c64f61d0 msgr2=0x5567c64f85c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5567c64f61d0 0x5567c64f85c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c63fc240 msgr2=0x5567c64f4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5567c63fc240 0x5567c64f4da0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c64fb850 msgr2=0x5567c64fdc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5567c64fb850 0x5567c64fdc40 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf80346a0 msgr2=0x7fbaf8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbaf80346a0 0x7fbaf8036b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc000f70 tx=0x7fbbfc001380 comp rx=0 tx=0).stop 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 msgr2=0x5567c64ede10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 --2- 172.21.15.169:0/3118747573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c63fb8f0 0x5567c64ede10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c005cc0 tx=0x7fbc0c017e30 comp rx=0 tx=0).stop 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc12f0c640 1 -- 172.21.15.169:0/3118747573 reap_dead start 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 shutdown_connections 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 >> 172.21.15.169:0/3118747573 conn(0x5567c636f240 msgr2=0x5567c64e1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 shutdown_connections 2024-09-13T06:29:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.412+0000 7fbc14bfb980 1 -- 172.21.15.169:0/3118747573 wait complete. 2024-09-13T06:29:44.427 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:29:18.031551Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:29:18.031533Z', 'tags': [], 'group_ids': []} 2024-09-13T06:29:44.442 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:44.442 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T06:29:44.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T06:29:44.443 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T06:29:44.504 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:29:44.504 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfce8c980 1 Processor -- start 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfce8c980 1 -- start start 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfce8c980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f47a2dadf0 0x55f47a2dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfce8c980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f47a160ae0 con 0x55f47a2dd750 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfce8c980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55f47a184e30 con 0x55f47a2dadf0 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfa99c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f47a2dadf0 0x55f47a2dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.500+0000 7f0bfa19b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55f47a2dd750 0x55f47a2dfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:49764/0 (socket says 172.21.15.169:49764) 2024-09-13T06:29:44.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.504+0000 7f0bfa19b640 1 -- 172.21.15.169:0/29964262 learned_addr learned my addr 172.21.15.169:0/29964262 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:29:44.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.504+0000 7f0bfa99c640 1 -- 172.21.15.169:0/29964262 >> v1:172.21.15.112:6789/0 conn(0x55f47a2dd750 legacy=0x55f47a2dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.504+0000 7f0bfa99c640 1 -- 172.21.15.169:0/29964262 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47a2e23f0 con 0x55f47a2dadf0 2024-09-13T06:29:44.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/29964262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a2dd1e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400a420 tx=0x7f0bf401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f056cbe3e374c0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bf999a640 1 -- 172.21.15.169:0/29964262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40af070 con 0x55f47a2dadf0 2024-09-13T06:29:44.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bf999a640 1 -- 172.21.15.169:0/29964262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40aa530 con 0x55f47a2dadf0 2024-09-13T06:29:44.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bf999a640 1 -- 172.21.15.169:0/29964262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40aa850 con 0x55f47a2dadf0 2024-09-13T06:29:44.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 -- 172.21.15.169:0/29964262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 msgr2=0x55f47a2dd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/29964262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a2dd1e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400a420 tx=0x7f0bf401afd0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 -- 172.21.15.169:0/29964262 shutdown_connections 2024-09-13T06:29:44.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/29964262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a2dd1e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 -- 172.21.15.169:0/29964262 >> 172.21.15.169:0/29964262 conn(0x55f47a24e280 msgr2=0x55f47a24e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 -- 172.21.15.169:0/29964262 shutdown_connections 2024-09-13T06:29:44.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.508+0000 7f0bfce8c980 1 -- 172.21.15.169:0/29964262 wait complete. 2024-09-13T06:29:44.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 Processor -- start 2024-09-13T06:29:44.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- start start 2024-09-13T06:29:44.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f47a186200 con 0x55f47a2dadf0 2024-09-13T06:29:44.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57222/0 (socket says 172.21.15.169:57222) 2024-09-13T06:29:44.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2286683071 learned_addr learned my addr 172.21.15.169:0/2286683071 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2286683071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47a3c6250 con 0x55f47a2dadf0 2024-09-13T06:29:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/2286683071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3c5c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400a420 tx=0x7f0bf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1ec3b1330928d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0ae8e09640 1 -- 172.21.15.169:0/2286683071 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40af050 con 0x55f47a2dadf0 2024-09-13T06:29:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0ae8e09640 1 -- 172.21.15.169:0/2286683071 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40b0040 con 0x55f47a2dadf0 2024-09-13T06:29:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0ae8e09640 1 -- 172.21.15.169:0/2286683071 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40aac60 con 0x55f47a2dadf0 2024-09-13T06:29:44.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2286683071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 msgr2=0x55f47a3c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2286683071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3c5c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400a420 tx=0x7f0bf40033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2286683071 shutdown_connections 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2286683071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3c5c80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2286683071 >> 172.21.15.169:0/2286683071 conn(0x55f47a24e280 msgr2=0x55f47a3c18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2286683071 shutdown_connections 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2286683071 wait complete. 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 Processor -- start 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.524+0000 7f0bfce8c980 1 -- start start 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfce8c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfce8c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f47a2e1e30 con 0x55f47a2dadf0 2024-09-13T06:29:44.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57238/0 (socket says 172.21.15.169:57238) 2024-09-13T06:29:44.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2469703301 learned_addr learned my addr 172.21.15.169:0/2469703301 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47a3cd3d0 con 0x55f47a2dadf0 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3cce90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40b8040 tx=0x7f0bf4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0ae7606640 1 -- 172.21.15.169:0/2469703301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40c5070 con 0x55f47a2dadf0 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0ae7606640 1 -- 172.21.15.169:0/2469703301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40c15d0 con 0x55f47a2dadf0 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f47a3cd660 con 0x55f47a2dadf0 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0ae7606640 1 -- 172.21.15.169:0/2469703301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40c18f0 con 0x55f47a2dadf0 2024-09-13T06:29:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f47a3d0340 con 0x55f47a2dadf0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0ae7606640 1 -- 172.21.15.169:0/2469703301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0bf40c8070 con 0x55f47a2dadf0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0ae7606640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ae0034650 0x7f0ae0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0ae7606640 1 -- 172.21.15.169:0/2469703301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f0bf40bb070 con 0x55f47a2dadf0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ae0034650 0x7f0ae0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a2dd750 0x55f47a3d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a3d44d0 con 0x55f47a2dd750 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfb19d640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a2dd750 0x55f47a3d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ae0034650 0x7f0ae0036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0001da0 tx=0x7f0bf0001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfb19d640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a2dd750 0x55f47a3d3f90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.528+0000 7f0bfb19d640 1 -- 172.21.15.169:0/2469703301 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a2dd750 2024-09-13T06:29:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a3d5260 0x55f47a3d7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a3d7c80 con 0x55f47a3d5260 2024-09-13T06:29:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a3d5260 0x55f47a3d7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a3d5260 0x55f47a3d7650 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2469703301 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bf40c7030 con 0x55f47a3d5260 2024-09-13T06:29:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a3d9530 con 0x55f47a3d5260 2024-09-13T06:29:44.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2469703301 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0bf40c7030 con 0x55f47a3d5260 2024-09-13T06:29:44.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a3d8760 con 0x55f47a3d5260 2024-09-13T06:29:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa99c640 1 -- 172.21.15.169:0/2469703301 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bf40c7030 con 0x55f47a3d5260 2024-09-13T06:29:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a3da8e0 0x55f47a3dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a3dd210 con 0x55f47a3da8e0 2024-09-13T06:29:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a3da8e0 0x55f47a3dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.532+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a3da8e0 0x55f47a3dccd0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa19b640 1 -- 172.21.15.169:0/2469703301 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a3da8e0 2024-09-13T06:29:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 Processor -- start 2024-09-13T06:29:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 -- start start 2024-09-13T06:29:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 0x55f47a3eb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f47a1df800 con 0x55f47a3eac20 2024-09-13T06:29:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 0x55f47a3eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 0x55f47a3eb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57248/0 (socket says 172.21.15.169:57248) 2024-09-13T06:29:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa99c640 1 -- 172.21.15.169:0/369612786 learned_addr learned my addr 172.21.15.169:0/369612786 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa99c640 1 -- 172.21.15.169:0/369612786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47a3eb580 con 0x55f47a3eac20 2024-09-13T06:29:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 0x55f47a3eb040 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40e3610 tx=0x7f0bf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0ae4e01640 1 -- 172.21.15.169:0/369612786 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40c9590 con 0x55f47a3eac20 2024-09-13T06:29:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f47a3eb810 con 0x55f47a3eac20 2024-09-13T06:29:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0ae4e01640 1 -- 172.21.15.169:0/369612786 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40c9730 con 0x55f47a3eac20 2024-09-13T06:29:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0ae4e01640 1 -- 172.21.15.169:0/369612786 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40e3980 con 0x55f47a3eac20 2024-09-13T06:29:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f47a3ee490 con 0x55f47a3eac20 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0ae4e01640 1 -- 172.21.15.169:0/369612786 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0bf40e1030 con 0x55f47a3eac20 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0ae4e01640 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ad4034650 0x7f0ad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0ae4e01640 1 -- 172.21.15.169:0/369612786 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f0bf40f2bc0 con 0x55f47a3eac20 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ad4034650 0x7f0ad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 Processor -- start 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.536+0000 7f0bfce8c980 1 -- start start 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ad4034650 0x7f0ad4036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55f47a3d8b00 tx=0x7f0bf000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3f7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f47a3c6510 con 0x55f47a3f7590 2024-09-13T06:29:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57262/0 (socket says 172.21.15.169:57262) 2024-09-13T06:29:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 -- 172.21.15.169:0/3071040526 learned_addr learned my addr 172.21.15.169:0/3071040526 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 -- 172.21.15.169:0/3071040526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47a3f7f40 con 0x55f47a3f7590 2024-09-13T06:29:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/3071040526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3f7970 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40ea040 tx=0x7f0bf40e3ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d101700026e023d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0ade7fc640 1 -- 172.21.15.169:0/3071040526 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40bfc50 con 0x55f47a3f7590 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0ade7fc640 1 -- 172.21.15.169:0/3071040526 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40e8410 con 0x55f47a3f7590 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0ade7fc640 1 -- 172.21.15.169:0/3071040526 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40da0b0 con 0x55f47a3f7590 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- 172.21.15.169:0/3071040526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 msgr2=0x55f47a3f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/3071040526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3f7970 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40ea040 tx=0x7f0bf40e3ef0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- 172.21.15.169:0/3071040526 shutdown_connections 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/3071040526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3f7970 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- 172.21.15.169:0/3071040526 >> 172.21.15.169:0/3071040526 conn(0x55f47a3f3970 msgr2=0x55f47a3f1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- 172.21.15.169:0/3071040526 shutdown_connections 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- 172.21.15.169:0/3071040526 wait complete. 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 Processor -- start 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- start start 2024-09-13T06:29:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3fe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfce8c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f47a3f83e0 con 0x55f47a3f7590 2024-09-13T06:29:44.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3fe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3fe7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:57276/0 (socket says 172.21.15.169:57276) 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 learned_addr learned my addr 172.21.15.169:0/1059910418 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47a3fecf0 con 0x55f47a3f7590 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.540+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3fe7b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40c9a10 tx=0x7f0bf40f4f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0adcff9640 1 -- 172.21.15.169:0/1059910418 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf410e070 con 0x55f47a3f7590 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0adcff9640 1 -- 172.21.15.169:0/1059910418 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40ef310 con 0x55f47a3f7590 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f47a3fecf0 con 0x55f47a3f7590 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0adcff9640 1 -- 172.21.15.169:0/1059910418 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf40ef4c0 con 0x55f47a3f7590 2024-09-13T06:29:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f47a3fecf0 con 0x55f47a3f7590 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0adcff9640 1 -- 172.21.15.169:0/1059910418 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0bf4119060 con 0x55f47a3f7590 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0adcff9640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ac40346a0 0x7f0ac4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0adcff9640 1 -- 172.21.15.169:0/1059910418 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f0bf4113bd0 con 0x55f47a3f7590 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ac40346a0 0x7f0ac4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a409880 0x55f47a40bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a40c490 con 0x55f47a409880 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfb19d640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a409880 0x55f47a40bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ac40346a0 0x7f0ac4036b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55f47a3d8730 tx=0x7f0bf0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfb19d640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a409880 0x55f47a40bd40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 realm 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a408cb0 con 0x55f47a409880 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a40cf20 con 0x55f47a409880 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a40dd00 0x55f47a4100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.544+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a410780 con 0x55f47a40dd00 2024-09-13T06:29:44.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a40dd00 0x55f47a4100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a40dd00 0x55f47a4100f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a410fd0 con 0x55f47a40dd00 2024-09-13T06:29:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 20 searching for the correct realm 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a412d40 0x55f47a415130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a412d40 0x55f47a415130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa19b640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a412d40 0x55f47a415130 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f0bf411b070 0x7f0bf40de910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x7f0bf411b070 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.548+0000 7f0bfb19d640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f0bf411b070 0x7f0bf40de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:29:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f0bf411b070 0x7f0bf40de910 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:29:44.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x7f0bf411b070 2024-09-13T06:29:44.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.552+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x7f0bf411b070 2024-09-13T06:29:44.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.556+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x7f0bf411b070 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a409880 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x7f0bf411b070 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x7f0bf411b070 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a412d40 2024-09-13T06:29:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.560+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4157b0 con 0x55f47a40dd00 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a411950 con 0x55f47a409880 2024-09-13T06:29:44.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a411590 con 0x55f47a40dd00 2024-09-13T06:29:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:29:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a412270 con 0x55f47a412d40 2024-09-13T06:29:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 zone default found 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 4 Realm: () 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 zonegroup default 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4160c0 con 0x7f0bf411b070 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a417e40 con 0x55f47a412d40 2024-09-13T06:29:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4182d0 con 0x55f47a412d40 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 started sync module instance, tier type = 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.564+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4172e0 con 0x55f47a40dd00 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94508511492096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4172e0 con 0x55f47a40dd00 2024-09-13T06:29:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a418de0 con 0x55f47a409880 2024-09-13T06:29:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94508511496400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a419680 con 0x55f47a409880 2024-09-13T06:29:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41a0c0 con 0x55f47a40dd00 2024-09-13T06:29:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94508511492096] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.568+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94508511496400] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94508511501200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4191d0 con 0x55f47a40dd00 2024-09-13T06:29:44.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41a960 con 0x7f0bf411b070 2024-09-13T06:29:44.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94508511503536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4191d0 con 0x7f0bf411b070 2024-09-13T06:29:44.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41b430 con 0x55f47a40dd00 2024-09-13T06:29:44.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94508511501200] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94508511503536] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94508511504592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41b3f0 con 0x55f47a40dd00 2024-09-13T06:29:44.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.572+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41b820 con 0x55f47a412d40 2024-09-13T06:29:44.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94508511489584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41c0c0 con 0x55f47a412d40 2024-09-13T06:29:44.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41cac0 con 0x55f47a412d40 2024-09-13T06:29:44.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94508511504592] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94508511489584] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94508511506208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41ceb0 con 0x55f47a412d40 2024-09-13T06:29:44.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x7f0bf411b070 2024-09-13T06:29:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94508511506208] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94508511509520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x7f0bf411b070 2024-09-13T06:29:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=0 2024-09-13T06:29:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=1 2024-09-13T06:29:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=2 2024-09-13T06:29:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=3 2024-09-13T06:29:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=4 2024-09-13T06:29:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=5 2024-09-13T06:29:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.576+0000 7f0bfce8c980 20 add_watcher() i=6 2024-09-13T06:29:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94508511509520] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 20 add_watcher() i=7 2024-09-13T06:29:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:29:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4208a0 con 0x55f47a409880 2024-09-13T06:29:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94508511515584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41dd60 con 0x55f47a409880 2024-09-13T06:29:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94508511515584] v33'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0ab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:29:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:29:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.580+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a429180 con 0x55f47a40dd00 2024-09-13T06:29:44.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.584+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.584+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4291e0 con 0x7f0bf411b070 2024-09-13T06:29:44.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.584+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.584+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4298d0 con 0x55f47a412d40 2024-09-13T06:29:44.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.588+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.588+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a429e40 con 0x55f47a409880 2024-09-13T06:29:44.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.588+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.588+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42a2f0 con 0x55f47a40dd00 2024-09-13T06:29:44.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.592+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.592+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42a2f0 con 0x55f47a412d40 2024-09-13T06:29:44.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.596+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.596+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4280b0 con 0x55f47a40dd00 2024-09-13T06:29:44.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.596+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.596+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a4280b0 con 0x55f47a409880 2024-09-13T06:29:44.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.596+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.600+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42ae50 con 0x55f47a40dd00 2024-09-13T06:29:44.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.600+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.600+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42ae50 con 0x55f47a40dd00 2024-09-13T06:29:44.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.604+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.604+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42ae50 con 0x55f47a40dd00 2024-09-13T06:29:44.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.604+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.604+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42ae50 con 0x55f47a412d40 2024-09-13T06:29:44.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.608+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.608+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42b300 con 0x55f47a40dd00 2024-09-13T06:29:44.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.608+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.608+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42b300 con 0x55f47a409880 2024-09-13T06:29:44.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.612+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.612+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42b720 con 0x55f47a409880 2024-09-13T06:29:44.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.612+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.612+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42b720 con 0x55f47a40dd00 2024-09-13T06:29:44.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.616+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.616+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.620+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.620+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a412d40 2024-09-13T06:29:44.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.620+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.620+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.624+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.624+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a409880 2024-09-13T06:29:44.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.624+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.624+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.628+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.628+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.632+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.632+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a412d40 2024-09-13T06:29:44.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.632+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.632+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.636+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.636+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a412d40 2024-09-13T06:29:44.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.636+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.636+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a412d40 2024-09-13T06:29:44.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.640+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.640+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a412d40 2024-09-13T06:29:44.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.640+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'29 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.640+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.644+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.644+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a409880 2024-09-13T06:29:44.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.644+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.644+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a40dd00 2024-09-13T06:29:44.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.648+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.648+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x55f47a409880 2024-09-13T06:29:44.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.648+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.648+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a42bbd0 con 0x7f0bf411b070 2024-09-13T06:29:44.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0a2bfff640 20 reqs_thread_entry: start 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 20 init_complete bucket index max shards: 11 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 20 Filter name: none 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0a29ffb640 20 reqs_thread_entry: start 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 20 rados->read ofs=0 len=0 2024-09-13T06:29:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a446c00 con 0x55f47a409880 2024-09-13T06:29:44.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:29:44.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f47a449020 con 0x7f0bf411b070 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0ab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:29:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.652+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94508511515584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a422d60 con 0x55f47a409880 2024-09-13T06:29:44.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.656+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94508511515584] v33'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.656+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94508511492096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x55f47a40dd00 2024-09-13T06:29:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94508511492096] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 20 remove_watcher() i=0 2024-09-13T06:29:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 2 removed watcher, disabling cache 2024-09-13T06:29:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94508511496400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x55f47a409880 2024-09-13T06:29:44.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94508511496400] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x55f47a409880 2024-09-13T06:29:44.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 20 remove_watcher() i=1 2024-09-13T06:29:44.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94508511501200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x55f47a40dd00 2024-09-13T06:29:44.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94508511501200] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 20 remove_watcher() i=2 2024-09-13T06:29:44.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.660+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94508511503536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a419b90 con 0x7f0bf411b070 2024-09-13T06:29:44.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.664+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94508511503536] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.664+0000 7f0bfce8c980 20 remove_watcher() i=3 2024-09-13T06:29:44.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.664+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94508511504592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x55f47a40dd00 2024-09-13T06:29:44.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.664+0000 7f0bfa99c640 1 -- 172.21.15.169:0/1059910418 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94508511504592] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf40fd070 con 0x55f47a40dd00 2024-09-13T06:29:44.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.664+0000 7f0bfce8c980 20 remove_watcher() i=4 2024-09-13T06:29:44.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.664+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94508511489584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a419b90 con 0x55f47a412d40 2024-09-13T06:29:44.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94508511489584] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfce8c980 20 remove_watcher() i=5 2024-09-13T06:29:44.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94508511506208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a41d3c0 con 0x55f47a412d40 2024-09-13T06:29:44.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfa19b640 1 -- 172.21.15.169:0/1059910418 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94508511506208] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf000e6c0 con 0x55f47a412d40 2024-09-13T06:29:44.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfce8c980 20 remove_watcher() i=6 2024-09-13T06:29:44.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94508511509520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f47a419b90 con 0x7f0bf411b070 2024-09-13T06:29:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94508511509520] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec0083f0 con 0x7f0bf411b070 2024-09-13T06:29:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.668+0000 7f0bfce8c980 20 remove_watcher() i=7 2024-09-13T06:29:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a40dd00 msgr2=0x55f47a4100f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a40dd00 0x55f47a4100f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a409880 msgr2=0x55f47a40bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a409880 0x55f47a40bd40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f0bf411b070 msgr2=0x7f0bf40de910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f0bf411b070 0x7f0bf40de910 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a412d40 msgr2=0x55f47a415130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a412d40 0x55f47a415130 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ac40346a0 msgr2=0x7f0ac4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ac40346a0 0x7f0ac4036b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55f47a3d8730 tx=0x7f0bf0010000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 msgr2=0x55f47a3fe7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3fe7b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40c9a10 tx=0x7f0bf40f4f10 comp rx=0 tx=0).stop 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfb19d640 1 -- 172.21.15.169:0/1059910418 reap_dead start 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 shutdown_connections 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/1059910418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3f7590 0x55f47a3fe7b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 >> 172.21.15.169:0/1059910418 conn(0x55f47a3f3970 msgr2=0x55f47a3f1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 shutdown_connections 2024-09-13T06:29:44.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/1059910418 wait complete. 2024-09-13T06:29:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ad4034650 msgr2=0x7f0ad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ad4034650 0x7f0ad4036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55f47a3d8b00 tx=0x7f0bf000f000 comp rx=0 tx=0).stop 2024-09-13T06:29:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 msgr2=0x55f47a3eb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 0x55f47a3eb040 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40e3610 tx=0x7f0bf40033b0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 shutdown_connections 2024-09-13T06:29:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ad4034650 0x7f0ad4036b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/369612786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a3eac20 0x55f47a3eb040 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 >> 172.21.15.169:0/369612786 conn(0x55f47a3dfd70 msgr2=0x55f47a3e27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 shutdown_connections 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/369612786 wait complete. 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a3d5260 msgr2=0x55f47a3d7650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f47a3d5260 0x55f47a3d7650 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a2dd750 msgr2=0x55f47a3d3f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f47a2dd750 0x55f47a3d3f90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a3da8e0 msgr2=0x55f47a3dccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f47a3da8e0 0x55f47a3dccd0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ae0034650 msgr2=0x7f0ae0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0ae0034650 0x7f0ae0036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0001da0 tx=0x7f0bf0001300 comp rx=0 tx=0).stop 2024-09-13T06:29:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 msgr2=0x55f47a3cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:29:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 --2- 172.21.15.169:0/2469703301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f47a2dadf0 0x55f47a3cce90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40b8040 tx=0x7f0bf4019810 comp rx=0 tx=0).stop 2024-09-13T06:29:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfb19d640 1 -- 172.21.15.169:0/2469703301 reap_dead start 2024-09-13T06:29:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 shutdown_connections 2024-09-13T06:29:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 >> 172.21.15.169:0/2469703301 conn(0x55f47a24e280 msgr2=0x55f47a3c0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:29:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 shutdown_connections 2024-09-13T06:29:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:29:44.672+0000 7f0bfce8c980 1 -- 172.21.15.169:0/2469703301 wait complete. 2024-09-13T06:29:44.687 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:29:44.706 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:29:44.712 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T06:30:19.713 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T06:30:19.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T06:30:19.715 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T06:30:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52bb5ec980 1 Processor -- start 2024-09-13T06:30:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52bb5ec980 1 -- start start 2024-09-13T06:30:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52bb5ec980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55ec468f1910 0x55ec468f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52bb5ec980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ec46776ae0 con 0x55ec468ed540 2024-09-13T06:30:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52bb5ec980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55ec4679ae30 con 0x55ec468f1910 2024-09-13T06:30:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52b88fb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55ec468f1910 0x55ec468f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52b88fb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55ec468f1910 0x55ec468f3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38818/0 (socket says 172.21.15.169:38818) 2024-09-13T06:30:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52b88fb640 1 -- 172.21.15.169:0/671522549 learned_addr learned my addr 172.21.15.169:0/671522549 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52b90fc640 1 --1- 172.21.15.169:0/671522549 >> v1:172.21.15.112:6789/0 conn(0x55ec468ed540 0x55ec468ed920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57448/0 (socket says 172.21.15.169:57448) 2024-09-13T06:30:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52b88fb640 1 -- 172.21.15.169:0/671522549 >> v1:172.21.15.112:6789/0 conn(0x55ec468ed540 legacy=0x55ec468ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.755+0000 7f52b88fb640 1 -- 172.21.15.169:0/671522549 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec468f5250 con 0x55ec468f1910 2024-09-13T06:30:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52b88fb640 1 --2- 172.21.15.169:0/671522549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468f1910 0x55ec468f3d00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f52a400a4e0 tx=0x7f52a401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff9d07793e40d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52b3fff640 1 -- 172.21.15.169:0/671522549 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a40aa540 con 0x55ec468f1910 2024-09-13T06:30:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52b3fff640 1 -- 172.21.15.169:0/671522549 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a40aa6e0 con 0x55ec468f1910 2024-09-13T06:30:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52b3fff640 1 -- 172.21.15.169:0/671522549 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a40aaa40 con 0x55ec468f1910 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 -- 172.21.15.169:0/671522549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468f1910 msgr2=0x55ec468f3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/671522549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468f1910 0x55ec468f3d00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f52a400a4e0 tx=0x7f52a401b090 comp rx=0 tx=0).stop 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 -- 172.21.15.169:0/671522549 shutdown_connections 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/671522549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468f1910 0x55ec468f3d00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 -- 172.21.15.169:0/671522549 >> 172.21.15.169:0/671522549 conn(0x55ec468e9060 msgr2=0x55ec468eb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 -- 172.21.15.169:0/671522549 shutdown_connections 2024-09-13T06:30:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.759+0000 7f52bb5ec980 1 -- 172.21.15.169:0/671522549 wait complete. 2024-09-13T06:30:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52bb5ec980 1 Processor -- start 2024-09-13T06:30:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52bb5ec980 1 -- start start 2024-09-13T06:30:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52bb5ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec468623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52bb5ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec4679c200 con 0x55ec468ed540 2024-09-13T06:30:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec468623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec468623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38822/0 (socket says 172.21.15.169:38822) 2024-09-13T06:30:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52b90fc640 1 -- 172.21.15.169:0/949878764 learned_addr learned my addr 172.21.15.169:0/949878764 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52b90fc640 1 -- 172.21.15.169:0/949878764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec468629b0 con 0x55ec468ed540 2024-09-13T06:30:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f52b90fc640 1 --2- 172.21.15.169:0/949878764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec468623e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00b240 tx=0x7f52ac00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde82d4c744eb1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f51a7606640 1 -- 172.21.15.169:0/949878764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac00e700 con 0x55ec468ed540 2024-09-13T06:30:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f51a7606640 1 -- 172.21.15.169:0/949878764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac00e8a0 con 0x55ec468ed540 2024-09-13T06:30:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.775+0000 7f51a7606640 1 -- 172.21.15.169:0/949878764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac00eb80 con 0x55ec468ed540 2024-09-13T06:30:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/949878764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 msgr2=0x55ec468623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/949878764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec468623e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00b240 tx=0x7f52ac00b700 comp rx=0 tx=0).stop 2024-09-13T06:30:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/949878764 shutdown_connections 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/949878764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec468623e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/949878764 >> 172.21.15.169:0/949878764 conn(0x55ec468e9060 msgr2=0x55ec469d45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/949878764 shutdown_connections 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/949878764 wait complete. 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 Processor -- start 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- start start 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec469e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec468f4d50 con 0x55ec468ed540 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec469e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec469e0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38824/0 (socket says 172.21.15.169:38824) 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52b90fc640 1 -- 172.21.15.169:0/1590025494 learned_addr learned my addr 172.21.15.169:0/1590025494 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52b90fc640 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec469e1380 con 0x55ec468ed540 2024-09-13T06:30:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52b90fc640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec469e0e40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f52ac000c10 tx=0x7f52ac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f51a5e03640 1 -- 172.21.15.169:0/1590025494 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac00fa90 con 0x55ec468ed540 2024-09-13T06:30:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f51a5e03640 1 -- 172.21.15.169:0/1590025494 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac00fc50 con 0x55ec468ed540 2024-09-13T06:30:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec469e1610 con 0x55ec468ed540 2024-09-13T06:30:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f51a5e03640 1 -- 172.21.15.169:0/1590025494 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac01a480 con 0x55ec468ed540 2024-09-13T06:30:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.779+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec469e42f0 con 0x55ec468ed540 2024-09-13T06:30:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f51a5e03640 1 -- 172.21.15.169:0/1590025494 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52ac017070 con 0x55ec468ed540 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f51a5e03640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f51a00346a0 0x7f51a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f51a5e03640 1 -- 172.21.15.169:0/1590025494 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f52ac015020 con 0x55ec468ed540 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b88fb640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f51a00346a0 0x7f51a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec468f1910 0x55ec469e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec469e8480 con 0x55ec468f1910 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b98fd640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec468f1910 0x55ec469e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b88fb640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f51a00346a0 0x7f51a0036b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ab000 tx=0x7f52a40a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b98fd640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec468f1910 0x55ec469e7f40 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b98fd640 1 -- 172.21.15.169:0/1590025494 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec468f1910 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec469e9280 0x55ec469eb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec469ebca0 con 0x55ec469e9280 2024-09-13T06:30:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b90fc640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec469e9280 0x55ec469eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b90fc640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec469e9280 0x55ec469eb670 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52b90fc640 1 -- 172.21.15.169:0/1590025494 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52ac02e070 con 0x55ec469e9280 2024-09-13T06:30:19.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.783+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec469ed550 con 0x55ec469e9280 2024-09-13T06:30:19.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b90fc640 1 -- 172.21.15.169:0/1590025494 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52ac02e070 con 0x55ec469e9280 2024-09-13T06:30:19.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec469ec780 con 0x55ec469e9280 2024-09-13T06:30:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b90fc640 1 -- 172.21.15.169:0/1590025494 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52ac02e070 con 0x55ec469e9280 2024-09-13T06:30:19.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec469ee900 0x55ec469f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec469f1230 con 0x55ec469ee900 2024-09-13T06:30:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b88fb640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec469ee900 0x55ec469f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b88fb640 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec469ee900 0x55ec469f0cf0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b88fb640 1 -- 172.21.15.169:0/1590025494 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52a40bc040 con 0x55ec469ee900 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 Processor -- start 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 -- start start 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 0x55ec469ff020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52bb5ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec467f5800 con 0x55ec469febe0 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 0x55ec469ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 0x55ec469ff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38826/0 (socket says 172.21.15.169:38826) 2024-09-13T06:30:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b90fc640 1 -- 172.21.15.169:0/388643497 learned_addr learned my addr 172.21.15.169:0/388643497 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.787+0000 7f52b90fc640 1 -- 172.21.15.169:0/388643497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec469ff560 con 0x55ec469febe0 2024-09-13T06:30:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b90fc640 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 0x55ec469ff020 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f52ac01af90 tx=0x7f52ac017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519effd640 1 -- 172.21.15.169:0/388643497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac042150 con 0x55ec469febe0 2024-09-13T06:30:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519effd640 1 -- 172.21.15.169:0/388643497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac0422f0 con 0x55ec469febe0 2024-09-13T06:30:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec46a02190 con 0x55ec469febe0 2024-09-13T06:30:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519effd640 1 -- 172.21.15.169:0/388643497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac01a960 con 0x55ec469febe0 2024-09-13T06:30:19.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec46a02190 con 0x55ec469febe0 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519effd640 1 -- 172.21.15.169:0/388643497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52ac0424f0 con 0x55ec469febe0 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519effd640 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5190034650 0x7f5190036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519effd640 1 -- 172.21.15.169:0/388643497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f52ac03e040 con 0x55ec469febe0 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b88fb640 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5190034650 0x7f5190036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52bb5ec980 1 Processor -- start 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52bb5ec980 1 -- start start 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52bb5ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec469d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b88fb640 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5190034650 0x7f5190036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55ec469e5430 tx=0x7f52a4005e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52bb5ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec46862d30 con 0x55ec469d9aa0 2024-09-13T06:30:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec469d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec469d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38830/0 (socket says 172.21.15.169:38830) 2024-09-13T06:30:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b90fc640 1 -- 172.21.15.169:0/2081430346 learned_addr learned my addr 172.21.15.169:0/2081430346 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b90fc640 1 -- 172.21.15.169:0/2081430346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec469da470 con 0x55ec469d9aa0 2024-09-13T06:30:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f52b90fc640 1 --2- 172.21.15.169:0/2081430346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec469d9ea0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f52ac01b6e0 tx=0x7f52ac041cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2733eec2e864c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519cff9640 1 -- 172.21.15.169:0/2081430346 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac057030 con 0x55ec469d9aa0 2024-09-13T06:30:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519cff9640 1 -- 172.21.15.169:0/2081430346 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac035d70 con 0x55ec469d9aa0 2024-09-13T06:30:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.791+0000 7f519cff9640 1 -- 172.21.15.169:0/2081430346 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac04a3d0 con 0x55ec469d9aa0 2024-09-13T06:30:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/2081430346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 msgr2=0x55ec469d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/2081430346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec469d9ea0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f52ac01b6e0 tx=0x7f52ac041cb0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/2081430346 shutdown_connections 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/2081430346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec469d9ea0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/2081430346 >> 172.21.15.169:0/2081430346 conn(0x55ec46a077b0 msgr2=0x55ec46a058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/2081430346 shutdown_connections 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/2081430346 wait complete. 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 Processor -- start 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- start start 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec46a14790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec469d8690 con 0x55ec469d9aa0 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec46a14790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52b90fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec46a14790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38838/0 (socket says 172.21.15.169:38838) 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 learned_addr learned my addr 172.21.15.169:0/3100614016 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec46a14cd0 con 0x55ec469d9aa0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52b90fc640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec46a14790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0527c0 tx=0x7f52ac033f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f518effd640 1 -- 172.21.15.169:0/3100614016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac06f070 con 0x55ec469d9aa0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f518effd640 1 -- 172.21.15.169:0/3100614016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac0417a0 con 0x55ec469d9aa0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec46a14cd0 con 0x55ec469d9aa0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f518effd640 1 -- 172.21.15.169:0/3100614016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac041a80 con 0x55ec469d9aa0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec46a14cd0 con 0x55ec469d9aa0 2024-09-13T06:30:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.795+0000 7f518effd640 1 -- 172.21.15.169:0/3100614016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52ac072070 con 0x55ec469d9aa0 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f518effd640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5184034600 0x7f5184036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f518effd640 1 -- 172.21.15.169:0/3100614016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f52ac05b070 con 0x55ec469d9aa0 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b88fb640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5184034600 0x7f5184036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec46a1f7a0 0x55ec46a21c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a22390 con 0x55ec46a1f7a0 2024-09-13T06:30:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b98fd640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec46a1f7a0 0x55ec46a21c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b88fb640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5184034600 0x7f5184036ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f52a400a190 tx=0x7f52a40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b98fd640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec46a1f7a0 0x55ec46a21c40 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 realm 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a1ec90 con 0x55ec46a1f7a0 2024-09-13T06:30:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a22e20 con 0x55ec46a1f7a0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec46a23c00 0x55ec46a25ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a26620 con 0x55ec46a23c00 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b90fc640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec46a23c00 0x55ec46a25ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b90fc640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec46a23c00 0x55ec46a25ff0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52ac071030 con 0x55ec46a23c00 2024-09-13T06:30:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.799+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a26ec0 con 0x55ec46a23c00 2024-09-13T06:30:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52ac071030 con 0x55ec46a23c00 2024-09-13T06:30:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52bb5ec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52bb5ec980 20 searching for the correct realm 2024-09-13T06:30:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec46a28c30 0x55ec46a2b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b88fb640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec46a28c30 0x55ec46a2b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b88fb640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec46a28c30 0x55ec46a2b020 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52ac071030 con 0x55ec46a23c00 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b90fc640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f52ac074060 0x7f52ac0058f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x7f52ac074060 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f52ac074060 0x7f52ac0058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f52ac074060 0x7f52ac0058f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.803+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac071030 con 0x55ec46a23c00 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac071030 con 0x55ec46a23c00 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x7f52ac074060 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x7f52ac074060 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.807+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x7f52ac074060 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x7f52ac074060 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x7f52ac074060 2024-09-13T06:30:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.811+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a28c30 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2b6a0 con 0x55ec46a23c00 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a27840 con 0x55ec46a1f7a0 2024-09-13T06:30:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a27cc0 con 0x55ec46a23c00 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.815+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a280e0 con 0x55ec46a28c30 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 zone default found 2024-09-13T06:30:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 4 Realm: () 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 zonegroup default 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2bb00 con 0x7f52ac074060 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2dd30 con 0x55ec46a28c30 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados->read ofs=0 len=0 2024-09-13T06:30:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2e0d0 con 0x55ec46a28c30 2024-09-13T06:30:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 started sync module instance, tier type = 2024-09-13T06:30:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2d170 con 0x55ec46a23c00 2024-09-13T06:30:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94473285719392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2d170 con 0x55ec46a23c00 2024-09-13T06:30:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.819+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2e920 con 0x55ec46a1f7a0 2024-09-13T06:30:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94473285723248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2f1c0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2fbe0 con 0x55ec46a23c00 2024-09-13T06:30:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94473285719392] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94473285723248] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94473285727952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2ed10 con 0x55ec46a23c00 2024-09-13T06:30:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.823+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a30480 con 0x7f52ac074060 2024-09-13T06:30:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94473285730256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2ed10 con 0x7f52ac074060 2024-09-13T06:30:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a30f40 con 0x55ec46a23c00 2024-09-13T06:30:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94473285727952] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94473285730256] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94473285731312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a30f00 con 0x55ec46a23c00 2024-09-13T06:30:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a31330 con 0x55ec46a28c30 2024-09-13T06:30:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94473285717184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a31bd0 con 0x55ec46a28c30 2024-09-13T06:30:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.827+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a32590 con 0x55ec46a28c30 2024-09-13T06:30:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94473285731312] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94473285717184] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94473285738720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a329b0 con 0x55ec46a28c30 2024-09-13T06:30:19.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a33200 con 0x7f52ac074060 2024-09-13T06:30:19.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94473285738720] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94473285740976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a335f0 con 0x7f52ac074060 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=0 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=1 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=2 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=3 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=4 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=5 2024-09-13T06:30:19.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.831+0000 7f52bb5ec980 20 add_watcher() i=6 2024-09-13T06:30:19.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94473285740976] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 20 add_watcher() i=7 2024-09-13T06:30:19.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:19.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a36620 con 0x55ec46a1f7a0 2024-09-13T06:30:19.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94473285742576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a33b00 con 0x55ec46a1f7a0 2024-09-13T06:30:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94473285742576] v33'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f516f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 5 note: GC not initialized 2024-09-13T06:30:19.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f516e7e4640 20 reqs_thread_entry: start 2024-09-13T06:30:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 20 Filter name: none 2024-09-13T06:30:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f50dffff640 20 reqs_thread_entry: start 2024-09-13T06:30:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.835+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a280 con 0x55ec46a23c00 2024-09-13T06:30:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a280 con 0x55ec46a23c00 2024-09-13T06:30:19.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a23c00 2024-09-13T06:30:19.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a28c30 2024-09-13T06:30:19.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a23c00 2024-09-13T06:30:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a28c30 2024-09-13T06:30:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a1f7a0 2024-09-13T06:30:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a1f7a0 2024-09-13T06:30:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.839+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a28c30 2024-09-13T06:30:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a28c30 2024-09-13T06:30:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5a240 con 0x55ec46a28c30 2024-09-13T06:30:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a1f7a0 2024-09-13T06:30:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x7f52ac074060 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a28c30 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x7f52ac074060 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a1f7a0 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a28c30 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a1f7a0 2024-09-13T06:30:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.843+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a28c30 2024-09-13T06:30:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a28c30 2024-09-13T06:30:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a1f7a0 2024-09-13T06:30:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.847+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a1f7a0 2024-09-13T06:30:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a28c30 2024-09-13T06:30:19.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a28c30 2024-09-13T06:30:19.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a23c00 2024-09-13T06:30:19.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a5bf10 con 0x55ec46a1f7a0 2024-09-13T06:30:19.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f516f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:19.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.851+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94473285742576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a57e90 con 0x55ec46a1f7a0 2024-09-13T06:30:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.855+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94473285742576] v33'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.855+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94473285719392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a32ff0 con 0x55ec46a23c00 2024-09-13T06:30:19.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94473285719392] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 20 remove_watcher() i=0 2024-09-13T06:30:19.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 2 removed watcher, disabling cache 2024-09-13T06:30:19.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94473285723248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a32ff0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94473285723248] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x55ec46a1f7a0 2024-09-13T06:30:19.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 20 remove_watcher() i=1 2024-09-13T06:30:19.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94473285727952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a32ff0 con 0x55ec46a23c00 2024-09-13T06:30:19.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94473285727952] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 20 remove_watcher() i=2 2024-09-13T06:30:19.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.859+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94473285730256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2f6d0 con 0x7f52ac074060 2024-09-13T06:30:19.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.863+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94473285730256] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.863+0000 7f52bb5ec980 20 remove_watcher() i=3 2024-09-13T06:30:19.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.863+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94473285731312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a32ff0 con 0x55ec46a23c00 2024-09-13T06:30:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.863+0000 7f52b90fc640 1 -- 172.21.15.169:0/3100614016 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94473285731312] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac088040 con 0x55ec46a23c00 2024-09-13T06:30:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.863+0000 7f52bb5ec980 20 remove_watcher() i=4 2024-09-13T06:30:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.863+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94473285717184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2f6d0 con 0x55ec46a28c30 2024-09-13T06:30:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94473285717184] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 20 remove_watcher() i=5 2024-09-13T06:30:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94473285738720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a32ff0 con 0x55ec46a28c30 2024-09-13T06:30:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52b88fb640 1 -- 172.21.15.169:0/3100614016 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94473285738720] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a40ca070 con 0x55ec46a28c30 2024-09-13T06:30:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 20 remove_watcher() i=6 2024-09-13T06:30:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94473285740976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ec46a2f6d0 con 0x7f52ac074060 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94473285740976] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b40083f0 con 0x7f52ac074060 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 20 remove_watcher() i=7 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec46a23c00 msgr2=0x55ec46a25ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec46a23c00 0x55ec46a25ff0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec46a1f7a0 msgr2=0x55ec46a21c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec46a1f7a0 0x55ec46a21c40 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f52ac074060 msgr2=0x7f52ac0058f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f52ac074060 0x7f52ac0058f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec46a28c30 msgr2=0x55ec46a2b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec46a28c30 0x55ec46a2b020 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5184034600 msgr2=0x7f5184036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5184034600 0x7f5184036ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f52a400a190 tx=0x7f52a40a6000 comp rx=0 tx=0).stop 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 msgr2=0x55ec46a14790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52b98fd640 1 -- 172.21.15.169:0/3100614016 reap_dead start 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec46a14790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0527c0 tx=0x7f52ac033f80 comp rx=0 tx=0).stop 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 shutdown_connections 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/3100614016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469d9aa0 0x55ec46a14790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 >> 172.21.15.169:0/3100614016 conn(0x55ec46a077b0 msgr2=0x55ec46a05880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 shutdown_connections 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/3100614016 wait complete. 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5190034650 msgr2=0x7f5190036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5190034650 0x7f5190036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55ec469e5430 tx=0x7f52a4005e50 comp rx=0 tx=0).stop 2024-09-13T06:30:19.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 msgr2=0x55ec469ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 0x55ec469ff020 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f52ac01af90 tx=0x7f52ac017f50 comp rx=0 tx=0).stop 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 shutdown_connections 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5190034650 0x7f5190036b10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/388643497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec469febe0 0x55ec469ff020 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 >> 172.21.15.169:0/388643497 conn(0x55ec469f3ce0 msgr2=0x55ec469f67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 shutdown_connections 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.867+0000 7f52bb5ec980 1 -- 172.21.15.169:0/388643497 wait complete. 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec469e9280 msgr2=0x55ec469eb670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55ec469e9280 0x55ec469eb670 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec468f1910 msgr2=0x55ec469e7f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55ec468f1910 0x55ec469e7f40 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec469ee900 msgr2=0x55ec469f0cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55ec469ee900 0x55ec469f0cf0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f51a00346a0 msgr2=0x7f51a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f51a00346a0 0x7f51a0036b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ab000 tx=0x7f52a40a5000 comp rx=0 tx=0).stop 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 msgr2=0x55ec469e0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 --2- 172.21.15.169:0/1590025494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec468ed540 0x55ec469e0e40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f52ac000c10 tx=0x7f52ac000ee0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52b98fd640 1 -- 172.21.15.169:0/1590025494 reap_dead start 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 shutdown_connections 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 >> 172.21.15.169:0/1590025494 conn(0x55ec468e9060 msgr2=0x55ec469d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 shutdown_connections 2024-09-13T06:30:19.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.871+0000 7f52bb5ec980 1 -- 172.21.15.169:0/1590025494 wait complete. 2024-09-13T06:30:19.882 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T06:30:19.883 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T06:30:19.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T06:30:19.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T06:30:19.883 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T06:30:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.955+0000 7f74e17c0980 1 Processor -- start 2024-09-13T06:30:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.955+0000 7f74e17c0980 1 -- start start 2024-09-13T06:30:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.955+0000 7f74e17c0980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5633fd0a4de0 0x5633fd0a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.955+0000 7f74e17c0980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633fcf2aae0 con 0x5633fd0a7740 2024-09-13T06:30:19.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.955+0000 7f74e17c0980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5633fcf4ee30 con 0x5633fd0a4de0 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74df2d0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5633fd0a4de0 0x5633fd0a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74deacf640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5633fd0a7740 0x5633fd0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57452/0 (socket says 172.21.15.169:57452) 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74deacf640 1 -- 172.21.15.169:0/1319579120 learned_addr learned my addr 172.21.15.169:0/1319579120 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74de2ce640 1 -- 172.21.15.169:0/1319579120 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824783195 0 0) 0x5633fcf2aae0 con 0x5633fd0a7740 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74de2ce640 1 -- 172.21.15.169:0/1319579120 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74cc001e20 con 0x5633fd0a7740 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74df2d0640 1 -- 172.21.15.169:0/1319579120 >> v1:172.21.15.112:6789/0 conn(0x5633fd0a7740 legacy=0x5633fd0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74df2d0640 1 -- 172.21.15.169:0/1319579120 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fd0ac3e0 con 0x5633fd0a4de0 2024-09-13T06:30:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74df2d0640 1 --2- 172.21.15.169:0/1319579120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd0a71d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74d000a420 tx=0x7f74d001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfea265dcb540338 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74de2ce640 1 -- 172.21.15.169:0/1319579120 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00af070 con 0x5633fd0a4de0 2024-09-13T06:30:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74de2ce640 1 -- 172.21.15.169:0/1319579120 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00aa530 con 0x5633fd0a4de0 2024-09-13T06:30:19.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.959+0000 7f74de2ce640 1 -- 172.21.15.169:0/1319579120 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00aa850 con 0x5633fd0a4de0 2024-09-13T06:30:19.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 -- 172.21.15.169:0/1319579120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 msgr2=0x5633fd0a71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1319579120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd0a71d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74d000a420 tx=0x7f74d001afd0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 -- 172.21.15.169:0/1319579120 shutdown_connections 2024-09-13T06:30:19.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1319579120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd0a71d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 -- 172.21.15.169:0/1319579120 >> 172.21.15.169:0/1319579120 conn(0x5633fd018270 msgr2=0x5633fd018680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 -- 172.21.15.169:0/1319579120 shutdown_connections 2024-09-13T06:30:19.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.963+0000 7f74e17c0980 1 -- 172.21.15.169:0/1319579120 wait complete. 2024-09-13T06:30:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 Processor -- start 2024-09-13T06:30:19.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- start start 2024-09-13T06:30:19.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd18fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5633fcf50200 con 0x5633fd0a4de0 2024-09-13T06:30:19.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd18fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd18fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38848/0 (socket says 172.21.15.169:38848) 2024-09-13T06:30:19.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 -- 172.21.15.169:0/1756168913 learned_addr learned my addr 172.21.15.169:0/1756168913 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 -- 172.21.15.169:0/1756168913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fd190060 con 0x5633fd0a4de0 2024-09-13T06:30:19.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 --2- 172.21.15.169:0/1756168913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd18fa90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74d0017be0 tx=0x7f74d00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beeeff157dc5bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f73cd60a640 1 -- 172.21.15.169:0/1756168913 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00af050 con 0x5633fd0a4de0 2024-09-13T06:30:19.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f73cd60a640 1 -- 172.21.15.169:0/1756168913 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00b0040 con 0x5633fd0a4de0 2024-09-13T06:30:19.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f73cd60a640 1 -- 172.21.15.169:0/1756168913 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00aaaf0 con 0x5633fd0a4de0 2024-09-13T06:30:19.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- 172.21.15.169:0/1756168913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 msgr2=0x5633fd18fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1756168913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd18fa90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74d0017be0 tx=0x7f74d00033b0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- 172.21.15.169:0/1756168913 shutdown_connections 2024-09-13T06:30:19.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1756168913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd18fa90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- 172.21.15.169:0/1756168913 >> 172.21.15.169:0/1756168913 conn(0x5633fd018270 msgr2=0x5633fd18b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- 172.21.15.169:0/1756168913 shutdown_connections 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- 172.21.15.169:0/1756168913 wait complete. 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 Processor -- start 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- start start 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74e17c0980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5633fd0abe20 con 0x5633fd0a4de0 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.979+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38860/0 (socket says 172.21.15.169:38860) 2024-09-13T06:30:19.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74df2d0640 1 -- 172.21.15.169:0/4695361 learned_addr learned my addr 172.21.15.169:0/4695361 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74df2d0640 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fd197100 con 0x5633fd0a4de0 2024-09-13T06:30:19.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74df2d0640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd196bc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f74d001b870 tx=0x7f74d0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f73cbe07640 1 -- 172.21.15.169:0/4695361 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00b6bf0 con 0x5633fd0a4de0 2024-09-13T06:30:19.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f73cbe07640 1 -- 172.21.15.169:0/4695361 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00b6d90 con 0x5633fd0a4de0 2024-09-13T06:30:19.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633fd197390 con 0x5633fd0a4de0 2024-09-13T06:30:19.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f73cbe07640 1 -- 172.21.15.169:0/4695361 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00bf530 con 0x5633fd0a4de0 2024-09-13T06:30:19.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633fd19a070 con 0x5633fd0a4de0 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f73cbe07640 1 -- 172.21.15.169:0/4695361 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74d00bf6d0 con 0x5633fd0a4de0 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f73cbe07640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73c40346a0 0x7f73c4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f73cbe07640 1 -- 172.21.15.169:0/4695361 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f74d00bb070 con 0x5633fd0a4de0 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74deacf640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73c40346a0 0x7f73c4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd0a7740 0x5633fd19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd19e1c0 con 0x5633fd0a7740 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74dfad1640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd0a7740 0x5633fd19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74deacf640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73c40346a0 0x7f73c4036b60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000f70 tx=0x7f74c80010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74dfad1640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd0a7740 0x5633fd19db50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74dfad1640 1 -- 172.21.15.169:0/4695361 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd0a7740 2024-09-13T06:30:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd19efb0 0x5633fd1a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.983+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1a19d0 con 0x5633fd19efb0 2024-09-13T06:30:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74df2d0640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd19efb0 0x5633fd1a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74df2d0640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd19efb0 0x5633fd1a13a0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74df2d0640 1 -- 172.21.15.169:0/4695361 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74d00b2070 con 0x5633fd19efb0 2024-09-13T06:30:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1a3280 con 0x5633fd19efb0 2024-09-13T06:30:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74df2d0640 1 -- 172.21.15.169:0/4695361 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f74d00b2070 con 0x5633fd19efb0 2024-09-13T06:30:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1a23f0 con 0x5633fd19efb0 2024-09-13T06:30:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74df2d0640 1 -- 172.21.15.169:0/4695361 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74d00b2070 con 0x5633fd19efb0 2024-09-13T06:30:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1a4630 0x5633fd1a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1a6f60 con 0x5633fd1a4630 2024-09-13T06:30:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74deacf640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1a4630 0x5633fd1a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.987+0000 7f74deacf640 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1a4630 0x5633fd1a6a20 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74deacf640 1 -- 172.21.15.169:0/4695361 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1a4630 2024-09-13T06:30:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74e17c0980 1 Processor -- start 2024-09-13T06:30:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74e17c0980 1 -- start start 2024-09-13T06:30:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74e17c0980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 0x5633fd1b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74e17c0980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5633fcfa9800 con 0x5633fd1b4950 2024-09-13T06:30:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 0x5633fd1b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 0x5633fd1b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38868/0 (socket says 172.21.15.169:38868) 2024-09-13T06:30:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74df2d0640 1 -- 172.21.15.169:0/4210741050 learned_addr learned my addr 172.21.15.169:0/4210741050 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74df2d0640 1 -- 172.21.15.169:0/4210741050 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fd1b52b0 con 0x5633fd1b4950 2024-09-13T06:30:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74df2d0640 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 0x5633fd1b4d70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f74d00e4010 tx=0x7f74d00b4630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f73c9602640 1 -- 172.21.15.169:0/4210741050 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00c9c40 con 0x5633fd1b4950 2024-09-13T06:30:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f73c9602640 1 -- 172.21.15.169:0/4210741050 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00c9de0 con 0x5633fd1b4950 2024-09-13T06:30:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633fd1b5540 con 0x5633fd1b4950 2024-09-13T06:30:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f73c9602640 1 -- 172.21.15.169:0/4210741050 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00bfbf0 con 0x5633fd1b4950 2024-09-13T06:30:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.991+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633fd1b5540 con 0x5633fd1b4950 2024-09-13T06:30:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f73c9602640 1 -- 172.21.15.169:0/4210741050 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74d00be6e0 con 0x5633fd1b4950 2024-09-13T06:30:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f73c9602640 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73b80346a0 0x7f73b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f73c9602640 1 -- 172.21.15.169:0/4210741050 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f74d00d7ae0 con 0x5633fd1b4950 2024-09-13T06:30:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74deacf640 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73b80346a0 0x7f73b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 Processor -- start 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- start start 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74deacf640 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73b80346a0 0x7f73b8036b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5633fd19b1b0 tx=0x7f74c800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5633fd190320 con 0x5633fd1c10a0 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38874/0 (socket says 172.21.15.169:38874) 2024-09-13T06:30:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74df2d0640 1 -- 172.21.15.169:0/973763524 learned_addr learned my addr 172.21.15.169:0/973763524 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74df2d0640 1 -- 172.21.15.169:0/973763524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fd1c1a50 con 0x5633fd1c10a0 2024-09-13T06:30:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74df2d0640 1 --2- 172.21.15.169:0/973763524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c1480 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f74d00c76f0 tx=0x7f74d00d8d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f6823b53e9930c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f73c2ffd640 1 -- 172.21.15.169:0/973763524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00d7e00 con 0x5633fd1c10a0 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f73c2ffd640 1 -- 172.21.15.169:0/973763524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00e4d30 con 0x5633fd1c10a0 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f73c2ffd640 1 -- 172.21.15.169:0/973763524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00e12d0 con 0x5633fd1c10a0 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- 172.21.15.169:0/973763524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 msgr2=0x5633fd1c1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 --2- 172.21.15.169:0/973763524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c1480 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f74d00c76f0 tx=0x7f74d00d8d90 comp rx=0 tx=0).stop 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- 172.21.15.169:0/973763524 shutdown_connections 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 --2- 172.21.15.169:0/973763524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c1480 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- 172.21.15.169:0/973763524 >> 172.21.15.169:0/973763524 conn(0x5633fd1bd480 msgr2=0x5633fd1bb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- 172.21.15.169:0/973763524 shutdown_connections 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- 172.21.15.169:0/973763524 wait complete. 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 Processor -- start 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- start start 2024-09-13T06:30:19.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74e17c0980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5633fd1c1ef0 con 0x5633fd1c10a0 2024-09-13T06:30:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.995+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74df2d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38884/0 (socket says 172.21.15.169:38884) 2024-09-13T06:30:20.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 learned_addr learned my addr 172.21.15.169:0/1584279765 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fd1c8740 con 0x5633fd1c10a0 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74df2d0640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c8200 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f74d00e6fd0 tx=0x7f74d00d77b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f73c17fa640 1 -- 172.21.15.169:0/1584279765 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d010b070 con 0x5633fd1c10a0 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f73c17fa640 1 -- 172.21.15.169:0/1584279765 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00e4b10 con 0x5633fd1c10a0 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633fd1c8740 con 0x5633fd1c10a0 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f73c17fa640 1 -- 172.21.15.169:0/1584279765 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d00d8630 con 0x5633fd1c10a0 2024-09-13T06:30:20.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633fd1c8740 con 0x5633fd1c10a0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f73c17fa640 1 -- 172.21.15.169:0/1584279765 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74d0116060 con 0x5633fd1c10a0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f73c17fa640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73a8034600 0x7f73a8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f73c17fa640 1 -- 172.21.15.169:0/1584279765 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f74d0101020 con 0x5633fd1c10a0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74deacf640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73a8034600 0x7f73a8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd1d3340 0x5633fd1d5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1d5f50 con 0x5633fd1d3340 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74dfad1640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd1d3340 0x5633fd1d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74deacf640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73a8034600 0x7f73a8036ac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c010 tx=0x7f74c8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:19.999+0000 7f74dfad1640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd1d3340 0x5633fd1d5800 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 realm 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1d2830 con 0x5633fd1d3340 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1d6a20 con 0x5633fd1d3340 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd1d7600 0x5633fd1d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1da230 con 0x5633fd1d7600 2024-09-13T06:30:20.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd1d7600 0x5633fd1d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd1d7600 0x5633fd1d9ac0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1daad0 con 0x5633fd1d7600 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 20 searching for the correct realm 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1dc840 0x5633fd1dec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74deacf640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1dc840 0x5633fd1dec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74deacf640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1dc840 0x5633fd1dec30 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f74d0118070 0x7f74d00e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.003+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x7f74d0118070 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f74d0118070 0x7f74d00e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f74d0118070 0x7f74d00e7380 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x7f74d0118070 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x7f74d0118070 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.007+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x7f74d0118070 2024-09-13T06:30:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.011+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d3340 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x7f74d0118070 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x7f74d0118070 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1dc840 2024-09-13T06:30:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df240 con 0x5633fd1d7600 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1db480 con 0x5633fd1d3340 2024-09-13T06:30:20.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.015+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1db900 con 0x5633fd1d7600 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1dbd60 con 0x5633fd1dc840 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 zone default found 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 4 Realm: () 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:20.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 zonegroup default 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1dfb50 con 0x7f74d0118070 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1df790 con 0x5633fd1dc840 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e1eb0 con 0x5633fd1dc840 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 started sync module instance, tier type = 2024-09-13T06:30:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.019+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e1210 con 0x5633fd1d7600 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94781289928496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e1210 con 0x5633fd1d7600 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e29e0 con 0x5633fd1d3340 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94781289931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e3280 con 0x5633fd1d3340 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e3cc0 con 0x5633fd1d7600 2024-09-13T06:30:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94781289928496] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94781289931952] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94781289936784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e2dd0 con 0x5633fd1d7600 2024-09-13T06:30:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.023+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e4560 con 0x7f74d0118070 2024-09-13T06:30:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94781289939120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e2dd0 con 0x7f74d0118070 2024-09-13T06:30:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e5030 con 0x5633fd1d7600 2024-09-13T06:30:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94781289936784] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94781289939120] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94781289940176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e4ff0 con 0x5633fd1d7600 2024-09-13T06:30:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.027+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e5420 con 0x5633fd1dc840 2024-09-13T06:30:20.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94781289925984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e5cc0 con 0x5633fd1dc840 2024-09-13T06:30:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e66c0 con 0x5633fd1dc840 2024-09-13T06:30:20.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94781289940176] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94781289925984] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94781289945104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e61d0 con 0x5633fd1dc840 2024-09-13T06:30:20.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e70d0 con 0x7f74d0118070 2024-09-13T06:30:20.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94781289945104] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.031+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94781289941792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e70d0 con 0x7f74d0118070 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=0 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=1 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=2 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=3 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=4 2024-09-13T06:30:20.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=5 2024-09-13T06:30:20.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=6 2024-09-13T06:30:20.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94781289941792] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 20 add_watcher() i=7 2024-09-13T06:30:20.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:20.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1ea360 con 0x5633fd1d3340 2024-09-13T06:30:20.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94781289950608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e7660 con 0x5633fd1d3340 2024-09-13T06:30:20.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94781289950608] v33'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.035+0000 7f7395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:20.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:20.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 5 note: GC not initialized 2024-09-13T06:30:20.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f7394fe1640 20 reqs_thread_entry: start 2024-09-13T06:30:20.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:20.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 20 Filter name: none 2024-09-13T06:30:20.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f730e7fc640 20 reqs_thread_entry: start 2024-09-13T06:30:20.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfe0 con 0x5633fd1d7600 2024-09-13T06:30:20.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfe0 con 0x5633fd1d7600 2024-09-13T06:30:20.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1d7600 2024-09-13T06:30:20.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1dc840 2024-09-13T06:30:20.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.039+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1d7600 2024-09-13T06:30:20.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1dc840 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1d3340 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1d3340 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1dc840 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1dc840 2024-09-13T06:30:20.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20dfa0 con 0x5633fd1dc840 2024-09-13T06:30:20.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f9e0 con 0x5633fd1d3340 2024-09-13T06:30:20.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f9e0 con 0x7f74d0118070 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f990 con 0x5633fd1dc840 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f990 con 0x7f74d0118070 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f990 con 0x5633fd1d3340 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f990 con 0x5633fd1dc840 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f990 con 0x5633fd1d3340 2024-09-13T06:30:20.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.043+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f990 con 0x5633fd1d7600 2024-09-13T06:30:20.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d7600 2024-09-13T06:30:20.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1dc840 2024-09-13T06:30:20.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d7600 2024-09-13T06:30:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1dc840 2024-09-13T06:30:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d3340 2024-09-13T06:30:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d7600 2024-09-13T06:30:20.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.047+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d7600 2024-09-13T06:30:20.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d7600 2024-09-13T06:30:20.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d3340 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1dc840 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1dc840 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d7600 2024-09-13T06:30:20.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20f940 con 0x5633fd1d3340 2024-09-13T06:30:20.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.051+0000 7f7395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.055+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94781289950608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20bdd0 con 0x5633fd1d3340 2024-09-13T06:30:20.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.055+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94781289950608] v33'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.055+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94781289928496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20b460 con 0x5633fd1d7600 2024-09-13T06:30:20.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94781289928496] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 20 remove_watcher() i=0 2024-09-13T06:30:20.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 2 removed watcher, disabling cache 2024-09-13T06:30:20.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94781289931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20b460 con 0x5633fd1d3340 2024-09-13T06:30:20.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94781289931952] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x5633fd1d3340 2024-09-13T06:30:20.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 20 remove_watcher() i=1 2024-09-13T06:30:20.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94781289936784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20b460 con 0x5633fd1d7600 2024-09-13T06:30:20.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94781289936784] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 20 remove_watcher() i=2 2024-09-13T06:30:20.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.059+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94781289939120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20b460 con 0x7f74d0118070 2024-09-13T06:30:20.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.063+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94781289939120] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.063+0000 7f74e17c0980 20 remove_watcher() i=3 2024-09-13T06:30:20.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.063+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94781289940176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd20b460 con 0x5633fd1d7600 2024-09-13T06:30:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.063+0000 7f74df2d0640 1 -- 172.21.15.169:0/1584279765 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94781289940176] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d00ea020 con 0x5633fd1d7600 2024-09-13T06:30:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.063+0000 7f74e17c0980 20 remove_watcher() i=4 2024-09-13T06:30:20.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.063+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94781289925984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e4530 con 0x5633fd1dc840 2024-09-13T06:30:20.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94781289925984] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 20 remove_watcher() i=5 2024-09-13T06:30:20.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94781289945104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e4530 con 0x5633fd1dc840 2024-09-13T06:30:20.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74deacf640 1 -- 172.21.15.169:0/1584279765 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94781289945104] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x5633fd1dc840 2024-09-13T06:30:20.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 20 remove_watcher() i=6 2024-09-13T06:30:20.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94781289941792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633fd1e4510 con 0x7f74d0118070 2024-09-13T06:30:20.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94781289941792] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d80083f0 con 0x7f74d0118070 2024-09-13T06:30:20.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 20 remove_watcher() i=7 2024-09-13T06:30:20.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd1d7600 msgr2=0x5633fd1d9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd1d7600 0x5633fd1d9ac0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd1d3340 msgr2=0x5633fd1d5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd1d3340 0x5633fd1d5800 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f74d0118070 msgr2=0x7f74d00e7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f74d0118070 0x7f74d00e7380 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1dc840 msgr2=0x5633fd1dec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1dc840 0x5633fd1dec30 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73a8034600 msgr2=0x7f73a8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73a8034600 0x7f73a8036ac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c010 tx=0x7f74c8010000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74dfad1640 1 -- 172.21.15.169:0/1584279765 reap_dead start 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 msgr2=0x5633fd1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c8200 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f74d00e6fd0 tx=0x7f74d00d77b0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 shutdown_connections 2024-09-13T06:30:20.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 --2- 172.21.15.169:0/1584279765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1c10a0 0x5633fd1c8200 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 >> 172.21.15.169:0/1584279765 conn(0x5633fd1bd480 msgr2=0x5633fd1bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 shutdown_connections 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.067+0000 7f74e17c0980 1 -- 172.21.15.169:0/1584279765 wait complete. 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73b80346a0 msgr2=0x7f73b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73b80346a0 0x7f73b8036b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5633fd19b1b0 tx=0x7f74c800f000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 msgr2=0x5633fd1b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 0x5633fd1b4d70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f74d00e4010 tx=0x7f74d00b4630 comp rx=0 tx=0).stop 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 shutdown_connections 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73b80346a0 0x7f73b8036b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4210741050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd1b4950 0x5633fd1b4d70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 >> 172.21.15.169:0/4210741050 conn(0x5633fd1a9aa0 msgr2=0x5633fd1ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 shutdown_connections 2024-09-13T06:30:20.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4210741050 wait complete. 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd19efb0 msgr2=0x5633fd1a13a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5633fd19efb0 0x5633fd1a13a0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd0a7740 msgr2=0x5633fd19db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5633fd0a7740 0x5633fd19db50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1a4630 msgr2=0x5633fd1a6a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5633fd1a4630 0x5633fd1a6a20 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73c40346a0 msgr2=0x7f73c4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f73c40346a0 0x7f73c4036b60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000f70 tx=0x7f74c80010b0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 msgr2=0x5633fd196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 --2- 172.21.15.169:0/4695361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5633fd0a4de0 0x5633fd196bc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f74d001b870 tx=0x7f74d0019810 comp rx=0 tx=0).stop 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74dfad1640 1 -- 172.21.15.169:0/4695361 reap_dead start 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 shutdown_connections 2024-09-13T06:30:20.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 >> 172.21.15.169:0/4695361 conn(0x5633fd018270 msgr2=0x5633fd18a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 shutdown_connections 2024-09-13T06:30:20.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.071+0000 7f74e17c0980 1 -- 172.21.15.169:0/4695361 wait complete. 2024-09-13T06:30:20.082 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T06:30:20.082 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T06:30:20.083 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T06:30:20.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T06:30:20.083 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T06:30:20.159 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:20.159 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa6227980 1 Processor -- start 2024-09-13T06:30:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa6227980 1 -- start start 2024-09-13T06:30:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa6227980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5642d23eea90 0x5642d23f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa6227980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5642d2272ae0 con 0x5642d235eac0 2024-09-13T06:30:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa6227980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5642d2296e30 con 0x5642d23eea90 2024-09-13T06:30:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa3536640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5642d23eea90 0x5642d23f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa3536640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5642d23eea90 0x5642d23f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38896/0 (socket says 172.21.15.169:38896) 2024-09-13T06:30:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa3536640 1 -- 172.21.15.169:0/3625081295 learned_addr learned my addr 172.21.15.169:0/3625081295 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa3d37640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5642d235eac0 0x5642d23ed370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57462/0 (socket says 172.21.15.169:57462) 2024-09-13T06:30:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa3536640 1 -- 172.21.15.169:0/3625081295 >> v1:172.21.15.112:6789/0 conn(0x5642d235eac0 legacy=0x5642d23ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.159+0000 7f5aa3536640 1 -- 172.21.15.169:0/3625081295 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d23f23d0 con 0x5642d23eea90 2024-09-13T06:30:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa3536640 1 --2- 172.21.15.169:0/3625081295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d23f0e80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800a5c0 tx=0x7f5a9801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b90b5d8e517bce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa2d35640 1 -- 172.21.15.169:0/3625081295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a980a6070 con 0x5642d23eea90 2024-09-13T06:30:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa2d35640 1 -- 172.21.15.169:0/3625081295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a980af070 con 0x5642d23eea90 2024-09-13T06:30:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa2d35640 1 -- 172.21.15.169:0/3625081295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a980aa5c0 con 0x5642d23eea90 2024-09-13T06:30:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 -- 172.21.15.169:0/3625081295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 msgr2=0x5642d23f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 --2- 172.21.15.169:0/3625081295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d23f0e80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800a5c0 tx=0x7f5a9801b340 comp rx=0 tx=0).stop 2024-09-13T06:30:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 -- 172.21.15.169:0/3625081295 shutdown_connections 2024-09-13T06:30:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 --2- 172.21.15.169:0/3625081295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d23f0e80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 -- 172.21.15.169:0/3625081295 >> 172.21.15.169:0/3625081295 conn(0x5642d23e5060 msgr2=0x5642d23e7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 -- 172.21.15.169:0/3625081295 shutdown_connections 2024-09-13T06:30:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.163+0000 7f5aa6227980 1 -- 172.21.15.169:0/3625081295 wait complete. 2024-09-13T06:30:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa6227980 1 Processor -- start 2024-09-13T06:30:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa6227980 1 -- start start 2024-09-13T06:30:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa6227980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 0x5642d23eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa6227980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5642d2298200 con 0x5642d235eac0 2024-09-13T06:30:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 0x5642d23eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 0x5642d23eaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38912/0 (socket says 172.21.15.169:38912) 2024-09-13T06:30:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa3d37640 1 -- 172.21.15.169:0/434453520 learned_addr learned my addr 172.21.15.169:0/434453520 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa3d37640 1 -- 172.21.15.169:0/434453520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d23eb0a0 con 0x5642d235eac0 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/434453520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 0x5642d23eaad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0015f0 tx=0x7f5a9c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfb9e618ccb72ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5991e0b640 1 -- 172.21.15.169:0/434453520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c013420 con 0x5642d235eac0 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5991e0b640 1 -- 172.21.15.169:0/434453520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c0135e0 con 0x5642d235eac0 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.179+0000 7f5991e0b640 1 -- 172.21.15.169:0/434453520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c013940 con 0x5642d235eac0 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/434453520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 msgr2=0x5642d23eaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 --2- 172.21.15.169:0/434453520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 0x5642d23eaad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0015f0 tx=0x7f5a9c001ab0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/434453520 shutdown_connections 2024-09-13T06:30:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 --2- 172.21.15.169:0/434453520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d235eac0 0x5642d23eaad0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/434453520 >> 172.21.15.169:0/434453520 conn(0x5642d23e5060 msgr2=0x5642d24d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/434453520 shutdown_connections 2024-09-13T06:30:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/434453520 wait complete. 2024-09-13T06:30:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 Processor -- start 2024-09-13T06:30:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- start start 2024-09-13T06:30:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d24df260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5642d23f1e10 con 0x5642d23eea90 2024-09-13T06:30:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d24df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d24df260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38914/0 (socket says 172.21.15.169:38914) 2024-09-13T06:30:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa3d37640 1 -- 172.21.15.169:0/218238833 learned_addr learned my addr 172.21.15.169:0/218238833 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa3d37640 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d24df7a0 con 0x5642d23eea90 2024-09-13T06:30:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d24df260 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c006640 tx=0x7f5a9c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f598bfff640 1 -- 172.21.15.169:0/218238833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c022020 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642d24dfa30 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f598bfff640 1 -- 172.21.15.169:0/218238833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c006320 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d24e2710 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.183+0000 7f598bfff640 1 -- 172.21.15.169:0/218238833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c004a60 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f598bfff640 1 -- 172.21.15.169:0/218238833 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a9c025020 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f598bfff640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f598c034650 0x7f598c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f598bfff640 1 -- 172.21.15.169:0/218238833 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f5a9c018030 con 0x5642d23eea90 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa3536640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f598c034650 0x7f598c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d24e4350 0x5642d24e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d24e6c80 con 0x5642d24e4350 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa4538640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d24e4350 0x5642d24e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa3536640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f598c034650 0x7f598c036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5a980ae000 tx=0x7f5a980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa4538640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d24e4350 0x5642d24e6740 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa4538640 1 -- 172.21.15.169:0/218238833 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d24e4350 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d24e7a10 0x5642d24e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d24ea440 con 0x5642d24e7a10 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d24e7a10 0x5642d24e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d24e7a10 0x5642d24e9e00 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa3d37640 1 -- 172.21.15.169:0/218238833 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a9c01b070 con 0x5642d24e7a10 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d24ebcf0 con 0x5642d24e7a10 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa3d37640 1 -- 172.21.15.169:0/218238833 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a9c01b070 con 0x5642d24e7a10 2024-09-13T06:30:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.187+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d24eaf20 con 0x5642d24e7a10 2024-09-13T06:30:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3d37640 1 -- 172.21.15.169:0/218238833 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a9c01b070 con 0x5642d24e7a10 2024-09-13T06:30:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d24ed0a0 0x5642d24ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d24ef9d0 con 0x5642d24ed0a0 2024-09-13T06:30:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3536640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d24ed0a0 0x5642d24ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3536640 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d24ed0a0 0x5642d24ef490 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3536640 1 -- 172.21.15.169:0/218238833 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d24ed0a0 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 Processor -- start 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 -- start start 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 0x5642d24fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5642d22f1800 con 0x5642d24fd390 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 0x5642d24fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 0x5642d24fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38930/0 (socket says 172.21.15.169:38930) 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3d37640 1 -- 172.21.15.169:0/2509076588 learned_addr learned my addr 172.21.15.169:0/2509076588 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3d37640 1 -- 172.21.15.169:0/2509076588 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d24fdcf0 con 0x5642d24fd390 2024-09-13T06:30:20.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 0x5642d24fd7b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0069a0 tx=0x7f5a9c035340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f59897fa640 1 -- 172.21.15.169:0/2509076588 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c04e070 con 0x5642d24fd390 2024-09-13T06:30:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f59897fa640 1 -- 172.21.15.169:0/2509076588 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c0413e0 con 0x5642d24fd390 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f59897fa640 1 -- 172.21.15.169:0/2509076588 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c026730 con 0x5642d24fd390 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.191+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642d24fdf80 con 0x5642d24fd390 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d2500c00 con 0x5642d24fd390 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f59897fa640 1 -- 172.21.15.169:0/2509076588 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a9c051070 con 0x5642d24fd390 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f59897fa640 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f597c034650 0x7f597c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f59897fa640 1 -- 172.21.15.169:0/2509076588 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f5a9c03e040 con 0x5642d24fd390 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3536640 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f597c034650 0x7f597c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 Processor -- start 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- start start 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d250a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3536640 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f597c034650 0x7f597c036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5642d24e3850 tx=0x7f5a98005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5642d23e92c0 con 0x5642d2509cb0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d250a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d250a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38934/0 (socket says 172.21.15.169:38934) 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3d37640 1 -- 172.21.15.169:0/2382160945 learned_addr learned my addr 172.21.15.169:0/2382160945 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3d37640 1 -- 172.21.15.169:0/2382160945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d250a660 con 0x5642d2509cb0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/2382160945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d250a090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c046010 tx=0x7f5a9c0114e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812c75ca1722ba6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5982ffd640 1 -- 172.21.15.169:0/2382160945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c067070 con 0x5642d2509cb0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5982ffd640 1 -- 172.21.15.169:0/2382160945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c01b680 con 0x5642d2509cb0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5982ffd640 1 -- 172.21.15.169:0/2382160945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c05e040 con 0x5642d2509cb0 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- 172.21.15.169:0/2382160945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 msgr2=0x5642d250a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 --2- 172.21.15.169:0/2382160945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d250a090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c046010 tx=0x7f5a9c0114e0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- 172.21.15.169:0/2382160945 shutdown_connections 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 --2- 172.21.15.169:0/2382160945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d250a090 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- 172.21.15.169:0/2382160945 >> 172.21.15.169:0/2382160945 conn(0x5642d2506090 msgr2=0x5642d2504190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- 172.21.15.169:0/2382160945 shutdown_connections 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.195+0000 7f5aa6227980 1 -- 172.21.15.169:0/2382160945 wait complete. 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 Processor -- start 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 -- start start 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d2510e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5642d250ab00 con 0x5642d2509cb0 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d2510e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa3d37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d2510e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38950/0 (socket says 172.21.15.169:38950) 2024-09-13T06:30:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 learned_addr learned my addr 172.21.15.169:0/167315978 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d25113d0 con 0x5642d2509cb0 2024-09-13T06:30:20.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d2510e90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c065040 tx=0x7f5a9c034f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f59817fa640 1 -- 172.21.15.169:0/167315978 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c070020 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f59817fa640 1 -- 172.21.15.169:0/167315978 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c068040 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642d25113d0 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f59817fa640 1 -- 172.21.15.169:0/167315978 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c067070 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d25113d0 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f59817fa640 1 -- 172.21.15.169:0/167315978 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a9c073020 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f59817fa640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f596c034650 0x7f596c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f59817fa640 1 -- 172.21.15.169:0/167315978 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f5a9c076bd0 con 0x5642d2509cb0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa3536640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f596c034650 0x7f596c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d251bf10 0x5642d251e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d251eb20 con 0x5642d251bf10 2024-09-13T06:30:20.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.199+0000 7f5aa4538640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d251bf10 0x5642d251e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa3536640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f596c034650 0x7f596c036b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5a98000c10 tx=0x7f5a980c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa4538640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d251bf10 0x5642d251e3d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 realm 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d251b3c0 con 0x5642d251bf10 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:20.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d251f5b0 con 0x5642d251bf10 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d2520390 0x5642d2522780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2522db0 con 0x5642d2520390 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d2520390 0x5642d2522780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d2520390 0x5642d2522780 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2523650 con 0x5642d2520390 2024-09-13T06:30:20.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:20.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 20 searching for the correct realm 2024-09-13T06:30:20.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d25253c0 0x5642d25277b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.203+0000 7f5aa3536640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d25253c0 0x5642d25277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3536640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d25253c0 0x5642d25277b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3d37640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5a9c075020 0x7f5a9c03c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x7f5a9c075020 2024-09-13T06:30:20.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5a9c075020 0x7f5a9c03c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5a9c075020 0x7f5a9c03c1d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.207+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x7f5a9c075020 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x7f5a9c075020 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.211+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x7f5a9c075020 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d251bf10 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x7f5a9c075020 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x7f5a9c075020 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.215+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d25253c0 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642d2527dc0 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:20.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2523fd0 con 0x5642d251bf10 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2524450 con 0x5642d2520390 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2524870 con 0x5642d25253c0 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 zone default found 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 4 Realm: () 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 zonegroup default 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2528220 con 0x7f5a9c075020 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.219+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d252a450 con 0x5642d25253c0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d252a7f0 con 0x5642d25253c0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 20 started sync module instance, tier type = 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:20.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2529890 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94844996459696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2529890 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.223+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252b080 con 0x5642d251bf10 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94844996463504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252b8d0 con 0x5642d251bf10 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252c320 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94844996459696] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94844996463504] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94844996468240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252b420 con 0x5642d2520390 2024-09-13T06:30:20.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252cbf0 con 0x7f5a9c075020 2024-09-13T06:30:20.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94844996470592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252b420 con 0x7f5a9c075020 2024-09-13T06:30:20.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.227+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252d630 con 0x5642d2520390 2024-09-13T06:30:20.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94844996468240] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94844996470592] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94844996471648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252d180 con 0x5642d2520390 2024-09-13T06:30:20.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252ded0 con 0x5642d25253c0 2024-09-13T06:30:20.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94844996475424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252d180 con 0x5642d25253c0 2024-09-13T06:30:20.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.231+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252ed40 con 0x5642d25253c0 2024-09-13T06:30:20.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94844996471648] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94844996475424] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94844996457440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252ed40 con 0x5642d25253c0 2024-09-13T06:30:20.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252f590 con 0x7f5a9c075020 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94844996457440] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94844996479600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252f440 con 0x7f5a9c075020 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=0 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=1 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=2 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=3 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=4 2024-09-13T06:30:20.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=5 2024-09-13T06:30:20.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=6 2024-09-13T06:30:20.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94844996479600] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 20 add_watcher() i=7 2024-09-13T06:30:20.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:20.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2532a10 con 0x5642d251bf10 2024-09-13T06:30:20.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.235+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94844996480720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252fe90 con 0x5642d251bf10 2024-09-13T06:30:20.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94844996480720] v33'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5959fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:20.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 5 note: GC not initialized 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5958fe1640 20 reqs_thread_entry: start 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 20 Filter name: none 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f58d27fc640 20 reqs_thread_entry: start 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555c50 con 0x5642d251bf10 2024-09-13T06:30:20.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:30:20.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642d25571a0 con 0x5642d25253c0 2024-09-13T06:30:20.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.239+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.243+0000 7f5959fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.243+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94844996480720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x5642d251bf10 2024-09-13T06:30:20.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.243+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94844996480720] v33'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.243+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94844996459696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x5642d2520390 2024-09-13T06:30:20.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94844996459696] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa6227980 20 remove_watcher() i=0 2024-09-13T06:30:20.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa6227980 2 removed watcher, disabling cache 2024-09-13T06:30:20.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94844996463504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x5642d251bf10 2024-09-13T06:30:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94844996463504] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x5642d251bf10 2024-09-13T06:30:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa6227980 20 remove_watcher() i=1 2024-09-13T06:30:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.247+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94844996468240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x5642d2520390 2024-09-13T06:30:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94844996468240] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa6227980 20 remove_watcher() i=2 2024-09-13T06:30:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94844996470592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x7f5a9c075020 2024-09-13T06:30:20.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94844996470592] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa6227980 20 remove_watcher() i=3 2024-09-13T06:30:20.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94844996471648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d252c740 con 0x5642d2520390 2024-09-13T06:30:20.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa3d37640 1 -- 172.21.15.169:0/167315978 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94844996471648] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a9c06a070 con 0x5642d2520390 2024-09-13T06:30:20.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa6227980 20 remove_watcher() i=4 2024-09-13T06:30:20.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.251+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94844996475424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x5642d25253c0 2024-09-13T06:30:20.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94844996475424] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 20 remove_watcher() i=5 2024-09-13T06:30:20.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94844996457440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x5642d25253c0 2024-09-13T06:30:20.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa3536640 1 -- 172.21.15.169:0/167315978 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94844996457440] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a980aaae0 con 0x5642d25253c0 2024-09-13T06:30:20.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 20 remove_watcher() i=6 2024-09-13T06:30:20.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94844996479600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642d2555000 con 0x7f5a9c075020 2024-09-13T06:30:20.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94844996479600] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a940083f0 con 0x7f5a9c075020 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 20 remove_watcher() i=7 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d2520390 msgr2=0x5642d2522780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d2520390 0x5642d2522780 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d251bf10 msgr2=0x5642d251e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d251bf10 0x5642d251e3d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5a9c075020 msgr2=0x7f5a9c03c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5a9c075020 0x7f5a9c03c1d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d25253c0 msgr2=0x5642d25277b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d25253c0 0x5642d25277b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f596c034650 msgr2=0x7f596c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f596c034650 0x7f596c036b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5a98000c10 tx=0x7f5a980c1040 comp rx=0 tx=0).stop 2024-09-13T06:30:20.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 msgr2=0x5642d2510e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/167315978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d2509cb0 0x5642d2510e90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c065040 tx=0x7f5a9c034f00 comp rx=0 tx=0).stop 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 reap_dead start 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa4538640 1 -- 172.21.15.169:0/167315978 reap_dead start 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 shutdown_connections 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 >> 172.21.15.169:0/167315978 conn(0x5642d2506090 msgr2=0x5642d2504160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 shutdown_connections 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/167315978 wait complete. 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f597c034650 msgr2=0x7f597c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f597c034650 0x7f597c036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5642d24e3850 tx=0x7f5a98005ad0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 msgr2=0x5642d24fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 0x5642d24fd7b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0069a0 tx=0x7f5a9c035340 comp rx=0 tx=0).stop 2024-09-13T06:30:20.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 shutdown_connections 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f597c034650 0x7f597c036b10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 --2- 172.21.15.169:0/2509076588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d24fd390 0x5642d24fd7b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.255+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 >> 172.21.15.169:0/2509076588 conn(0x5642d24f24e0 msgr2=0x5642d24f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 shutdown_connections 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/2509076588 wait complete. 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d24e7a10 msgr2=0x5642d24e9e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5642d24e7a10 0x5642d24e9e00 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d24e4350 msgr2=0x5642d24e6740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5642d24e4350 0x5642d24e6740 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d24ed0a0 msgr2=0x5642d24ef490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5642d24ed0a0 0x5642d24ef490 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f598c034650 msgr2=0x7f598c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f598c034650 0x7f598c036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5a980ae000 tx=0x7f5a980a6000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 msgr2=0x5642d24df260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 --2- 172.21.15.169:0/218238833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5642d23eea90 0x5642d24df260 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c006640 tx=0x7f5a9c000f50 comp rx=0 tx=0).stop 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa4538640 1 -- 172.21.15.169:0/218238833 reap_dead start 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 shutdown_connections 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 >> 172.21.15.169:0/218238833 conn(0x5642d23e5060 msgr2=0x5642d24d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 shutdown_connections 2024-09-13T06:30:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.259+0000 7f5aa6227980 1 -- 172.21.15.169:0/218238833 wait complete. 2024-09-13T06:30:20.269 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T06:30:20.270 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T06:30:20.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T06:30:20.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T06:30:20.270 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T06:30:20.343 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:20.343 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:20.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed171c9980 1 Processor -- start 2024-09-13T06:30:20.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed171c9980 1 -- start start 2024-09-13T06:30:20.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed171c9980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f4209262a0 0x55f4209b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed171c9980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f420839ae0 con 0x55f4209b48f0 2024-09-13T06:30:20.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed171c9980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55f42085de30 con 0x55f4209262a0 2024-09-13T06:30:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed14cd9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f4209262a0 0x55f4209b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed144d8640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55f4209b48f0 0x55f4209b6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57464/0 (socket says 172.21.15.169:57464) 2024-09-13T06:30:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed14cd9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f4209262a0 0x55f4209b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38962/0 (socket says 172.21.15.169:38962) 2024-09-13T06:30:20.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed144d8640 1 -- 172.21.15.169:0/1180056181 learned_addr learned my addr 172.21.15.169:0/1180056181 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed14cd9640 1 -- 172.21.15.169:0/1180056181 >> v1:172.21.15.112:6789/0 conn(0x55f4209b48f0 legacy=0x55f4209b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.343+0000 7fed14cd9640 1 -- 172.21.15.169:0/1180056181 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420926830 con 0x55f4209262a0 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed14cd9640 1 --2- 172.21.15.169:0/1180056181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f4209b43b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fed0400a480 tx=0x7fed0401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a716ae26e7af04db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed13cd7640 1 -- 172.21.15.169:0/1180056181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040b0070 con 0x55f4209262a0 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed13cd7640 1 -- 172.21.15.169:0/1180056181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed040ab540 con 0x55f4209262a0 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed13cd7640 1 -- 172.21.15.169:0/1180056181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040ab840 con 0x55f4209262a0 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 -- 172.21.15.169:0/1180056181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 msgr2=0x55f4209b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 --2- 172.21.15.169:0/1180056181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f4209b43b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fed0400a480 tx=0x7fed0401b280 comp rx=0 tx=0).stop 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 -- 172.21.15.169:0/1180056181 shutdown_connections 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 --2- 172.21.15.169:0/1180056181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f4209b43b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 -- 172.21.15.169:0/1180056181 >> 172.21.15.169:0/1180056181 conn(0x55f4209ac0a0 msgr2=0x55f4209ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 -- 172.21.15.169:0/1180056181 shutdown_connections 2024-09-13T06:30:20.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.347+0000 7fed171c9980 1 -- 172.21.15.169:0/1180056181 wait complete. 2024-09-13T06:30:20.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed171c9980 1 Processor -- start 2024-09-13T06:30:20.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed171c9980 1 -- start start 2024-09-13T06:30:20.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed171c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f420a9caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed171c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f42085f200 con 0x55f4209262a0 2024-09-13T06:30:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f420a9caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f420a9caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38976/0 (socket says 172.21.15.169:38976) 2024-09-13T06:30:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed14cd9640 1 -- 172.21.15.169:0/3752984512 learned_addr learned my addr 172.21.15.169:0/3752984512 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed14cd9640 1 -- 172.21.15.169:0/3752984512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420a9d0c0 con 0x55f4209262a0 2024-09-13T06:30:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fed14cd9640 1 --2- 172.21.15.169:0/3752984512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f420a9caf0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fed04017e90 tx=0x7fed04003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a09852e261de40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fec02e0d640 1 -- 172.21.15.169:0/3752984512 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040b0070 con 0x55f4209262a0 2024-09-13T06:30:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fec02e0d640 1 -- 172.21.15.169:0/3752984512 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed040b1040 con 0x55f4209262a0 2024-09-13T06:30:20.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.363+0000 7fec02e0d640 1 -- 172.21.15.169:0/3752984512 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040abc30 con 0x55f4209262a0 2024-09-13T06:30:20.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/3752984512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 msgr2=0x55f420a9caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 --2- 172.21.15.169:0/3752984512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f420a9caf0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fed04017e90 tx=0x7fed04003030 comp rx=0 tx=0).stop 2024-09-13T06:30:20.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/3752984512 shutdown_connections 2024-09-13T06:30:20.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 --2- 172.21.15.169:0/3752984512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209262a0 0x55f420a9caf0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/3752984512 >> 172.21.15.169:0/3752984512 conn(0x55f4209ac0a0 msgr2=0x55f420a98720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/3752984512 shutdown_connections 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/3752984512 wait complete. 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 Processor -- start 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- start start 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209b48f0 0x55f420aa3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f4209b8f10 con 0x55f4209b48f0 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209b48f0 0x55f420aa3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209b48f0 0x55f420aa3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38990/0 (socket says 172.21.15.169:38990) 2024-09-13T06:30:20.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed14cd9640 1 -- 172.21.15.169:0/2348256816 learned_addr learned my addr 172.21.15.169:0/2348256816 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed14cd9640 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420aa43c0 con 0x55f4209b48f0 2024-09-13T06:30:20.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209b48f0 0x55f420aa3e80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fed04017e90 tx=0x7fed04018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fec0160a640 1 -- 172.21.15.169:0/2348256816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040c6070 con 0x55f4209b48f0 2024-09-13T06:30:20.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f420aa4650 con 0x55f4209b48f0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fec0160a640 1 -- 172.21.15.169:0/2348256816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed040b78c0 con 0x55f4209b48f0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fec0160a640 1 -- 172.21.15.169:0/2348256816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040b7ba0 con 0x55f4209b48f0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.367+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f420aa7330 con 0x55f4209b48f0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fec0160a640 1 -- 172.21.15.169:0/2348256816 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fed040c9070 con 0x55f4209b48f0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fec0160a640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febfc034650 0x7febfc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fec0160a640 1 -- 172.21.15.169:0/2348256816 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fed040bc070 con 0x55f4209b48f0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed144d8640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febfc034650 0x7febfc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420aa8f70 0x55f420aab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aab8a0 con 0x55f420aa8f70 2024-09-13T06:30:20.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed154da640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420aa8f70 0x55f420aab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed144d8640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febfc034650 0x7febfc036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed08000f70 tx=0x7fed080012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed154da640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420aa8f70 0x55f420aab360 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed154da640 1 -- 172.21.15.169:0/2348256816 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420aa8f70 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420aac6a0 0x55f420aaea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aaf0c0 con 0x55f420aac6a0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420aac6a0 0x55f420aaea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420aac6a0 0x55f420aaea90 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed14cd9640 1 -- 172.21.15.169:0/2348256816 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed040d2070 con 0x55f420aac6a0 2024-09-13T06:30:20.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420ab0970 con 0x55f420aac6a0 2024-09-13T06:30:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed14cd9640 1 -- 172.21.15.169:0/2348256816 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed040d2070 con 0x55f420aac6a0 2024-09-13T06:30:20.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.371+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aafba0 con 0x55f420aac6a0 2024-09-13T06:30:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed14cd9640 1 -- 172.21.15.169:0/2348256816 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed040d2070 con 0x55f420aac6a0 2024-09-13T06:30:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420ab1d20 0x55f420ab4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420ab4690 con 0x55f420ab1d20 2024-09-13T06:30:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed144d8640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420ab1d20 0x55f420ab4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed144d8640 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420ab1d20 0x55f420ab4110 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed144d8640 1 -- 172.21.15.169:0/2348256816 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed0800e620 con 0x55f420ab1d20 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 Processor -- start 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 -- start start 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 0x55f420ac2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f4208b8800 con 0x55f420ac2120 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 0x55f420ac2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 0x55f420ac2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38992/0 (socket says 172.21.15.169:38992) 2024-09-13T06:30:20.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed14cd9640 1 -- 172.21.15.169:0/3002210379 learned_addr learned my addr 172.21.15.169:0/3002210379 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed14cd9640 1 -- 172.21.15.169:0/3002210379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420ac2a80 con 0x55f420ac2120 2024-09-13T06:30:20.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed14cd9640 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 0x55f420ac2540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fed0401b2a0 tx=0x7fed040c0960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7febfa7fc640 1 -- 172.21.15.169:0/3002210379 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040db800 con 0x55f420ac2120 2024-09-13T06:30:20.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7febfa7fc640 1 -- 172.21.15.169:0/3002210379 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed040db9a0 con 0x55f420ac2120 2024-09-13T06:30:20.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f420ac2cb0 con 0x55f420ac2120 2024-09-13T06:30:20.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7febfa7fc640 1 -- 172.21.15.169:0/3002210379 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040dbc80 con 0x55f420ac2120 2024-09-13T06:30:20.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.375+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f420ac2cb0 con 0x55f420ac2120 2024-09-13T06:30:20.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7febfa7fc640 1 -- 172.21.15.169:0/3002210379 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fed040b65c0 con 0x55f420ac2120 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7febfa7fc640 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febec034650 0x7febec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7febfa7fc640 1 -- 172.21.15.169:0/3002210379 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fed040a8070 con 0x55f420ac2120 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed144d8640 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febec034650 0x7febec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 Processor -- start 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- start start 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed144d8640 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febec034650 0x7febec036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed0800bf60 tx=0x7fed0800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f420a9d380 con 0x55f420ad03b0 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:38998/0 (socket says 172.21.15.169:38998) 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed14cd9640 1 -- 172.21.15.169:0/976572167 learned_addr learned my addr 172.21.15.169:0/976572167 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed14cd9640 1 -- 172.21.15.169:0/976572167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420ad0d80 con 0x55f420ad03b0 2024-09-13T06:30:20.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed14cd9640 1 --2- 172.21.15.169:0/976572167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad07b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fed040bf640 tx=0x7fed040b68b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e57c56d0f68360f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7febebfff640 1 -- 172.21.15.169:0/976572167 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040b6be0 con 0x55f420ad03b0 2024-09-13T06:30:20.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7febebfff640 1 -- 172.21.15.169:0/976572167 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed04104070 con 0x55f420ad03b0 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7febebfff640 1 -- 172.21.15.169:0/976572167 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040d5450 con 0x55f420ad03b0 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- 172.21.15.169:0/976572167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 msgr2=0x55f420ad07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 --2- 172.21.15.169:0/976572167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad07b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fed040bf640 tx=0x7fed040b68b0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- 172.21.15.169:0/976572167 shutdown_connections 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 --2- 172.21.15.169:0/976572167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad07b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- 172.21.15.169:0/976572167 >> 172.21.15.169:0/976572167 conn(0x55f4209b0330 msgr2=0x55f4209b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- 172.21.15.169:0/976572167 shutdown_connections 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- 172.21.15.169:0/976572167 wait complete. 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 Processor -- start 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 -- start start 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.379+0000 7fed171c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f420ad1680 con 0x55f420ad03b0 2024-09-13T06:30:20.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed14cd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39004/0 (socket says 172.21.15.169:39004) 2024-09-13T06:30:20.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 learned_addr learned my addr 172.21.15.169:0/2393821904 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420ad8010 con 0x55f420ad03b0 2024-09-13T06:30:20.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad7ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fed040bf640 tx=0x7fed040cef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7febea7fc640 1 -- 172.21.15.169:0/2393821904 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04117070 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7febea7fc640 1 -- 172.21.15.169:0/2393821904 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed040cce70 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f420ad8010 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7febea7fc640 1 -- 172.21.15.169:0/2393821904 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed040d4510 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f420ad8010 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7febea7fc640 1 -- 172.21.15.169:0/2393821904 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fed0411a070 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7febea7fc640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febe00346a0 0x7febe0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7febea7fc640 1 -- 172.21.15.169:0/2393821904 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fed0411dc10 con 0x55f420ad03b0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed144d8640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febe00346a0 0x7febe0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420ae29d0 0x55f420ae4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420ae5590 con 0x55f420ae29d0 2024-09-13T06:30:20.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed154da640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420ae29d0 0x55f420ae4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed144d8640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febe00346a0 0x7febe0036b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55f420ab0940 tx=0x7fed08010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed154da640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420ae29d0 0x55f420ae4e40 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 20 realm 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.383+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420ae1f10 con 0x55f420ae29d0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420ae60b0 con 0x55f420ae29d0 2024-09-13T06:30:20.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420ae6c90 0x55f420ae9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420ae98c0 con 0x55f420ae6c90 2024-09-13T06:30:20.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420ae6c90 0x55f420ae9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420ae6c90 0x55f420ae9150 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aea160 con 0x55f420ae6c90 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 20 searching for the correct realm 2024-09-13T06:30:20.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420aebed0 0x55f420aee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed144d8640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420aebed0 0x55f420aee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed144d8640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420aebed0 0x55f420aee2c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.387+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fed0411c060 0x7fed040c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x7fed0411c060 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fed0411c060 0x7fed040c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fed0411c060 0x7fed040c7920 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.391+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x7fed0411c060 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x7fed0411c060 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.395+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x7fed0411c060 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae29d0 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x7fed0411c060 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x7fed0411c060 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420aebed0 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.399+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f420aee940 con 0x55f420ae6c90 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aeab10 con 0x55f420ae29d0 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aeaf30 con 0x55f420ae6c90 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aeaf30 con 0x55f420aebed0 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 zone default found 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 4 Realm: () 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 zonegroup default 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aeedf0 con 0x7fed0411c060 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420aeb620 con 0x55f420aebed0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420af11a0 con 0x55f420aebed0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 started sync module instance, tier type = 2024-09-13T06:30:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.403+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af04b0 con 0x55f420ae6c90 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94507008723408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af04b0 con 0x55f420ae6c90 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af1cb0 con 0x55f420ae29d0 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94507008726944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af2550 con 0x55f420ae29d0 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af2f90 con 0x55f420ae6c90 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.407+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94507008723408] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94507008726944] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94507008731744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af20a0 con 0x55f420ae6c90 2024-09-13T06:30:20.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af3830 con 0x7fed0411c060 2024-09-13T06:30:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94507008734080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af20a0 con 0x7fed0411c060 2024-09-13T06:30:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af42f0 con 0x55f420ae6c90 2024-09-13T06:30:20.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.411+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94507008734080] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94507008731744] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94507008720896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af42b0 con 0x55f420ae6c90 2024-09-13T06:30:20.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af46e0 con 0x55f420aebed0 2024-09-13T06:30:20.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94507008735136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af4f80 con 0x55f420aebed0 2024-09-13T06:30:20.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af5940 con 0x55f420aebed0 2024-09-13T06:30:20.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94507008720896] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94507008735136] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94507008736704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af5940 con 0x55f420aebed0 2024-09-13T06:30:20.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.415+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af61e0 con 0x7fed0411c060 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94507008736704] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94507008743024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af61e0 con 0x7fed0411c060 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=0 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=1 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=2 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=3 2024-09-13T06:30:20.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=4 2024-09-13T06:30:20.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=5 2024-09-13T06:30:20.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=6 2024-09-13T06:30:20.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94507008743024] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 20 add_watcher() i=7 2024-09-13T06:30:20.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:20.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420af95e0 con 0x55f420ae29d0 2024-09-13T06:30:20.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.419+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94507008745216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af6b30 con 0x55f420ae29d0 2024-09-13T06:30:20.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94507008745216] v33'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7febcafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 5 note: GC not initialized 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7febc9fe3640 20 reqs_thread_entry: start 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 20 Filter name: none 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7feb3b7fe640 20 reqs_thread_entry: start 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420b1c780 con 0x55f420ae29d0 2024-09-13T06:30:20.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:30:20.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f420b1dcd0 con 0x55f420aebed0 2024-09-13T06:30:20.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7febcafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.423+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94507008745216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420adc9a0 con 0x55f420ae29d0 2024-09-13T06:30:20.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.427+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94507008745216] v33'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.427+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94507008723408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af5ed0 con 0x55f420ae6c90 2024-09-13T06:30:20.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.427+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94507008723408] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.427+0000 7fed171c9980 20 remove_watcher() i=0 2024-09-13T06:30:20.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.427+0000 7fed171c9980 2 removed watcher, disabling cache 2024-09-13T06:30:20.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.427+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94507008726944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af09d0 con 0x55f420ae29d0 2024-09-13T06:30:20.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.431+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94507008726944] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x55f420ae29d0 2024-09-13T06:30:20.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.431+0000 7fed171c9980 20 remove_watcher() i=1 2024-09-13T06:30:20.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.431+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94507008731744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af09d0 con 0x55f420ae6c90 2024-09-13T06:30:20.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.431+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94507008731744] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.431+0000 7fed171c9980 20 remove_watcher() i=2 2024-09-13T06:30:20.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.431+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94507008734080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af09d0 con 0x7fed0411c060 2024-09-13T06:30:20.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.435+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94507008734080] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.435+0000 7fed171c9980 20 remove_watcher() i=3 2024-09-13T06:30:20.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.435+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94507008720896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af3380 con 0x55f420ae6c90 2024-09-13T06:30:20.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.435+0000 7fed14cd9640 1 -- 172.21.15.169:0/2393821904 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94507008720896] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed04119030 con 0x55f420ae6c90 2024-09-13T06:30:20.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.435+0000 7fed171c9980 20 remove_watcher() i=4 2024-09-13T06:30:20.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.435+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94507008735136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af0000 con 0x55f420aebed0 2024-09-13T06:30:20.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94507008735136] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 20 remove_watcher() i=5 2024-09-13T06:30:20.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94507008736704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af0000 con 0x55f420aebed0 2024-09-13T06:30:20.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed144d8640 1 -- 172.21.15.169:0/2393821904 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94507008736704] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0800e620 con 0x55f420aebed0 2024-09-13T06:30:20.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 20 remove_watcher() i=6 2024-09-13T06:30:20.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94507008743024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f420af3dc0 con 0x7fed0411c060 2024-09-13T06:30:20.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94507008743024] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed0c00a4d0 con 0x7fed0411c060 2024-09-13T06:30:20.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 20 remove_watcher() i=7 2024-09-13T06:30:20.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420ae6c90 msgr2=0x55f420ae9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420ae6c90 0x55f420ae9150 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420ae29d0 msgr2=0x55f420ae4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420ae29d0 0x55f420ae4e40 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fed0411c060 msgr2=0x7fed040c7920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fed0411c060 0x7fed040c7920 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420aebed0 msgr2=0x55f420aee2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420aebed0 0x55f420aee2c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febe00346a0 msgr2=0x7febe0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febe00346a0 0x7febe0036b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55f420ab0940 tx=0x7fed08010000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 msgr2=0x55f420ad7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed154da640 1 -- 172.21.15.169:0/2393821904 reap_dead start 2024-09-13T06:30:20.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad7ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fed040bf640 tx=0x7fed040cef90 comp rx=0 tx=0).stop 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 shutdown_connections 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/2393821904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ad03b0 0x55f420ad7ad0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 >> 172.21.15.169:0/2393821904 conn(0x55f4209b0330 msgr2=0x55f4209b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 shutdown_connections 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/2393821904 wait complete. 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febec034650 msgr2=0x7febec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febec034650 0x7febec036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed0800bf60 tx=0x7fed0800f000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 msgr2=0x55f420ac2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 0x55f420ac2540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fed0401b2a0 tx=0x7fed040c0960 comp rx=0 tx=0).stop 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 shutdown_connections 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febec034650 0x7febec036b10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 --2- 172.21.15.169:0/3002210379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f420ac2120 0x55f420ac2540 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 >> 172.21.15.169:0/3002210379 conn(0x55f420ab7270 msgr2=0x55f420ab9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 shutdown_connections 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.439+0000 7fed171c9980 1 -- 172.21.15.169:0/3002210379 wait complete. 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420aac6a0 msgr2=0x55f420aaea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f420aac6a0 0x55f420aaea90 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420aa8f70 msgr2=0x55f420aab360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f420aa8f70 0x55f420aab360 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420ab1d20 msgr2=0x55f420ab4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f420ab1d20 0x55f420ab4110 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febfc034650 msgr2=0x7febfc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7febfc034650 0x7febfc036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed08000f70 tx=0x7fed080012c0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209b48f0 msgr2=0x55f420aa3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 --2- 172.21.15.169:0/2348256816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4209b48f0 0x55f420aa3e80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fed04017e90 tx=0x7fed04018020 comp rx=0 tx=0).stop 2024-09-13T06:30:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed154da640 1 -- 172.21.15.169:0/2348256816 reap_dead start 2024-09-13T06:30:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 shutdown_connections 2024-09-13T06:30:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 >> 172.21.15.169:0/2348256816 conn(0x55f4209ac0a0 msgr2=0x55f420a972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 shutdown_connections 2024-09-13T06:30:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.443+0000 7fed171c9980 1 -- 172.21.15.169:0/2348256816 wait complete. 2024-09-13T06:30:20.453 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T06:30:20.454 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T06:30:20.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T06:30:20.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T06:30:20.454 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T06:30:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0db8e9980 1 Processor -- start 2024-09-13T06:30:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0db8e9980 1 -- start start 2024-09-13T06:30:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0db8e9980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5627c3a0c8f0 0x5627c3a0ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0db8e9980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627c3892ae0 con 0x5627c3a0d240 2024-09-13T06:30:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0db8e9980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5627c38b6e30 con 0x5627c3a0c8f0 2024-09-13T06:30:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0d93f9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5627c3a0c8f0 0x5627c3a0ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0d8bf8640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5627c3a0d240 0x5627c3a11c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57476/0 (socket says 172.21.15.169:57476) 2024-09-13T06:30:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/301647849 learned_addr learned my addr 172.21.15.169:0/301647849 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.527+0000 7fe0d93f9640 1 -- 172.21.15.169:0/301647849 >> v1:172.21.15.112:6789/0 conn(0x5627c3a0d240 legacy=0x5627c3a11c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.531+0000 7fe0d93f9640 1 -- 172.21.15.169:0/301647849 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c3a144c0 con 0x5627c3a0c8f0 2024-09-13T06:30:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.531+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/301647849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3a0ccd0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a480 tx=0x7fe0cc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab233e738127e49f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.531+0000 7fe0cbfff640 1 -- 172.21.15.169:0/301647849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0b0070 con 0x5627c3a0c8f0 2024-09-13T06:30:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0cbfff640 1 -- 172.21.15.169:0/301647849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0ab540 con 0x5627c3a0c8f0 2024-09-13T06:30:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0cbfff640 1 -- 172.21.15.169:0/301647849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0ab840 con 0x5627c3a0c8f0 2024-09-13T06:30:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 -- 172.21.15.169:0/301647849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 msgr2=0x5627c3a0ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/301647849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3a0ccd0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a480 tx=0x7fe0cc01b280 comp rx=0 tx=0).stop 2024-09-13T06:30:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 -- 172.21.15.169:0/301647849 shutdown_connections 2024-09-13T06:30:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/301647849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3a0ccd0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 -- 172.21.15.169:0/301647849 >> 172.21.15.169:0/301647849 conn(0x5627c3980240 msgr2=0x5627c3980650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 -- 172.21.15.169:0/301647849 shutdown_connections 2024-09-13T06:30:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.535+0000 7fe0db8e9980 1 -- 172.21.15.169:0/301647849 wait complete. 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.547+0000 7fe0db8e9980 1 Processor -- start 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.547+0000 7fe0db8e9980 1 -- start start 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.547+0000 7fe0db8e9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3af7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.547+0000 7fe0db8e9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5627c38b8200 con 0x5627c3a0c8f0 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3af7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3af7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39018/0 (socket says 172.21.15.169:39018) 2024-09-13T06:30:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 -- 172.21.15.169:0/3482945935 learned_addr learned my addr 172.21.15.169:0/3482945935 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 -- 172.21.15.169:0/3482945935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c3af8200 con 0x5627c3a0c8f0 2024-09-13T06:30:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/3482945935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3af7c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0ae040 tx=0x7fe0cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5007029eb896587 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fdfc7606640 1 -- 172.21.15.169:0/3482945935 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0b0040 con 0x5627c3a0c8f0 2024-09-13T06:30:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fdfc7606640 1 -- 172.21.15.169:0/3482945935 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0ab9b0 con 0x5627c3a0c8f0 2024-09-13T06:30:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fdfc7606640 1 -- 172.21.15.169:0/3482945935 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0abc90 con 0x5627c3a0c8f0 2024-09-13T06:30:20.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- 172.21.15.169:0/3482945935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 msgr2=0x5627c3af7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/3482945935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3af7c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0ae040 tx=0x7fe0cc003030 comp rx=0 tx=0).stop 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- 172.21.15.169:0/3482945935 shutdown_connections 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/3482945935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3af7c30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- 172.21.15.169:0/3482945935 >> 172.21.15.169:0/3482945935 conn(0x5627c3980240 msgr2=0x5627c3af3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- 172.21.15.169:0/3482945935 shutdown_connections 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- 172.21.15.169:0/3482945935 wait complete. 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 Processor -- start 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- start start 2024-09-13T06:30:20.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3afee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0db8e9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5627c3a13f00 con 0x5627c3a0c8f0 2024-09-13T06:30:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3afee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3afee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39034/0 (socket says 172.21.15.169:39034) 2024-09-13T06:30:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2441131197 learned_addr learned my addr 172.21.15.169:0/2441131197 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.551+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c3aff380 con 0x5627c3a0c8f0 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3afee40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0030b0 tx=0x7fe0cc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fdfc5e03640 1 -- 172.21.15.169:0/2441131197 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0c5070 con 0x5627c3a0c8f0 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627c3aff610 con 0x5627c3a0c8f0 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fdfc5e03640 1 -- 172.21.15.169:0/2441131197 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0b6970 con 0x5627c3a0c8f0 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fdfc5e03640 1 -- 172.21.15.169:0/2441131197 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0b0050 con 0x5627c3a0c8f0 2024-09-13T06:30:20.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c3b022f0 con 0x5627c3a0c8f0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fdfc5e03640 1 -- 172.21.15.169:0/2441131197 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe0cc0c8070 con 0x5627c3a0c8f0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fdfc5e03640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfc0034650 0x7fdfc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fdfc5e03640 1 -- 172.21.15.169:0/2441131197 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fe0cc0bc070 con 0x5627c3a0c8f0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfc0034650 0x7fdfc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3a0d240 0x5627c3b05df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b06460 con 0x5627c3a0d240 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d9bfa640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3a0d240 0x5627c3b05df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfc0034650 0x7fdfc0036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0001650 tx=0x7fe0d0006740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d9bfa640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3a0d240 0x5627c3b05df0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2441131197 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3a0d240 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b07250 0x5627c3b09640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b09c70 con 0x5627c3b07250 2024-09-13T06:30:20.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b07250 0x5627c3b09640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.555+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b07250 0x5627c3b09640 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2441131197 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0cc0c7030 con 0x5627c3b07250 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b0b520 con 0x5627c3b07250 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2441131197 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0cc0c7030 con 0x5627c3b07250 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b0a750 con 0x5627c3b07250 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2441131197 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0cc0c7030 con 0x5627c3b07250 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b0c8d0 0x5627c3b0ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b0f200 con 0x5627c3b0c8d0 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b0c8d0 0x5627c3b0ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b0c8d0 0x5627c3b0ecc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2441131197 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b0c8d0 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 Processor -- start 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 -- start start 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 0x5627c3b1cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0db8e9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5627c3911800 con 0x5627c3b1cbb0 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 0x5627c3b1cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 0x5627c3b1cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39048/0 (socket says 172.21.15.169:39048) 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.559+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2781962630 learned_addr learned my addr 172.21.15.169:0/2781962630 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2781962630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c3b1d510 con 0x5627c3b1cbb0 2024-09-13T06:30:20.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 0x5627c3b1cfd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0e3c80 tx=0x7fe0cc0cc450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fdfbeffd640 1 -- 172.21.15.169:0/2781962630 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0d5040 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627c3b1d7a0 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fdfbeffd640 1 -- 172.21.15.169:0/2781962630 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0aa8e0 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c3b20420 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fdfbeffd640 1 -- 172.21.15.169:0/2781962630 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0f0060 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fdfbeffd640 1 -- 172.21.15.169:0/2781962630 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe0cc0cc740 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fdfbeffd640 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfb0034600 0x7fdfb0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fdfbeffd640 1 -- 172.21.15.169:0/2781962630 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fe0cc0a8070 con 0x5627c3b1cbb0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfb0034600 0x7fdfb0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0db8e9980 1 Processor -- start 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0db8e9980 1 -- start start 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfb0034600 0x7fdfb0036ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0006340 tx=0x7fe0d000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0db8e9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0db8e9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5627c3af84c0 con 0x5627c3b294a0 2024-09-13T06:30:20.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b29880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39056/0 (socket says 172.21.15.169:39056) 2024-09-13T06:30:20.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2857977394 learned_addr learned my addr 172.21.15.169:0/2857977394 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.563+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2857977394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c3b29e50 con 0x5627c3b294a0 2024-09-13T06:30:20.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2857977394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b29880 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0bff90 tx=0x7fe0cc0b90d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7299655b9f63fee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fdfbcff9640 1 -- 172.21.15.169:0/2857977394 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0d7b50 con 0x5627c3b294a0 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fdfbcff9640 1 -- 172.21.15.169:0/2857977394 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0eb3f0 con 0x5627c3b294a0 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fdfbcff9640 1 -- 172.21.15.169:0/2857977394 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0edc60 con 0x5627c3b294a0 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2857977394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 msgr2=0x5627c3b29880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2857977394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b29880 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0bff90 tx=0x7fe0cc0b90d0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2857977394 shutdown_connections 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2857977394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b29880 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2857977394 >> 172.21.15.169:0/2857977394 conn(0x5627c3b25880 msgr2=0x5627c3b23980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2857977394 shutdown_connections 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2857977394 wait complete. 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 Processor -- start 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- start start 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b30630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5627c3b2a2f0 con 0x5627c3b294a0 2024-09-13T06:30:20.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b30630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0d93f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b30630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39072/0 (socket says 172.21.15.169:39072) 2024-09-13T06:30:20.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 learned_addr learned my addr 172.21.15.169:0/2380014858 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c3b30b70 con 0x5627c3b294a0 2024-09-13T06:30:20.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b30630 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0d7810 tx=0x7fe0cc002150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fdfaeffd640 1 -- 172.21.15.169:0/2380014858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc111070 con 0x5627c3b294a0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fdfaeffd640 1 -- 172.21.15.169:0/2380014858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0c1320 con 0x5627c3b294a0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627c3b30b70 con 0x5627c3b294a0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fdfaeffd640 1 -- 172.21.15.169:0/2380014858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc0cca30 con 0x5627c3b294a0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.567+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c3b30b70 con 0x5627c3b294a0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fdfaeffd640 1 -- 172.21.15.169:0/2380014858 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe0cc114070 con 0x5627c3b294a0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fdfaeffd640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfa4034650 0x7fdfa4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fdfaeffd640 1 -- 172.21.15.169:0/2380014858 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fe0cc0fc030 con 0x5627c3b294a0 2024-09-13T06:30:20.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfa4034650 0x7fdfa4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3b3b5e0 0x5627c3b3daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b3e1f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d9bfa640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3b3b5e0 0x5627c3b3daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfa4034650 0x7fdfa4036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5627c3b03430 tx=0x7fe0d0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d9bfa640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3b3b5e0 0x5627c3b3daa0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 realm 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b3aa90 con 0x5627c3b3b5e0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b3ecb0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b3fa90 0x5627c3b41e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b424e0 con 0x5627c3b3fa90 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b3fa90 0x5627c3b41e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b3fa90 0x5627c3b41e80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.571+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b42d80 con 0x5627c3b3fa90 2024-09-13T06:30:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0db8e9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0db8e9980 20 searching for the correct realm 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b44af0 0x5627c3b46ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b44af0 0x5627c3b46ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d8bf8640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b44af0 0x5627c3b46ee0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d93f9640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe0cc116060 0x7fe0cc0ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x7fe0cc116060 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe0cc116060 0x7fe0cc0ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe0cc116060 0x7fe0cc0ed410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.575+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x7fe0cc116060 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x7fe0cc116060 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.579+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x7fe0cc116060 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x7fe0cc116060 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x7fe0cc116060 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.583+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b44af0 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b474f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b43700 con 0x5627c3b3b5e0 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b43b80 con 0x5627c3b3fa90 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b43fa0 con 0x5627c3b44af0 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 zone default found 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 4 Realm: () 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:20.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 zonegroup default 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b47950 con 0x7fe0cc116060 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b49b80 con 0x5627c3b44af0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b49f20 con 0x5627c3b44af0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 started sync module instance, tier type = 2024-09-13T06:30:20.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.587+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b48fc0 con 0x5627c3b3fa90 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.591+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.591+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728787105008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b48fc0 con 0x5627c3b3fa90 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.591+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4a8e0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.591+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.591+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728787108912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4b130 con 0x5627c3b3b5e0 2024-09-13T06:30:20.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.591+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4bb30 con 0x5627c3b3fa90 2024-09-13T06:30:20.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728787108912] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728787105008] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728787102480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4ac80 con 0x5627c3b3fa90 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4c3d0 con 0x7fe0cc116060 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728787115808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4ac80 con 0x7fe0cc116060 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4ce90 con 0x5627c3b3fa90 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728787102480] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.595+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728787115808] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728787116864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4ce50 con 0x5627c3b3fa90 2024-09-13T06:30:20.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4d280 con 0x5627c3b44af0 2024-09-13T06:30:20.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728787113536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4db20 con 0x5627c3b44af0 2024-09-13T06:30:20.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4e4e0 con 0x5627c3b44af0 2024-09-13T06:30:20.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728787116864] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728787113536] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728787124272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4e8d0 con 0x5627c3b44af0 2024-09-13T06:30:20.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4f120 con 0x7fe0cc116060 2024-09-13T06:30:20.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.599+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728787124272] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728787126480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4f540 con 0x7fe0cc116060 2024-09-13T06:30:20.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=0 2024-09-13T06:30:20.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=1 2024-09-13T06:30:20.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=2 2024-09-13T06:30:20.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=3 2024-09-13T06:30:20.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=4 2024-09-13T06:30:20.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=5 2024-09-13T06:30:20.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=6 2024-09-13T06:30:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728787126480] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 20 add_watcher() i=7 2024-09-13T06:30:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b525a0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728787128080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4f960 con 0x5627c3b3b5e0 2024-09-13T06:30:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728787128080] v33'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.603+0000 7fdf8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 5 note: GC not initialized 2024-09-13T06:30:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fdf8e7e4640 20 reqs_thread_entry: start 2024-09-13T06:30:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 20 Filter name: none 2024-09-13T06:30:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fdefffff640 20 reqs_thread_entry: start 2024-09-13T06:30:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b757b0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:30:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b76d00 con 0x5627c3b44af0 2024-09-13T06:30:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fdf8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.607+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728787128080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b751d0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94728787128080] v33'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728787105008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4eee0 con 0x5627c3b3fa90 2024-09-13T06:30:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94728787105008] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0db8e9980 20 remove_watcher() i=0 2024-09-13T06:30:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0db8e9980 2 removed watcher, disabling cache 2024-09-13T06:30:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728787108912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b494f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94728787108912] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x5627c3b3b5e0 2024-09-13T06:30:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0db8e9980 20 remove_watcher() i=1 2024-09-13T06:30:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.611+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728787102480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b494f0 con 0x5627c3b3fa90 2024-09-13T06:30:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.615+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94728787102480] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.615+0000 7fe0db8e9980 20 remove_watcher() i=2 2024-09-13T06:30:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.615+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728787115808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b494f0 con 0x7fe0cc116060 2024-09-13T06:30:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.615+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94728787115808] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.615+0000 7fe0db8e9980 20 remove_watcher() i=3 2024-09-13T06:30:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.615+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728787116864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b4bf20 con 0x5627c3b3fa90 2024-09-13T06:30:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0d93f9640 1 -- 172.21.15.169:0/2380014858 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94728787116864] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc113030 con 0x5627c3b3fa90 2024-09-13T06:30:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0db8e9980 20 remove_watcher() i=4 2024-09-13T06:30:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728787113536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b48b10 con 0x5627c3b44af0 2024-09-13T06:30:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94728787113536] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0db8e9980 20 remove_watcher() i=5 2024-09-13T06:30:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728787124272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b48b10 con 0x5627c3b44af0 2024-09-13T06:30:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0d8bf8640 1 -- 172.21.15.169:0/2380014858 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94728787124272] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d000f070 con 0x5627c3b44af0 2024-09-13T06:30:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0db8e9980 20 remove_watcher() i=6 2024-09-13T06:30:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.619+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728787126480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5627c3b48b10 con 0x7fe0cc116060 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94728787126480] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d40083f0 con 0x7fe0cc116060 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 20 remove_watcher() i=7 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b3fa90 msgr2=0x5627c3b41e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b3fa90 0x5627c3b41e80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3b3b5e0 msgr2=0x5627c3b3daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3b3b5e0 0x5627c3b3daa0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe0cc116060 msgr2=0x7fe0cc0ed410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe0cc116060 0x7fe0cc0ed410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b44af0 msgr2=0x5627c3b46ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b44af0 0x5627c3b46ee0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfa4034650 msgr2=0x7fdfa4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfa4034650 0x7fdfa4036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5627c3b03430 tx=0x7fe0d0010000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 msgr2=0x5627c3b30630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2380014858 reap_dead start 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b30630 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0d7810 tx=0x7fe0cc002150 comp rx=0 tx=0).stop 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 shutdown_connections 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2380014858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b294a0 0x5627c3b30630 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 >> 172.21.15.169:0/2380014858 conn(0x5627c3b25880 msgr2=0x5627c3b23950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 shutdown_connections 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2380014858 wait complete. 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfb0034600 msgr2=0x7fdfb0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfb0034600 0x7fdfb0036ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0006340 tx=0x7fe0d000f000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 msgr2=0x5627c3b1cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 0x5627c3b1cfd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0e3c80 tx=0x7fe0cc0cc450 comp rx=0 tx=0).stop 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 shutdown_connections 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfb0034600 0x7fdfb0036ac0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2781962630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3b1cbb0 0x5627c3b1cfd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 >> 172.21.15.169:0/2781962630 conn(0x5627c3b11cb0 msgr2=0x5627c3b14780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 shutdown_connections 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2781962630 wait complete. 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b07250 msgr2=0x5627c3b09640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5627c3b07250 0x5627c3b09640 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3a0d240 msgr2=0x5627c3b05df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5627c3a0d240 0x5627c3b05df0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b0c8d0 msgr2=0x5627c3b0ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5627c3b0c8d0 0x5627c3b0ecc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfc0034650 msgr2=0x7fdfc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdfc0034650 0x7fdfc0036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0001650 tx=0x7fe0d0006740 comp rx=0 tx=0).stop 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 msgr2=0x5627c3afee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 --2- 172.21.15.169:0/2441131197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627c3a0c8f0 0x5627c3afee40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0030b0 tx=0x7fe0cc018020 comp rx=0 tx=0).stop 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0d9bfa640 1 -- 172.21.15.169:0/2441131197 reap_dead start 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 shutdown_connections 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 >> 172.21.15.169:0/2441131197 conn(0x5627c3980240 msgr2=0x5627c3af23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 shutdown_connections 2024-09-13T06:30:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.623+0000 7fe0db8e9980 1 -- 172.21.15.169:0/2441131197 wait complete. 2024-09-13T06:30:20.633 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T06:30:20.634 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T06:30:20.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T06:30:20.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T06:30:20.634 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T06:30:20.707 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:20.707 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aef10a980 1 Processor -- start 2024-09-13T06:30:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aef10a980 1 -- start start 2024-09-13T06:30:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aef10a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f350b57c70 0x55f350b5a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aef10a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3509d9ae0 con 0x55f350b538f0 2024-09-13T06:30:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aef10a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55f3509fde30 con 0x55f350b57c70 2024-09-13T06:30:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5ae7fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f350b57c70 0x55f350b5a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aecc1a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55f350b538f0 0x55f350b53cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57488/0 (socket says 172.21.15.169:57488) 2024-09-13T06:30:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5aecc1a640 1 -- 172.21.15.169:0/3988275329 learned_addr learned my addr 172.21.15.169:0/3988275329 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5ae7fff640 1 -- 172.21.15.169:0/3988275329 >> v1:172.21.15.112:6789/0 conn(0x55f350b538f0 legacy=0x55f350b53cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.707+0000 7f5ae7fff640 1 -- 172.21.15.169:0/3988275329 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350b5b5b0 con 0x55f350b57c70 2024-09-13T06:30:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/3988275329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b57c70 0x55f350b5a060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800a480 tx=0x7f5ad801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a55744e776517c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5ae77fe640 1 -- 172.21.15.169:0/3988275329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad80b0070 con 0x55f350b57c70 2024-09-13T06:30:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5ae77fe640 1 -- 172.21.15.169:0/3988275329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad80ab540 con 0x55f350b57c70 2024-09-13T06:30:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5ae77fe640 1 -- 172.21.15.169:0/3988275329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad80ab840 con 0x55f350b57c70 2024-09-13T06:30:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 -- 172.21.15.169:0/3988275329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b57c70 msgr2=0x55f350b5a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 --2- 172.21.15.169:0/3988275329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b57c70 0x55f350b5a060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800a480 tx=0x7f5ad801b280 comp rx=0 tx=0).stop 2024-09-13T06:30:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 -- 172.21.15.169:0/3988275329 shutdown_connections 2024-09-13T06:30:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 --2- 172.21.15.169:0/3988275329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b57c70 0x55f350b5a060 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 -- 172.21.15.169:0/3988275329 >> 172.21.15.169:0/3988275329 conn(0x55f350ac7240 msgr2=0x55f350ac7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 -- 172.21.15.169:0/3988275329 shutdown_connections 2024-09-13T06:30:20.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.711+0000 7f5aef10a980 1 -- 172.21.15.169:0/3988275329 wait complete. 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aef10a980 1 Processor -- start 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aef10a980 1 -- start start 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aef10a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c3ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aef10a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f3509ff200 con 0x55f350b538f0 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c3ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c3ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39082/0 (socket says 172.21.15.169:39082) 2024-09-13T06:30:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2038232261 learned_addr learned my addr 172.21.15.169:0/2038232261 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2038232261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350c3f260 con 0x55f350b538f0 2024-09-13T06:30:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/2038232261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c3ec90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0001d90 tx=0x7f5ae0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87447df526431e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f59dae05640 1 -- 172.21.15.169:0/2038232261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0013030 con 0x55f350b538f0 2024-09-13T06:30:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f59dae05640 1 -- 172.21.15.169:0/2038232261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae000e690 con 0x55f350b538f0 2024-09-13T06:30:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.727+0000 7f59dae05640 1 -- 172.21.15.169:0/2038232261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae000ea10 con 0x55f350b538f0 2024-09-13T06:30:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2038232261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 msgr2=0x55f350c3ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2038232261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c3ec90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0001d90 tx=0x7f5ae0001e80 comp rx=0 tx=0).stop 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2038232261 shutdown_connections 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2038232261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c3ec90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2038232261 >> 172.21.15.169:0/2038232261 conn(0x55f350ac7240 msgr2=0x55f350c3a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2038232261 shutdown_connections 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2038232261 wait complete. 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 Processor -- start 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- start start 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c46000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f350b5b0b0 con 0x55f350b538f0 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c46000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39084/0 (socket says 172.21.15.169:39084) 2024-09-13T06:30:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2178407621 learned_addr learned my addr 172.21.15.169:0/2178407621 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350c46540 con 0x55f350b538f0 2024-09-13T06:30:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c46000 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55f350c3fe70 tx=0x7f5ae0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f59d9602640 1 -- 172.21.15.169:0/2178407621 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0027070 con 0x55f350b538f0 2024-09-13T06:30:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f350c467d0 con 0x55f350b538f0 2024-09-13T06:30:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f59d9602640 1 -- 172.21.15.169:0/2178407621 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0019900 con 0x55f350b538f0 2024-09-13T06:30:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f350c494b0 con 0x55f350b538f0 2024-09-13T06:30:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f59d9602640 1 -- 172.21.15.169:0/2178407621 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0019be0 con 0x55f350b538f0 2024-09-13T06:30:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f59d9602640 1 -- 172.21.15.169:0/2178407621 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5ae002a070 con 0x55f350b538f0 2024-09-13T06:30:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f59d9602640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59d40346a0 0x7f59d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f59d9602640 1 -- 172.21.15.169:0/2178407621 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f5ae001f070 con 0x55f350b538f0 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59d40346a0 0x7f59d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350b57c70 0x55f350c4cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.731+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c4d630 con 0x55f350b57c70 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aed41b640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350b57c70 0x55f350c4cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59d40346a0 0x7f59d4036b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80ad000 tx=0x7f5ad80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aed41b640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350b57c70 0x55f350c4cff0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aed41b640 1 -- 172.21.15.169:0/2178407621 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350b57c70 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c4e420 0x55f350c50810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c50e40 con 0x55f350c4e420 2024-09-13T06:30:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c4e420 0x55f350c50810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c4e420 0x55f350c50810 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2178407621 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ae0029030 con 0x55f350c4e420 2024-09-13T06:30:20.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c526f0 con 0x55f350c4e420 2024-09-13T06:30:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2178407621 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ae0029030 con 0x55f350c4e420 2024-09-13T06:30:20.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c51920 con 0x55f350c4e420 2024-09-13T06:30:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.735+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2178407621 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ae0029030 con 0x55f350c4e420 2024-09-13T06:30:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c53aa0 0x55f350c55e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c563d0 con 0x55f350c53aa0 2024-09-13T06:30:20.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c53aa0 0x55f350c55e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c53aa0 0x55f350c55e90 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5ae7fff640 1 -- 172.21.15.169:0/2178407621 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ad80b3040 con 0x55f350c53aa0 2024-09-13T06:30:20.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 Processor -- start 2024-09-13T06:30:20.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 -- start start 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 0x55f350c64210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f350a58800 con 0x55f350c63df0 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 0x55f350c64210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 0x55f350c64210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39088/0 (socket says 172.21.15.169:39088) 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aecc1a640 1 -- 172.21.15.169:0/3778167454 learned_addr learned my addr 172.21.15.169:0/3778167454 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aecc1a640 1 -- 172.21.15.169:0/3778167454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350c64750 con 0x55f350c63df0 2024-09-13T06:30:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 0x55f350c64210 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0019640 tx=0x7f5ae002aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f59d27fc640 1 -- 172.21.15.169:0/3778167454 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae002be30 con 0x55f350c63df0 2024-09-13T06:30:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f59d27fc640 1 -- 172.21.15.169:0/3778167454 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0045040 con 0x55f350c63df0 2024-09-13T06:30:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f350c649e0 con 0x55f350c63df0 2024-09-13T06:30:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f59d27fc640 1 -- 172.21.15.169:0/3778167454 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae002b3b0 con 0x55f350c63df0 2024-09-13T06:30:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.739+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f350c67660 con 0x55f350c63df0 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f59d27fc640 1 -- 172.21.15.169:0/3778167454 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5ae0016070 con 0x55f350c63df0 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f59d27fc640 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59c4034650 0x7f59c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f59d27fc640 1 -- 172.21.15.169:0/3778167454 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f5ae003f040 con 0x55f350c63df0 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59c4034650 0x7f59c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 Processor -- start 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- start start 2024-09-13T06:30:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59c4034650 0x7f59c4036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55f350c4a5f0 tx=0x7f5ad8005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c70aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f350c3f5e0 con 0x55f350c706c0 2024-09-13T06:30:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c70aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c70aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39104/0 (socket says 172.21.15.169:39104) 2024-09-13T06:30:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2404413786 learned_addr learned my addr 172.21.15.169:0/2404413786 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 -- 172.21.15.169:0/2404413786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350c71070 con 0x55f350c706c0 2024-09-13T06:30:20.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/2404413786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c70aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0025040 tx=0x7f5ae0053b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e4ac907a692ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f59c3fff640 1 -- 172.21.15.169:0/2404413786 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae004d140 con 0x55f350c706c0 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f59c3fff640 1 -- 172.21.15.169:0/2404413786 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0016b20 con 0x55f350c706c0 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f59c3fff640 1 -- 172.21.15.169:0/2404413786 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0056ce0 con 0x55f350c706c0 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- 172.21.15.169:0/2404413786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 msgr2=0x55f350c70aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2404413786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c70aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0025040 tx=0x7f5ae0053b70 comp rx=0 tx=0).stop 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- 172.21.15.169:0/2404413786 shutdown_connections 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2404413786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c70aa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- 172.21.15.169:0/2404413786 >> 172.21.15.169:0/2404413786 conn(0x55f350c6caa0 msgr2=0x55f350c6aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- 172.21.15.169:0/2404413786 shutdown_connections 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- 172.21.15.169:0/2404413786 wait complete. 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 Processor -- start 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- start start 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c77840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aef10a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f350c71510 con 0x55f350c706c0 2024-09-13T06:30:20.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c77840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c77840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39116/0 (socket says 172.21.15.169:39116) 2024-09-13T06:30:20.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.743+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 learned_addr learned my addr 172.21.15.169:0/1894585592 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350c77d80 con 0x55f350c706c0 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c77840 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0052540 tx=0x7f5ae002cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f59c27fc640 1 -- 172.21.15.169:0/1894585592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae002b950 con 0x55f350c706c0 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f59c27fc640 1 -- 172.21.15.169:0/1894585592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae002b570 con 0x55f350c706c0 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f350c77d80 con 0x55f350c706c0 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f59c27fc640 1 -- 172.21.15.169:0/1894585592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae002baf0 con 0x55f350c706c0 2024-09-13T06:30:20.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f350c77d80 con 0x55f350c706c0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f59c27fc640 1 -- 172.21.15.169:0/1894585592 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5ae007a060 con 0x55f350c706c0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f59c27fc640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59b8034600 0x7f59b8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f59c27fc640 1 -- 172.21.15.169:0/1894585592 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f5ae0014070 con 0x55f350c706c0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59b8034600 0x7f59b8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350c82810 0x55f350c84cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c85420 con 0x55f350c82810 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aed41b640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350c82810 0x55f350c84cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59b8034600 0x7f59b8036ac0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8018eb0 tx=0x7f5ad80b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aed41b640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350c82810 0x55f350c84cd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 realm 2024-09-13T06:30:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c81cc0 con 0x55f350c82810 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c85ee0 con 0x55f350c82810 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c86cc0 0x55f350c890b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.747+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89710 con 0x55f350c86cc0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c86cc0 0x55f350c890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c86cc0 0x55f350c890b0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 20 searching for the correct realm 2024-09-13T06:30:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c8bd20 0x55f350c8e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8e6f0 con 0x55f350c8bd20 2024-09-13T06:30:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c8bd20 0x55f350c8e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5ae7fff640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c8bd20 0x55f350c8e110 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8e6f0 con 0x55f350c86cc0 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5ae007c070 0x7f5ae00488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.751+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x7f5ae007c070 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5ae007c070 0x7f5ae00488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5ae007c070 0x7f5ae00488d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c8bd20 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x7f5ae007c070 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x7f5ae007c070 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.755+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c8bd20 2024-09-13T06:30:20.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c8bd20 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c8bd20 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x7f5ae007c070 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c82810 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x7f5ae007c070 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c8bd20 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x7f5ae007c070 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.759+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c8bd20 2024-09-13T06:30:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f350c89fb0 con 0x55f350c86cc0 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8a800 con 0x55f350c82810 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8abf0 con 0x55f350c86cc0 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8abf0 con 0x55f350c8bd20 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 zone default found 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 4 Realm: () 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 zonegroup default 2024-09-13T06:30:20.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.763+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8eb70 con 0x7f5ae007c070 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c908f0 con 0x55f350c8bd20 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c90c90 con 0x55f350c8bd20 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 started sync module instance, tier type = 2024-09-13T06:30:20.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8fd90 con 0x55f350c86cc0 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94503520764528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c8fd90 con 0x55f350c86cc0 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91650 con 0x55f350c82810 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94503520768416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91ef0 con 0x55f350c82810 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.767+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c928b0 con 0x55f350c86cc0 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94503520764528] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94503520768416] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94503520770624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c928b0 con 0x55f350c86cc0 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91e60 con 0x7f5ae007c070 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94503520775376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c928b0 con 0x7f5ae007c070 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c93c00 con 0x55f350c86cc0 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.771+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94503520775376] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94503520770624] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94503520776432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c92400 con 0x55f350c86cc0 2024-09-13T06:30:20.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c944a0 con 0x55f350c8bd20 2024-09-13T06:30:20.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94503520780272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c92400 con 0x55f350c8bd20 2024-09-13T06:30:20.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c95310 con 0x55f350c8bd20 2024-09-13T06:30:20.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94503520776432] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94503520780272] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94503520778000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c95310 con 0x55f350c8bd20 2024-09-13T06:30:20.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.775+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c95b60 con 0x7f5ae007c070 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94503520785648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c95f90 con 0x7f5ae007c070 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=0 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=1 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=2 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=3 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=4 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=5 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94503520778000] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=6 2024-09-13T06:30:20.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94503520785648] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 20 add_watcher() i=7 2024-09-13T06:30:20.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:20.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350c94e60 con 0x55f350c82810 2024-09-13T06:30:20.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.779+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94503520783968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c96540 con 0x55f350c82810 2024-09-13T06:30:20.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94503520783968] v33'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f59a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:20.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 5 note: GC not initialized 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f59a1fe3640 20 reqs_thread_entry: start 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 20 Filter name: none 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f59137fe640 20 reqs_thread_entry: start 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350cbc220 con 0x55f350c82810 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f350cbd770 con 0x55f350c8bd20 2024-09-13T06:30:20.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f59a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.783+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94503520783968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350cba980 con 0x55f350c82810 2024-09-13T06:30:20.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94503520783968] v33'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94503520764528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c94e60 con 0x55f350c86cc0 2024-09-13T06:30:20.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94503520764528] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aef10a980 20 remove_watcher() i=0 2024-09-13T06:30:20.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aef10a980 2 removed watcher, disabling cache 2024-09-13T06:30:20.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94503520768416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c90270 con 0x55f350c82810 2024-09-13T06:30:20.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94503520768416] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x55f350c82810 2024-09-13T06:30:20.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aef10a980 20 remove_watcher() i=1 2024-09-13T06:30:20.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.787+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94503520770624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c94e60 con 0x55f350c86cc0 2024-09-13T06:30:20.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.791+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94503520770624] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.791+0000 7f5aef10a980 20 remove_watcher() i=2 2024-09-13T06:30:20.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.791+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94503520775376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91a40 con 0x7f5ae007c070 2024-09-13T06:30:20.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.791+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94503520775376] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.791+0000 7f5aef10a980 20 remove_watcher() i=3 2024-09-13T06:30:20.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.791+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94503520776432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91a40 con 0x55f350c86cc0 2024-09-13T06:30:20.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aecc1a640 1 -- 172.21.15.169:0/1894585592 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94503520776432] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae007cd70 con 0x55f350c86cc0 2024-09-13T06:30:20.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 20 remove_watcher() i=4 2024-09-13T06:30:20.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94503520780272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91a40 con 0x55f350c8bd20 2024-09-13T06:30:20.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94503520780272] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 20 remove_watcher() i=5 2024-09-13T06:30:20.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94503520778000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c91a40 con 0x55f350c8bd20 2024-09-13T06:30:20.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5ae7fff640 1 -- 172.21.15.169:0/1894585592 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94503520778000] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad80c9030 con 0x55f350c8bd20 2024-09-13T06:30:20.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 20 remove_watcher() i=6 2024-09-13T06:30:20.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94503520785648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f350c93710 con 0x7f5ae007c070 2024-09-13T06:30:20.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94503520785648] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae800a4d0 con 0x7f5ae007c070 2024-09-13T06:30:20.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 20 remove_watcher() i=7 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c86cc0 msgr2=0x55f350c890b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c86cc0 0x55f350c890b0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350c82810 msgr2=0x55f350c84cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350c82810 0x55f350c84cd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5ae007c070 msgr2=0x7f5ae00488d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5ae007c070 0x7f5ae00488d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c8bd20 msgr2=0x55f350c8e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.795+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c8bd20 0x55f350c8e110 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59b8034600 msgr2=0x7f59b8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59b8034600 0x7f59b8036ac0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8018eb0 tx=0x7f5ad80b9040 comp rx=0 tx=0).stop 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 msgr2=0x55f350c77840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aed41b640 1 -- 172.21.15.169:0/1894585592 reap_dead start 2024-09-13T06:30:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c77840 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0052540 tx=0x7f5ae002cc80 comp rx=0 tx=0).stop 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 shutdown_connections 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/1894585592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c706c0 0x55f350c77840 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 >> 172.21.15.169:0/1894585592 conn(0x55f350c6caa0 msgr2=0x55f350c6ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 shutdown_connections 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/1894585592 wait complete. 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59c4034650 msgr2=0x7f59c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59c4034650 0x7f59c4036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55f350c4a5f0 tx=0x7f5ad8005a10 comp rx=0 tx=0).stop 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 msgr2=0x55f350c64210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 0x55f350c64210 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0019640 tx=0x7f5ae002aab0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 shutdown_connections 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59c4034650 0x7f59c4036b10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/3778167454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350c63df0 0x55f350c64210 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 >> 172.21.15.169:0/3778167454 conn(0x55f350c58f40 msgr2=0x55f350c5b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 shutdown_connections 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/3778167454 wait complete. 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c4e420 msgr2=0x55f350c50810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f350c4e420 0x55f350c50810 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350b57c70 msgr2=0x55f350c4cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f350b57c70 0x55f350c4cff0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c53aa0 msgr2=0x55f350c55e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f350c53aa0 0x55f350c55e90 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59d40346a0 msgr2=0x7f59d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f59d40346a0 0x7f59d4036b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80ad000 tx=0x7f5ad80a5040 comp rx=0 tx=0).stop 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 msgr2=0x55f350c46000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 --2- 172.21.15.169:0/2178407621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f350b538f0 0x55f350c46000 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55f350c3fe70 tx=0x7f5ae0000bd0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aed41b640 1 -- 172.21.15.169:0/2178407621 reap_dead start 2024-09-13T06:30:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 shutdown_connections 2024-09-13T06:30:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 >> 172.21.15.169:0/2178407621 conn(0x55f350ac7240 msgr2=0x55f350c39440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 shutdown_connections 2024-09-13T06:30:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.799+0000 7f5aef10a980 1 -- 172.21.15.169:0/2178407621 wait complete. 2024-09-13T06:30:20.809 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T06:30:20.810 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T06:30:20.810 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T06:30:20.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T06:30:20.810 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T06:30:20.886 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:20.886 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:20.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a8cf6980 1 Processor -- start 2024-09-13T06:30:20.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a8cf6980 1 -- start start 2024-09-13T06:30:20.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a8cf6980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x56290e833880 0x56290e835ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a8cf6980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56290e6b9ae0 con 0x56290e7a62e0 2024-09-13T06:30:20.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a8cf6980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x56290e6dde30 con 0x56290e833880 2024-09-13T06:30:20.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a6005640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x56290e833880 0x56290e835ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a6806640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x56290e7a62e0 0x56290e832160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57502/0 (socket says 172.21.15.169:57502) 2024-09-13T06:30:20.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a6806640 1 -- 172.21.15.169:0/1082471440 learned_addr learned my addr 172.21.15.169:0/1082471440 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:20.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a6005640 1 -- 172.21.15.169:0/1082471440 >> v1:172.21.15.112:6789/0 conn(0x56290e7a62e0 legacy=0x56290e832160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a6005640 1 -- 172.21.15.169:0/1082471440 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e8361e0 con 0x56290e833880 2024-09-13T06:30:20.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.887+0000 7fb2a6005640 1 --2- 172.21.15.169:0/1082471440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e833880 0x56290e835ca0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00a480 tx=0x7fb29c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba84e9916df3c512 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a5804640 1 -- 172.21.15.169:0/1082471440 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29c0af070 con 0x56290e833880 2024-09-13T06:30:20.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a5804640 1 -- 172.21.15.169:0/1082471440 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0a3e50 con 0x56290e833880 2024-09-13T06:30:20.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a5804640 1 -- 172.21.15.169:0/1082471440 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29c0aa680 con 0x56290e833880 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1082471440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e833880 msgr2=0x56290e835ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/1082471440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e833880 0x56290e835ca0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00a480 tx=0x7fb29c01b280 comp rx=0 tx=0).stop 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1082471440 shutdown_connections 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/1082471440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e833880 0x56290e835ca0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1082471440 >> 172.21.15.169:0/1082471440 conn(0x56290e82c0a0 msgr2=0x56290e82e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1082471440 shutdown_connections 2024-09-13T06:30:20.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.891+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1082471440 wait complete. 2024-09-13T06:30:20.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a8cf6980 1 Processor -- start 2024-09-13T06:30:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a8cf6980 1 -- start start 2024-09-13T06:30:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a8cf6980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e923450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a8cf6980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56290e6df200 con 0x56290e7a62e0 2024-09-13T06:30:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e923450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e923450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39146/0 (socket says 172.21.15.169:39146) 2024-09-13T06:30:20.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a6806640 1 -- 172.21.15.169:0/2434399186 learned_addr learned my addr 172.21.15.169:0/2434399186 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a6806640 1 -- 172.21.15.169:0/2434399186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e923a20 con 0x56290e7a62e0 2024-09-13T06:30:20.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb2a6806640 1 --2- 172.21.15.169:0/2434399186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e923450 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb298001d90 tx=0x7fb298001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1fa3e93c075487 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb194e09640 1 -- 172.21.15.169:0/2434399186 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298013030 con 0x56290e7a62e0 2024-09-13T06:30:20.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb194e09640 1 -- 172.21.15.169:0/2434399186 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29800e690 con 0x56290e7a62e0 2024-09-13T06:30:20.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.903+0000 7fb194e09640 1 -- 172.21.15.169:0/2434399186 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29800ea10 con 0x56290e7a62e0 2024-09-13T06:30:20.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2434399186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 msgr2=0x56290e923450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2434399186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e923450 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb298001d90 tx=0x7fb298001e80 comp rx=0 tx=0).stop 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2434399186 shutdown_connections 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2434399186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e923450 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2434399186 >> 172.21.15.169:0/2434399186 conn(0x56290e82c0a0 msgr2=0x56290e91f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2434399186 shutdown_connections 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2434399186 wait complete. 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 Processor -- start 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- start start 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e92a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56290e841a10 con 0x56290e7a62e0 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e92a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e92a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39148/0 (socket says 172.21.15.169:39148) 2024-09-13T06:30:20.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a6806640 1 -- 172.21.15.169:0/2050367550 learned_addr learned my addr 172.21.15.169:0/2050367550 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a6806640 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e92ad00 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a6806640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e92a7c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x56290e924630 tx=0x7fb298000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb193606640 1 -- 172.21.15.169:0/2050367550 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298027070 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb193606640 1 -- 172.21.15.169:0/2050367550 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298019900 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56290e92af90 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb193606640 1 -- 172.21.15.169:0/2050367550 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298019c20 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.907+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290e92dc70 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb193606640 1 -- 172.21.15.169:0/2050367550 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb29802a070 con 0x56290e7a62e0 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb193606640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb18c034650 0x7fb18c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb193606640 1 -- 172.21.15.169:0/2050367550 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb29801f070 con 0x56290e7a62e0 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a6005640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb18c034650 0x7fb18c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e833880 0x56290e9317b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e931df0 con 0x56290e833880 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a7007640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e833880 0x56290e9317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a6005640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb18c034650 0x7fb18c036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0ac000 tx=0x7fb29c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a7007640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e833880 0x56290e9317b0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a7007640 1 -- 172.21.15.169:0/2050367550 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e833880 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e932bc0 0x56290e934fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e9355f0 con 0x56290e932bc0 2024-09-13T06:30:20.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a6806640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e932bc0 0x56290e934fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a6806640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e932bc0 0x56290e934fb0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a6806640 1 -- 172.21.15.169:0/2050367550 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb298029030 con 0x56290e932bc0 2024-09-13T06:30:20.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e936ea0 con 0x56290e932bc0 2024-09-13T06:30:20.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a6806640 1 -- 172.21.15.169:0/2050367550 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb298029030 con 0x56290e932bc0 2024-09-13T06:30:20.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.911+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e936010 con 0x56290e932bc0 2024-09-13T06:30:20.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6806640 1 -- 172.21.15.169:0/2050367550 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb298029030 con 0x56290e932bc0 2024-09-13T06:30:20.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e938250 0x56290e93a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e93ab80 con 0x56290e938250 2024-09-13T06:30:20.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6005640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e938250 0x56290e93a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6005640 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e938250 0x56290e93a640 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6005640 1 -- 172.21.15.169:0/2050367550 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb29c0b2040 con 0x56290e938250 2024-09-13T06:30:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 Processor -- start 2024-09-13T06:30:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 -- start start 2024-09-13T06:30:20.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 0x56290e948990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56290e738800 con 0x56290e948570 2024-09-13T06:30:20.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 0x56290e948990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 0x56290e948990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39150/0 (socket says 172.21.15.169:39150) 2024-09-13T06:30:20.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6806640 1 -- 172.21.15.169:0/2073149308 learned_addr learned my addr 172.21.15.169:0/2073149308 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6806640 1 -- 172.21.15.169:0/2073149308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e948ed0 con 0x56290e948570 2024-09-13T06:30:20.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a6806640 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 0x56290e948990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb298016fd0 tx=0x7fb29800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb190e01640 1 -- 172.21.15.169:0/2073149308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298032b30 con 0x56290e948570 2024-09-13T06:30:20.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb190e01640 1 -- 172.21.15.169:0/2073149308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298032cd0 con 0x56290e948570 2024-09-13T06:30:20.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56290e949160 con 0x56290e948570 2024-09-13T06:30:20.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb190e01640 1 -- 172.21.15.169:0/2073149308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298041170 con 0x56290e948570 2024-09-13T06:30:20.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.915+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290e94bde0 con 0x56290e948570 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb190e01640 1 -- 172.21.15.169:0/2073149308 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb298016070 con 0x56290e948570 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb190e01640 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb180034650 0x7fb180036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb190e01640 1 -- 172.21.15.169:0/2073149308 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb298014070 con 0x56290e948570 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6005640 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb180034650 0x7fb180036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 Processor -- start 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- start start 2024-09-13T06:30:20.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6005640 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb180034650 0x7fb180036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56290e92edb0 tx=0x7fb29c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e955320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56290e923da0 con 0x56290e954f20 2024-09-13T06:30:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e955320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e955320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39158/0 (socket says 172.21.15.169:39158) 2024-09-13T06:30:20.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6806640 1 -- 172.21.15.169:0/1112593313 learned_addr learned my addr 172.21.15.169:0/1112593313 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6806640 1 -- 172.21.15.169:0/1112593313 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e9558f0 con 0x56290e954f20 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a6806640 1 --2- 172.21.15.169:0/1112593313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e955320 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb298019640 tx=0x7fb298022530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbacd9c5b36b1987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb18a7fc640 1 -- 172.21.15.169:0/1112593313 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298064070 con 0x56290e954f20 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb18a7fc640 1 -- 172.21.15.169:0/1112593313 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298036e60 con 0x56290e954f20 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb18a7fc640 1 -- 172.21.15.169:0/1112593313 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29805b040 con 0x56290e954f20 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1112593313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 msgr2=0x56290e955320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/1112593313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e955320 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb298019640 tx=0x7fb298022530 comp rx=0 tx=0).stop 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1112593313 shutdown_connections 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/1112593313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e955320 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1112593313 >> 172.21.15.169:0/1112593313 conn(0x56290e951250 msgr2=0x56290e94f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1112593313 shutdown_connections 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/1112593313 wait complete. 2024-09-13T06:30:20.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 Processor -- start 2024-09-13T06:30:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- start start 2024-09-13T06:30:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e95c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.919+0000 7fb2a8cf6980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56290e955de0 con 0x56290e954f20 2024-09-13T06:30:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e95c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e95c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39160/0 (socket says 172.21.15.169:39160) 2024-09-13T06:30:20.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 learned_addr learned my addr 172.21.15.169:0/446188096 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290e95c610 con 0x56290e954f20 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6806640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e95c0d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb2980225d0 tx=0x7fb298034200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb188ff9640 1 -- 172.21.15.169:0/446188096 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298064070 con 0x56290e954f20 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56290e95c610 con 0x56290e954f20 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb188ff9640 1 -- 172.21.15.169:0/446188096 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298065040 con 0x56290e954f20 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb188ff9640 1 -- 172.21.15.169:0/446188096 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb298041550 con 0x56290e954f20 2024-09-13T06:30:20.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290e95c610 con 0x56290e954f20 2024-09-13T06:30:20.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb188ff9640 1 -- 172.21.15.169:0/446188096 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb298070020 con 0x56290e954f20 2024-09-13T06:30:20.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb188ff9640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb170034650 0x7fb170036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb188ff9640 1 -- 172.21.15.169:0/446188096 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb29806e020 con 0x56290e954f20 2024-09-13T06:30:20.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6005640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb170034650 0x7fb170036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e967170 0x56290e969630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e969d80 con 0x56290e967170 2024-09-13T06:30:20.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a7007640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e967170 0x56290e969630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a6005640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb170034650 0x7fb170036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb29c01b2c0 tx=0x7fb29c0b8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a7007640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e967170 0x56290e969630 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 20 realm 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.923+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e966620 con 0x56290e967170 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e96a840 con 0x56290e967170 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e96b620 0x56290e96da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e96e070 con 0x56290e96b620 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6806640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e96b620 0x56290e96da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6806640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e96b620 0x56290e96da10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e96e460 con 0x56290e96b620 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 20 searching for the correct realm 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e96fe00 0x56290e9722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56290e972970 con 0x56290e96fe00 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6005640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e96fe00 0x56290e9722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6005640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e96fe00 0x56290e9722a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.927+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56290e972970 con 0x56290e96b620 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb29800c570 0x7fb2980372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x7fb29800c570 2024-09-13T06:30:20.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb29800c570 0x7fb2980372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb29800c570 0x7fb2980372e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96fe00 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x7fb29800c570 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.931+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x7fb29800c570 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96fe00 2024-09-13T06:30:20.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96fe00 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96fe00 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x7fb29800c570 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e967170 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.935+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x7fb29800c570 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96fe00 2024-09-13T06:30:20.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x7fb29800c570 2024-09-13T06:30:20.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96fe00 2024-09-13T06:30:20.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb298072070 con 0x56290e96b620 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e96e770 con 0x56290e967170 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.939+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e96eb60 con 0x56290e96b620 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e96eb60 con 0x56290e96fe00 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 zone default found 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 4 Realm: () 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 zonegroup default 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e972df0 con 0x7fb29800c570 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e974b70 con 0x56290e96fe00 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e974f10 con 0x56290e96fe00 2024-09-13T06:30:20.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:20.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 started sync module instance, tier type = 2024-09-13T06:30:20.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:20.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.943+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e974010 con 0x56290e96b620 2024-09-13T06:30:20.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94734338442512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e974010 con 0x56290e96b620 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e9758d0 con 0x56290e967170 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94734338446368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e976170 con 0x56290e967170 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e976b90 con 0x56290e96b620 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94734338442512] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94734338446368] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94734338451072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e975cc0 con 0x56290e96b620 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.947+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e977430 con 0x7fb29800c570 2024-09-13T06:30:20.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94734338453376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e975cc0 con 0x7fb29800c570 2024-09-13T06:30:20.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e977eb0 con 0x56290e96b620 2024-09-13T06:30:20.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94734338453376] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94734338451072] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94734338440032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e9779c0 con 0x56290e96b620 2024-09-13T06:30:20.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.951+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e978750 con 0x56290e96fe00 2024-09-13T06:30:20.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94734338458272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e9779c0 con 0x56290e96fe00 2024-09-13T06:30:20.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e9795c0 con 0x56290e96fe00 2024-09-13T06:30:20.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94734338440032] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94734338458272] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94734338454432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e9795c0 con 0x56290e96fe00 2024-09-13T06:30:20.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e979e10 con 0x7fb29800c570 2024-09-13T06:30:20.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94734338454432] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94734338462448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e979cc0 con 0x7fb29800c570 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=0 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=1 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=2 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=3 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=4 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=5 2024-09-13T06:30:20.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=6 2024-09-13T06:30:20.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94734338462448] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 20 add_watcher() i=7 2024-09-13T06:30:20.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:20.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.955+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e97d290 con 0x56290e967170 2024-09-13T06:30:20.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94734338463568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e97a6e0 con 0x56290e967170 2024-09-13T06:30:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94734338463568] v33'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb15d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 5 note: GC not initialized 2024-09-13T06:30:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb0d7fff640 20 reqs_thread_entry: start 2024-09-13T06:30:20.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:20.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 20 Filter name: none 2024-09-13T06:30:20.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb0d5ffb640 20 reqs_thread_entry: start 2024-09-13T06:30:20.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 20 rados->read ofs=0 len=0 2024-09-13T06:30:20.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e9a04b0 con 0x56290e967170 2024-09-13T06:30:20.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56290e9a1a00 con 0x56290e96fe00 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.959+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.963+0000 7fb15d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.963+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94734338463568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e99ec10 con 0x56290e967170 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.963+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94734338463568] v33'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.963+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94734338442512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e99e340 con 0x56290e96b620 2024-09-13T06:30:20.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94734338442512] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 20 remove_watcher() i=0 2024-09-13T06:30:20.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 2 removed watcher, disabling cache 2024-09-13T06:30:20.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94734338446368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e99e340 con 0x56290e967170 2024-09-13T06:30:20.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94734338446368] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x56290e967170 2024-09-13T06:30:20.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 20 remove_watcher() i=1 2024-09-13T06:30:20.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94734338451072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e99e340 con 0x56290e96b620 2024-09-13T06:30:20.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94734338451072] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 20 remove_watcher() i=2 2024-09-13T06:30:20.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.967+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94734338453376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e976680 con 0x7fb29800c570 2024-09-13T06:30:20.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94734338453376] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a8cf6980 20 remove_watcher() i=3 2024-09-13T06:30:20.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94734338440032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e99e340 con 0x56290e96b620 2024-09-13T06:30:20.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a6806640 1 -- 172.21.15.169:0/446188096 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94734338440032] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb298067070 con 0x56290e96b620 2024-09-13T06:30:20.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a8cf6980 20 remove_watcher() i=4 2024-09-13T06:30:20.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94734338458272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e976f80 con 0x56290e96fe00 2024-09-13T06:30:20.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94734338458272] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a8cf6980 20 remove_watcher() i=5 2024-09-13T06:30:20.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.971+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94734338454432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e973b60 con 0x56290e96fe00 2024-09-13T06:30:20.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a6005640 1 -- 172.21.15.169:0/446188096 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94734338454432] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb29c0d7070 con 0x56290e96fe00 2024-09-13T06:30:20.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 20 remove_watcher() i=6 2024-09-13T06:30:20.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94734338462448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56290e99e340 con 0x7fb29800c570 2024-09-13T06:30:20.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94734338462448] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a000a4d0 con 0x7fb29800c570 2024-09-13T06:30:20.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 20 remove_watcher() i=7 2024-09-13T06:30:20.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e96b620 msgr2=0x56290e96da10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e96b620 0x56290e96da10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e967170 msgr2=0x56290e969630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e967170 0x56290e969630 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb29800c570 msgr2=0x7fb2980372e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb29800c570 0x7fb2980372e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e96fe00 msgr2=0x56290e9722a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e96fe00 0x56290e9722a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb170034650 msgr2=0x7fb170036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb170034650 0x7fb170036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb29c01b2c0 tx=0x7fb29c0b8040 comp rx=0 tx=0).stop 2024-09-13T06:30:20.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 msgr2=0x56290e95c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a7007640 1 -- 172.21.15.169:0/446188096 reap_dead start 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e95c0d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb2980225d0 tx=0x7fb298034200 comp rx=0 tx=0).stop 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 shutdown_connections 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/446188096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e954f20 0x56290e95c0d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 >> 172.21.15.169:0/446188096 conn(0x56290e951250 msgr2=0x56290e94f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 shutdown_connections 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/446188096 wait complete. 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb180034650 msgr2=0x7fb180036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb180034650 0x7fb180036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56290e92edb0 tx=0x7fb29c005a10 comp rx=0 tx=0).stop 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 msgr2=0x56290e948990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 0x56290e948990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb298016fd0 tx=0x7fb29800d9e0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 shutdown_connections 2024-09-13T06:30:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb180034650 0x7fb180036b10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2073149308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e948570 0x56290e948990 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 >> 172.21.15.169:0/2073149308 conn(0x56290e93d6c0 msgr2=0x56290e940140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 shutdown_connections 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2073149308 wait complete. 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e932bc0 msgr2=0x56290e934fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x56290e932bc0 0x56290e934fb0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e833880 msgr2=0x56290e9317b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x56290e833880 0x56290e9317b0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e938250 msgr2=0x56290e93a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x56290e938250 0x56290e93a640 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb18c034650 msgr2=0x7fb18c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb18c034650 0x7fb18c036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0ac000 tx=0x7fb29c0a5000 comp rx=0 tx=0).stop 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 msgr2=0x56290e92a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 --2- 172.21.15.169:0/2050367550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56290e7a62e0 0x56290e92a7c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x56290e924630 tx=0x7fb298000bd0 comp rx=0 tx=0).stop 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a7007640 1 -- 172.21.15.169:0/2050367550 reap_dead start 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 shutdown_connections 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 >> 172.21.15.169:0/2050367550 conn(0x56290e82c0a0 msgr2=0x56290e91dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 shutdown_connections 2024-09-13T06:30:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:20.975+0000 7fb2a8cf6980 1 -- 172.21.15.169:0/2050367550 wait complete. 2024-09-13T06:30:20.986 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T06:30:20.987 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T06:30:20.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T06:30:20.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T06:30:20.987 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T06:30:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:21.068 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73447df980 1 Processor -- start 2024-09-13T06:30:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73447df980 1 -- start start 2024-09-13T06:30:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73447df980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b946a3b6d0 0x55b946a3bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73447df980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b9468c3ae0 con 0x55b946a3c020 2024-09-13T06:30:21.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73447df980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55b9468e7e30 con 0x55b946a3b6d0 2024-09-13T06:30:21.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73422ef640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b946a3b6d0 0x55b946a3bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f7341aee640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55b946a3c020 0x55b946a40a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57510/0 (socket says 172.21.15.169:57510) 2024-09-13T06:30:21.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f7341aee640 1 -- 172.21.15.169:0/432907055 learned_addr learned my addr 172.21.15.169:0/432907055 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:21.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73422ef640 1 -- 172.21.15.169:0/432907055 >> v1:172.21.15.112:6789/0 conn(0x55b946a3c020 legacy=0x55b946a40a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.067+0000 7f73422ef640 1 -- 172.21.15.169:0/432907055 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946a432a0 con 0x55b946a3b6d0 2024-09-13T06:30:21.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73422ef640 1 --2- 172.21.15.169:0/432907055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946a3bab0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f733800a480 tx=0x7f733801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd7a303f8c2989b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73412ed640 1 -- 172.21.15.169:0/432907055 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380b0070 con 0x55b946a3b6d0 2024-09-13T06:30:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73412ed640 1 -- 172.21.15.169:0/432907055 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380ab540 con 0x55b946a3b6d0 2024-09-13T06:30:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73412ed640 1 -- 172.21.15.169:0/432907055 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380ab840 con 0x55b946a3b6d0 2024-09-13T06:30:21.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 -- 172.21.15.169:0/432907055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 msgr2=0x55b946a3bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 --2- 172.21.15.169:0/432907055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946a3bab0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f733800a480 tx=0x7f733801b280 comp rx=0 tx=0).stop 2024-09-13T06:30:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 -- 172.21.15.169:0/432907055 shutdown_connections 2024-09-13T06:30:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 --2- 172.21.15.169:0/432907055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946a3bab0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 -- 172.21.15.169:0/432907055 >> 172.21.15.169:0/432907055 conn(0x55b946a371f0 msgr2=0x55b946a39610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 -- 172.21.15.169:0/432907055 shutdown_connections 2024-09-13T06:30:21.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.071+0000 7f73447df980 1 -- 172.21.15.169:0/432907055 wait complete. 2024-09-13T06:30:21.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 Processor -- start 2024-09-13T06:30:21.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- start start 2024-09-13T06:30:21.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b26b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b9468e9200 con 0x55b946a3b6d0 2024-09-13T06:30:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b26b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b26b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39186/0 (socket says 172.21.15.169:39186) 2024-09-13T06:30:21.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73422ef640 1 -- 172.21.15.169:0/622441007 learned_addr learned my addr 172.21.15.169:0/622441007 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73422ef640 1 -- 172.21.15.169:0/622441007 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946b27110 con 0x55b946a3b6d0 2024-09-13T06:30:21.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73422ef640 1 --2- 172.21.15.169:0/622441007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b26b40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f73380ae040 tx=0x7f7338003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78086067fbc2d96e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f7230608640 1 -- 172.21.15.169:0/622441007 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380b0040 con 0x55b946a3b6d0 2024-09-13T06:30:21.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f7230608640 1 -- 172.21.15.169:0/622441007 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380ab9b0 con 0x55b946a3b6d0 2024-09-13T06:30:21.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f7230608640 1 -- 172.21.15.169:0/622441007 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380abc90 con 0x55b946a3b6d0 2024-09-13T06:30:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- 172.21.15.169:0/622441007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 msgr2=0x55b946b26b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 --2- 172.21.15.169:0/622441007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b26b40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f73380ae040 tx=0x7f7338003030 comp rx=0 tx=0).stop 2024-09-13T06:30:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- 172.21.15.169:0/622441007 shutdown_connections 2024-09-13T06:30:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 --2- 172.21.15.169:0/622441007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b26b40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- 172.21.15.169:0/622441007 >> 172.21.15.169:0/622441007 conn(0x55b946a371f0 msgr2=0x55b946b22770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- 172.21.15.169:0/622441007 shutdown_connections 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- 172.21.15.169:0/622441007 wait complete. 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 Processor -- start 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- start start 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b2ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.087+0000 7f73447df980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b946a42ce0 con 0x55b946a3b6d0 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b2ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b2ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39196/0 (socket says 172.21.15.169:39196) 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73422ef640 1 -- 172.21.15.169:0/1758288196 learned_addr learned my addr 172.21.15.169:0/1758288196 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73422ef640 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946b2e2f0 con 0x55b946a3b6d0 2024-09-13T06:30:21.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73422ef640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b2ddb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f73380ab510 tx=0x7f7338018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f722ee05640 1 -- 172.21.15.169:0/1758288196 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380b0070 con 0x55b946a3b6d0 2024-09-13T06:30:21.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f722ee05640 1 -- 172.21.15.169:0/1758288196 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380b6970 con 0x55b946a3b6d0 2024-09-13T06:30:21.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b946b2e580 con 0x55b946a3b6d0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f722ee05640 1 -- 172.21.15.169:0/1758288196 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380b6c50 con 0x55b946a3b6d0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b946b31260 con 0x55b946a3b6d0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f722ee05640 1 -- 172.21.15.169:0/1758288196 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73380bf3f0 con 0x55b946a3b6d0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f722ee05640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7228034650 0x7f7228036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f722ee05640 1 -- 172.21.15.169:0/1758288196 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f73380bc070 con 0x55b946a3b6d0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f7341aee640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7228034650 0x7f7228036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946a3c020 0x55b946b34d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b353b0 con 0x55b946a3c020 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f7342af0640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946a3c020 0x55b946b34d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f7341aee640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7228034650 0x7f7228036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f733c0012f0 tx=0x7f733c006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f7342af0640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946a3c020 0x55b946b34d40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f7342af0640 1 -- 172.21.15.169:0/1758288196 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946a3c020 2024-09-13T06:30:21.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b361a0 0x55b946b38590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.091+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b38bd0 con 0x55b946b361a0 2024-09-13T06:30:21.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73422ef640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b361a0 0x55b946b38590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73422ef640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b361a0 0x55b946b38590 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73422ef640 1 -- 172.21.15.169:0/1758288196 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73380b3040 con 0x55b946b361a0 2024-09-13T06:30:21.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b3a480 con 0x55b946b361a0 2024-09-13T06:30:21.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73422ef640 1 -- 172.21.15.169:0/1758288196 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73380b3040 con 0x55b946b361a0 2024-09-13T06:30:21.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b395c0 con 0x55b946b361a0 2024-09-13T06:30:21.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73422ef640 1 -- 172.21.15.169:0/1758288196 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73380b3040 con 0x55b946b361a0 2024-09-13T06:30:21.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b3a080 0x55b946b3d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b3e080 con 0x55b946b3a080 2024-09-13T06:30:21.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f7341aee640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b3a080 0x55b946b3d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f7341aee640 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b3a080 0x55b946b3d8f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f7341aee640 1 -- 172.21.15.169:0/1758288196 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b3a080 2024-09-13T06:30:21.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 Processor -- start 2024-09-13T06:30:21.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 -- start start 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.095+0000 7f73447df980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 0x55b946b4bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b946942800 con 0x55b946b4bb10 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 0x55b946b4bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 0x55b946b4bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39198/0 (socket says 172.21.15.169:39198) 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 -- 172.21.15.169:0/341546582 learned_addr learned my addr 172.21.15.169:0/341546582 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 -- 172.21.15.169:0/341546582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946b4c470 con 0x55b946b4bb10 2024-09-13T06:30:21.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 0x55b946b4bf30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f73380e4010 tx=0x7f73380b4660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7227fff640 1 -- 172.21.15.169:0/341546582 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380b5890 con 0x55b946b4bb10 2024-09-13T06:30:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7227fff640 1 -- 172.21.15.169:0/341546582 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380b5a30 con 0x55b946b4bb10 2024-09-13T06:30:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b946b4c6a0 con 0x55b946b4bb10 2024-09-13T06:30:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7227fff640 1 -- 172.21.15.169:0/341546582 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380e4b60 con 0x55b946b4bb10 2024-09-13T06:30:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b946b4f320 con 0x55b946b4bb10 2024-09-13T06:30:21.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7227fff640 1 -- 172.21.15.169:0/341546582 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73380e4d00 con 0x55b946b4bb10 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7227fff640 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f721c034650 0x7f721c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7227fff640 1 -- 172.21.15.169:0/341546582 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f73380d7070 con 0x55b946b4bb10 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7341aee640 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f721c034650 0x7f721c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 Processor -- start 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 -- start start 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f7341aee640 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f721c034650 0x7f721c036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f733c0062e0 tx=0x7f733c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b9469b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73447df980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b946b273d0 con 0x55b9469b1e40 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b9469b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b9469b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39214/0 (socket says 172.21.15.169:39214) 2024-09-13T06:30:21.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.099+0000 7f73422ef640 1 -- 172.21.15.169:0/2176978990 learned_addr learned my addr 172.21.15.169:0/2176978990 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 -- 172.21.15.169:0/2176978990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9469b27f0 con 0x55b9469b1e40 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 --2- 172.21.15.169:0/2176978990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b9469b2220 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f73380e1ab0 tx=0x7f73380b4a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab66f2bd39fb9ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f7225ffb640 1 -- 172.21.15.169:0/2176978990 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380dc070 con 0x55b9469b1e40 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f7225ffb640 1 -- 172.21.15.169:0/2176978990 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380b4c10 con 0x55b9469b1e40 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f7225ffb640 1 -- 172.21.15.169:0/2176978990 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380bebd0 con 0x55b9469b1e40 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/2176978990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 msgr2=0x55b9469b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 --2- 172.21.15.169:0/2176978990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b9469b2220 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f73380e1ab0 tx=0x7f73380b4a30 comp rx=0 tx=0).stop 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/2176978990 shutdown_connections 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 --2- 172.21.15.169:0/2176978990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b9469b2220 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/2176978990 >> 172.21.15.169:0/2176978990 conn(0x55b946b54800 msgr2=0x55b946b52900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/2176978990 shutdown_connections 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/2176978990 wait complete. 2024-09-13T06:30:21.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 Processor -- start 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- start start 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b946b61850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b9469b0a30 con 0x55b9469b1e40 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b946b61850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b946b61850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39228/0 (socket says 172.21.15.169:39228) 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 learned_addr learned my addr 172.21.15.169:0/3997606877 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946b61d90 con 0x55b9469b1e40 2024-09-13T06:30:21.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73422ef640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b946b61850 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7338007000 tx=0x7f73380df150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f7213fff640 1 -- 172.21.15.169:0/3997606877 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338107070 con 0x55b9469b1e40 2024-09-13T06:30:21.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b946b61d90 con 0x55b9469b1e40 2024-09-13T06:30:21.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b946b62200 con 0x55b9469b1e40 2024-09-13T06:30:21.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f7213fff640 1 -- 172.21.15.169:0/3997606877 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380fc070 con 0x55b9469b1e40 2024-09-13T06:30:21.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.103+0000 7f7213fff640 1 -- 172.21.15.169:0/3997606877 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73380dc070 con 0x55b9469b1e40 2024-09-13T06:30:21.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7213fff640 1 -- 172.21.15.169:0/3997606877 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f733810a070 con 0x55b9469b1e40 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7213fff640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f720c034600 0x7f720c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7213fff640 1 -- 172.21.15.169:0/3997606877 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f73380a8070 con 0x55b9469b1e40 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7341aee640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f720c034600 0x7f720c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946b6c7f0 0x55b946b6ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b6f400 con 0x55b946b6c7f0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7342af0640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946b6c7f0 0x55b946b6ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7341aee640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f720c034600 0x7f720c036ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b946b3e480 tx=0x7f733c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7342af0640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946b6c7f0 0x55b946b6ecb0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 realm 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b6bc60 con 0x55b946b6c7f0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b6fed0 con 0x55b946b6c7f0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b70cb0 0x55b946b730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73720 con 0x55b946b70cb0 2024-09-13T06:30:21.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73422ef640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b70cb0 0x55b946b730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73422ef640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b70cb0 0x55b946b730a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.107+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 20 searching for the correct realm 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b75ce0 0x55b946b780d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b78750 con 0x55b946b75ce0 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7341aee640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b75ce0 0x55b946b780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7341aee640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b75ce0 0x55b946b780d0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b78750 con 0x55b946b70cb0 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73422ef640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f733810c060 0x7f73381077b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x7f733810c060 2024-09-13T06:30:21.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f733810c060 0x7f73381077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f733810c060 0x7f73381077b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b75ce0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.111+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x7f733810c060 2024-09-13T06:30:21.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x7f733810c060 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b75ce0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.115+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b75ce0 2024-09-13T06:30:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b75ce0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x7f733810c060 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x7f733810c060 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b75ce0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x7f733810c060 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b75ce0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.119+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b946b73f70 con 0x55b946b70cb0 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b747c0 con 0x55b946b6c7f0 2024-09-13T06:30:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b74bb0 con 0x55b946b70cb0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b74bb0 con 0x55b946b75ce0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 zone default found 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 4 Realm: () 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 zonegroup default 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b78bb0 con 0x7f733810c060 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b75120 con 0x55b946b75ce0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7aef0 con 0x55b946b75ce0 2024-09-13T06:30:21.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 started sync module instance, tier type = 2024-09-13T06:30:21.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:21.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.123+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7a270 con 0x55b946b70cb0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254243751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7a270 con 0x55b946b70cb0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7b9b0 con 0x55b946b6c7f0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254243755200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7c250 con 0x55b946b6c7f0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7cc70 con 0x55b946b70cb0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254243751792] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.127+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254243755200] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254243759968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7bda0 con 0x55b946b70cb0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7d540 con 0x7f733810c060 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254243762320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7bda0 con 0x7f733810c060 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7df80 con 0x55b946b70cb0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254243759968] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254243762320] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254243763376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7dad0 con 0x55b946b70cb0 2024-09-13T06:30:21.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.131+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7e820 con 0x55b946b75ce0 2024-09-13T06:30:21.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254243767152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7dad0 con 0x55b946b75ce0 2024-09-13T06:30:21.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7f690 con 0x55b946b75ce0 2024-09-13T06:30:21.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254243763376] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254243767152] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254243770848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7fa30 con 0x55b946b75ce0 2024-09-13T06:30:21.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b80280 con 0x7f733810c060 2024-09-13T06:30:21.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254243773456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b80680 con 0x7f733810c060 2024-09-13T06:30:21.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=0 2024-09-13T06:30:21.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=1 2024-09-13T06:30:21.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=2 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=3 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=4 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=5 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254243770848] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.135+0000 7f73447df980 20 add_watcher() i=6 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254243773456] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 add_watcher() i=7 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946b79dc0 con 0x55b946b6c7f0 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254243774736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b79dc0 con 0x55b946b6c7f0 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254243774736] v33'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f71f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 5 note: GC not initialized 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f71737fe640 20 reqs_thread_entry: start 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 Filter name: none 2024-09-13T06:30:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f71717fa640 20 reqs_thread_entry: start 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba6d80 con 0x7f733810c060 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.139+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba5520 con 0x55b946b6c7f0 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T06:30:21.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:30:21.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T06:30:21.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T06:30:21.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba5df0 con 0x7f733810c060 2024-09-13T06:30:21.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v33'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T06:30:21.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:30:21.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T06:30:21.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94254243928384 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946baa820 con 0x7f733810c060 2024-09-13T06:30:21.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== watch-notify(notify (1) cookie 94254243773456 notify 141733920778 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55b946ba6190 con 0x7f733810c060 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7225ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94254243773456 notifier 4722 bl.length()=556 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7225ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7225ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7225ffb640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7208003eb0 con 0x7f733810c060 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(65 notify.7 [notify cookie 94254243928384 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== watch-notify(notify_complete (2) cookie 94254243928384 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b946ba67d0 con 0x7f733810c060 2024-09-13T06:30:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.143+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba58f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f73447df980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:30:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f73447df980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f73447df980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94254243943264 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba58f0 con 0x55b946b75ce0 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== watch-notify(notify (1) cookie 94254243767152 notify 141733920797 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f733c01b030 con 0x55b946b75ce0 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(68 notify.5 [notify cookie 94254243943264 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f72257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94254243767152 notifier 4722 bl.length()=177 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f72257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f72257fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f72257fa640 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7178003410 con 0x55b946b75ce0 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== watch-notify(notify_complete (2) cookie 94254243943264 notify 141733920797 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b9468c3ae0 con 0x55b946b75ce0 2024-09-13T06:30:21.150 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T06:30:21.144804Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:30:21.144792Z","tags":[],"group_ids":[]} 2024-09-13T06:30:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f71f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254243774736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x55b946b6c7f0 2024-09-13T06:30:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94254243774736] v33'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.147+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254243751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x55b946b70cb0 2024-09-13T06:30:21.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94254243751792] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f73447df980 20 remove_watcher() i=0 2024-09-13T06:30:21.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f73447df980 2 removed watcher, disabling cache 2024-09-13T06:30:21.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254243755200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x55b946b6c7f0 2024-09-13T06:30:21.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94254243755200] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x55b946b6c7f0 2024-09-13T06:30:21.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f73447df980 20 remove_watcher() i=1 2024-09-13T06:30:21.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.151+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254243759968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x55b946b70cb0 2024-09-13T06:30:21.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94254243759968] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73447df980 20 remove_watcher() i=2 2024-09-13T06:30:21.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254243762320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x7f733810c060 2024-09-13T06:30:21.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94254243762320] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73447df980 20 remove_watcher() i=3 2024-09-13T06:30:21.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254243763376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7d090 con 0x55b946b70cb0 2024-09-13T06:30:21.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73422ef640 1 -- 172.21.15.169:0/3997606877 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94254243763376] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338109030 con 0x55b946b70cb0 2024-09-13T06:30:21.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73447df980 20 remove_watcher() i=4 2024-09-13T06:30:21.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.155+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254243767152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x55b946b75ce0 2024-09-13T06:30:21.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94254243767152] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 20 remove_watcher() i=5 2024-09-13T06:30:21.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254243770848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946ba4b20 con 0x55b946b75ce0 2024-09-13T06:30:21.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f7341aee640 1 -- 172.21.15.169:0/3997606877 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94254243770848] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733c00f070 con 0x55b946b75ce0 2024-09-13T06:30:21.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 20 remove_watcher() i=6 2024-09-13T06:30:21.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254243773456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b946b7f1e0 con 0x7f733810c060 2024-09-13T06:30:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94254243773456] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73340083f0 con 0x7f733810c060 2024-09-13T06:30:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 20 remove_watcher() i=7 2024-09-13T06:30:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b70cb0 msgr2=0x55b946b730a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b70cb0 0x55b946b730a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946b6c7f0 msgr2=0x55b946b6ecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946b6c7f0 0x55b946b6ecb0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f733810c060 msgr2=0x7f73381077b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f733810c060 0x7f73381077b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b75ce0 msgr2=0x55b946b780d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b75ce0 0x55b946b780d0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f720c034600 msgr2=0x7f720c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f720c034600 0x7f720c036ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b946b3e480 tx=0x7f733c010000 comp rx=0 tx=0).stop 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f7342af0640 1 -- 172.21.15.169:0/3997606877 reap_dead start 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 msgr2=0x55b946b61850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b946b61850 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7338007000 tx=0x7f73380df150 comp rx=0 tx=0).stop 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 shutdown_connections 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/3997606877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9469b1e40 0x55b946b61850 secure :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7338007000 tx=0x7f73380df150 comp rx=0 tx=0).stop 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 >> 172.21.15.169:0/3997606877 conn(0x55b946b54800 msgr2=0x55b946b528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 shutdown_connections 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/3997606877 wait complete. 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f721c034650 msgr2=0x7f721c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f721c034650 0x7f721c036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f733c0062e0 tx=0x7f733c00f000 comp rx=0 tx=0).stop 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 msgr2=0x55b946b4bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 0x55b946b4bf30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f73380e4010 tx=0x7f73380b4660 comp rx=0 tx=0).stop 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 shutdown_connections 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f721c034650 0x7f721c036b10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/341546582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946b4bb10 0x55b946b4bf30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 >> 172.21.15.169:0/341546582 conn(0x55b946b40c60 msgr2=0x55b946b436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 shutdown_connections 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/341546582 wait complete. 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b361a0 msgr2=0x55b946b38590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b946b361a0 0x55b946b38590 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946a3c020 msgr2=0x55b946b34d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b946a3c020 0x55b946b34d40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b3a080 msgr2=0x55b946b3d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.159+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b946b3a080 0x55b946b3d8f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7228034650 msgr2=0x7f7228036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7228034650 0x7f7228036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f733c0012f0 tx=0x7f733c006700 comp rx=0 tx=0).stop 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 msgr2=0x55b946b2ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 --2- 172.21.15.169:0/1758288196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b946a3b6d0 0x55b946b2ddb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f73380ab510 tx=0x7f7338018020 comp rx=0 tx=0).stop 2024-09-13T06:30:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f7342af0640 1 -- 172.21.15.169:0/1758288196 reap_dead start 2024-09-13T06:30:21.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 shutdown_connections 2024-09-13T06:30:21.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 >> 172.21.15.169:0/1758288196 conn(0x55b946a371f0 msgr2=0x55b946b212f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 shutdown_connections 2024-09-13T06:30:21.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.163+0000 7f73447df980 1 -- 172.21.15.169:0/1758288196 wait complete. 2024-09-13T06:30:21.172 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T06:30:21.144804Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:30:21.144792Z', 'tags': [], 'group_ids': []} 2024-09-13T06:30:21.197 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:30:21.203 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T06:30:21.203 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T06:30:21.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T06:30:21.203 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T06:30:21.249 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:21.249 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb8197d980 1 Processor -- start 2024-09-13T06:30:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb8197d980 1 -- start start 2024-09-13T06:30:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb8197d980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55e2c56bea90 0x55e2c56c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb8197d980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2c5542ae0 con 0x55e2c562f2e0 2024-09-13T06:30:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb8197d980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55e2c5566e30 con 0x55e2c56bea90 2024-09-13T06:30:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb7ec8c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55e2c56bea90 0x55e2c56c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb7f48d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55e2c562f2e0 0x55e2c56bd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57526/0 (socket says 172.21.15.169:57526) 2024-09-13T06:30:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.247+0000 7feb7f48d640 1 -- 172.21.15.169:0/2644772671 learned_addr learned my addr 172.21.15.169:0/2644772671 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb7ec8c640 1 -- 172.21.15.169:0/2644772671 >> v1:172.21.15.112:6789/0 conn(0x55e2c562f2e0 legacy=0x55e2c56bd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb7ec8c640 1 -- 172.21.15.169:0/2644772671 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c56c23d0 con 0x55e2c56bea90 2024-09-13T06:30:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/2644772671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c56bea90 0x55e2c56c0e80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feb7000a420 tx=0x7feb7001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bde631c5b0099fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb7e48b640 1 -- 172.21.15.169:0/2644772671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb700af070 con 0x55e2c56bea90 2024-09-13T06:30:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb7e48b640 1 -- 172.21.15.169:0/2644772671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb700aa530 con 0x55e2c56bea90 2024-09-13T06:30:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb7e48b640 1 -- 172.21.15.169:0/2644772671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb700aa850 con 0x55e2c56bea90 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb8197d980 1 -- 172.21.15.169:0/2644772671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c56bea90 msgr2=0x55e2c56c0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb8197d980 1 --2- 172.21.15.169:0/2644772671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c56bea90 0x55e2c56c0e80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feb7000a420 tx=0x7feb7001afd0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb8197d980 1 -- 172.21.15.169:0/2644772671 shutdown_connections 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb8197d980 1 --2- 172.21.15.169:0/2644772671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c56bea90 0x55e2c56c0e80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.251+0000 7feb8197d980 1 -- 172.21.15.169:0/2644772671 >> 172.21.15.169:0/2644772671 conn(0x55e2c56b50a0 msgr2=0x55e2c56b74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.255+0000 7feb8197d980 1 -- 172.21.15.169:0/2644772671 shutdown_connections 2024-09-13T06:30:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.255+0000 7feb8197d980 1 -- 172.21.15.169:0/2644772671 wait complete. 2024-09-13T06:30:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 Processor -- start 2024-09-13T06:30:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- start start 2024-09-13T06:30:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c57a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e2c5568200 con 0x55e2c562f2e0 2024-09-13T06:30:21.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c57a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c57a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39246/0 (socket says 172.21.15.169:39246) 2024-09-13T06:30:21.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb7f48d640 1 -- 172.21.15.169:0/1963522383 learned_addr learned my addr 172.21.15.169:0/1963522383 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb7f48d640 1 -- 172.21.15.169:0/1963522383 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c57a6050 con 0x55e2c562f2e0 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb7f48d640 1 --2- 172.21.15.169:0/1963522383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c57a5a80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7feb74001e20 tx=0x7feb7400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaa348f001c36b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7fea6d60a640 1 -- 172.21.15.169:0/1963522383 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74012020 con 0x55e2c562f2e0 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7fea6d60a640 1 -- 172.21.15.169:0/1963522383 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7400e7c0 con 0x55e2c562f2e0 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7fea6d60a640 1 -- 172.21.15.169:0/1963522383 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7400eb00 con 0x55e2c562f2e0 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- 172.21.15.169:0/1963522383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 msgr2=0x55e2c57a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 --2- 172.21.15.169:0/1963522383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c57a5a80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7feb74001e20 tx=0x7feb7400b790 comp rx=0 tx=0).stop 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- 172.21.15.169:0/1963522383 shutdown_connections 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 --2- 172.21.15.169:0/1963522383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c57a5a80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- 172.21.15.169:0/1963522383 >> 172.21.15.169:0/1963522383 conn(0x55e2c56b50a0 msgr2=0x55e2c57a16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- 172.21.15.169:0/1963522383 shutdown_connections 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- 172.21.15.169:0/1963522383 wait complete. 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 Processor -- start 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.267+0000 7feb8197d980 1 -- start start 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c56bac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e2c56c1e40 con 0x55e2c562f2e0 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c56bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c56bac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39262/0 (socket says 172.21.15.169:39262) 2024-09-13T06:30:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7f48d640 1 -- 172.21.15.169:0/1142924924 learned_addr learned my addr 172.21.15.169:0/1142924924 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7f48d640 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c56bb170 con 0x55e2c562f2e0 2024-09-13T06:30:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7f48d640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c56bac30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7feb74001e20 tx=0x7feb74000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7fea6be07640 1 -- 172.21.15.169:0/1142924924 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74012030 con 0x55e2c562f2e0 2024-09-13T06:30:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c56b9350 con 0x55e2c562f2e0 2024-09-13T06:30:21.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7fea6be07640 1 -- 172.21.15.169:0/1142924924 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74001480 con 0x55e2c562f2e0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7fea6be07640 1 -- 172.21.15.169:0/1142924924 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7401a8d0 con 0x55e2c562f2e0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c56b9840 con 0x55e2c562f2e0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7fea6be07640 1 -- 172.21.15.169:0/1142924924 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb74015020 con 0x55e2c562f2e0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7fea6be07640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea64034650 0x7fea64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7fea6be07640 1 -- 172.21.15.169:0/1142924924 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7feb74020030 con 0x55e2c562f2e0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea64034650 0x7fea64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c56bea90 0x55e2c57b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57b6750 con 0x55e2c56bea90 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7fc8e640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c56bea90 0x55e2c57b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea64034650 0x7fea64036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feb700ac000 tx=0x7feb700a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7fc8e640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c56bea90 0x55e2c57b6210 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb7fc8e640 1 -- 172.21.15.169:0/1142924924 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c56bea90 2024-09-13T06:30:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57b7170 0x55e2c57b9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.271+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57b9da0 con 0x55e2c57b7170 2024-09-13T06:30:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb7f48d640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57b7170 0x55e2c57b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb7f48d640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57b7170 0x55e2c57b9630 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb7f48d640 1 -- 172.21.15.169:0/1142924924 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb74008030 con 0x55e2c57b7170 2024-09-13T06:30:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57bb6a0 con 0x55e2c57b7170 2024-09-13T06:30:21.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb7f48d640 1 -- 172.21.15.169:0/1142924924 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feb74008030 con 0x55e2c57b7170 2024-09-13T06:30:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57ba810 con 0x55e2c57b7170 2024-09-13T06:30:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb7f48d640 1 -- 172.21.15.169:0/1142924924 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb74008030 con 0x55e2c57b7170 2024-09-13T06:30:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57bca50 0x55e2c57bee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.275+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57bf380 con 0x55e2c57bca50 2024-09-13T06:30:21.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57bca50 0x55e2c57bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57bca50 0x55e2c57bee40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7ec8c640 1 -- 172.21.15.169:0/1142924924 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb700b2070 con 0x55e2c57bca50 2024-09-13T06:30:21.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb8197d980 1 Processor -- start 2024-09-13T06:30:21.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb8197d980 1 -- start start 2024-09-13T06:30:21.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb8197d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 0x55e2c57cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb8197d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e2c55c1800 con 0x55e2c57ccd00 2024-09-13T06:30:21.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 0x55e2c57cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 0x55e2c57cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39272/0 (socket says 172.21.15.169:39272) 2024-09-13T06:30:21.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7f48d640 1 -- 172.21.15.169:0/1954471970 learned_addr learned my addr 172.21.15.169:0/1954471970 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7f48d640 1 -- 172.21.15.169:0/1954471970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c57cd660 con 0x55e2c57ccd00 2024-09-13T06:30:21.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb7f48d640 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 0x55e2c57cd120 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7feb7401a6f0 tx=0x7feb7400db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7fea69602640 1 -- 172.21.15.169:0/1954471970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74024630 con 0x55e2c57ccd00 2024-09-13T06:30:21.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7fea69602640 1 -- 172.21.15.169:0/1954471970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb740247d0 con 0x55e2c57ccd00 2024-09-13T06:30:21.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c57cd8f0 con 0x55e2c57ccd00 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7fea69602640 1 -- 172.21.15.169:0/1954471970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74016570 con 0x55e2c57ccd00 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c57cd8f0 con 0x55e2c57ccd00 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7fea69602640 1 -- 172.21.15.169:0/1954471970 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb74040070 con 0x55e2c57ccd00 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7fea69602640 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea58034650 0x7fea58036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.279+0000 7fea69602640 1 -- 172.21.15.169:0/1954471970 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7feb74005050 con 0x55e2c57ccd00 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea58034650 0x7fea58036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 Processor -- start 2024-09-13T06:30:21.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- start start 2024-09-13T06:30:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea58034650 0x7fea58036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55e2c56ba2a0 tx=0x7feb70005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57d9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e2c57a63d0 con 0x55e2c57d9450 2024-09-13T06:30:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57d9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57d9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39284/0 (socket says 172.21.15.169:39284) 2024-09-13T06:30:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 -- 172.21.15.169:0/2317949576 learned_addr learned my addr 172.21.15.169:0/2317949576 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 -- 172.21.15.169:0/2317949576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c57d9e00 con 0x55e2c57d9450 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 --2- 172.21.15.169:0/2317949576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57d9830 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feb740353f0 tx=0x7feb74016880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd902bca321869bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7fea62ffd640 1 -- 172.21.15.169:0/2317949576 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7405d030 con 0x55e2c57d9450 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7fea62ffd640 1 -- 172.21.15.169:0/2317949576 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74050e30 con 0x55e2c57d9450 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7fea62ffd640 1 -- 172.21.15.169:0/2317949576 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74054070 con 0x55e2c57d9450 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- 172.21.15.169:0/2317949576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 msgr2=0x55e2c57d9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 --2- 172.21.15.169:0/2317949576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57d9830 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feb740353f0 tx=0x7feb74016880 comp rx=0 tx=0).stop 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- 172.21.15.169:0/2317949576 shutdown_connections 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 --2- 172.21.15.169:0/2317949576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57d9830 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- 172.21.15.169:0/2317949576 >> 172.21.15.169:0/2317949576 conn(0x55e2c57d5830 msgr2=0x55e2c57d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- 172.21.15.169:0/2317949576 shutdown_connections 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- 172.21.15.169:0/2317949576 wait complete. 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 Processor -- start 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- start start 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb8197d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e2c57da2a0 con 0x55e2c57d9450 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57e0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39296/0 (socket says 172.21.15.169:39296) 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 learned_addr learned my addr 172.21.15.169:0/4162907132 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.283+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c57e0b70 con 0x55e2c57d9450 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7f48d640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57e0630 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7feb740353f0 tx=0x7feb74021ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7fea617fa640 1 -- 172.21.15.169:0/4162907132 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb740487f0 con 0x55e2c57d9450 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c57e0b70 con 0x55e2c57d9450 2024-09-13T06:30:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7fea617fa640 1 -- 172.21.15.169:0/4162907132 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb74048990 con 0x55e2c57d9450 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7fea617fa640 1 -- 172.21.15.169:0/4162907132 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74057480 con 0x55e2c57d9450 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c57e0b70 con 0x55e2c57d9450 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7fea617fa640 1 -- 172.21.15.169:0/4162907132 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb74070070 con 0x55e2c57d9450 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7fea617fa640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea480346a0 0x7fea48036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7fea617fa640 1 -- 172.21.15.169:0/4162907132 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7feb74061070 con 0x55e2c57d9450 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea480346a0 0x7fea48036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c57eb740 0x55e2c57edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57ee350 con 0x55e2c57eb740 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7fc8e640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c57eb740 0x55e2c57edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea480346a0 0x7fea48036b60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb7001b010 tx=0x7feb700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7fc8e640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c57eb740 0x55e2c57edc00 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 realm 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57eabf0 con 0x55e2c57eb740 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57eee20 con 0x55e2c57eb740 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57efc00 0x55e2c57f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2670 con 0x55e2c57efc00 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.287+0000 7feb7f48d640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57efc00 0x55e2c57f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7f48d640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57efc00 0x55e2c57f1ff0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb74085040 con 0x55e2c57efc00 2024-09-13T06:30:21.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:21.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feb74085040 con 0x55e2c57efc00 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 20 searching for the correct realm 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57f4c30 0x55e2c57f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f76a0 con 0x55e2c57f4c30 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57f4c30 0x55e2c57f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7ec8c640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57f4c30 0x55e2c57f7020 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f76a0 con 0x55e2c57efc00 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feb74085040 con 0x55e2c57efc00 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7f48d640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7feb74017050 0x7feb7403f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x7feb74017050 2024-09-13T06:30:21.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7fc8e640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7feb74017050 0x7feb7403f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7fc8e640 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7feb74017050 0x7feb7403f2c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.291+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57f4c30 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb74085040 con 0x55e2c57efc00 2024-09-13T06:30:21.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb74085040 con 0x55e2c57efc00 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x7feb74017050 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x7feb74017050 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57f4c30 2024-09-13T06:30:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.295+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57f4c30 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57f4c30 2024-09-13T06:30:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x7feb74017050 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57eb740 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x7feb74017050 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57f4c30 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x7feb74017050 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.299+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57f4c30 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f2ec0 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f3710 con 0x55e2c57eb740 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f3b00 con 0x55e2c57efc00 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f3b00 con 0x55e2c57f4c30 2024-09-13T06:30:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 zone default found 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 4 Realm: () 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 zonegroup default 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f7b20 con 0x7feb74017050 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.303+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f4040 con 0x55e2c57f4c30 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f9df0 con 0x55e2c57f4c30 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 20 started sync module instance, tier type = 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f91e0 con 0x55e2c57efc00 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432464443104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f91e0 con 0x55e2c57efc00 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fa870 con 0x55e2c57eb740 2024-09-13T06:30:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432464446400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fb0c0 con 0x55e2c57eb740 2024-09-13T06:30:21.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.307+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fbae0 con 0x55e2c57efc00 2024-09-13T06:30:21.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94432464446400] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94432464443104] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432464451024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fac10 con 0x55e2c57efc00 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fc380 con 0x7feb74017050 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432464453328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fac10 con 0x7feb74017050 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fce30 con 0x55e2c57efc00 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94432464451024] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.311+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94432464453328] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432464454384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57f8d30 con 0x55e2c57efc00 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fd2e0 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432464457264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fdb80 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fe540 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94432464454384] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94432464457264] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432464461968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fe960 con 0x55e2c57f4c30 2024-09-13T06:30:21.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.315+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fe960 con 0x7feb74017050 2024-09-13T06:30:21.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94432464461968] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432464464704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fca20 con 0x7feb74017050 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=0 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=1 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=2 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=3 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=4 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=5 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=6 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94432464464704] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 20 add_watcher() i=7 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:21.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5802580 con 0x55e2c57eb740 2024-09-13T06:30:21.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432464465760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57ffaa0 con 0x55e2c57eb740 2024-09-13T06:30:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.319+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94432464465760] v33'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fea35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 5 note: GC not initialized 2024-09-13T06:30:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fea34fe1640 20 reqs_thread_entry: start 2024-09-13T06:30:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 Filter name: none 2024-09-13T06:30:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fe9ae7fc640 20 reqs_thread_entry: start 2024-09-13T06:30:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T06:30:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5825c40 con 0x7feb74017050 2024-09-13T06:30:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:30:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5829e00 con 0x7feb74017050 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v33'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94432464636880 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582aa30 con 0x55e2c57f4c30 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== watch-notify(notify (1) cookie 94432464457264 notify 141733920798 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7feb700bd1f0 con 0x55e2c57f4c30 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fea62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 94432464457264 notifier 4729 bl.length()=382 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fea62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:30:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fea62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:30:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7fea62ffd640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fea44003eb0 con 0x55e2c57f4c30 2024-09-13T06:30:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(64 notify.5 [notify cookie 94432464636880 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== watch-notify(notify_complete (2) cookie 94432464636880 notify 141733920798 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e2c56c23d0 con 0x55e2c57f4c30 2024-09-13T06:30:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582a8d0 con 0x55e2c57eb740 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 : miss 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 20 rados->read ofs=0 len=0 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.323+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 8.14 8:2b113b97:root::.bucket.meta.myfoo6%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5828300 con 0x55e2c57efc00 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(67 .bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x17 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:21.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:30:21.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 2024-09-13T06:30:21.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 8.14 8:2b113b97:root::.bucket.meta.myfoo6%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c58317a0 con 0x55e2c57efc00 2024-09-13T06:30:21.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 .bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v33'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x17 2024-09-13T06:30:21.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:21.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:30:21.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9, ofs0, ns] 2024-09-13T06:30:21.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.327+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94432464633760 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582be70 con 0x55e2c57efc00 2024-09-13T06:30:21.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify (1) cookie 94432464443104 notify 141733920805 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55e2c5827b90 con 0x55e2c57efc00 2024-09-13T06:30:21.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7fea627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94432464443104 notifier 4729 bl.length()=748 2024-09-13T06:30:21.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7fea627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x17 2024-09-13T06:30:21.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7fea627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:21.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7fea627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:30:21.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(69 notify.0 [notify cookie 94432464633760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7fea627fc640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe9b4003540 con 0x55e2c57efc00 2024-09-13T06:30:21.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify_complete (2) cookie 94432464633760 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feb74033040 con 0x55e2c57efc00 2024-09-13T06:30:21.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): orig_sources= new_sources= 2024-09-13T06:30:21.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): potential sources added=[] removed=[] 2024-09-13T06:30:21.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): orig_dests= new_dests= 2024-09-13T06:30:21.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): potential dests added=[] removed=[] 2024-09-13T06:30:21.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5827fa0 con 0x55e2c57efc00 2024-09-13T06:30:21.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 bud.buckets [call] v33'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.331+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5830f90 con 0x55e2c57efc00 2024-09-13T06:30:21.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(72 bud.buckets [call] v33'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5830f90 con 0x55e2c57eb740 2024-09-13T06:30:21.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v33'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T06:30:21.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T06:30:21.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T06:30:21.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94432464633760 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582c0f0 con 0x7feb74017050 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== watch-notify(notify (1) cookie 94432464453328 notify 141733920780 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55e2c5829b10 con 0x7feb74017050 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7fea627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94432464453328 notifier 4729 bl.length()=316 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7fea627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7fea627fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7fea627fc640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe9b4003570 con 0x7feb74017050 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(74 notify.3 [notify cookie 94432464633760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== watch-notify(notify_complete (2) cookie 94432464633760 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feb7802a910 con 0x7feb74017050 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 2024-09-13T06:30:21.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.335+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:76 8.14 8:2b113b97:root::.bucket.meta.myfoo6%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582f5d0 con 0x55e2c57efc00 2024-09-13T06:30:21.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(76 .bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v33'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb8197d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x17 2024-09-13T06:30:21.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb8197d980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:21.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb8197d980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:30:21.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9, ofs0, ns] 2024-09-13T06:30:21.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94432464633760 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582c5a0 con 0x55e2c57efc00 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== watch-notify(notify (1) cookie 94432464443104 notify 141733920806 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7feb74033040 con 0x55e2c57efc00 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7fea62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94432464443104 notifier 4729 bl.length()=748 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7fea62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x17 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7fea62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7fea62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7fea62ffd640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fea44003eb0 con 0x55e2c57efc00 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(77 notify.0 [notify cookie 94432464633760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.339+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== watch-notify(notify_complete (2) cookie 94432464633760 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e2c56b9840 con 0x55e2c57efc00 2024-09-13T06:30:21.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): orig_sources= new_sources= 2024-09-13T06:30:21.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): potential sources added=[] removed=[] 2024-09-13T06:30:21.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): orig_dests= new_dests= 2024-09-13T06:30:21.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 20 handle_bi_update(): bucket=:myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]): potential dests added=[] removed=[] 2024-09-13T06:30:21.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:79 4.a 4:53b35094:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57efc00 2024-09-13T06:30:21.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(79 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:80 4.2f 4:f5cfa444:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57eb740 2024-09-13T06:30:21.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(80 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 4.7 4:e0e5e61f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57eb740 2024-09-13T06:30:21.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(81 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:82 4.37 4:ee29046d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x7feb74017050 2024-09-13T06:30:21.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(82 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 4.20 4:07c23fd2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57efc00 2024-09-13T06:30:21.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(83 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:84 4.37 4:edee92ac:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x7feb74017050 2024-09-13T06:30:21.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(84 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:85 4.36 4:6ca78c8b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x7feb74017050 2024-09-13T06:30:21.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(85 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.343+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:86 4.1f 4:f8326c74:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57efc00 2024-09-13T06:30:21.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(86 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:87 4.9 4:939a328b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57eb740 2024-09-13T06:30:21.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(87 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8 [call out=85b] v0'0 uv19 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:88 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57efc00 2024-09-13T06:30:21.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(88 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [call out=377b] v0'0 uv3 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:89 4.1e 4:7a009d31:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57eb740 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(89 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 get_obj_state: octx=0x7feb7404f440 obj=myfoo6:thirteen state=0x55e2c5826b08 s->prefetch_data=0 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:90 3.39 3:9f1015b8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582ff80 con 0x55e2c57f4c30 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(90 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 10 manifest: total_size = 8 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.6644861398695923756 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T06:30:21.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 get_obj_state: octx=0x7feb7404f440 obj=myfoo6:thirteen state=0x55e2c5826b08 s->prefetch_data=0 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 2024-09-13T06:30:21.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.347+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582f5a0 con 0x55e2c57efc00 2024-09-13T06:30:21.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(91 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:92 3.39 3:9f1015b8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5832eb0 con 0x55e2c57f4c30 2024-09-13T06:30:21.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(92 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v33'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:93 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5834950 con 0x55e2c57efc00 2024-09-13T06:30:21.353 INFO:teuthology.orchestra.run.smithi169.stderr:1 objects processed in :myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9]). Next marker thirteen 2024-09-13T06:30:21.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5834950 con 0x7feb74017050 2024-09-13T06:30:21.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v33'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94432464667568 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5834950 con 0x55e2c57f4c30 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== watch-notify(notify (1) cookie 94432464457264 notify 141733920799 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55e2c56c23d0 con 0x55e2c57f4c30 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7fea627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94432464457264 notifier 4729 bl.length()=556 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7fea627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7fea627fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(95 notify.5 [notify cookie 94432464667568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.351+0000 7fea627fc640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe9b40030a0 con 0x55e2c57f4c30 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== watch-notify(notify_complete (2) cookie 94432464667568 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feb700b65d0 con 0x55e2c57f4c30 2024-09-13T06:30:21.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5834950 con 0x55e2c57eb740 2024-09-13T06:30:21.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(93 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7fea62ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T06:30:21.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:30:21.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94432464667568 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5826920 con 0x55e2c57f4c30 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== watch-notify(notify (1) cookie 94432464457264 notify 141733920800 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7feb700b65d0 con 0x55e2c57f4c30 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7fea627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 94432464457264 notifier 4729 bl.length()=177 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7fea627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7fea627fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7fea627fc640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe9b40030a0 con 0x55e2c57f4c30 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(98 notify.5 [notify cookie 94432464667568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== watch-notify(notify_complete (2) cookie 94432464667568 notify 141733920800 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feb700b67a0 con 0x55e2c57f4c30 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 10 removing user index: bar 2024-09-13T06:30:21.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c582a3b0 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== osd_op_reply(100 bar [delete] v33'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.355+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94432464667568 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5826920 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== watch-notify(notify (1) cookie 94432464464704 notify 141733920781 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e2c582fff0 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7fea62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94432464464704 notifier 4729 bl.length()=152 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7fea62ffd640 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fea44003eb0 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 24 ==== osd_op_reply(101 notify.7 [notify cookie 94432464667568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 25 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 26 ==== watch-notify(notify_complete (2) cookie 94432464667568 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e2c5830f90 con 0x7feb74017050 2024-09-13T06:30:21.361 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T06:30:21.144804Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:30:21.144792Z","tags":[],"group_ids":[]} 2024-09-13T06:30:21.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7fea35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:21.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432464465760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5823a70 con 0x55e2c57eb740 2024-09-13T06:30:21.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94432464465760] v33'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.359+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432464443104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5823a70 con 0x55e2c57efc00 2024-09-13T06:30:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94432464443104] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb8197d980 20 remove_watcher() i=0 2024-09-13T06:30:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb8197d980 2 removed watcher, disabling cache 2024-09-13T06:30:21.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432464446400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5823a70 con 0x55e2c57eb740 2024-09-13T06:30:21.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94432464446400] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x55e2c57eb740 2024-09-13T06:30:21.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb8197d980 20 remove_watcher() i=1 2024-09-13T06:30:21.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.363+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432464451024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5823a70 con 0x55e2c57efc00 2024-09-13T06:30:21.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94432464451024] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb8197d980 20 remove_watcher() i=2 2024-09-13T06:30:21.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432464453328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fb5d0 con 0x7feb74017050 2024-09-13T06:30:21.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 27 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94432464453328] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb8197d980 20 remove_watcher() i=3 2024-09-13T06:30:21.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432464454384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5823a70 con 0x55e2c57efc00 2024-09-13T06:30:21.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb7f48d640 1 -- 172.21.15.169:0/4162907132 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94432464454384] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb7408f040 con 0x55e2c57efc00 2024-09-13T06:30:21.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb8197d980 20 remove_watcher() i=4 2024-09-13T06:30:21.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.367+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432464457264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fb5d0 con 0x55e2c57f4c30 2024-09-13T06:30:21.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94432464457264] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 20 remove_watcher() i=5 2024-09-13T06:30:21.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432464461968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c5823a70 con 0x55e2c57f4c30 2024-09-13T06:30:21.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb7ec8c640 1 -- 172.21.15.169:0/4162907132 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94432464461968] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb700c9070 con 0x55e2c57f4c30 2024-09-13T06:30:21.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 20 remove_watcher() i=6 2024-09-13T06:30:21.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432464464704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e2c57fb5d0 con 0x7feb74017050 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 <== osd.2 v2:172.21.15.169:6816/1749135367 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94432464464704] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb780083f0 con 0x7feb74017050 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 20 remove_watcher() i=7 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57efc00 msgr2=0x55e2c57f1ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57efc00 0x55e2c57f1ff0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c57eb740 msgr2=0x55e2c57edc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c57eb740 0x55e2c57edc00 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7feb74017050 msgr2=0x7feb7403f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7feb74017050 0x7feb7403f2c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57f4c30 msgr2=0x55e2c57f7020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57f4c30 0x55e2c57f7020 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea480346a0 msgr2=0x7fea48036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea480346a0 0x7fea48036b60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb7001b010 tx=0x7feb700a7000 comp rx=0 tx=0).stop 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 msgr2=0x55e2c57e0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57e0630 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7feb740353f0 tx=0x7feb74021ef0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb7fc8e640 1 -- 172.21.15.169:0/4162907132 reap_dead start 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 shutdown_connections 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/4162907132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57d9450 0x55e2c57e0630 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 >> 172.21.15.169:0/4162907132 conn(0x55e2c57d5830 msgr2=0x55e2c57d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 shutdown_connections 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/4162907132 wait complete. 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea58034650 msgr2=0x7fea58036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea58034650 0x7fea58036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55e2c56ba2a0 tx=0x7feb70005d90 comp rx=0 tx=0).stop 2024-09-13T06:30:21.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 msgr2=0x55e2c57cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 0x55e2c57cd120 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7feb7401a6f0 tx=0x7feb7400db30 comp rx=0 tx=0).stop 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 shutdown_connections 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea58034650 0x7fea58036b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 --2- 172.21.15.169:0/1954471970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c57ccd00 0x55e2c57cd120 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 >> 172.21.15.169:0/1954471970 conn(0x55e2c57c1e50 msgr2=0x55e2c57c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 shutdown_connections 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.371+0000 7feb8197d980 1 -- 172.21.15.169:0/1954471970 wait complete. 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57b7170 msgr2=0x55e2c57b9630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55e2c57b7170 0x55e2c57b9630 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c56bea90 msgr2=0x55e2c57b6210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55e2c56bea90 0x55e2c57b6210 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57bca50 msgr2=0x55e2c57bee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55e2c57bca50 0x55e2c57bee40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea64034650 msgr2=0x7fea64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fea64034650 0x7fea64036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feb700ac000 tx=0x7feb700a5000 comp rx=0 tx=0).stop 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 msgr2=0x55e2c56bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 --2- 172.21.15.169:0/1142924924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e2c562f2e0 0x55e2c56bac30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7feb74001e20 tx=0x7feb74000ee0 comp rx=0 tx=0).stop 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb7fc8e640 1 -- 172.21.15.169:0/1142924924 reap_dead start 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 shutdown_connections 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 >> 172.21.15.169:0/1142924924 conn(0x55e2c56b50a0 msgr2=0x55e2c57a0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 shutdown_connections 2024-09-13T06:30:21.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:21.375+0000 7feb8197d980 1 -- 172.21.15.169:0/1142924924 wait complete. 2024-09-13T06:30:21.384 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T06:30:21.144804Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:30:21.144792Z', 'tags': [], 'group_ids': []} 2024-09-13T06:30:26.395 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:30:26.395 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T06:30:26.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T06:30:26.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T06:30:26.395 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T06:30:26.443 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:26.443 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:26.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6018f6c980 1 Processor -- start 2024-09-13T06:30:26.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6018f6c980 1 -- start start 2024-09-13T06:30:26.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6018f6c980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x559c26b55ca0 0x559c26b58090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6018f6c980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c269d7ae0 con 0x559c26b51920 2024-09-13T06:30:26.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6018f6c980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x559c269fbe30 con 0x559c26b55ca0 2024-09-13T06:30:26.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6016a7c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x559c26b51920 0x559c26b51d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57534/0 (socket says 172.21.15.169:57534) 2024-09-13T06:30:26.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f6016a7c640 1 -- 172.21.15.169:0/1856335233 learned_addr learned my addr 172.21.15.169:0/1856335233 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:30:26.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f601627b640 1 --2- 172.21.15.169:0/1856335233 >> v2:172.21.15.112:3300/0 conn(0x559c26b55ca0 0x559c26b58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f601627b640 1 -- 172.21.15.169:0/1856335233 >> v1:172.21.15.112:6789/0 conn(0x559c26b51920 legacy=0x559c26b51d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.442+0000 7f601627b640 1 -- 172.21.15.169:0/1856335233 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c26b595e0 con 0x559c26b55ca0 2024-09-13T06:30:26.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f601627b640 1 --2- 172.21.15.169:0/1856335233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26b58090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f600c00a480 tx=0x7f600c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff637d07bbea5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6015a7a640 1 -- 172.21.15.169:0/1856335233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600c0b0070 con 0x559c26b55ca0 2024-09-13T06:30:26.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6015a7a640 1 -- 172.21.15.169:0/1856335233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600c0ab540 con 0x559c26b55ca0 2024-09-13T06:30:26.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6015a7a640 1 -- 172.21.15.169:0/1856335233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600c0ab840 con 0x559c26b55ca0 2024-09-13T06:30:26.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 -- 172.21.15.169:0/1856335233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 msgr2=0x559c26b58090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 --2- 172.21.15.169:0/1856335233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26b58090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f600c00a480 tx=0x7f600c01b280 comp rx=0 tx=0).stop 2024-09-13T06:30:26.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 -- 172.21.15.169:0/1856335233 shutdown_connections 2024-09-13T06:30:26.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 --2- 172.21.15.169:0/1856335233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26b58090 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 -- 172.21.15.169:0/1856335233 >> 172.21.15.169:0/1856335233 conn(0x559c26ac5270 msgr2=0x559c26ac5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 -- 172.21.15.169:0/1856335233 shutdown_connections 2024-09-13T06:30:26.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.446+0000 7f6018f6c980 1 -- 172.21.15.169:0/1856335233 wait complete. 2024-09-13T06:30:26.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6018f6c980 1 Processor -- start 2024-09-13T06:30:26.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6018f6c980 1 -- start start 2024-09-13T06:30:26.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6018f6c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 0x559c26c3cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6018f6c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559c269fd200 con 0x559c26b51920 2024-09-13T06:30:26.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 0x559c26c3cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 0x559c26c3cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39316/0 (socket says 172.21.15.169:39316) 2024-09-13T06:30:26.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6016a7c640 1 -- 172.21.15.169:0/1215778779 learned_addr learned my addr 172.21.15.169:0/1215778779 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.462+0000 7f6016a7c640 1 -- 172.21.15.169:0/1215778779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c26c3d310 con 0x559c26b51920 2024-09-13T06:30:26.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6016a7c640 1 --2- 172.21.15.169:0/1215778779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 0x559c26c3cd40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6008001e20 tx=0x7f600800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbc6dd350ac0c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f5f04e09640 1 -- 172.21.15.169:0/1215778779 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008012020 con 0x559c26b51920 2024-09-13T06:30:26.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f5f04e09640 1 -- 172.21.15.169:0/1215778779 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600800e7c0 con 0x559c26b51920 2024-09-13T06:30:26.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f5f04e09640 1 -- 172.21.15.169:0/1215778779 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600800eb00 con 0x559c26b51920 2024-09-13T06:30:26.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/1215778779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 msgr2=0x559c26c3cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 --2- 172.21.15.169:0/1215778779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 0x559c26c3cd40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6008001e20 tx=0x7f600800b790 comp rx=0 tx=0).stop 2024-09-13T06:30:26.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/1215778779 shutdown_connections 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 --2- 172.21.15.169:0/1215778779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b51920 0x559c26c3cd40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/1215778779 >> 172.21.15.169:0/1215778779 conn(0x559c26ac5270 msgr2=0x559c26c38970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/1215778779 shutdown_connections 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/1215778779 wait complete. 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 Processor -- start 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- start start 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26c44330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559c26b590e0 con 0x559c26b55ca0 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26c44330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26c44330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39320/0 (socket says 172.21.15.169:39320) 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6016a7c640 1 -- 172.21.15.169:0/2848928568 learned_addr learned my addr 172.21.15.169:0/2848928568 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6016a7c640 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c26c44870 con 0x559c26b55ca0 2024-09-13T06:30:26.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26c44330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6008001e20 tx=0x7f6008000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f5f03606640 1 -- 172.21.15.169:0/2848928568 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008012030 con 0x559c26b55ca0 2024-09-13T06:30:26.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c26c44b00 con 0x559c26b55ca0 2024-09-13T06:30:26.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c26c477e0 con 0x559c26b55ca0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f5f03606640 1 -- 172.21.15.169:0/2848928568 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6008001480 con 0x559c26b55ca0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.466+0000 7f5f03606640 1 -- 172.21.15.169:0/2848928568 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600801a880 con 0x559c26b55ca0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f5f03606640 1 -- 172.21.15.169:0/2848928568 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6008015020 con 0x559c26b55ca0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f5f03606640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5efc0346a0 0x7f5efc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f5f03606640 1 -- 172.21.15.169:0/2848928568 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f6008020030 con 0x559c26b55ca0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f601627b640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5efc0346a0 0x7f5efc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c492b0 0x559c26c4b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c4bc70 con 0x559c26c492b0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f601727d640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c492b0 0x559c26c4b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f601627b640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5efc0346a0 0x7f5efc036b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f600c0ad000 tx=0x7f600c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f601727d640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c492b0 0x559c26c4b6a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f601727d640 1 -- 172.21.15.169:0/2848928568 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c492b0 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c4ca60 0x559c26c4ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c4f480 con 0x559c26c4ca60 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c4ca60 0x559c26c4ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c4ca60 0x559c26c4ee50 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.470+0000 7f6016a7c640 1 -- 172.21.15.169:0/2848928568 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6008008030 con 0x559c26c4ca60 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c50d30 con 0x559c26c4ca60 2024-09-13T06:30:26.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6016a7c640 1 -- 172.21.15.169:0/2848928568 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6008008030 con 0x559c26c4ca60 2024-09-13T06:30:26.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c4fea0 con 0x559c26c4ca60 2024-09-13T06:30:26.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6016a7c640 1 -- 172.21.15.169:0/2848928568 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6008008030 con 0x559c26c4ca60 2024-09-13T06:30:26.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c520e0 0x559c26c544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c54a10 con 0x559c26c520e0 2024-09-13T06:30:26.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f601627b640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c520e0 0x559c26c544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f601627b640 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c520e0 0x559c26c544d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f601627b640 1 -- 172.21.15.169:0/2848928568 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f600c0b3040 con 0x559c26c520e0 2024-09-13T06:30:26.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 Processor -- start 2024-09-13T06:30:26.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 -- start start 2024-09-13T06:30:26.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 0x559c26c62810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6018f6c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559c26a56800 con 0x559c26c623f0 2024-09-13T06:30:26.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 0x559c26c62810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 0x559c26c62810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39324/0 (socket says 172.21.15.169:39324) 2024-09-13T06:30:26.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.474+0000 7f6016a7c640 1 -- 172.21.15.169:0/2625548050 learned_addr learned my addr 172.21.15.169:0/2625548050 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6016a7c640 1 -- 172.21.15.169:0/2625548050 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c26c62d50 con 0x559c26c623f0 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 0x559c26c62810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f600802cfd0 tx=0x7f600800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f5f00e01640 1 -- 172.21.15.169:0/2625548050 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008016530 con 0x559c26c623f0 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c26c62f80 con 0x559c26c623f0 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f5f00e01640 1 -- 172.21.15.169:0/2625548050 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600803f020 con 0x559c26c623f0 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f5f00e01640 1 -- 172.21.15.169:0/2625548050 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008016860 con 0x559c26c623f0 2024-09-13T06:30:26.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c26c62f80 con 0x559c26c623f0 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f5f00e01640 1 -- 172.21.15.169:0/2625548050 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6008009070 con 0x559c26c623f0 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f5f00e01640 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ef0034650 0x7f5ef0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f5f00e01640 1 -- 172.21.15.169:0/2625548050 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f6008040030 con 0x559c26c623f0 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f601627b640 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ef0034650 0x7f5ef0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6018f6c980 1 Processor -- start 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6018f6c980 1 -- start start 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6018f6c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f601627b640 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ef0034650 0x7f5ef0036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x559c26c48920 tx=0x7f600c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6018f6c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559c26c3d690 con 0x559c26c6e960 2024-09-13T06:30:26.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c6ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39332/0 (socket says 172.21.15.169:39332) 2024-09-13T06:30:26.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.478+0000 7f6016a7c640 1 -- 172.21.15.169:0/3752900692 learned_addr learned my addr 172.21.15.169:0/3752900692 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 -- 172.21.15.169:0/3752900692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c26c6f310 con 0x559c26c6e960 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 --2- 172.21.15.169:0/3752900692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c6ed40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6008017fb0 tx=0x7f6008041400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d10e9134e61452 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f5efa7fc640 1 -- 172.21.15.169:0/3752900692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008041ae0 con 0x559c26c6e960 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f5efa7fc640 1 -- 172.21.15.169:0/3752900692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6008057070 con 0x559c26c6e960 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f5efa7fc640 1 -- 172.21.15.169:0/3752900692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008041610 con 0x559c26c6e960 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/3752900692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 msgr2=0x559c26c6ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 --2- 172.21.15.169:0/3752900692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c6ed40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6008017fb0 tx=0x7f6008041400 comp rx=0 tx=0).stop 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/3752900692 shutdown_connections 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 --2- 172.21.15.169:0/3752900692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c6ed40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/3752900692 >> 172.21.15.169:0/3752900692 conn(0x559c26c6ad40 msgr2=0x559c26c68e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/3752900692 shutdown_connections 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/3752900692 wait complete. 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 Processor -- start 2024-09-13T06:30:26.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- start start 2024-09-13T06:30:26.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c75be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559c26c6f7b0 con 0x559c26c6e960 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c75be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c75be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39344/0 (socket says 172.21.15.169:39344) 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 learned_addr learned my addr 172.21.15.169:0/2695920710 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c26c76120 con 0x559c26c6e960 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c75be0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f600802f080 tx=0x7f6008030120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f5ef8ff9640 1 -- 172.21.15.169:0/2695920710 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60080459b0 con 0x559c26c6e960 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c26c76120 con 0x559c26c6e960 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f5ef8ff9640 1 -- 172.21.15.169:0/2695920710 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6008045b50 con 0x559c26c6e960 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f5ef8ff9640 1 -- 172.21.15.169:0/2695920710 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600803b920 con 0x559c26c6e960 2024-09-13T06:30:26.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.482+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c26c76120 con 0x559c26c6e960 2024-09-13T06:30:26.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f5ef8ff9640 1 -- 172.21.15.169:0/2695920710 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6008071020 con 0x559c26c6e960 2024-09-13T06:30:26.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f5ef8ff9640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ee0034650 0x7f5ee0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f5ef8ff9640 1 -- 172.21.15.169:0/2695920710 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7f600806f020 con 0x559c26c6e960 2024-09-13T06:30:26.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601627b640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ee0034650 0x7f5ee0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c80c70 0x559c26c83130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c83880 con 0x559c26c80c70 2024-09-13T06:30:26.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601727d640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c80c70 0x559c26c83130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601627b640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ee0034650 0x7f5ee0036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f600c000c10 tx=0x7f600c0b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601727d640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c80c70 0x559c26c83130 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 realm 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c80120 con 0x559c26c80c70 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:26.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c84350 con 0x559c26c80c70 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c85100 0x559c26c874f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c87b70 con 0x559c26c85100 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c85100 0x559c26c874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.486+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c85100 0x559c26c874f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:26.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 20 searching for the correct realm 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c8a130 0x559c26c8c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8cba0 con 0x559c26c8a130 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f601627b640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c8a130 0x559c26c8c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f601627b640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c8a130 0x559c26c8c520 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8cba0 con 0x559c26c85100 2024-09-13T06:30:26.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6016a7c640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6008048730 0x7f6008025050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x7f6008048730 2024-09-13T06:30:26.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.490+0000 7f601727d640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6008048730 0x7f6008025050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6008048730 0x7f6008025050 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c8a130 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x7f6008048730 2024-09-13T06:30:26.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.494+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x7f6008048730 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c8a130 2024-09-13T06:30:26.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c8a130 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c8a130 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.498+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x7f6008048730 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c80c70 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x7f6008048730 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c8a130 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x7f6008048730 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c8a130 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.502+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559c26c883c0 con 0x559c26c85100 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c88c10 con 0x559c26c80c70 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c89000 con 0x559c26c85100 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c89000 con 0x559c26c8a130 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:26.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 zone default found 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 4 Realm: () 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 zonegroup default 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8d020 con 0x7f6008048730 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8ee30 con 0x559c26c8a130 2024-09-13T06:30:26.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8f270 con 0x559c26c8a130 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 started sync module instance, tier type = 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:26.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.506+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8e240 con 0x559c26c85100 2024-09-13T06:30:26.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94129153959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8e240 con 0x559c26c85100 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c8fd30 con 0x559c26c80c70 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94129153964096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c905d0 con 0x559c26c80c70 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c91010 con 0x559c26c85100 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.510+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94129153959744] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94129153964096] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94129153968864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c90120 con 0x559c26c85100 2024-09-13T06:30:26.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c918b0 con 0x7f6008048730 2024-09-13T06:30:26.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94129153971200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c90120 con 0x7f6008048730 2024-09-13T06:30:26.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c92370 con 0x559c26c85100 2024-09-13T06:30:26.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.514+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94129153968864] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94129153971200] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94129153972256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c92330 con 0x559c26c85100 2024-09-13T06:30:26.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c92760 con 0x559c26c8a130 2024-09-13T06:30:26.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94129153957264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c93000 con 0x559c26c8a130 2024-09-13T06:30:26.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c93a00 con 0x559c26c8a130 2024-09-13T06:30:26.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94129153972256] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94129153957264] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.518+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94129153977168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c93510 con 0x559c26c8a130 2024-09-13T06:30:26.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c94410 con 0x7f6008048730 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94129153977168] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94129153973824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c94410 con 0x7f6008048730 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=0 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=1 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=2 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=3 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=4 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=5 2024-09-13T06:30:26.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=6 2024-09-13T06:30:26.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94129153973824] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 20 add_watcher() i=7 2024-09-13T06:30:26.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:26.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26c976f0 con 0x559c26c80c70 2024-09-13T06:30:26.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.522+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94129153982672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c949a0 con 0x559c26c80c70 2024-09-13T06:30:26.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94129153982672] v33'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f5ecd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:26.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:26.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:26.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 5 note: GC not initialized 2024-09-13T06:30:26.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f5e47fff640 20 reqs_thread_entry: start 2024-09-13T06:30:26.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:26.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 Filter name: none 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f5e45ffb640 20 reqs_thread_entry: start 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26cbae90 con 0x7f6008048730 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb9630 con 0x559c26c8a130 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:30:26.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:30:26.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:30:26.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:30:26.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.526+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb9f00 con 0x7f6008048730 2024-09-13T06:30:26.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:30:26.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:30:26.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:30:26.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94129154136656 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26cbe930 con 0x559c26c8a130 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== watch-notify(notify (1) cookie 94129153957264 notify 141733920801 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559c26b595e0 con 0x559c26c8a130 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f5efa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94129153957264 notifier 4736 bl.length()=556 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f5efa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f5efa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f5efa7fc640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5edc003eb0 con 0x559c26c8a130 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(65 notify.5 [notify cookie 94129154136656 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== watch-notify(notify_complete (2) cookie 94129154136656 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f600c0b7560 con 0x559c26c8a130 2024-09-13T06:30:26.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb9a50 con 0x559c26c8a130 2024-09-13T06:30:26.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:30:26.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:30:26.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:30:26.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.530+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94129154136656 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559c26cbe930 con 0x559c26c85100 2024-09-13T06:30:26.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94129153968864 notify 141733920807 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f6008033040 con 0x559c26c85100 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f5ef9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 94129153968864 notifier 4736 bl.length()=177 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f5ef9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [notify cookie 94129154136656 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f5ef9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f5ef9ffb640 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5e4c003410 con 0x559c26c85100 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94129154136656 notify 141733920807 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6008046040 con 0x559c26c85100 2024-09-13T06:30:26.537 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:30:26.531995Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:30:26.531976Z","tags":[],"group_ids":[]} 2024-09-13T06:30:26.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f5ecd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:26.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.534+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94129153982672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c80c70 2024-09-13T06:30:26.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.538+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94129153982672] v33'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.538+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94129153959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c85100 2024-09-13T06:30:26.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.538+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94129153959744] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.538+0000 7f6018f6c980 20 remove_watcher() i=0 2024-09-13T06:30:26.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.538+0000 7f6018f6c980 2 removed watcher, disabling cache 2024-09-13T06:30:26.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.538+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94129153964096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c80c70 2024-09-13T06:30:26.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94129153964096] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x559c26c80c70 2024-09-13T06:30:26.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6018f6c980 20 remove_watcher() i=1 2024-09-13T06:30:26.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94129153968864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c85100 2024-09-13T06:30:26.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94129153968864] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6018f6c980 20 remove_watcher() i=2 2024-09-13T06:30:26.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94129153971200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c90ae0 con 0x7f6008048730 2024-09-13T06:30:26.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94129153971200] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6018f6c980 20 remove_watcher() i=3 2024-09-13T06:30:26.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.542+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94129153972256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c85100 2024-09-13T06:30:26.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.546+0000 7f6016a7c640 1 -- 172.21.15.169:0/2695920710 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94129153972256] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6008067040 con 0x559c26c85100 2024-09-13T06:30:26.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.546+0000 7f6018f6c980 20 remove_watcher() i=4 2024-09-13T06:30:26.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.546+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94129153957264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c8a130 2024-09-13T06:30:26.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.546+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94129153957264] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.546+0000 7f6018f6c980 20 remove_watcher() i=5 2024-09-13T06:30:26.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.546+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94129153977168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26cb8c30 con 0x559c26c8a130 2024-09-13T06:30:26.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f601627b640 1 -- 172.21.15.169:0/2695920710 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94129153977168] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c0c9030 con 0x559c26c8a130 2024-09-13T06:30:26.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 20 remove_watcher() i=6 2024-09-13T06:30:26.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94129153973824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559c26c92b50 con 0x7f6008048730 2024-09-13T06:30:26.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94129153973824] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x7f6008048730 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 20 remove_watcher() i=7 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c85100 msgr2=0x559c26c874f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c85100 0x559c26c874f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c80c70 msgr2=0x559c26c83130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c80c70 0x559c26c83130 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6008048730 msgr2=0x7f6008025050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6008048730 0x7f6008025050 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c8a130 msgr2=0x559c26c8c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c8a130 0x559c26c8c520 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ee0034650 msgr2=0x7f5ee0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ee0034650 0x7f5ee0036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f600c000c10 tx=0x7f600c0b9040 comp rx=0 tx=0).stop 2024-09-13T06:30:26.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 msgr2=0x559c26c75be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c75be0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f600802f080 tx=0x7f6008030120 comp rx=0 tx=0).stop 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f601727d640 1 -- 172.21.15.169:0/2695920710 reap_dead start 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 shutdown_connections 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2695920710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c6e960 0x559c26c75be0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 >> 172.21.15.169:0/2695920710 conn(0x559c26c6ad40 msgr2=0x559c26c68e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 shutdown_connections 2024-09-13T06:30:26.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2695920710 wait complete. 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ef0034650 msgr2=0x7f5ef0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ef0034650 0x7f5ef0036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x559c26c48920 tx=0x7f600c005a10 comp rx=0 tx=0).stop 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 msgr2=0x559c26c62810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 0x559c26c62810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f600802cfd0 tx=0x7f600800df80 comp rx=0 tx=0).stop 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 shutdown_connections 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5ef0034650 0x7f5ef0036b10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2625548050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26c623f0 0x559c26c62810 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 >> 172.21.15.169:0/2625548050 conn(0x559c26c57540 msgr2=0x559c26c59fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 shutdown_connections 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.550+0000 7f6018f6c980 1 -- 172.21.15.169:0/2625548050 wait complete. 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c4ca60 msgr2=0x559c26c4ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x559c26c4ca60 0x559c26c4ee50 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c492b0 msgr2=0x559c26c4b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x559c26c492b0 0x559c26c4b6a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c520e0 msgr2=0x559c26c544d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x559c26c520e0 0x559c26c544d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5efc0346a0 msgr2=0x7f5efc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5efc0346a0 0x7f5efc036b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f600c0ad000 tx=0x7f600c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 msgr2=0x559c26c44330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 --2- 172.21.15.169:0/2848928568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559c26b55ca0 0x559c26c44330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6008001e20 tx=0x7f6008000ee0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f601727d640 1 -- 172.21.15.169:0/2848928568 reap_dead start 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 shutdown_connections 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 >> 172.21.15.169:0/2848928568 conn(0x559c26ac5270 msgr2=0x559c26c374f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 shutdown_connections 2024-09-13T06:30:26.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.554+0000 7f6018f6c980 1 -- 172.21.15.169:0/2848928568 wait complete. 2024-09-13T06:30:26.566 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:30:26.531995Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:30:26.531976Z', 'tags': [], 'group_ids': []} 2024-09-13T06:30:26.589 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:30:26.596 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T06:30:26.596 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T06:30:26.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T06:30:26.596 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T06:30:26.630 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:26.630 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:26.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb291036980 1 Processor -- start 2024-09-13T06:30:26.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb291036980 1 -- start start 2024-09-13T06:30:26.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb291036980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558ecbe7b8f0 0x558ecbe7bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb291036980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ecbd01ae0 con 0x558ecbe7c240 2024-09-13T06:30:26.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb291036980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x558ecbd25e30 con 0x558ecbe7b8f0 2024-09-13T06:30:26.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb28eb46640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558ecbe7b8f0 0x558ecbe7bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb28eb46640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558ecbe7b8f0 0x558ecbe7bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39356/0 (socket says 172.21.15.169:39356) 2024-09-13T06:30:26.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb28eb46640 1 -- 172.21.15.169:0/4261743896 learned_addr learned my addr 172.21.15.169:0/4261743896 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb28e345640 1 --1- 172.21.15.169:0/4261743896 >> v1:172.21.15.112:6789/0 conn(0x558ecbe7c240 0x558ecbe80c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57542/0 (socket says 172.21.15.169:57542) 2024-09-13T06:30:26.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb28eb46640 1 -- 172.21.15.169:0/4261743896 >> v1:172.21.15.112:6789/0 conn(0x558ecbe7c240 legacy=0x558ecbe80c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.630+0000 7fb28eb46640 1 -- 172.21.15.169:0/4261743896 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecbe834c0 con 0x558ecbe7b8f0 2024-09-13T06:30:26.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb28eb46640 1 --2- 172.21.15.169:0/4261743896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbe7bcd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb28000a4e0 tx=0x7fb28001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db162b6faca64f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb28db44640 1 -- 172.21.15.169:0/4261743896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800aa540 con 0x558ecbe7b8f0 2024-09-13T06:30:26.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb28db44640 1 -- 172.21.15.169:0/4261743896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800aa6e0 con 0x558ecbe7b8f0 2024-09-13T06:30:26.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb28db44640 1 -- 172.21.15.169:0/4261743896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800aaa40 con 0x558ecbe7b8f0 2024-09-13T06:30:26.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 -- 172.21.15.169:0/4261743896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 msgr2=0x558ecbe7bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 --2- 172.21.15.169:0/4261743896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbe7bcd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb28000a4e0 tx=0x7fb28001b090 comp rx=0 tx=0).stop 2024-09-13T06:30:26.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 -- 172.21.15.169:0/4261743896 shutdown_connections 2024-09-13T06:30:26.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 --2- 172.21.15.169:0/4261743896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbe7bcd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 -- 172.21.15.169:0/4261743896 >> 172.21.15.169:0/4261743896 conn(0x558ecbdef240 msgr2=0x558ecbdef650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 -- 172.21.15.169:0/4261743896 shutdown_connections 2024-09-13T06:30:26.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.634+0000 7fb291036980 1 -- 172.21.15.169:0/4261743896 wait complete. 2024-09-13T06:30:26.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 Processor -- start 2024-09-13T06:30:26.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- start start 2024-09-13T06:30:26.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf66be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558ecbd27200 con 0x558ecbe7b8f0 2024-09-13T06:30:26.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf66be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf66be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39366/0 (socket says 172.21.15.169:39366) 2024-09-13T06:30:26.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb28eb46640 1 -- 172.21.15.169:0/3350312914 learned_addr learned my addr 172.21.15.169:0/3350312914 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb28eb46640 1 -- 172.21.15.169:0/3350312914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecbf671b0 con 0x558ecbe7b8f0 2024-09-13T06:30:26.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb28eb46640 1 --2- 172.21.15.169:0/3350312914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf66be0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb280017ca0 tx=0x7fb2800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ea270c6fab5d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb17ce09640 1 -- 172.21.15.169:0/3350312914 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b9030 con 0x558ecbe7b8f0 2024-09-13T06:30:26.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb17ce09640 1 -- 172.21.15.169:0/3350312914 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800aaac0 con 0x558ecbe7b8f0 2024-09-13T06:30:26.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb17ce09640 1 -- 172.21.15.169:0/3350312914 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800aada0 con 0x558ecbe7b8f0 2024-09-13T06:30:26.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- 172.21.15.169:0/3350312914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 msgr2=0x558ecbf66be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 --2- 172.21.15.169:0/3350312914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf66be0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb280017ca0 tx=0x7fb2800033b0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- 172.21.15.169:0/3350312914 shutdown_connections 2024-09-13T06:30:26.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 --2- 172.21.15.169:0/3350312914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf66be0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- 172.21.15.169:0/3350312914 >> 172.21.15.169:0/3350312914 conn(0x558ecbdef240 msgr2=0x558ecbf62810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- 172.21.15.169:0/3350312914 shutdown_connections 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.650+0000 7fb291036980 1 -- 172.21.15.169:0/3350312914 wait complete. 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 Processor -- start 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 -- start start 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf6de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558ecbe82f00 con 0x558ecbe7b8f0 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf6de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf6de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39378/0 (socket says 172.21.15.169:39378) 2024-09-13T06:30:26.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28eb46640 1 -- 172.21.15.169:0/651801486 learned_addr learned my addr 172.21.15.169:0/651801486 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28eb46640 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecbf6e390 con 0x558ecbe7b8f0 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28eb46640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf6de50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb280005cc0 tx=0x7fb280017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb17b606640 1 -- 172.21.15.169:0/651801486 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b9030 con 0x558ecbe7b8f0 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ecbf6e620 con 0x558ecbe7b8f0 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb17b606640 1 -- 172.21.15.169:0/651801486 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800c3070 con 0x558ecbe7b8f0 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecbf71300 con 0x558ecbe7b8f0 2024-09-13T06:30:26.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb17b606640 1 -- 172.21.15.169:0/651801486 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800cc060 con 0x558ecbe7b8f0 2024-09-13T06:30:26.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb17b606640 1 -- 172.21.15.169:0/651801486 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2800c5030 con 0x558ecbe7b8f0 2024-09-13T06:30:26.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb17b606640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb1740346a0 0x7fb174036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb17b606640 1 -- 172.21.15.169:0/651801486 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb2800ba070 con 0x558ecbe7b8f0 2024-09-13T06:30:26.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28e345640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb1740346a0 0x7fb174036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbe7c240 0x558ecbf74de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbf75400 con 0x558ecbe7c240 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.654+0000 7fb28f347640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbe7c240 0x558ecbf74de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28e345640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb1740346a0 0x7fb174036b60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb284000f70 tx=0x7fb284001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28f347640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbe7c240 0x558ecbf74de0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28f347640 1 -- 172.21.15.169:0/651801486 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbe7c240 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbf76220 0x558ecbf78610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbf78c40 con 0x558ecbf76220 2024-09-13T06:30:26.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28eb46640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbf76220 0x558ecbf78610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28eb46640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbf76220 0x558ecbf78610 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28eb46640 1 -- 172.21.15.169:0/651801486 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbf76220 2024-09-13T06:30:26.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbf7a4f0 con 0x558ecbf76220 2024-09-13T06:30:26.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28eb46640 1 -- 172.21.15.169:0/651801486 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbf76220 2024-09-13T06:30:26.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbf79720 con 0x558ecbf76220 2024-09-13T06:30:26.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28eb46640 1 -- 172.21.15.169:0/651801486 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbf76220 2024-09-13T06:30:26.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbf7b8a0 0x558ecbf7dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbf7e1d0 con 0x558ecbf7b8a0 2024-09-13T06:30:26.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.658+0000 7fb28e345640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbf7b8a0 0x558ecbf7dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28e345640 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbf7b8a0 0x558ecbf7dc90 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28e345640 1 -- 172.21.15.169:0/651801486 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb28400f6a0 con 0x558ecbf7b8a0 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb291036980 1 Processor -- start 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb291036980 1 -- start start 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb291036980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 0x558ecbf8bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb291036980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558ecbd80800 con 0x558ecbf8bb90 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 0x558ecbf8bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 0x558ecbf8bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39392/0 (socket says 172.21.15.169:39392) 2024-09-13T06:30:26.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28eb46640 1 -- 172.21.15.169:0/2749161798 learned_addr learned my addr 172.21.15.169:0/2749161798 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28eb46640 1 -- 172.21.15.169:0/2749161798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecbf8c4f0 con 0x558ecbf8bb90 2024-09-13T06:30:26.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb28eb46640 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 0x558ecbf8bfb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb2800d0b50 tx=0x7fb2800c66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb178e01640 1 -- 172.21.15.169:0/2749161798 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800c6a90 con 0x558ecbf8bb90 2024-09-13T06:30:26.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ecbf8c780 con 0x558ecbf8bb90 2024-09-13T06:30:26.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb178e01640 1 -- 172.21.15.169:0/2749161798 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800dd0d0 con 0x558ecbf8bb90 2024-09-13T06:30:26.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb178e01640 1 -- 172.21.15.169:0/2749161798 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800dd3b0 con 0x558ecbf8bb90 2024-09-13T06:30:26.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecbf8f400 con 0x558ecbf8bb90 2024-09-13T06:30:26.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb178e01640 1 -- 172.21.15.169:0/2749161798 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2800b3040 con 0x558ecbf8bb90 2024-09-13T06:30:26.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.662+0000 7fb178e01640 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb168034650 0x7fb168036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb178e01640 1 -- 172.21.15.169:0/2749161798 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb2800e6cc0 con 0x558ecbf8bb90 2024-09-13T06:30:26.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28e345640 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb168034650 0x7fb168036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 Processor -- start 2024-09-13T06:30:26.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- start start 2024-09-13T06:30:26.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28e345640 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb168034650 0x7fb168036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x558ecbf72440 tx=0x7fb28400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf98900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558ecbf67470 con 0x558ecbf98520 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf98900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf98900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39396/0 (socket says 172.21.15.169:39396) 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 -- 172.21.15.169:0/3935066881 learned_addr learned my addr 172.21.15.169:0/3935066881 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 -- 172.21.15.169:0/3935066881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecbf98ed0 con 0x558ecbf98520 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 --2- 172.21.15.169:0/3935066881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf98900 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b5d10 tx=0x7fb2800bd4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7358c2f7c3a310f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb1727fc640 1 -- 172.21.15.169:0/3935066881 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800d2dc0 con 0x558ecbf98520 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb1727fc640 1 -- 172.21.15.169:0/3935066881 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800e3950 con 0x558ecbf98520 2024-09-13T06:30:26.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb1727fc640 1 -- 172.21.15.169:0/3935066881 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b43a0 con 0x558ecbf98520 2024-09-13T06:30:26.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- 172.21.15.169:0/3935066881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 msgr2=0x558ecbf98900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 --2- 172.21.15.169:0/3935066881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf98900 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b5d10 tx=0x7fb2800bd4c0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- 172.21.15.169:0/3935066881 shutdown_connections 2024-09-13T06:30:26.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 --2- 172.21.15.169:0/3935066881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf98900 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- 172.21.15.169:0/3935066881 >> 172.21.15.169:0/3935066881 conn(0x558ecbf94900 msgr2=0x558ecbf92a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- 172.21.15.169:0/3935066881 shutdown_connections 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- 172.21.15.169:0/3935066881 wait complete. 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 Processor -- start 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- start start 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf9f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb291036980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558ecbf99370 con 0x558ecbf98520 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf9f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39408/0 (socket says 172.21.15.169:39408) 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.666+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 learned_addr learned my addr 172.21.15.169:0/4221520846 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecbf9fc40 con 0x558ecbf98520 2024-09-13T06:30:26.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28eb46640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf9f700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb2800e2640 tx=0x7fb2800d9f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb170ff9640 1 -- 172.21.15.169:0/4221520846 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800fc040 con 0x558ecbf98520 2024-09-13T06:30:26.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ecbf9fc40 con 0x558ecbf98520 2024-09-13T06:30:26.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb170ff9640 1 -- 172.21.15.169:0/4221520846 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800a9ce0 con 0x558ecbf98520 2024-09-13T06:30:26.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb170ff9640 1 -- 172.21.15.169:0/4221520846 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b4a40 con 0x558ecbf98520 2024-09-13T06:30:26.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecbf9fc40 con 0x558ecbf98520 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb170ff9640 1 -- 172.21.15.169:0/4221520846 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb280109020 con 0x558ecbf98520 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb170ff9640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb158034650 0x7fb158036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb170ff9640 1 -- 172.21.15.169:0/4221520846 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb280107020 con 0x558ecbf98520 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28e345640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb158034650 0x7fb158036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbfaa7f0 0x558ecbfaccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfad400 con 0x558ecbfaa7f0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28f347640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbfaa7f0 0x558ecbfaccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28e345640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb158034650 0x7fb158036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb28400ffd0 tx=0x7fb284010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28f347640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbfaa7f0 0x558ecbfaccb0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 20 realm 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.670+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfa9c70 con 0x558ecbfaa7f0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfadec0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbfaeca0 0x558ecbfb1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb1740 con 0x558ecbfaeca0 2024-09-13T06:30:26.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28eb46640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbfaeca0 0x558ecbfb1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28eb46640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbfaeca0 0x558ecbfb1090 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb1f90 con 0x558ecbfaeca0 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 20 searching for the correct realm 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbfb3d00 0x558ecbfb60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28e345640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbfb3d00 0x558ecbfb60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28e345640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbfb3d00 0x558ecbfb60f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.674+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb2800fda20 0x7fb2800cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x7fb2800fda20 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb2800fda20 0x7fb2800cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb2800fda20 0x7fb2800cf7b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.678+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x7fb2800fda20 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x7fb2800fda20 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.682+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x7fb2800fda20 2024-09-13T06:30:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaa7f0 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x7fb2800fda20 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x7fb2800fda20 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfb3d00 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.686+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb6720 con 0x558ecbfaeca0 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:26.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb2910 con 0x558ecbfaa7f0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb31b0 con 0x558ecbfaeca0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb2550 con 0x558ecbfb3d00 2024-09-13T06:30:26.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:26.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 zone default found 2024-09-13T06:30:26.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 4 Realm: () 2024-09-13T06:30:26.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:26.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 zonegroup default 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb7050 con 0x7fb2800fda20 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb8dd0 con 0x558ecbfb3d00 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb9340 con 0x558ecbfb3d00 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 started sync module instance, tier type = 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.690+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb8270 con 0x558ecbfaeca0 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94071795976080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb8270 con 0x558ecbfaeca0 2024-09-13T06:30:26.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb9dc0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94071795980560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfba660 con 0x558ecbfaa7f0 2024-09-13T06:30:26.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbb080 con 0x558ecbfaeca0 2024-09-13T06:30:26.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.694+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94071795976080] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94071795980560] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94071795985264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfba1b0 con 0x558ecbfaeca0 2024-09-13T06:30:26.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbb920 con 0x7fb2800fda20 2024-09-13T06:30:26.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94071795987568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfba1b0 con 0x7fb2800fda20 2024-09-13T06:30:26.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbc3a0 con 0x558ecbfaeca0 2024-09-13T06:30:26.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94071795987568] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.698+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94071795985264] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94071795973568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbbeb0 con 0x558ecbfaeca0 2024-09-13T06:30:26.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbcc40 con 0x558ecbfb3d00 2024-09-13T06:30:26.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94071795992464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbbeb0 con 0x558ecbfb3d00 2024-09-13T06:30:26.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbdab0 con 0x558ecbfb3d00 2024-09-13T06:30:26.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94071795973568] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94071795988624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbe300 con 0x558ecbfb3d00 2024-09-13T06:30:26.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbeb90 con 0x7fb2800fda20 2024-09-13T06:30:26.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.702+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94071795992464] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94071795988624] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94071795994592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbe300 con 0x7fb2800fda20 2024-09-13T06:30:26.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=0 2024-09-13T06:30:26.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=1 2024-09-13T06:30:26.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=2 2024-09-13T06:30:26.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=3 2024-09-13T06:30:26.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=4 2024-09-13T06:30:26.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=5 2024-09-13T06:30:26.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=6 2024-09-13T06:30:26.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94071795994592] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 20 add_watcher() i=7 2024-09-13T06:30:26.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:26.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbe300 con 0x558ecbfaa7f0 2024-09-13T06:30:26.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.706+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94071795998288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbf380 con 0x558ecbfaa7f0 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94071795998288] v33'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 5 note: GC not initialized 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb144fe1640 20 reqs_thread_entry: start 2024-09-13T06:30:26.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:26.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 20 Filter name: none 2024-09-13T06:30:26.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb13dffb640 20 reqs_thread_entry: start 2024-09-13T06:30:26.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T06:30:26.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe51c0 con 0x7fb2800fda20 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.710+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe9380 con 0x7fb2800fda20 2024-09-13T06:30:26.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.714+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v33'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.716 INFO:teuthology.orchestra.run.smithi169.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T06:30:26.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.714+0000 7fb145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:26.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.714+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94071795998288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe2ff0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94071795998288] v33'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94071795976080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe2ff0 con 0x558ecbfaeca0 2024-09-13T06:30:26.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94071795976080] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb291036980 20 remove_watcher() i=0 2024-09-13T06:30:26.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb291036980 2 removed watcher, disabling cache 2024-09-13T06:30:26.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94071795980560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe2ff0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94071795980560] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x558ecbfaa7f0 2024-09-13T06:30:26.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb291036980 20 remove_watcher() i=1 2024-09-13T06:30:26.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.718+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94071795985264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe2ff0 con 0x558ecbfaeca0 2024-09-13T06:30:26.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.722+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94071795985264] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.722+0000 7fb291036980 20 remove_watcher() i=2 2024-09-13T06:30:26.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.722+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94071795987568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbab70 con 0x7fb2800fda20 2024-09-13T06:30:26.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.722+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94071795987568] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.722+0000 7fb291036980 20 remove_watcher() i=3 2024-09-13T06:30:26.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.722+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94071795973568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfe2ff0 con 0x558ecbfaeca0 2024-09-13T06:30:26.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb28eb46640 1 -- 172.21.15.169:0/4221520846 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94071795973568] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800bf930 con 0x558ecbfaeca0 2024-09-13T06:30:26.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb291036980 20 remove_watcher() i=4 2024-09-13T06:30:26.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94071795992464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbb470 con 0x558ecbfb3d00 2024-09-13T06:30:26.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94071795992464] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb291036980 20 remove_watcher() i=5 2024-09-13T06:30:26.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94071795988624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfb7dc0 con 0x558ecbfb3d00 2024-09-13T06:30:26.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb28e345640 1 -- 172.21.15.169:0/4221520846 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94071795988624] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284037040 con 0x558ecbfb3d00 2024-09-13T06:30:26.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb291036980 20 remove_watcher() i=6 2024-09-13T06:30:26.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.726+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94071795994592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558ecbfbb920 con 0x7fb2800fda20 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94071795994592] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2880083f0 con 0x7fb2800fda20 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 20 remove_watcher() i=7 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbfaeca0 msgr2=0x558ecbfb1090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbfaeca0 0x558ecbfb1090 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbfaa7f0 msgr2=0x558ecbfaccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbfaa7f0 0x558ecbfaccb0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb2800fda20 msgr2=0x7fb2800cf7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb2800fda20 0x7fb2800cf7b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbfb3d00 msgr2=0x558ecbfb60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbfb3d00 0x558ecbfb60f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb158034650 msgr2=0x7fb158036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb158034650 0x7fb158036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb28400ffd0 tx=0x7fb284010000 comp rx=0 tx=0).stop 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb28f347640 1 -- 172.21.15.169:0/4221520846 reap_dead start 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 msgr2=0x558ecbf9f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf9f700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb2800e2640 tx=0x7fb2800d9f40 comp rx=0 tx=0).stop 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 shutdown_connections 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/4221520846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf98520 0x558ecbf9f700 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 >> 172.21.15.169:0/4221520846 conn(0x558ecbf94900 msgr2=0x558ecbf929d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 shutdown_connections 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/4221520846 wait complete. 2024-09-13T06:30:26.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb168034650 msgr2=0x7fb168036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb168034650 0x7fb168036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x558ecbf72440 tx=0x7fb28400f000 comp rx=0 tx=0).stop 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 msgr2=0x558ecbf8bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 0x558ecbf8bfb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb2800d0b50 tx=0x7fb2800c66b0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 shutdown_connections 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb168034650 0x7fb168036b10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/2749161798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbf8bb90 0x558ecbf8bfb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 >> 172.21.15.169:0/2749161798 conn(0x558ecbf80ce0 msgr2=0x558ecbf83760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 shutdown_connections 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/2749161798 wait complete. 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbf76220 msgr2=0x558ecbf78610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558ecbf76220 0x558ecbf78610 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbe7c240 msgr2=0x558ecbf74de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558ecbe7c240 0x558ecbf74de0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbf7b8a0 msgr2=0x558ecbf7dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558ecbf7b8a0 0x558ecbf7dc90 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb1740346a0 msgr2=0x7fb174036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb1740346a0 0x7fb174036b60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb284000f70 tx=0x7fb284001380 comp rx=0 tx=0).stop 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 msgr2=0x558ecbf6de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 --2- 172.21.15.169:0/651801486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558ecbe7b8f0 0x558ecbf6de50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb280005cc0 tx=0x7fb280017e30 comp rx=0 tx=0).stop 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb28f347640 1 -- 172.21.15.169:0/651801486 reap_dead start 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 shutdown_connections 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 >> 172.21.15.169:0/651801486 conn(0x558ecbdef240 msgr2=0x558ecbf61390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 shutdown_connections 2024-09-13T06:30:26.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.730+0000 7fb291036980 1 -- 172.21.15.169:0/651801486 wait complete. 2024-09-13T06:30:26.744 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:30:26.749 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:30:26.749 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T06:30:26.754 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:30:26.754 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T06:30:26.754 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T06:30:26.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T06:30:26.755 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T06:30:26.824 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:26.824 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:26.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11f45c980 1 Processor -- start 2024-09-13T06:30:26.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11f45c980 1 -- start start 2024-09-13T06:30:26.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11f45c980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55912e07aa90 0x55912e07ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11f45c980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55912defeae0 con 0x55912dfeb2e0 2024-09-13T06:30:26.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11f45c980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55912df22e30 con 0x55912e07aa90 2024-09-13T06:30:26.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11c76b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55912e07aa90 0x55912e07ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11c76b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55912e07aa90 0x55912e07ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39418/0 (socket says 172.21.15.169:39418) 2024-09-13T06:30:26.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11cf6c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55912dfeb2e0 0x55912e079370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57554/0 (socket says 172.21.15.169:57554) 2024-09-13T06:30:26.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11c76b640 1 -- 172.21.15.169:0/514732601 learned_addr learned my addr 172.21.15.169:0/514732601 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11c76b640 1 -- 172.21.15.169:0/514732601 >> v1:172.21.15.112:6789/0 conn(0x55912dfeb2e0 legacy=0x55912e079370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.822+0000 7fb11c76b640 1 -- 172.21.15.169:0/514732601 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55912e07e3d0 con 0x55912e07aa90 2024-09-13T06:30:26.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11c76b640 1 --2- 172.21.15.169:0/514732601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e07aa90 0x55912e07ce80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb11000a5c0 tx=0x7fb11001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ef15f9475cc3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11bf6a640 1 -- 172.21.15.169:0/514732601 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1100a6070 con 0x55912e07aa90 2024-09-13T06:30:26.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11bf6a640 1 -- 172.21.15.169:0/514732601 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1100af070 con 0x55912e07aa90 2024-09-13T06:30:26.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11bf6a640 1 -- 172.21.15.169:0/514732601 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1100aa5c0 con 0x55912e07aa90 2024-09-13T06:30:26.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 -- 172.21.15.169:0/514732601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e07aa90 msgr2=0x55912e07ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 --2- 172.21.15.169:0/514732601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e07aa90 0x55912e07ce80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb11000a5c0 tx=0x7fb11001b340 comp rx=0 tx=0).stop 2024-09-13T06:30:26.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 -- 172.21.15.169:0/514732601 shutdown_connections 2024-09-13T06:30:26.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 --2- 172.21.15.169:0/514732601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e07aa90 0x55912e07ce80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 -- 172.21.15.169:0/514732601 >> 172.21.15.169:0/514732601 conn(0x55912e0710a0 msgr2=0x55912e0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 -- 172.21.15.169:0/514732601 shutdown_connections 2024-09-13T06:30:26.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.826+0000 7fb11f45c980 1 -- 172.21.15.169:0/514732601 wait complete. 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 Processor -- start 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- start start 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e161a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55912df24200 con 0x55912dfeb2e0 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e161a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39434/0 (socket says 172.21.15.169:39434) 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11cf6c640 1 -- 172.21.15.169:0/621182305 learned_addr learned my addr 172.21.15.169:0/621182305 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11cf6c640 1 -- 172.21.15.169:0/621182305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55912e161fd0 con 0x55912dfeb2e0 2024-09-13T06:30:26.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/621182305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e161a00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb10c001e50 tx=0x7fb10c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ad9352b6a74b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb00ae0d640 1 -- 172.21.15.169:0/621182305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c00e5d0 con 0x55912dfeb2e0 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb00ae0d640 1 -- 172.21.15.169:0/621182305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c00e770 con 0x55912dfeb2e0 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb00ae0d640 1 -- 172.21.15.169:0/621182305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c00eab0 con 0x55912dfeb2e0 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- 172.21.15.169:0/621182305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 msgr2=0x55912e161a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 --2- 172.21.15.169:0/621182305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e161a00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb10c001e50 tx=0x7fb10c001e80 comp rx=0 tx=0).stop 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- 172.21.15.169:0/621182305 shutdown_connections 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 --2- 172.21.15.169:0/621182305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e161a00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- 172.21.15.169:0/621182305 >> 172.21.15.169:0/621182305 conn(0x55912e0710a0 msgr2=0x55912e15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- 172.21.15.169:0/621182305 shutdown_connections 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.842+0000 7fb11f45c980 1 -- 172.21.15.169:0/621182305 wait complete. 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 Processor -- start 2024-09-13T06:30:26.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 -- start start 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e076c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55912e07de40 con 0x55912dfeb2e0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e076c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e076c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39436/0 (socket says 172.21.15.169:39436) 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2936834401 learned_addr learned my addr 172.21.15.169:0/2936834401 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55912e077190 con 0x55912dfeb2e0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e076c50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x55912e162be0 tx=0x7fb10c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb00960a640 1 -- 172.21.15.169:0/2936834401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c001260 con 0x55912dfeb2e0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55912e075370 con 0x55912dfeb2e0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55912e075860 con 0x55912dfeb2e0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb00960a640 1 -- 172.21.15.169:0/2936834401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c00fa40 con 0x55912dfeb2e0 2024-09-13T06:30:26.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb00960a640 1 -- 172.21.15.169:0/2936834401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c02c060 con 0x55912dfeb2e0 2024-09-13T06:30:26.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb00960a640 1 -- 172.21.15.169:0/2936834401 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb10c017070 con 0x55912dfeb2e0 2024-09-13T06:30:26.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb00960a640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb0040346a0 0x7fb004036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb00960a640 1 -- 172.21.15.169:0/2936834401 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb10c015020 con 0x55912dfeb2e0 2024-09-13T06:30:26.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11c76b640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb0040346a0 0x7fb004036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e07aa90 0x55912e172190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1726d0 con 0x55912e07aa90 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11d76d640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e07aa90 0x55912e172190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.846+0000 7fb11c76b640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb0040346a0 0x7fb004036b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1100ae000 tx=0x7fb1100a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11d76d640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e07aa90 0x55912e172190 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11d76d640 1 -- 172.21.15.169:0/2936834401 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e07aa90 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e173140 0x55912e175600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e175d70 con 0x55912e173140 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e173140 0x55912e175600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e173140 0x55912e175600 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2936834401 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb10c02e070 con 0x55912e173140 2024-09-13T06:30:26.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e177620 con 0x55912e173140 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2936834401 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb10c02e070 con 0x55912e173140 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e176850 con 0x55912e173140 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2936834401 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb10c02e070 con 0x55912e173140 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1789d0 0x55912e17adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e17b300 con 0x55912e1789d0 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.850+0000 7fb11c76b640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1789d0 0x55912e17adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11c76b640 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1789d0 0x55912e17adc0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11c76b640 1 -- 172.21.15.169:0/2936834401 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1789d0 2024-09-13T06:30:26.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11f45c980 1 Processor -- start 2024-09-13T06:30:26.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11f45c980 1 -- start start 2024-09-13T06:30:26.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11f45c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 0x55912e189120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11f45c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55912df7d800 con 0x55912e188d00 2024-09-13T06:30:26.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 0x55912e189120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 0x55912e189120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39444/0 (socket says 172.21.15.169:39444) 2024-09-13T06:30:26.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11cf6c640 1 -- 172.21.15.169:0/1147285518 learned_addr learned my addr 172.21.15.169:0/1147285518 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11cf6c640 1 -- 172.21.15.169:0/1147285518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55912e189660 con 0x55912e188d00 2024-09-13T06:30:26.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 0x55912e189120 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb10c027fd0 tx=0x7fb10c01af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb0027fc640 1 -- 172.21.15.169:0/1147285518 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c0421b0 con 0x55912e188d00 2024-09-13T06:30:26.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55912e1898f0 con 0x55912e188d00 2024-09-13T06:30:26.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb0027fc640 1 -- 172.21.15.169:0/1147285518 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c01a690 con 0x55912e188d00 2024-09-13T06:30:26.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb0027fc640 1 -- 172.21.15.169:0/1147285518 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c01a990 con 0x55912e188d00 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55912e18c570 con 0x55912e188d00 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb0027fc640 1 -- 172.21.15.169:0/1147285518 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb10c0424a0 con 0x55912e188d00 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb0027fc640 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faff40347f0 0x7faff4036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb0027fc640 1 -- 172.21.15.169:0/1147285518 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb10c010570 con 0x55912e188d00 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.854+0000 7fb11c76b640 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faff40347f0 0x7faff4036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 Processor -- start 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- start start 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11c76b640 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faff40347f0 0x7faff4036cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55912e076320 tx=0x7fb110005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e1958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55912e162350 con 0x55912e1954e0 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e1958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e1958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39454/0 (socket says 172.21.15.169:39454) 2024-09-13T06:30:26.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2504883020 learned_addr learned my addr 172.21.15.169:0/2504883020 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 -- 172.21.15.169:0/2504883020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55912e195eb0 con 0x55912e1954e0 2024-09-13T06:30:26.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/2504883020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e1958e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00f700 tx=0x7fb10c053cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fbb82980032eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7faff3fff640 1 -- 172.21.15.169:0/2504883020 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c035e00 con 0x55912e1954e0 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7faff3fff640 1 -- 172.21.15.169:0/2504883020 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c062070 con 0x55912e1954e0 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7faff3fff640 1 -- 172.21.15.169:0/2504883020 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c033e00 con 0x55912e1954e0 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- 172.21.15.169:0/2504883020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 msgr2=0x55912e1958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2504883020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e1958e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00f700 tx=0x7fb10c053cd0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- 172.21.15.169:0/2504883020 shutdown_connections 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2504883020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e1958e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- 172.21.15.169:0/2504883020 >> 172.21.15.169:0/2504883020 conn(0x55912e191810 msgr2=0x55912e18f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- 172.21.15.169:0/2504883020 shutdown_connections 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- 172.21.15.169:0/2504883020 wait complete. 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 Processor -- start 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- start start 2024-09-13T06:30:26.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11f45c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55912e1963a0 con 0x55912e1954e0 2024-09-13T06:30:26.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39458/0 (socket says 172.21.15.169:39458) 2024-09-13T06:30:26.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.858+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 learned_addr learned my addr 172.21.15.169:0/212022366 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:26.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55912e19cb90 con 0x55912e1954e0 2024-09-13T06:30:26.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e19c650 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00f700 tx=0x7fb10c010210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7faff27fc640 1 -- 172.21.15.169:0/212022366 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c075070 con 0x55912e1954e0 2024-09-13T06:30:26.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55912e19cb90 con 0x55912e1954e0 2024-09-13T06:30:26.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7faff27fc640 1 -- 172.21.15.169:0/212022366 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c035e00 con 0x55912e1954e0 2024-09-13T06:30:26.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7faff27fc640 1 -- 172.21.15.169:0/212022366 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10c0535b0 con 0x55912e1954e0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55912e19d000 con 0x55912e1954e0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7faff27fc640 1 -- 172.21.15.169:0/212022366 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb10c078070 con 0x55912e1954e0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7faff27fc640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fafe80345b0 0x7fafe8036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7faff27fc640 1 -- 172.21.15.169:0/212022366 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fb10c07bc10 con 0x55912e1954e0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11c76b640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fafe80345b0 0x7fafe8036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e1a7770 0x55912e1a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1aa380 con 0x55912e1a7770 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11d76d640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e1a7770 0x55912e1a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11c76b640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fafe80345b0 0x7fafe8036a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb110000c10 tx=0x7fb1100c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11d76d640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e1a7770 0x55912e1a9c30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 realm 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1a6ba0 con 0x55912e1a7770 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1aae50 con 0x55912e1a7770 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e1abc30 0x55912e1ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.862+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1ae6a0 con 0x55912e1abc30 2024-09-13T06:30:26.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e1abc30 0x55912e1ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e1abc30 0x55912e1ae020 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1aeef0 con 0x55912e1abc30 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 20 searching for the correct realm 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1b0c60 0x55912e1b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11c76b640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1b0c60 0x55912e1b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11c76b640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1b0c60 0x55912e1b3050 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb10c07a060 0x7fb10c047650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.866+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x7fb10c07a060 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb10c07a060 0x7fb10c047650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb10c07a060 0x7fb10c047650 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x7fb10c07a060 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.870+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x7fb10c07a060 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x7fb10c07a060 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1a7770 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.874+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x7fb10c07a060 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x7fb10c07a060 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1b0c60 2024-09-13T06:30:26.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b36d0 con 0x55912e1abc30 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.878+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1af870 con 0x55912e1a7770 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1af480 con 0x55912e1abc30 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1af4d0 con 0x55912e1b0c60 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 zone default found 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 4 Realm: () 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:26.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 zonegroup default 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b3fe0 con 0x7fb10c07a060 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b5d60 con 0x55912e1b0c60 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b6150 con 0x55912e1b0c60 2024-09-13T06:30:26.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 started sync module instance, tier type = 2024-09-13T06:30:26.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:26.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.882+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b5200 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94082032162608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b5200 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b6bb0 con 0x55912e1a7770 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94082032166656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b7450 con 0x55912e1a7770 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b7e70 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94082032162608] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94082032166656] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94082032171360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b6fa0 con 0x55912e1abc30 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.886+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b8710 con 0x7fb10c07a060 2024-09-13T06:30:26.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94082032173664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b6fa0 con 0x7fb10c07a060 2024-09-13T06:30:26.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b91e0 con 0x55912e1abc30 2024-09-13T06:30:26.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94082032171360] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94082032173664] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94082032174720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b91a0 con 0x55912e1abc30 2024-09-13T06:30:26.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b9610 con 0x55912e1b0c60 2024-09-13T06:30:26.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94082032160080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1b9eb0 con 0x55912e1b0c60 2024-09-13T06:30:26.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.890+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1ba8b0 con 0x55912e1b0c60 2024-09-13T06:30:26.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94082032174720] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94082032160080] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94082032179712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1ba3c0 con 0x55912e1b0c60 2024-09-13T06:30:26.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1bb2c0 con 0x7fb10c07a060 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94082032179712] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94082032176336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1bb2c0 con 0x7fb10c07a060 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=0 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=1 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=2 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=3 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=4 2024-09-13T06:30:26.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=5 2024-09-13T06:30:26.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=6 2024-09-13T06:30:26.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94082032176336] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 20 add_watcher() i=7 2024-09-13T06:30:26.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:26.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1be560 con 0x55912e1a7770 2024-09-13T06:30:26.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.894+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94082032185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1bb850 con 0x55912e1a7770 2024-09-13T06:30:26.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.898+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94082032185216] v33'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.898+0000 7fafd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:26.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.898+0000 7fb11f45c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:26.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.898+0000 7fb11f45c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:26.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.898+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1bdd70 con 0x55912e1abc30 2024-09-13T06:30:26.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.902+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.902+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1bdd70 con 0x7fb10c07a060 2024-09-13T06:30:26.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.902+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.902+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c7640 con 0x55912e1b0c60 2024-09-13T06:30:26.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.902+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.902+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c7620 con 0x55912e1a7770 2024-09-13T06:30:26.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.906+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.906+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8060 con 0x55912e1abc30 2024-09-13T06:30:26.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.906+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.906+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8060 con 0x55912e1b0c60 2024-09-13T06:30:26.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.910+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.910+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c85d0 con 0x55912e1abc30 2024-09-13T06:30:26.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.910+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.910+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c85d0 con 0x55912e1a7770 2024-09-13T06:30:26.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.914+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.914+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8b40 con 0x55912e1abc30 2024-09-13T06:30:26.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.914+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.914+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8b40 con 0x55912e1abc30 2024-09-13T06:30:26.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.918+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.918+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8b40 con 0x55912e1abc30 2024-09-13T06:30:26.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.918+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.918+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8b40 con 0x55912e1b0c60 2024-09-13T06:30:26.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.918+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.918+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8f00 con 0x55912e1abc30 2024-09-13T06:30:26.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.922+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.922+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c8f00 con 0x55912e1a7770 2024-09-13T06:30:26.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.922+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.922+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1a7770 2024-09-13T06:30:26.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.926+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.926+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1abc30 2024-09-13T06:30:26.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.926+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.926+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1abc30 2024-09-13T06:30:26.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.930+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.930+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1b0c60 2024-09-13T06:30:26.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.930+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.930+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1abc30 2024-09-13T06:30:26.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.934+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.934+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1a7770 2024-09-13T06:30:26.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.934+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.934+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1abc30 2024-09-13T06:30:26.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.938+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.938+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1abc30 2024-09-13T06:30:26.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.938+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.938+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1b0c60 2024-09-13T06:30:26.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.942+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.942+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1abc30 2024-09-13T06:30:26.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.942+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.942+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c93b0 con 0x55912e1b0c60 2024-09-13T06:30:26.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.946+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.946+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x55912e1b0c60 2024-09-13T06:30:26.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.946+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.946+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x55912e1b0c60 2024-09-13T06:30:26.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.950+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.950+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x55912e1abc30 2024-09-13T06:30:26.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.950+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.950+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x55912e1a7770 2024-09-13T06:30:26.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.950+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.950+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x55912e1abc30 2024-09-13T06:30:26.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.954+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.954+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x55912e1a7770 2024-09-13T06:30:26.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.954+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.954+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1c9440 con 0x7fb10c07a060 2024-09-13T06:30:26.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fafd27e4640 20 reqs_thread_entry: start 2024-09-13T06:30:26.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:26.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 20 Filter name: none 2024-09-13T06:30:26.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fafcb7fe640 20 reqs_thread_entry: start 2024-09-13T06:30:26.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T06:30:26.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e49b0 con 0x7fb10c07a060 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:26.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e6e80 con 0x55912e1abc30 2024-09-13T06:30:26.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 : miss 2024-09-13T06:30:26.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.958+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 8.14 8:2b113b97:root::.bucket.meta.myfoo6%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e6e20 con 0x55912e1abc30 2024-09-13T06:30:26.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(96 .bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv4 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:30:26.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x17 2024-09-13T06:30:26.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:26.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:26.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:30:26.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 2024-09-13T06:30:26.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 4.a 4:53b35094:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e264350 con 0x55912e1abc30 2024-09-13T06:30:26.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(97 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 4.2f 4:f5cfa444:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e264350 con 0x55912e1a7770 2024-09-13T06:30:26.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(98 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:99 4.7 4:e0e5e61f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e264350 con 0x55912e1a7770 2024-09-13T06:30:26.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(99 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:100 4.37 4:ee29046d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e264350 con 0x7fb10c07a060 2024-09-13T06:30:26.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(100 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 4.20 4:07c23fd2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x55912e1abc30 2024-09-13T06:30:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(101 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:102 4.37 4:edee92ac:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x7fb10c07a060 2024-09-13T06:30:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(102 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 4.36 4:6ca78c8b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x7fb10c07a060 2024-09-13T06:30:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(103 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.962+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:104 4.1f 4:f8326c74:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x55912e1abc30 2024-09-13T06:30:26.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(104 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 4.9 4:939a328b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x55912e1a7770 2024-09-13T06:30:26.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(105 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8 [call out=85b] v0'0 uv19 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x55912e1abc30 2024-09-13T06:30:26.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(106 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [call out=345b] v0'0 uv5 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T06:30:26.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:107 4.1e 4:7a009d31:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e2642d0 con 0x55912e1a7770 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(107 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 20 get_obj_state: octx=0x7fb10c03a1c0 obj=myfoo6:thirteen state=0x55912e2623d8 s->prefetch_data=0 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:108 3.39 3:9f1015b8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e263200 con 0x55912e1b0c60 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(108 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 10 manifest: total_size = 8 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 20 get_obj_state: setting s->obj_tag to _z8s-58h3ZF5A5xlfBCV71Ih2DI1RodX 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 20 get_obj_state: octx=0x7fb10c03a1c0 obj=myfoo6:thirteen state=0x55912e2623d8 s->prefetch_data=0 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 20 prepare_atomic_modification: state is not atomic. state=0x55912e2623d8 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 2024-09-13T06:30:26.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.966+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:109 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e263ac0 con 0x55912e1abc30 2024-09-13T06:30:26.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(109 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 3.39 3:9f1015b8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e263ac0 con 0x55912e1b0c60 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(110 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9_thirteen [call] v33'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:111 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e263a10 con 0x55912e1abc30 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 4.a 4:53b35094:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e263a10 con 0x55912e1abc30 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:113 4.2f 4:f5cfa444:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1ef8c0 con 0x55912e1a7770 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:114 4.7 4:e0e5e61f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e263a10 con 0x55912e1a7770 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:115 4.37 4:ee29046d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1f4a30 con 0x7fb10c07a060 2024-09-13T06:30:26.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:116 4.20 4:07c23fd2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e263a10 con 0x55912e1abc30 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:117 4.37 4:edee92ac:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1f9830 con 0x7fb10c07a060 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:118 4.36 4:6ca78c8b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1fc1d0 con 0x7fb10c07a060 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:119 4.1f 4:f8326c74:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1feae0 con 0x55912e1abc30 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:120 4.9 4:939a328b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e201570 con 0x55912e1a7770 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:121 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e203fa0 con 0x55912e1abc30 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:122 4.1e 4:7a009d31:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e206e00 con 0x55912e1a7770 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(113 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(114 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(115 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(118 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(117 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(116 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(120 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8 [call out=85b] v0'0 uv19 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(122 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(112 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.970+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(119 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(111 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7faff3fff640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T06:30:26.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(121 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:30:26.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:30:26.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:30:26.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9])"; uploads.size()=0; is_truncated=0 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:123 4.a 4:53b35094:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:124 4.2f 4:f5cfa444:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e206d80 con 0x55912e1a7770 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:125 4.7 4:e0e5e61f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1fe3f0 con 0x55912e1a7770 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:126 4.37 4:ee29046d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:127 4.20 4:07c23fd2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1fe3f0 con 0x55912e1abc30 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:128 4.37 4:edee92ac:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:129 4.36 4:6ca78c8b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e206d40 con 0x7fb10c07a060 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:130 4.1f 4:f8326c74:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:131 4.9 4:939a328b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e206d40 con 0x55912e1a7770 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:132 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e1f8cf0 con 0x55912e1abc30 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:133 4.1e 4:7a009d31:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e200fb0 con 0x55912e1a7770 2024-09-13T06:30:26.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(124 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(125 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(126 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(131 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8 [call out=85b] v0'0 uv19 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(133 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== osd_op_reply(129 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== osd_op_reply(128 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(123 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(127 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(132 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(130 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.974+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== osd_op_reply(134 bud.buckets [call] v33'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1a7770 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1a7770 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(136 myfoo6 [call,call,delete] v33'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94082032439824 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 24 ==== watch-notify(notify (1) cookie 94082032173664 notify 141733920783 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55912e1c7bb0 con 0x7fb10c07a060 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7faff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94082032173664 notifier 4750 bl.length()=150 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7faff37fe640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7faf440032d0 con 0x7fb10c07a060 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 25 ==== osd_op_reply(137 notify.3 [notify cookie 94082032439824 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 27 ==== watch-notify(notify_complete (2) cookie 94082032439824 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55912e1c8970 con 0x7fb10c07a060 2024-09-13T06:30:26.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.978+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:139 8.14 8:2b113b97:root::.bucket.meta.myfoo6%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(139 .bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [call,call,delete] v33'5 uv5 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 from cache 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9, ofs0, ns] 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94082032462032 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== watch-notify(notify (1) cookie 94082032162608 notify 141733920808 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55912e1e63a0 con 0x55912e1abc30 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7faff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94082032162608 notifier 4750 bl.length()=207 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7faff3fff640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fafe0003d70 con 0x55912e1abc30 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(140 notify.0 [notify cookie 94082032462032 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 55 ==== watch-notify(notify_complete (2) cookie 94082032462032 notify 141733920808 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55912e075860 con 0x55912e1abc30 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 4.a 4:53b35094:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:143 4.2f 4:f5cfa444:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1fe8d0 con 0x55912e1a7770 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:144 4.7 4:e0e5e61f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204440 con 0x55912e1a7770 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:145 4.37 4:ee29046d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:146 4.20 4:07c23fd2:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e5190 con 0x55912e1abc30 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:147 4.37 4:edee92ac:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e5a60 con 0x7fb10c07a060 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:148 4.36 4:6ca78c8b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1fe8d0 con 0x7fb10c07a060 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:149 4.1f 4:f8326c74:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e5190 con 0x55912e1abc30 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:150 4.9 4:939a328b:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204440 con 0x55912e1a7770 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:151 4.31 4:8c998905:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.982+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:152 4.1e 4:7a009d31:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e5a60 con 0x55912e1a7770 2024-09-13T06:30:26.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== osd_op_reply(144 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.2 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(143 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.1 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== osd_op_reply(150 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.8 [delete] v33'21 uv21 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 56 ==== osd_op_reply(146 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.4 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 28 ==== osd_op_reply(145 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.3 [delete] v33'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 29 ==== osd_op_reply(148 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.6 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 30 ==== osd_op_reply(147 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.5 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 57 ==== osd_op_reply(151 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.9 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 58 ==== osd_op_reply(149 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.7 [delete] v33'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 59 ==== osd_op_reply(142 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.0 [delete] v33'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(152 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9.10 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 : miss 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 20 rados->read ofs=0 len=0 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:153 6.1b 6:daaaa19f:::pubsub..bucket.myfoo6%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1b0c60 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(153 pubsub..bucket.myfoo6/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 info.flags=0x0 2024-09-13T06:30:26.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 10 adding default.rgw.log++pubsub..bucket.myfoo6/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 to cache LRU end 2024-09-13T06:30:26.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.986+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:154 6.1b 6:daaaa19f:::pubsub..bucket.myfoo6%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204440 con 0x55912e1b0c60 2024-09-13T06:30:26.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(154 pubsub..bucket.myfoo6/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.9 [delete] v33'23 uv17 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1fe8d0 con 0x55912e1abc30 2024-09-13T06:30:26.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 60 ==== osd_op_reply(155 bud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11f45c980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T06:30:26.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e1e5190 con 0x55912e1a7770 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v33'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11f45c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94082032462032 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1b0c60 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== watch-notify(notify (1) cookie 94082032160080 notify 141733920802 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55912e1c87a0 con 0x55912e1b0c60 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7faff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94082032160080 notifier 4750 bl.length()=170 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(157 notify.5 [notify cookie 94082032462032 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.990+0000 7faff3fff640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fafe0003d70 con 0x55912e1b0c60 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== watch-notify(notify_complete (2) cookie 94082032462032 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55912e1c85d0 con 0x55912e1b0c60 2024-09-13T06:30:26.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 10 removing email index: 2024-09-13T06:30:26.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 10 removing user buckets index 2024-09-13T06:30:26.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:26.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 61 ==== osd_op_reply(159 bud.buckets [delete] v33'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:26.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T06:30:26.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94082032462032 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1b0c60 2024-09-13T06:30:26.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== watch-notify(notify (1) cookie 94082032179712 notify 141733920803 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55912e1c85d0 con 0x55912e1b0c60 2024-09-13T06:30:26.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7faff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94082032179712 notifier 4750 bl.length()=160 2024-09-13T06:30:26.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7faff37fe640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7faf440032d0 con 0x55912e1b0c60 2024-09-13T06:30:26.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(160 notify.6 [notify cookie 94082032462032 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== watch-notify(notify_complete (2) cookie 94082032462032 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55912e1c8400 con 0x55912e1b0c60 2024-09-13T06:30:26.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:26.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 10 removing user index: bud 2024-09-13T06:30:26.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.994+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 31 ==== osd_op_reply(162 bud [call,call,delete] v33'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11f45c980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11f45c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94082032462032 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1b0c60 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== watch-notify(notify (1) cookie 94082032160080 notify 141733920804 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55912e1c8400 con 0x55912e1b0c60 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7faff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94082032160080 notifier 4750 bl.length()=152 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7faff3fff640 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fafe0003d70 con 0x55912e1b0c60 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== osd_op_reply(163 notify.5 [notify cookie 94082032462032 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:27.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== watch-notify(notify_complete (2) cookie 94082032462032 notify 141733920804 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55912e1c77f0 con 0x55912e1b0c60 2024-09-13T06:30:27.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fafd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:27.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94082032185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1a7770 2024-09-13T06:30:27.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94082032185216] v33'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:27.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:26.998+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94082032162608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:27.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 62 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94082032162608] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:27.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11f45c980 20 remove_watcher() i=0 2024-09-13T06:30:27.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11f45c980 2 removed watcher, disabling cache 2024-09-13T06:30:27.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94082032166656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1a7770 2024-09-13T06:30:27.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94082032166656] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x55912e1a7770 2024-09-13T06:30:27.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11f45c980 20 remove_watcher() i=1 2024-09-13T06:30:27.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.002+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94082032171360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:27.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.006+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 63 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94082032171360] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:27.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.006+0000 7fb11f45c980 20 remove_watcher() i=2 2024-09-13T06:30:27.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.006+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94082032173664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:27.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.006+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 32 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94082032173664] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:27.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.006+0000 7fb11f45c980 20 remove_watcher() i=3 2024-09-13T06:30:27.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.006+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94082032174720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1abc30 2024-09-13T06:30:27.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11cf6c640 1 -- 172.21.15.169:0/212022366 <== osd.0 v2:172.21.15.112:6800/389376018 64 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94082032174720] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10c077030 con 0x55912e1abc30 2024-09-13T06:30:27.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11f45c980 20 remove_watcher() i=4 2024-09-13T06:30:27.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94082032160080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1b0c60 2024-09-13T06:30:27.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94082032160080] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:27.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11f45c980 20 remove_watcher() i=5 2024-09-13T06:30:27.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94082032179712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x55912e1b0c60 2024-09-13T06:30:27.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11c76b640 1 -- 172.21.15.169:0/212022366 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94082032179712] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1100aaae0 con 0x55912e1b0c60 2024-09-13T06:30:27.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11f45c980 20 remove_watcher() i=6 2024-09-13T06:30:27.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.010+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94082032176336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55912e204000 con 0x7fb10c07a060 2024-09-13T06:30:27.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 <== osd.2 v2:172.21.15.169:6816/1749135367 33 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94082032176336] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11400a4d0 con 0x7fb10c07a060 2024-09-13T06:30:27.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 20 remove_watcher() i=7 2024-09-13T06:30:27.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e1abc30 msgr2=0x55912e1ae020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e1abc30 0x55912e1ae020 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e1a7770 msgr2=0x55912e1a9c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e1a7770 0x55912e1a9c30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb10c07a060 msgr2=0x7fb10c047650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fb10c07a060 0x7fb10c047650 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1b0c60 msgr2=0x55912e1b3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1b0c60 0x55912e1b3050 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fafe80345b0 msgr2=0x7fafe8036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fafe80345b0 0x7fafe8036a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb110000c10 tx=0x7fb1100c1040 comp rx=0 tx=0).stop 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 msgr2=0x55912e19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11d76d640 1 -- 172.21.15.169:0/212022366 reap_dead start 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e19c650 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00f700 tx=0x7fb10c010210 comp rx=0 tx=0).stop 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 shutdown_connections 2024-09-13T06:30:27.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/212022366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e1954e0 0x55912e19c650 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 >> 172.21.15.169:0/212022366 conn(0x55912e191810 msgr2=0x55912e18f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 shutdown_connections 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/212022366 wait complete. 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faff40347f0 msgr2=0x7faff4036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faff40347f0 0x7faff4036cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55912e076320 tx=0x7fb110005ad0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 msgr2=0x55912e189120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 0x55912e189120 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb10c027fd0 tx=0x7fb10c01af50 comp rx=0 tx=0).stop 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 shutdown_connections 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7faff40347f0 0x7faff4036cb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/1147285518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912e188d00 0x55912e189120 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 >> 172.21.15.169:0/1147285518 conn(0x55912e17de50 msgr2=0x55912e1808d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 shutdown_connections 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/1147285518 wait complete. 2024-09-13T06:30:27.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e173140 msgr2=0x55912e175600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55912e173140 0x55912e175600 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e07aa90 msgr2=0x55912e172190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55912e07aa90 0x55912e172190 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1789d0 msgr2=0x55912e17adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55912e1789d0 0x55912e17adc0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb0040346a0 msgr2=0x7fb004036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fb0040346a0 0x7fb004036b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1100ae000 tx=0x7fb1100a6000 comp rx=0 tx=0).stop 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 msgr2=0x55912e076c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 --2- 172.21.15.169:0/2936834401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55912dfeb2e0 0x55912e076c50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x55912e162be0 tx=0x7fb10c000bd0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11d76d640 1 -- 172.21.15.169:0/2936834401 reap_dead start 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 shutdown_connections 2024-09-13T06:30:27.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 >> 172.21.15.169:0/2936834401 conn(0x55912e0710a0 msgr2=0x55912e15c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 shutdown_connections 2024-09-13T06:30:27.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.014+0000 7fb11f45c980 1 -- 172.21.15.169:0/2936834401 wait complete. 2024-09-13T06:30:27.026 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T06:30:27.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T06:30:27.026 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T06:30:27.098 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:30:27.099 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:30:27.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd740c1e980 1 Processor -- start 2024-09-13T06:30:27.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd740c1e980 1 -- start start 2024-09-13T06:30:27.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd740c1e980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ad67b5900 0x560ad67b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd740c1e980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ad663aae0 con 0x560ad67b1580 2024-09-13T06:30:27.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd740c1e980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x560ad665ee30 con 0x560ad67b5900 2024-09-13T06:30:27.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd73df2d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ad67b5900 0x560ad67b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd73df2d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560ad67b5900 0x560ad67b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39462/0 (socket says 172.21.15.169:39462) 2024-09-13T06:30:27.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd73e72e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x560ad67b1580 0x560ad67b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:57556/0 (socket says 172.21.15.169:57556) 2024-09-13T06:30:27.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd73df2d640 1 -- 172.21.15.169:0/879201038 learned_addr learned my addr 172.21.15.169:0/879201038 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:27.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd73df2d640 1 -- 172.21.15.169:0/879201038 >> v1:172.21.15.112:6789/0 conn(0x560ad67b1580 legacy=0x560ad67b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.098+0000 7fd73df2d640 1 -- 172.21.15.169:0/879201038 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad67b9240 con 0x560ad67b5900 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd73df2d640 1 --2- 172.21.15.169:0/879201038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b5900 0x560ad67b7cf0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd73000a5c0 tx=0x7fd73001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ded42076f7b71f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd73d72c640 1 -- 172.21.15.169:0/879201038 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7300a6070 con 0x560ad67b5900 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd73d72c640 1 -- 172.21.15.169:0/879201038 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7300af070 con 0x560ad67b5900 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd73d72c640 1 -- 172.21.15.169:0/879201038 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7300aa5c0 con 0x560ad67b5900 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 -- 172.21.15.169:0/879201038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b5900 msgr2=0x560ad67b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 --2- 172.21.15.169:0/879201038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b5900 0x560ad67b7cf0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd73000a5c0 tx=0x7fd73001b340 comp rx=0 tx=0).stop 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 -- 172.21.15.169:0/879201038 shutdown_connections 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 --2- 172.21.15.169:0/879201038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b5900 0x560ad67b7cf0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 -- 172.21.15.169:0/879201038 >> 172.21.15.169:0/879201038 conn(0x560ad67ad0a0 msgr2=0x560ad67af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 -- 172.21.15.169:0/879201038 shutdown_connections 2024-09-13T06:30:27.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.102+0000 7fd740c1e980 1 -- 172.21.15.169:0/879201038 wait complete. 2024-09-13T06:30:27.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.114+0000 7fd740c1e980 1 Processor -- start 2024-09-13T06:30:27.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.114+0000 7fd740c1e980 1 -- start start 2024-09-13T06:30:27.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.114+0000 7fd740c1e980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad689c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.114+0000 7fd740c1e980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ad6660200 con 0x560ad67b1580 2024-09-13T06:30:27.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad689c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad689c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39470/0 (socket says 172.21.15.169:39470) 2024-09-13T06:30:27.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 -- 172.21.15.169:0/125768934 learned_addr learned my addr 172.21.15.169:0/125768934 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:27.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 -- 172.21.15.169:0/125768934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad689cef0 con 0x560ad67b1580 2024-09-13T06:30:27.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 --2- 172.21.15.169:0/125768934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad689c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b240 tx=0x7fd72800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cee86a54bdbb6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd62c608640 1 -- 172.21.15.169:0/125768934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72800e700 con 0x560ad67b1580 2024-09-13T06:30:27.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd62c608640 1 -- 172.21.15.169:0/125768934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72800e8a0 con 0x560ad67b1580 2024-09-13T06:30:27.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd62c608640 1 -- 172.21.15.169:0/125768934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72800eb80 con 0x560ad67b1580 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- 172.21.15.169:0/125768934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 msgr2=0x560ad689c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 --2- 172.21.15.169:0/125768934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad689c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b240 tx=0x7fd72800b700 comp rx=0 tx=0).stop 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- 172.21.15.169:0/125768934 shutdown_connections 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 --2- 172.21.15.169:0/125768934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad689c920 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- 172.21.15.169:0/125768934 >> 172.21.15.169:0/125768934 conn(0x560ad67ad0a0 msgr2=0x560ad6898550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- 172.21.15.169:0/125768934 shutdown_connections 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- 172.21.15.169:0/125768934 wait complete. 2024-09-13T06:30:27.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 Processor -- start 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- start start 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad68a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ad67b8d40 con 0x560ad67b1580 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad68a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad68a3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39474/0 (socket says 172.21.15.169:39474) 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 -- 172.21.15.169:0/3404915484 learned_addr learned my addr 172.21.15.169:0/3404915484 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad68a4190 con 0x560ad67b1580 2024-09-13T06:30:27.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad68a3c50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd728000c10 tx=0x7fd728000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd62ae05640 1 -- 172.21.15.169:0/3404915484 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72800fa90 con 0x560ad67b1580 2024-09-13T06:30:27.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ad68a4420 con 0x560ad67b1580 2024-09-13T06:30:27.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.118+0000 7fd62ae05640 1 -- 172.21.15.169:0/3404915484 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72800fc50 con 0x560ad67b1580 2024-09-13T06:30:27.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad68a7100 con 0x560ad67b1580 2024-09-13T06:30:27.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd62ae05640 1 -- 172.21.15.169:0/3404915484 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72802c060 con 0x560ad67b1580 2024-09-13T06:30:27.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd62ae05640 1 -- 172.21.15.169:0/3404915484 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd728017070 con 0x560ad67b1580 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd62ae05640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd624034650 0x7fd624036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd62ae05640 1 -- 172.21.15.169:0/3404915484 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fd728015020 con 0x560ad67b1580 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd624034650 0x7fd624036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad67b5900 0x560ad68aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ab260 con 0x560ad67b5900 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73ef2f640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad67b5900 0x560ad68aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd624034650 0x7fd624036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd7300ae000 tx=0x7fd7300a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73ef2f640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad67b5900 0x560ad68aac20 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3404915484 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad67b5900 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68ac050 0x560ad68ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68aea80 con 0x560ad68ac050 2024-09-13T06:30:27.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68ac050 0x560ad68ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.122+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68ac050 0x560ad68ae440 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73e72e640 1 -- 172.21.15.169:0/3404915484 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd72802e070 con 0x560ad68ac050 2024-09-13T06:30:27.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68b0330 con 0x560ad68ac050 2024-09-13T06:30:27.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73e72e640 1 -- 172.21.15.169:0/3404915484 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd72802e070 con 0x560ad68ac050 2024-09-13T06:30:27.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68af560 con 0x560ad68ac050 2024-09-13T06:30:27.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73e72e640 1 -- 172.21.15.169:0/3404915484 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd72802e070 con 0x560ad68ac050 2024-09-13T06:30:27.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68b16e0 0x560ad68b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68b4010 con 0x560ad68b16e0 2024-09-13T06:30:27.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68b16e0 0x560ad68b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68b16e0 0x560ad68b3ad0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73df2d640 1 -- 172.21.15.169:0/3404915484 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68b16e0 2024-09-13T06:30:27.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 Processor -- start 2024-09-13T06:30:27.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 -- start start 2024-09-13T06:30:27.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 0x560ad68c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd740c1e980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ad66b9800 con 0x560ad67274c0 2024-09-13T06:30:27.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 0x560ad68c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 0x560ad68c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39490/0 (socket says 172.21.15.169:39490) 2024-09-13T06:30:27.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.126+0000 7fd73e72e640 1 -- 172.21.15.169:0/97582203 learned_addr learned my addr 172.21.15.169:0/97582203 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:27.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73e72e640 1 -- 172.21.15.169:0/97582203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad68c5dc0 con 0x560ad67274c0 2024-09-13T06:30:27.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73e72e640 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 0x560ad68c5880 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd72800e870 tx=0x7fd72804a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd623fff640 1 -- 172.21.15.169:0/97582203 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72801a480 con 0x560ad67274c0 2024-09-13T06:30:27.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd623fff640 1 -- 172.21.15.169:0/97582203 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72801a620 con 0x560ad67274c0 2024-09-13T06:30:27.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ad68c5f90 con 0x560ad67274c0 2024-09-13T06:30:27.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd623fff640 1 -- 172.21.15.169:0/97582203 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72801a900 con 0x560ad67274c0 2024-09-13T06:30:27.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad68c5f90 con 0x560ad67274c0 2024-09-13T06:30:27.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd623fff640 1 -- 172.21.15.169:0/97582203 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd72801d7c0 con 0x560ad67274c0 2024-09-13T06:30:27.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd623fff640 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd618034650 0x7fd618036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd623fff640 1 -- 172.21.15.169:0/97582203 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fd728038030 con 0x560ad67274c0 2024-09-13T06:30:27.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73df2d640 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd618034650 0x7fd618036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd740c1e980 1 Processor -- start 2024-09-13T06:30:27.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd740c1e980 1 -- start start 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73df2d640 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd618034650 0x7fd618036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd730017f50 tx=0x7fd730005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd740c1e980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd740c1e980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ad689d270 con 0x560ad68c2ad0 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39506/0 (socket says 172.21.15.169:39506) 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73e72e640 1 -- 172.21.15.169:0/2920237672 learned_addr learned my addr 172.21.15.169:0/2920237672 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:27.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.130+0000 7fd73e72e640 1 -- 172.21.15.169:0/2920237672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad68c3480 con 0x560ad68c2ad0 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd73e72e640 1 --2- 172.21.15.169:0/2920237672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68c2eb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd72800e820 tx=0x7fd728030860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6693fadee0281147 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd621ffb640 1 -- 172.21.15.169:0/2920237672 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72800a360 con 0x560ad68c2ad0 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd621ffb640 1 -- 172.21.15.169:0/2920237672 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72805e070 con 0x560ad68c2ad0 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd621ffb640 1 -- 172.21.15.169:0/2920237672 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728019c10 con 0x560ad68c2ad0 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/2920237672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 msgr2=0x560ad68c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 --2- 172.21.15.169:0/2920237672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68c2eb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd72800e820 tx=0x7fd728030860 comp rx=0 tx=0).stop 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/2920237672 shutdown_connections 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 --2- 172.21.15.169:0/2920237672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68c2eb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/2920237672 >> 172.21.15.169:0/2920237672 conn(0x560ad68cb6a0 msgr2=0x560ad68c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/2920237672 shutdown_connections 2024-09-13T06:30:27.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/2920237672 wait complete. 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 Processor -- start 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- start start 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68d8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560ad68c1660 con 0x560ad68c2ad0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd73e72e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68d8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:39510/0 (socket says 172.21.15.169:39510) 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 learned_addr learned my addr 172.21.15.169:0/3658354219 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad68d8c50 con 0x560ad68c2ad0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68d8710 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd72803ffd0 tx=0x7fd72800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd60ffff640 1 -- 172.21.15.169:0/3658354219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7280470c0 con 0x560ad68c2ad0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd60ffff640 1 -- 172.21.15.169:0/3658354219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728047260 con 0x560ad68c2ad0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ad68d8c50 con 0x560ad68c2ad0 2024-09-13T06:30:27.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd60ffff640 1 -- 172.21.15.169:0/3658354219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728047580 con 0x560ad68c2ad0 2024-09-13T06:30:27.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad68d8c50 con 0x560ad68c2ad0 2024-09-13T06:30:27.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.134+0000 7fd60ffff640 1 -- 172.21.15.169:0/3658354219 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7280328c0 con 0x560ad68c2ad0 2024-09-13T06:30:27.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd60ffff640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6080345b0 0x7fd608036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd60ffff640 1 -- 172.21.15.169:0/3658354219 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5996+0+0 (secure 0 0 0) 0x7fd72803b040 con 0x560ad68c2ad0 2024-09-13T06:30:27.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6080345b0 0x7fd608036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad68e37a0 0x560ad68e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68e6390 con 0x560ad68e37a0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73ef2f640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad68e37a0 0x560ad68e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6080345b0 0x7fd608036a70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c10 tx=0x7fd7300c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73ef2f640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad68e37a0 0x560ad68e5c40 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 realm 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68e2c90 con 0x560ad68e37a0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:30:27.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68e6e60 con 0x560ad68e37a0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68e7c40 0x560ad68ea030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ea6b0 con 0x560ad68e7c40 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68e7c40 0x560ad68ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68e7c40 0x560ad68ea030 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.138+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68eaf00 con 0x560ad68e7c40 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd740c1e980 20 searching for the correct realm 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68ecc70 0x560ad68ef060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68ecc70 0x560ad68ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73df2d640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68ecc70 0x560ad68ef060 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73e72e640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd728032bb0 0x7fd728044330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x7fd728032bb0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd728032bb0 0x7fd728044330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd728032bb0 0x7fd728044330 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.142+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x7fd728032bb0 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x7fd728032bb0 2024-09-13T06:30:27.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.146+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x7fd728032bb0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e37a0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x7fd728032bb0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x7fd728032bb0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68ecc70 2024-09-13T06:30:27.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.150+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ef6e0 con 0x560ad68e7c40 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68eb8b0 con 0x560ad68e37a0 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68eb4f0 con 0x560ad68e7c40 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ec250 con 0x560ad68ecc70 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 zone default found 2024-09-13T06:30:27.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 4 Realm: () 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 zonegroup default 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f0050 con 0x7fd728032bb0 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f2320 con 0x560ad68ecc70 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f26c0 con 0x560ad68ecc70 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 started sync module instance, tier type = 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:30:27.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.154+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f1760 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94604549362656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f1d90 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f3080 con 0x560ad68e37a0 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94604549368784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f38d0 con 0x560ad68e37a0 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f42d0 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94604549368784] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.158+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94604549362656] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94604549363744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f3420 con 0x560ad68e7c40 2024-09-13T06:30:27.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f4b70 con 0x7fd728032bb0 2024-09-13T06:30:27.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94604549375680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f3420 con 0x7fd728032bb0 2024-09-13T06:30:27.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f55b0 con 0x560ad68e7c40 2024-09-13T06:30:27.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94604549375680] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.162+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94604549363744] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94604549373408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f5100 con 0x560ad68e7c40 2024-09-13T06:30:27.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f59b0 con 0x560ad68ecc70 2024-09-13T06:30:27.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94604549378576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f6250 con 0x560ad68ecc70 2024-09-13T06:30:27.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f6c10 con 0x560ad68ecc70 2024-09-13T06:30:27.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94604549373408] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94604549378576] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94604549376736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f6c10 con 0x560ad68ecc70 2024-09-13T06:30:27.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.166+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f74b0 con 0x7fd728032bb0 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94604549376736] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94604549384512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f74b0 con 0x7fd728032bb0 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=0 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=1 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=2 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=3 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=4 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=5 2024-09-13T06:30:27.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=6 2024-09-13T06:30:27.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94604549384512] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 20 add_watcher() i=7 2024-09-13T06:30:27.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 2 all 8 watchers are set, enabling cache 2024-09-13T06:30:27.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad68fa850 con 0x560ad68e37a0 2024-09-13T06:30:27.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.170+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94604549399056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f7620 con 0x560ad68e37a0 2024-09-13T06:30:27.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94604549399056] v33'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd5f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:27.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd740c1e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:30:27.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd740c1e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:30:27.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f9b80 con 0x560ad68e7c40 2024-09-13T06:30:27.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.174+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f9c00 con 0x7fd728032bb0 2024-09-13T06:30:27.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.178+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.178+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69039f0 con 0x560ad68ecc70 2024-09-13T06:30:27.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.178+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.178+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6903f60 con 0x560ad68e37a0 2024-09-13T06:30:27.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.182+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.182+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904410 con 0x560ad68e7c40 2024-09-13T06:30:27.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.182+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.182+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904410 con 0x560ad68ecc70 2024-09-13T06:30:27.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.182+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.182+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904980 con 0x560ad68e7c40 2024-09-13T06:30:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.186+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.186+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904980 con 0x560ad68e37a0 2024-09-13T06:30:27.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.186+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.186+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904ef0 con 0x560ad68e7c40 2024-09-13T06:30:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.190+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.190+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904ef0 con 0x560ad68e7c40 2024-09-13T06:30:27.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.190+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.190+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904ef0 con 0x560ad68e7c40 2024-09-13T06:30:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.194+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.194+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6904ef0 con 0x560ad68ecc70 2024-09-13T06:30:27.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.194+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.194+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69053a0 con 0x560ad68e7c40 2024-09-13T06:30:27.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.194+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.194+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69053a0 con 0x560ad68e37a0 2024-09-13T06:30:27.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.198+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.198+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905430 con 0x560ad68e37a0 2024-09-13T06:30:27.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.198+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.198+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69054c0 con 0x560ad68e7c40 2024-09-13T06:30:27.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.202+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.202+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69054c0 con 0x560ad68e7c40 2024-09-13T06:30:27.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.202+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.202+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69054c0 con 0x560ad68ecc70 2024-09-13T06:30:27.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.206+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.206+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905580 con 0x560ad68e7c40 2024-09-13T06:30:27.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.206+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.206+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905580 con 0x560ad68e37a0 2024-09-13T06:30:27.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.210+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.210+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905550 con 0x560ad68e7c40 2024-09-13T06:30:27.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.210+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.210+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905550 con 0x560ad68e7c40 2024-09-13T06:30:27.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.214+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.214+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905550 con 0x560ad68ecc70 2024-09-13T06:30:27.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.214+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.214+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905550 con 0x560ad68e7c40 2024-09-13T06:30:27.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.218+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.218+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68ecc70 2024-09-13T06:30:27.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.218+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.218+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68ecc70 2024-09-13T06:30:27.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.218+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.218+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68ecc70 2024-09-13T06:30:27.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.222+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.222+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68e7c40 2024-09-13T06:30:27.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.222+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.222+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68e37a0 2024-09-13T06:30:27.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.226+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'49 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.226+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68e7c40 2024-09-13T06:30:27.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.226+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.226+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x560ad68e37a0 2024-09-13T06:30:27.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6905a90 con 0x7fd728032bb0 2024-09-13T06:30:27.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd56f7fe640 20 reqs_thread_entry: start 2024-09-13T06:30:27.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd740c1e980 20 init_complete bucket index max shards: 11 2024-09-13T06:30:27.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd740c1e980 20 Filter name: none 2024-09-13T06:30:27.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd56d7fa640 20 reqs_thread_entry: start 2024-09-13T06:30:27.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd740c1e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:30:27.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.230+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6903460 con 0x7fd728032bb0 2024-09-13T06:30:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:30:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:30:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:30:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6903420 con 0x560ad68e37a0 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 : miss 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 8.b 8:d5abeb29:root::.bucket.meta.myfoo7%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6923120 con 0x560ad68ecc70 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(96 .bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 info.flags=0x17 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 to cache LRU end 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 4.18 4:1b3b648f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a0620 con 0x560ad68e7c40 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(97 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 4.9 4:93f382bd:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a06a0 con 0x560ad68e37a0 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(98 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1 [call out=85b] v0'0 uv20 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:99 4.1d 4:b94c1641:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a06a0 con 0x560ad68ecc70 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(99 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.234+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 4.30 4:0cf9314d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a06a0 con 0x560ad68e7c40 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(100 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:101 4.10 4:0adce86a:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a06a0 con 0x7fd728032bb0 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(101 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:102 4.38 4:1fcdb095:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a06a0 con 0x560ad68e7c40 2024-09-13T06:30:27.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(102 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 [call out=377b] v0'0 uv7 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 10 cls_bucket_list_unordered: got fourteen 2024-09-13T06:30:27.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 4.24 4:24dfbf12:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a0660 con 0x560ad68e37a0 2024-09-13T06:30:27.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(103 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:104 4.11 4:88b90139:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a0660 con 0x560ad68ecc70 2024-09-13T06:30:27.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(104 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:105 4.16 4:6850534d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a0660 con 0x560ad68ecc70 2024-09-13T06:30:27.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(105 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:106 4.22 4:4422348c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a0660 con 0x560ad68e37a0 2024-09-13T06:30:27.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(106 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:107 4.2a 4:5597c189:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69a0660 con 0x560ad68e37a0 2024-09-13T06:30:27.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(107 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 20 get_obj_state: octx=0x7fd728063f40 obj=myfoo7:fourteen state=0x560ad699e688 s->prefetch_data=0 2024-09-13T06:30:27.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.238+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:108 3.38 3:1f3bf496:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad699f4b0 con 0x560ad68ecc70 2024-09-13T06:30:27.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(108 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 10 manifest: total_size = 8 2024-09-13T06:30:27.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7467425979150476396 2024-09-13T06:30:27.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 20 get_obj_state: octx=0x7fd728063f40 obj=myfoo7:fourteen state=0x560ad699e688 s->prefetch_data=0 2024-09-13T06:30:27.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 20 prepare_atomic_modification: state is not atomic. state=0x560ad699e688 2024-09-13T06:30:27.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 2024-09-13T06:30:27.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:109 4.38 4:1fcdb095:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad699fe50 con 0x560ad68e7c40 2024-09-13T06:30:27.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(109 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.242+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 3.38 3:1f3bf496:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad699fe50 con 0x560ad68ecc70 2024-09-13T06:30:27.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(110 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10_fourteen [call] v33'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:111 4.38 4:1fcdb095:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6927cd0 con 0x560ad68e7c40 2024-09-13T06:30:27.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 4.18 4:1b3b648f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6927cd0 con 0x560ad68e7c40 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:113 4.9 4:93f382bd:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6927cd0 con 0x560ad68e37a0 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:114 4.1d 4:b94c1641:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad692f420 con 0x560ad68ecc70 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:115 4.30 4:0cf9314d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6927cd0 con 0x560ad68e7c40 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:116 4.10 4:0adce86a:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6934660 con 0x7fd728032bb0 2024-09-13T06:30:27.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:117 4.38 4:1fcdb095:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69370e0 con 0x560ad68e7c40 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:118 4.24 4:24dfbf12:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad69370e0 con 0x560ad68e37a0 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:119 4.11 4:88b90139:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c4a0 con 0x560ad68ecc70 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:120 4.16 4:6850534d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693f1c0 con 0x560ad68ecc70 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:121 4.22 4:4422348c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6941a90 con 0x560ad68e37a0 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(116 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:122 4.2a 4:5597c189:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6941a90 con 0x560ad68e37a0 2024-09-13T06:30:27.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(114 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(118 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(112 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(113 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1 [call out=85b] v0'0 uv20 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(119 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(115 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(121 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(120 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(122 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(111 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd6217fa640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(117 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10])"; uploads.size()=0; is_truncated=0 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:123 4.18 4:1b3b648f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693eb70 con 0x560ad68e7c40 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:124 4.9 4:93f382bd:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693d950 con 0x560ad68e37a0 2024-09-13T06:30:27.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:125 4.1d 4:b94c1641:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693eb70 con 0x560ad68ecc70 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:126 4.30 4:0cf9314d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6933060 con 0x560ad68e7c40 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:127 4.10 4:0adce86a:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693eb70 con 0x7fd728032bb0 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.246+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:128 4.38 4:1fcdb095:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6933060 con 0x560ad68e7c40 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(124 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1 [call out=85b] v0'0 uv20 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:129 4.24 4:24dfbf12:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6933060 con 0x560ad68e37a0 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(125 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:130 4.11 4:88b90139:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693f020 con 0x560ad68ecc70 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:131 4.16 4:6850534d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6933060 con 0x560ad68ecc70 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:132 4.22 4:4422348c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693f020 con 0x560ad68e37a0 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(127 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:133 4.2a 4:5597c189:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6933060 con 0x560ad68e37a0 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(123 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(130 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(129 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(131 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(126 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(133 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(128 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(132 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693f020 con 0x560ad68e37a0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(134 fud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693f020 con 0x7fd728032bb0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.250+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ef20 con 0x7fd728032bb0 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(136 myfoo7 [call,call,delete] v33'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94604549679728 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693d950 con 0x7fd728032bb0 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== watch-notify(notify (1) cookie 94604549375680 notify 141733920784 ret 0) ==== 192+0+0 (crc 0 0 0) 0x560ad6904980 con 0x7fd728032bb0 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd621ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920784 cookie 94604549375680 notifier 4757 bl.length()=150 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd621ffb640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd604003d70 con 0x7fd728032bb0 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(137 notify.3 [notify cookie 94604549679728 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== watch-notify(notify_complete (2) cookie 94604549679728 notify 141733920784 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ad6904d20 con 0x7fd728032bb0 2024-09-13T06:30:27.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:139 8.b 8:d5abeb29:root::.bucket.meta.myfoo7%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ef20 con 0x560ad68ecc70 2024-09-13T06:30:27.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(139 .bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 [call,call,delete] v33'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 from cache 2024-09-13T06:30:27.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10, ofs0, ns] 2024-09-13T06:30:27.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94604549566608 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ef20 con 0x560ad68e37a0 2024-09-13T06:30:27.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== watch-notify(notify (1) cookie 94604549368784 notify 141733920769 ret 0) ==== 250+0+0 (crc 0 0 0) 0x560ad6904d20 con 0x560ad68e37a0 2024-09-13T06:30:27.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd6217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94604549368784 notifier 4757 bl.length()=208 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd6217fa640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd5740032d0 con 0x560ad68e37a0 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.254+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(140 notify.1 [notify cookie 94604549566608 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== watch-notify(notify_complete (2) cookie 94604549566608 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ad68f9540 con 0x560ad68e37a0 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 4.18 4:1b3b648f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ea70 con 0x560ad68e7c40 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:143 4.9 4:93f382bd:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6930aa0 con 0x560ad68e37a0 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:144 4.1d 4:b94c1641:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69312f0 con 0x560ad68ecc70 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:145 4.30 4:0cf9314d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ea70 con 0x560ad68e7c40 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:146 4.10 4:0adce86a:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6930200 con 0x7fd728032bb0 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:147 4.38 4:1fcdb095:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6921b10 con 0x560ad68e7c40 2024-09-13T06:30:27.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:148 4.24 4:24dfbf12:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ea70 con 0x560ad68e37a0 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:149 4.11 4:88b90139:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69312f0 con 0x560ad68ecc70 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:150 4.16 4:6850534d:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad6921b10 con 0x560ad68ecc70 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:151 4.22 4:4422348c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68e37a0 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:152 4.2a 4:5597c189:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad69312f0 con 0x560ad68e37a0 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 24 ==== osd_op_reply(146 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.4 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(145 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.3 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(148 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.6 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(147 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.5 [delete] v33'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.258+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== osd_op_reply(149 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.7 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(143 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.1 [delete] v33'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(151 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.9 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(144 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.2 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== osd_op_reply(150 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.8 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 47 ==== osd_op_reply(152 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.10 [delete] v33'4 uv4 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(142 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10.0 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 : miss 2024-09-13T06:30:27.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 20 rados->read ofs=0 len=0 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:153 6.e 6:74ed6d9d:::pubsub..bucket.myfoo7%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68e7c40 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(153 pubsub..bucket.myfoo7/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 info.flags=0x0 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 10 adding default.rgw.log++pubsub..bucket.myfoo7/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 to cache LRU end 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.262+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:154 6.e 6:74ed6d9d:::pubsub..bucket.myfoo7%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68e7c40 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(154 pubsub..bucket.myfoo7/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.10 [delete] v33'30 uv23 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68e37a0 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 48 ==== osd_op_reply(155 fud.buckets [call] v33'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd740c1e980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T06:30:27.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68ecc70 2024-09-13T06:30:27.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v33'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd740c1e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:30:27.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94604549566608 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68e7c40 2024-09-13T06:30:27.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== watch-notify(notify (1) cookie 94604549363744 notify 141733920809 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560ad6903f60 con 0x560ad68e7c40 2024-09-13T06:30:27.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd621ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 94604549363744 notifier 4757 bl.length()=170 2024-09-13T06:30:27.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(157 notify.2 [notify cookie 94604549566608 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.266+0000 7fd621ffb640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd604003d70 con 0x560ad68e7c40 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== watch-notify(notify_complete (2) cookie 94604549566608 notify 141733920809 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ad68a7100 con 0x560ad68e7c40 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 10 removing email index: 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 10 removing user buckets index 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x560ad68e37a0 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 49 ==== osd_op_reply(159 fud.buckets [delete] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94604549671232 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad6922010 con 0x560ad68ecc70 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== watch-notify(notify (1) cookie 94604549376736 notify 141733920805 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560ad6922670 con 0x560ad68ecc70 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd6217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94604549376736 notifier 4757 bl.length()=160 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(160 notify.6 [notify cookie 94604549671232 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd6217fa640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd5740032d0 con 0x560ad68ecc70 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 43 ==== watch-notify(notify_complete (2) cookie 94604549671232 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ad69044a0 con 0x560ad68ecc70 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 10 removing user index: fud 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad693c940 con 0x7fd728032bb0 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 25 ==== osd_op_reply(162 fud [call,call,delete] v33'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.270+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94604549671232 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560ad693ea70 con 0x560ad68ecc70 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 44 ==== watch-notify(notify (1) cookie 94604549378576 notify 141733920806 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560ad69044a0 con 0x560ad68ecc70 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd6217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94604549378576 notifier 4757 bl.length()=152 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 45 ==== osd_op_reply(163 notify.5 [notify cookie 94604549671232 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd6217fa640 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd5740032d0 con 0x560ad68ecc70 2024-09-13T06:30:27.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 46 ==== watch-notify(notify_complete (2) cookie 94604549671232 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ad69047b0 con 0x560ad68ecc70 2024-09-13T06:30:27.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd5f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:30:27.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.274+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94604549399056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ff420 con 0x560ad68e37a0 2024-09-13T06:30:27.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 50 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94604549399056] v33'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94604549362656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ff420 con 0x560ad68e7c40 2024-09-13T06:30:27.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94604549362656] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd740c1e980 20 remove_watcher() i=0 2024-09-13T06:30:27.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd740c1e980 2 removed watcher, disabling cache 2024-09-13T06:30:27.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94604549368784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f13e0 con 0x560ad68e37a0 2024-09-13T06:30:27.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.1 v2:172.21.15.169:6808/3492903297 51 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94604549368784] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x560ad68e37a0 2024-09-13T06:30:27.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd740c1e980 20 remove_watcher() i=1 2024-09-13T06:30:27.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.278+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94604549363744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ff420 con 0x560ad68e7c40 2024-09-13T06:30:27.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.282+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 55 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94604549363744] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.282+0000 7fd740c1e980 20 remove_watcher() i=2 2024-09-13T06:30:27.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.282+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94604549375680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f2bd0 con 0x7fd728032bb0 2024-09-13T06:30:27.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.282+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 26 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94604549375680] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.282+0000 7fd740c1e980 20 remove_watcher() i=3 2024-09-13T06:30:27.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.282+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94604549373408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f13e0 con 0x560ad68e7c40 2024-09-13T06:30:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd73e72e640 1 -- 172.21.15.169:0/3658354219 <== osd.0 v2:172.21.15.112:6800/389376018 56 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94604549373408] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd728074020 con 0x560ad68e7c40 2024-09-13T06:30:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd740c1e980 20 remove_watcher() i=4 2024-09-13T06:30:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94604549378576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f1820 con 0x560ad68ecc70 2024-09-13T06:30:27.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 48 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94604549378576] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd740c1e980 20 remove_watcher() i=5 2024-09-13T06:30:27.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94604549376736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68ff420 con 0x560ad68ecc70 2024-09-13T06:30:27.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd73df2d640 1 -- 172.21.15.169:0/3658354219 <== osd.3 v2:172.21.15.169:6800/747740583 49 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94604549376736] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7300aaad0 con 0x560ad68ecc70 2024-09-13T06:30:27.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd740c1e980 20 remove_watcher() i=6 2024-09-13T06:30:27.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.286+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94604549384512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560ad68f2bd0 con 0x7fd728032bb0 2024-09-13T06:30:27.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 <== osd.2 v2:172.21.15.169:6816/1749135367 27 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94604549384512] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x7fd728032bb0 2024-09-13T06:30:27.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 20 remove_watcher() i=7 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68e7c40 msgr2=0x560ad68ea030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68e7c40 0x560ad68ea030 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad68e37a0 msgr2=0x560ad68e5c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad68e37a0 0x560ad68e5c40 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd728032bb0 msgr2=0x7fd728044330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd728032bb0 0x7fd728044330 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68ecc70 msgr2=0x560ad68ef060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68ecc70 0x560ad68ef060 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6080345b0 msgr2=0x7fd608036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6080345b0 0x7fd608036a70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c10 tx=0x7fd7300c1040 comp rx=0 tx=0).stop 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 msgr2=0x560ad68d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3658354219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad68c2ad0 0x560ad68d8710 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd72803ffd0 tx=0x7fd72800a560 comp rx=0 tx=0).stop 2024-09-13T06:30:27.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 reap_dead start 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3658354219 reap_dead start 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 shutdown_connections 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 >> 172.21.15.169:0/3658354219 conn(0x560ad68cb6a0 msgr2=0x560ad68c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 shutdown_connections 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3658354219 wait complete. 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd618034650 msgr2=0x7fd618036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd618034650 0x7fd618036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd730017f50 tx=0x7fd730005ad0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 msgr2=0x560ad68c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 0x560ad68c5880 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd72800e870 tx=0x7fd72804a3a0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 shutdown_connections 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd618034650 0x7fd618036b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/97582203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67274c0 0x560ad68c5880 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 >> 172.21.15.169:0/97582203 conn(0x560ad68b6bf0 msgr2=0x560ad68b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 shutdown_connections 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/97582203 wait complete. 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68ac050 msgr2=0x560ad68ae440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560ad68ac050 0x560ad68ae440 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad67b5900 msgr2=0x560ad68aac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560ad67b5900 0x560ad68aac20 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68b16e0 msgr2=0x560ad68b3ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560ad68b16e0 0x560ad68b3ad0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd624034650 msgr2=0x7fd624036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd624034650 0x7fd624036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd7300ae000 tx=0x7fd7300a6000 comp rx=0 tx=0).stop 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 msgr2=0x560ad68a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:30:27.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 --2- 172.21.15.169:0/3404915484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560ad67b1580 0x560ad68a3c50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd728000c10 tx=0x7fd728000ee0 comp rx=0 tx=0).stop 2024-09-13T06:30:27.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd73ef2f640 1 -- 172.21.15.169:0/3404915484 reap_dead start 2024-09-13T06:30:27.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 shutdown_connections 2024-09-13T06:30:27.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 >> 172.21.15.169:0/3404915484 conn(0x560ad67ad0a0 msgr2=0x560ad68970d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:30:27.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 shutdown_connections 2024-09-13T06:30:27.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:30:27.290+0000 7fd740c1e980 1 -- 172.21.15.169:0/3404915484 wait complete. 2024-09-13T06:31:07.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T06:31:07.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T06:31:07.305 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T06:31:07.345 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:07.346 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:07.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.341+0000 7f263e2ec980 1 Processor -- start 2024-09-13T06:31:07.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.341+0000 7f263e2ec980 1 -- start start 2024-09-13T06:31:07.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.341+0000 7f263e2ec980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b3a027b8e0 0x55b3a027bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.341+0000 7f263e2ec980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3a0101ae0 con 0x55b3a027c230 2024-09-13T06:31:07.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.341+0000 7f263e2ec980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55b3a0125e30 con 0x55b3a027b8e0 2024-09-13T06:31:07.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.345+0000 7f263bdfc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b3a027b8e0 0x55b3a027bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.345+0000 7f263bdfc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55b3a027b8e0 0x55b3a027bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45726/0 (socket says 172.21.15.169:45726) 2024-09-13T06:31:07.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.345+0000 7f263bdfc640 1 -- 172.21.15.169:0/1606124938 learned_addr learned my addr 172.21.15.169:0/1606124938 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.345+0000 7f263bdfc640 1 -- 172.21.15.169:0/1606124938 >> v1:172.21.15.112:6789/0 conn(0x55b3a027c230 legacy=0x55b3a0280c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.345+0000 7f263bdfc640 1 -- 172.21.15.169:0/1606124938 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a02834b0 con 0x55b3a027b8e0 2024-09-13T06:31:07.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263bdfc640 1 --2- 172.21.15.169:0/1606124938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a027bcc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f263400a4e0 tx=0x7f263401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6ddb1684e03291 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263adfa640 1 -- 172.21.15.169:0/1606124938 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340aa540 con 0x55b3a027b8e0 2024-09-13T06:31:07.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263adfa640 1 -- 172.21.15.169:0/1606124938 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340aa6e0 con 0x55b3a027b8e0 2024-09-13T06:31:07.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263adfa640 1 -- 172.21.15.169:0/1606124938 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340aaa40 con 0x55b3a027b8e0 2024-09-13T06:31:07.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 -- 172.21.15.169:0/1606124938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 msgr2=0x55b3a027bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1606124938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a027bcc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f263400a4e0 tx=0x7f263401b090 comp rx=0 tx=0).stop 2024-09-13T06:31:07.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 -- 172.21.15.169:0/1606124938 shutdown_connections 2024-09-13T06:31:07.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1606124938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a027bcc0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 -- 172.21.15.169:0/1606124938 >> 172.21.15.169:0/1606124938 conn(0x55b3a01ef230 msgr2=0x55b3a01ef640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 -- 172.21.15.169:0/1606124938 shutdown_connections 2024-09-13T06:31:07.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.349+0000 7f263e2ec980 1 -- 172.21.15.169:0/1606124938 wait complete. 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.365+0000 7f263e2ec980 1 Processor -- start 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.365+0000 7f263e2ec980 1 -- start start 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.365+0000 7f263e2ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a0366bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.365+0000 7f263e2ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b3a0127200 con 0x55b3a027b8e0 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a0366bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a0366bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45730/0 (socket says 172.21.15.169:45730) 2024-09-13T06:31:07.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 -- 172.21.15.169:0/2091070350 learned_addr learned my addr 172.21.15.169:0/2091070350 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 -- 172.21.15.169:0/2091070350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a03671a0 con 0x55b3a027b8e0 2024-09-13T06:31:07.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 --2- 172.21.15.169:0/2091070350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a0366bd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2634017ca0 tx=0x7f26340033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d7d0bef434c061 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f2529e0b640 1 -- 172.21.15.169:0/2091070350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340b9070 con 0x55b3a027b8e0 2024-09-13T06:31:07.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f2529e0b640 1 -- 172.21.15.169:0/2091070350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340aaa80 con 0x55b3a027b8e0 2024-09-13T06:31:07.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f2529e0b640 1 -- 172.21.15.169:0/2091070350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340aad60 con 0x55b3a027b8e0 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- 172.21.15.169:0/2091070350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 msgr2=0x55b3a0366bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 --2- 172.21.15.169:0/2091070350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a0366bd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2634017ca0 tx=0x7f26340033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- 172.21.15.169:0/2091070350 shutdown_connections 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 --2- 172.21.15.169:0/2091070350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a0366bd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- 172.21.15.169:0/2091070350 >> 172.21.15.169:0/2091070350 conn(0x55b3a01ef230 msgr2=0x55b3a0362800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- 172.21.15.169:0/2091070350 shutdown_connections 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- 172.21.15.169:0/2091070350 wait complete. 2024-09-13T06:31:07.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 Processor -- start 2024-09-13T06:31:07.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- start start 2024-09-13T06:31:07.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a036de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263e2ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b3a0282ef0 con 0x55b3a027b8e0 2024-09-13T06:31:07.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a036de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a036de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45742/0 (socket says 172.21.15.169:45742) 2024-09-13T06:31:07.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 -- 172.21.15.169:0/70910462 learned_addr learned my addr 172.21.15.169:0/70910462 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.369+0000 7f263bdfc640 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a036e340 con 0x55b3a027b8e0 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263bdfc640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a036de00 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f263401aec0 tx=0x7f2634017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f2523fff640 1 -- 172.21.15.169:0/70910462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340cc070 con 0x55b3a027b8e0 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f2523fff640 1 -- 172.21.15.169:0/70910462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340c7410 con 0x55b3a027b8e0 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3a036e5d0 con 0x55b3a027b8e0 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f2523fff640 1 -- 172.21.15.169:0/70910462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340b9070 con 0x55b3a027b8e0 2024-09-13T06:31:07.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a03712b0 con 0x55b3a027b8e0 2024-09-13T06:31:07.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f2523fff640 1 -- 172.21.15.169:0/70910462 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f26340b3040 con 0x55b3a027b8e0 2024-09-13T06:31:07.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f2523fff640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2524034650 0x7f2524036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f2523fff640 1 -- 172.21.15.169:0/70910462 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f26340c4070 con 0x55b3a027b8e0 2024-09-13T06:31:07.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263b5fb640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2524034650 0x7f2524036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a027c230 0x55b3a0374f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03754d0 con 0x55b3a027c230 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263c5fd640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a027c230 0x55b3a0374f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263b5fb640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2524034650 0x7f2524036b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2630000f70 tx=0x7f2630001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263c5fd640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a027c230 0x55b3a0374f00 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263c5fd640 1 -- 172.21.15.169:0/70910462 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a027c230 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03762f0 0x55b3a03786e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a0378d20 con 0x55b3a03762f0 2024-09-13T06:31:07.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.373+0000 7f263bdfc640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03762f0 0x55b3a03786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263bdfc640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03762f0 0x55b3a03786e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263bdfc640 1 -- 172.21.15.169:0/70910462 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03762f0 2024-09-13T06:31:07.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a037a5d0 con 0x55b3a03762f0 2024-09-13T06:31:07.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263bdfc640 1 -- 172.21.15.169:0/70910462 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03762f0 2024-09-13T06:31:07.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a0379800 con 0x55b3a03762f0 2024-09-13T06:31:07.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263bdfc640 1 -- 172.21.15.169:0/70910462 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03762f0 2024-09-13T06:31:07.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a037b980 0x55b3a037dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a037e2b0 con 0x55b3a037b980 2024-09-13T06:31:07.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263b5fb640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a037b980 0x55b3a037dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263b5fb640 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a037b980 0x55b3a037dd70 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263b5fb640 1 -- 172.21.15.169:0/70910462 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f263000d040 con 0x55b3a037b980 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 Processor -- start 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 -- start start 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 0x55b3a038c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.377+0000 7f263e2ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b3a0180800 con 0x55b3a038bd40 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 0x55b3a038c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 0x55b3a038c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45754/0 (socket says 172.21.15.169:45754) 2024-09-13T06:31:07.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 -- 172.21.15.169:0/3751132490 learned_addr learned my addr 172.21.15.169:0/3751132490 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 -- 172.21.15.169:0/3751132490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a038c6a0 con 0x55b3a038bd40 2024-09-13T06:31:07.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 0x55b3a038c160 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f26340e4010 tx=0x7f26340d7380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f25217fa640 1 -- 172.21.15.169:0/3751132490 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340e8020 con 0x55b3a038bd40 2024-09-13T06:31:07.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f25217fa640 1 -- 172.21.15.169:0/3751132490 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340e4dc0 con 0x55b3a038bd40 2024-09-13T06:31:07.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3a038c930 con 0x55b3a038bd40 2024-09-13T06:31:07.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f25217fa640 1 -- 172.21.15.169:0/3751132490 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340cf490 con 0x55b3a038bd40 2024-09-13T06:31:07.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a038c930 con 0x55b3a038bd40 2024-09-13T06:31:07.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f25217fa640 1 -- 172.21.15.169:0/3751132490 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f26340eb020 con 0x55b3a038bd40 2024-09-13T06:31:07.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f25217fa640 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2514034650 0x7f2514036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f25217fa640 1 -- 172.21.15.169:0/3751132490 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f26340d6040 con 0x55b3a038bd40 2024-09-13T06:31:07.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263b5fb640 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2514034650 0x7f2514036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263e2ec980 1 Processor -- start 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263e2ec980 1 -- start start 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263b5fb640 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2514034650 0x7f2514036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55b3a037e6b0 tx=0x7f2630006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263e2ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a0398910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263e2ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b3a0367460 con 0x55b3a0398530 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a0398910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.381+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a0398910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45756/0 (socket says 172.21.15.169:45756) 2024-09-13T06:31:07.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 -- 172.21.15.169:0/3159216113 learned_addr learned my addr 172.21.15.169:0/3159216113 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 -- 172.21.15.169:0/3159216113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a0398ee0 con 0x55b3a0398530 2024-09-13T06:31:07.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 --2- 172.21.15.169:0/3159216113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a0398910 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f26340cff10 tx=0x7f26340d7c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98efd56aefc4036 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f251affd640 1 -- 172.21.15.169:0/3159216113 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340d1a90 con 0x55b3a0398530 2024-09-13T06:31:07.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f251affd640 1 -- 172.21.15.169:0/3159216113 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340eed10 con 0x55b3a0398530 2024-09-13T06:31:07.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f251affd640 1 -- 172.21.15.169:0/3159216113 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340d1570 con 0x55b3a0398530 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/3159216113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 msgr2=0x55b3a0398910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 --2- 172.21.15.169:0/3159216113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a0398910 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f26340cff10 tx=0x7f26340d7c60 comp rx=0 tx=0).stop 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/3159216113 shutdown_connections 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 --2- 172.21.15.169:0/3159216113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a0398910 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/3159216113 >> 172.21.15.169:0/3159216113 conn(0x55b3a0394910 msgr2=0x55b3a0392a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/3159216113 shutdown_connections 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/3159216113 wait complete. 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 Processor -- start 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- start start 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a039f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b3a0399380 con 0x55b3a0398530 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a039f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a039f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45758/0 (socket says 172.21.15.169:45758) 2024-09-13T06:31:07.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 learned_addr learned my addr 172.21.15.169:0/1974638851 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a039fc50 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263bdfc640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a039f710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f26340e4860 tx=0x7f26340d27c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f25197fa640 1 -- 172.21.15.169:0/1974638851 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340e42c0 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3a039fc50 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f25197fa640 1 -- 172.21.15.169:0/1974638851 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634105070 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f25197fa640 1 -- 172.21.15.169:0/1974638851 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340c8960 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.385+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a03a00c0 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f25197fa640 1 -- 172.21.15.169:0/1974638851 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2634111060 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f25197fa640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2504034650 0x7f2504036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f25197fa640 1 -- 172.21.15.169:0/1974638851 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f2634100c20 con 0x55b3a0398530 2024-09-13T06:31:07.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263b5fb640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2504034650 0x7f2504036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a03aa7b0 0x55b3a03acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03ad3c0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263c5fd640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a03aa7b0 0x55b3a03acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263b5fb640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2504034650 0x7f2504036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f26300207d0 tx=0x7f2630011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263c5fd640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a03aa7b0 0x55b3a03acc70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 realm 2024-09-13T06:31:07.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03a9be0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03ade80 con 0x55b3a03aa7b0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03aec60 0x55b3a03b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b16e0 con 0x55b3a03aec60 2024-09-13T06:31:07.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263bdfc640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03aec60 0x55b3a03b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.389+0000 7f263bdfc640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03aec60 0x55b3a03b1050 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:07.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 20 searching for the correct realm 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a03b3ca0 0x55b3a03b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b6710 con 0x55b3a03b3ca0 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263b5fb640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a03b3ca0 0x55b3a03b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263b5fb640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a03b3ca0 0x55b3a03b6090 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b6710 con 0x55b3a03aec60 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263bdfc640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f26340ed020 0x7f26340f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x7f26340ed020 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263c5fd640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f26340ed020 0x7f26340f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263c5fd640 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f26340ed020 0x7f26340f5390 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.393+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03b3ca0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x7f26340ed020 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x7f26340ed020 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.397+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03b3ca0 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03b3ca0 2024-09-13T06:31:07.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03b3ca0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x7f26340ed020 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.401+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aa7b0 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x7f26340ed020 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03b3ca0 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x7f26340ed020 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03b3ca0 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.405+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b1f30 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:07.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b2780 con 0x55b3a03aa7b0 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b2b70 con 0x55b3a03aec60 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b2b70 con 0x55b3a03b3ca0 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 zone default found 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 4 Realm: () 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 zonegroup default 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b6b70 con 0x7f26340ed020 2024-09-13T06:31:07.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b8da0 con 0x55b3a03b3ca0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b9140 con 0x55b3a03b3ca0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 started sync module instance, tier type = 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:07.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.409+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b81e0 con 0x55b3a03aec60 2024-09-13T06:31:07.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94229975762688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b81e0 con 0x55b3a03aec60 2024-09-13T06:31:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b9990 con 0x55b3a03aa7b0 2024-09-13T06:31:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94229975766240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03ba230 con 0x55b3a03aa7b0 2024-09-13T06:31:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bac70 con 0x55b3a03aec60 2024-09-13T06:31:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.413+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94229975762688] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94229975766240] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94229975770944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b9d80 con 0x55b3a03aec60 2024-09-13T06:31:07.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bb510 con 0x7f26340ed020 2024-09-13T06:31:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94229975773280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03b9d80 con 0x7f26340ed020 2024-09-13T06:31:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bbfb0 con 0x55b3a03aec60 2024-09-13T06:31:07.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94229975770944] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.417+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94229975773280] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94229975774336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bbf70 con 0x55b3a03aec60 2024-09-13T06:31:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bc3a0 con 0x55b3a03b3ca0 2024-09-13T06:31:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94229975760176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bcc40 con 0x55b3a03b3ca0 2024-09-13T06:31:07.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bd640 con 0x55b3a03b3ca0 2024-09-13T06:31:07.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94229975774336] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94229975760176] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94229975775904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bc790 con 0x55b3a03b3ca0 2024-09-13T06:31:07.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.421+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bdee0 con 0x7f26340ed020 2024-09-13T06:31:07.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94229975775904] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94229975781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bc790 con 0x7f26340ed020 2024-09-13T06:31:07.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=0 2024-09-13T06:31:07.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=1 2024-09-13T06:31:07.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=2 2024-09-13T06:31:07.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=3 2024-09-13T06:31:07.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=4 2024-09-13T06:31:07.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=5 2024-09-13T06:31:07.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=6 2024-09-13T06:31:07.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94229975781712] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 20 add_watcher() i=7 2024-09-13T06:31:07.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:07.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03c0f10 con 0x55b3a03aa7b0 2024-09-13T06:31:07.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.425+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94229975783984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03be3d0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94229975783984] v35'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f24f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:07.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:07.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:07.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 5 note: GC not initialized 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f24f0fe1640 20 reqs_thread_entry: start 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 20 Filter name: none 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f246a7fc640 20 reqs_thread_entry: start 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e45a0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:31:07.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:31:07.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:31:07.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:07.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e7030 con 0x55b3a03b3ca0 2024-09-13T06:31:07.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call] v35'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.429+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e7030 con 0x55b3a03b3ca0 2024-09-13T06:31:07.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.433+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(64 usage.10 [call] v35'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.433+0000 7f24f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:07.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.433+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94229975783984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03c3270 con 0x55b3a03aa7b0 2024-09-13T06:31:07.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.433+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94229975783984] v35'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.433+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94229975762688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03bda30 con 0x55b3a03aec60 2024-09-13T06:31:07.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94229975762688] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263e2ec980 20 remove_watcher() i=0 2024-09-13T06:31:07.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263e2ec980 2 removed watcher, disabling cache 2024-09-13T06:31:07.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94229975766240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x55b3a03aa7b0 2024-09-13T06:31:07.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94229975766240] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x55b3a03aa7b0 2024-09-13T06:31:07.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263e2ec980 20 remove_watcher() i=1 2024-09-13T06:31:07.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.437+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94229975770944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x55b3a03aec60 2024-09-13T06:31:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.441+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94229975770944] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.441+0000 7f263e2ec980 20 remove_watcher() i=2 2024-09-13T06:31:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.441+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94229975773280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x7f26340ed020 2024-09-13T06:31:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.441+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94229975773280] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.441+0000 7f263e2ec980 20 remove_watcher() i=3 2024-09-13T06:31:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.441+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94229975774336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x55b3a03aec60 2024-09-13T06:31:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263bdfc640 1 -- 172.21.15.169:0/1974638851 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94229975774336] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26340ce310 con 0x55b3a03aec60 2024-09-13T06:31:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263e2ec980 20 remove_watcher() i=4 2024-09-13T06:31:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94229975760176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x55b3a03b3ca0 2024-09-13T06:31:07.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94229975760176] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263e2ec980 20 remove_watcher() i=5 2024-09-13T06:31:07.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94229975775904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x55b3a03b3ca0 2024-09-13T06:31:07.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263b5fb640 1 -- 172.21.15.169:0/1974638851 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94229975775904] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2630036040 con 0x55b3a03b3ca0 2024-09-13T06:31:07.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263e2ec980 20 remove_watcher() i=6 2024-09-13T06:31:07.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.445+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94229975781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b3a03e4140 con 0x7f26340ed020 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94229975781712] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x7f26340ed020 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 20 remove_watcher() i=7 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03aec60 msgr2=0x55b3a03b1050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03aec60 0x55b3a03b1050 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a03aa7b0 msgr2=0x55b3a03acc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a03aa7b0 0x55b3a03acc70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f26340ed020 msgr2=0x7f26340f5390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f26340ed020 0x7f26340f5390 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a03b3ca0 msgr2=0x55b3a03b6090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a03b3ca0 0x55b3a03b6090 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2504034650 msgr2=0x7f2504036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2504034650 0x7f2504036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f26300207d0 tx=0x7f2630011000 comp rx=0 tx=0).stop 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 msgr2=0x55b3a039f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263c5fd640 1 -- 172.21.15.169:0/1974638851 reap_dead start 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a039f710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f26340e4860 tx=0x7f26340d27c0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 shutdown_connections 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/1974638851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a0398530 0x55b3a039f710 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 >> 172.21.15.169:0/1974638851 conn(0x55b3a0394910 msgr2=0x55b3a03929e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 shutdown_connections 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/1974638851 wait complete. 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2514034650 msgr2=0x7f2514036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2514034650 0x7f2514036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55b3a037e6b0 tx=0x7f2630006000 comp rx=0 tx=0).stop 2024-09-13T06:31:07.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 msgr2=0x55b3a038c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 0x55b3a038c160 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f26340e4010 tx=0x7f26340d7380 comp rx=0 tx=0).stop 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 shutdown_connections 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2514034650 0x7f2514036b10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/3751132490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a038bd40 0x55b3a038c160 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 >> 172.21.15.169:0/3751132490 conn(0x55b3a0380e90 msgr2=0x55b3a0383910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 shutdown_connections 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/3751132490 wait complete. 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03762f0 msgr2=0x55b3a03786e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55b3a03762f0 0x55b3a03786e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a027c230 msgr2=0x55b3a0374f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55b3a027c230 0x55b3a0374f00 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a037b980 msgr2=0x55b3a037dd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55b3a037b980 0x55b3a037dd70 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2524034650 msgr2=0x7f2524036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2524034650 0x7f2524036b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2630000f70 tx=0x7f2630001420 comp rx=0 tx=0).stop 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 msgr2=0x55b3a036de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 --2- 172.21.15.169:0/70910462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b3a027b8e0 0x55b3a036de00 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f263401aec0 tx=0x7f2634017e30 comp rx=0 tx=0).stop 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263c5fd640 1 -- 172.21.15.169:0/70910462 reap_dead start 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 shutdown_connections 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 >> 172.21.15.169:0/70910462 conn(0x55b3a01ef230 msgr2=0x55b3a0361380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 shutdown_connections 2024-09-13T06:31:07.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.449+0000 7f263e2ec980 1 -- 172.21.15.169:0/70910462 wait complete. 2024-09-13T06:31:07.464 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T06:31:07.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T06:31:07.464 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T06:31:07.543 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:07.543 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:07.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f9142349980 1 Processor -- start 2024-09-13T06:31:07.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f9142349980 1 -- start start 2024-09-13T06:31:07.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f9142349980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555b19c8fb00 0x555b19d1e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f9142349980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b19ba3ae0 con 0x555b19d1e870 2024-09-13T06:31:07.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f9142349980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x555b19bc7e30 con 0x555b19c8fb00 2024-09-13T06:31:07.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f913fe59640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555b19c8fb00 0x555b19d1e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f913f658640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x555b19d1e870 0x555b19d20c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:39144/0 (socket says 172.21.15.169:39144) 2024-09-13T06:31:07.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f913fe59640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x555b19c8fb00 0x555b19d1e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45760/0 (socket says 172.21.15.169:45760) 2024-09-13T06:31:07.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f913f658640 1 -- 172.21.15.169:0/767344124 learned_addr learned my addr 172.21.15.169:0/767344124 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:07.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f913fe59640 1 -- 172.21.15.169:0/767344124 >> v1:172.21.15.112:6789/0 conn(0x555b19d1e870 legacy=0x555b19d20c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.541+0000 7f913fe59640 1 -- 172.21.15.169:0/767344124 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b19d23390 con 0x555b19c8fb00 2024-09-13T06:31:07.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f913fe59640 1 --2- 172.21.15.169:0/767344124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19d1e330 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f913800a420 tx=0x7f913801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c05d9b1983f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f913ee57640 1 -- 172.21.15.169:0/767344124 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380af070 con 0x555b19c8fb00 2024-09-13T06:31:07.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f913ee57640 1 -- 172.21.15.169:0/767344124 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380aa530 con 0x555b19c8fb00 2024-09-13T06:31:07.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f913ee57640 1 -- 172.21.15.169:0/767344124 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380aa850 con 0x555b19c8fb00 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 -- 172.21.15.169:0/767344124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 msgr2=0x555b19d1e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 --2- 172.21.15.169:0/767344124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19d1e330 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f913800a420 tx=0x7f913801afd0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 -- 172.21.15.169:0/767344124 shutdown_connections 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 --2- 172.21.15.169:0/767344124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19d1e330 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 -- 172.21.15.169:0/767344124 >> 172.21.15.169:0/767344124 conn(0x555b19d16060 msgr2=0x555b19d18480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 -- 172.21.15.169:0/767344124 shutdown_connections 2024-09-13T06:31:07.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.545+0000 7f9142349980 1 -- 172.21.15.169:0/767344124 wait complete. 2024-09-13T06:31:07.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 Processor -- start 2024-09-13T06:31:07.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- start start 2024-09-13T06:31:07.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e06a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b19bc9200 con 0x555b19c8fb00 2024-09-13T06:31:07.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e06a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e06a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45764/0 (socket says 172.21.15.169:45764) 2024-09-13T06:31:07.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f913fe59640 1 -- 172.21.15.169:0/2893895051 learned_addr learned my addr 172.21.15.169:0/2893895051 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f913fe59640 1 -- 172.21.15.169:0/2893895051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b19e07020 con 0x555b19c8fb00 2024-09-13T06:31:07.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f913fe59640 1 --2- 172.21.15.169:0/2893895051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e06a50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f913800a420 tx=0x7f91380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc2f0e14f9e5e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f902de0b640 1 -- 172.21.15.169:0/2893895051 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380af050 con 0x555b19c8fb00 2024-09-13T06:31:07.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f902de0b640 1 -- 172.21.15.169:0/2893895051 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380b0040 con 0x555b19c8fb00 2024-09-13T06:31:07.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f902de0b640 1 -- 172.21.15.169:0/2893895051 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380aac60 con 0x555b19c8fb00 2024-09-13T06:31:07.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- 172.21.15.169:0/2893895051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 msgr2=0x555b19e06a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 --2- 172.21.15.169:0/2893895051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e06a50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f913800a420 tx=0x7f91380033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- 172.21.15.169:0/2893895051 shutdown_connections 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 --2- 172.21.15.169:0/2893895051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e06a50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- 172.21.15.169:0/2893895051 >> 172.21.15.169:0/2893895051 conn(0x555b19d16060 msgr2=0x555b19e02680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- 172.21.15.169:0/2893895051 shutdown_connections 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.561+0000 7f9142349980 1 -- 172.21.15.169:0/2893895051 wait complete. 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 Processor -- start 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 -- start start 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e0dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b19d22e30 con 0x555b19c8fb00 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e0dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e0dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45772/0 (socket says 172.21.15.169:45772) 2024-09-13T06:31:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f913fe59640 1 -- 172.21.15.169:0/2357525960 learned_addr learned my addr 172.21.15.169:0/2357525960 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f913fe59640 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b19e0e200 con 0x555b19c8fb00 2024-09-13T06:31:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f913fe59640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e0dcc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f913801b870 tx=0x7f9138019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9027fff640 1 -- 172.21.15.169:0/2357525960 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380c5020 con 0x555b19c8fb00 2024-09-13T06:31:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b19e0e490 con 0x555b19c8fb00 2024-09-13T06:31:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9027fff640 1 -- 172.21.15.169:0/2357525960 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380c1480 con 0x555b19c8fb00 2024-09-13T06:31:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b19e11170 con 0x555b19c8fb00 2024-09-13T06:31:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9027fff640 1 -- 172.21.15.169:0/2357525960 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380c1760 con 0x555b19c8fb00 2024-09-13T06:31:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9027fff640 1 -- 172.21.15.169:0/2357525960 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f91380ca440 con 0x555b19c8fb00 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9027fff640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90280346a0 0x7f9028036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9027fff640 1 -- 172.21.15.169:0/2357525960 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f91380bb070 con 0x555b19c8fb00 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f913f658640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90280346a0 0x7f9028036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19d1e870 0x555b19e14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e15340 con 0x555b19d1e870 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.565+0000 7f914065a640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19d1e870 0x555b19e14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913f658640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90280346a0 0x7f9028036b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9128000f70 tx=0x7f91280012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f914065a640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19d1e870 0x555b19e14dc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f914065a640 1 -- 172.21.15.169:0/2357525960 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19d1e870 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e16160 0x555b19e18550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e18b80 con 0x555b19e16160 2024-09-13T06:31:07.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913fe59640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e16160 0x555b19e18550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913fe59640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e16160 0x555b19e18550 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913fe59640 1 -- 172.21.15.169:0/2357525960 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91380c7070 con 0x555b19e16160 2024-09-13T06:31:07.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e1a430 con 0x555b19e16160 2024-09-13T06:31:07.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913fe59640 1 -- 172.21.15.169:0/2357525960 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f91380c7070 con 0x555b19e16160 2024-09-13T06:31:07.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e19660 con 0x555b19e16160 2024-09-13T06:31:07.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913fe59640 1 -- 172.21.15.169:0/2357525960 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91380c7070 con 0x555b19e16160 2024-09-13T06:31:07.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e1b7e0 0x555b19e1dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e1e110 con 0x555b19e1b7e0 2024-09-13T06:31:07.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.569+0000 7f913f658640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e1b7e0 0x555b19e1dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913f658640 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e1b7e0 0x555b19e1dbd0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913f658640 1 -- 172.21.15.169:0/2357525960 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f912800e620 con 0x555b19e1b7e0 2024-09-13T06:31:07.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f9142349980 1 Processor -- start 2024-09-13T06:31:07.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f9142349980 1 -- start start 2024-09-13T06:31:07.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f9142349980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 0x555b19e2bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f9142349980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b19c22800 con 0x555b19e2bad0 2024-09-13T06:31:07.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 0x555b19e2bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 0x555b19e2bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45776/0 (socket says 172.21.15.169:45776) 2024-09-13T06:31:07.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913fe59640 1 -- 172.21.15.169:0/595489652 learned_addr learned my addr 172.21.15.169:0/595489652 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913fe59640 1 -- 172.21.15.169:0/595489652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b19e2c430 con 0x555b19e2bad0 2024-09-13T06:31:07.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f913fe59640 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 0x555b19e2bef0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f91380e3000 tx=0x7f91380c9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f90257fa640 1 -- 172.21.15.169:0/595489652 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380bfc70 con 0x555b19e2bad0 2024-09-13T06:31:07.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b19e2c6c0 con 0x555b19e2bad0 2024-09-13T06:31:07.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f90257fa640 1 -- 172.21.15.169:0/595489652 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380bfe10 con 0x555b19e2bad0 2024-09-13T06:31:07.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b19e2f340 con 0x555b19e2bad0 2024-09-13T06:31:07.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f90257fa640 1 -- 172.21.15.169:0/595489652 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380dc1f0 con 0x555b19e2bad0 2024-09-13T06:31:07.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f90257fa640 1 -- 172.21.15.169:0/595489652 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f91380c93e0 con 0x555b19e2bad0 2024-09-13T06:31:07.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.573+0000 7f90257fa640 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9018034650 0x7f9018036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f90257fa640 1 -- 172.21.15.169:0/595489652 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f91380eebe0 con 0x555b19e2bad0 2024-09-13T06:31:07.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913f658640 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9018034650 0x7f9018036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 Processor -- start 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- start start 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19d1b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913f658640 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9018034650 0x7f9018036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f912800bf60 tx=0x7f912800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b19e072e0 con 0x555b19d1b520 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19d1b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19d1b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45780/0 (socket says 172.21.15.169:45780) 2024-09-13T06:31:07.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 -- 172.21.15.169:0/1160498081 learned_addr learned my addr 172.21.15.169:0/1160498081 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 -- 172.21.15.169:0/1160498081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b19d1bed0 con 0x555b19d1b520 2024-09-13T06:31:07.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 --2- 172.21.15.169:0/1160498081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19d1b900 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f91380b4a90 tx=0x7f91380b55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee7345cbea11b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f901effd640 1 -- 172.21.15.169:0/1160498081 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380c96d0 con 0x555b19d1b520 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f901effd640 1 -- 172.21.15.169:0/1160498081 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380dc970 con 0x555b19d1b520 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f901effd640 1 -- 172.21.15.169:0/1160498081 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380c9870 con 0x555b19d1b520 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- 172.21.15.169:0/1160498081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 msgr2=0x555b19d1b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 --2- 172.21.15.169:0/1160498081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19d1b900 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f91380b4a90 tx=0x7f91380b55c0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- 172.21.15.169:0/1160498081 shutdown_connections 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 --2- 172.21.15.169:0/1160498081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19d1b900 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- 172.21.15.169:0/1160498081 >> 172.21.15.169:0/1160498081 conn(0x555b19e348a0 msgr2=0x555b19e329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- 172.21.15.169:0/1160498081 shutdown_connections 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- 172.21.15.169:0/1160498081 wait complete. 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 Processor -- start 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- start start 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19e416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f9142349980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555b19d1bed0 con 0x555b19d1b520 2024-09-13T06:31:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19e416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19e416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45786/0 (socket says 172.21.15.169:45786) 2024-09-13T06:31:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 learned_addr learned my addr 172.21.15.169:0/3913248348 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.577+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b19e41bf0 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f913fe59640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19e416b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f91380e6040 tx=0x7f91380c3170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f901d7fa640 1 -- 172.21.15.169:0/3913248348 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380cfa10 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b19e41bf0 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b19e41bf0 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f901d7fa640 1 -- 172.21.15.169:0/3913248348 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913810d070 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f901d7fa640 1 -- 172.21.15.169:0/3913248348 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91380b5900 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f901d7fa640 1 -- 172.21.15.169:0/3913248348 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f91380f9070 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f901d7fa640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90080346a0 0x7f9008036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f901d7fa640 1 -- 172.21.15.169:0/3913248348 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f91380c5820 con 0x555b19d1b520 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f913f658640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90080346a0 0x7f9008036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19e4c610 0x555b19e4eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e4f200 con 0x555b19e4c610 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f914065a640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19e4c610 0x555b19e4eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f913f658640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90080346a0 0x7f9008036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x555b19e122b0 tx=0x7f9128010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f914065a640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19e4c610 0x555b19e4eab0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 realm 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e4bb00 con 0x555b19e4c610 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e4fcd0 con 0x555b19e4c610 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e508b0 0x555b19e52d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e534e0 con 0x555b19e508b0 2024-09-13T06:31:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.581+0000 7f913fe59640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e508b0 0x555b19e52d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913fe59640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e508b0 0x555b19e52d70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 20 searching for the correct realm 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e55af0 0x555b19e57ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e584f0 con 0x555b19e55af0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913f658640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e55af0 0x555b19e57ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913f658640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e55af0 0x555b19e57ee0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e584f0 con 0x555b19e508b0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913fe59640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f91380e4040 0x7f91380a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x7f91380e4040 2024-09-13T06:31:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f914065a640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f91380e4040 0x7f91380a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.585+0000 7f914065a640 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f91380e4040 0x7f91380a5140 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e55af0 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x7f91380e4040 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x7f91380e4040 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.589+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e55af0 2024-09-13T06:31:07.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e55af0 2024-09-13T06:31:07.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e55af0 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x7f91380e4040 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.593+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x7f91380e4040 2024-09-13T06:31:07.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e55af0 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x7f91380e4040 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e55af0 2024-09-13T06:31:07.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555b19e53d80 con 0x555b19e508b0 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e545d0 con 0x555b19e4c610 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.597+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e549c0 con 0x555b19e508b0 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e549c0 con 0x555b19e55af0 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 zone default found 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 4 Realm: () 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:07.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 zonegroup default 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e58950 con 0x7f91380e4040 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5a6d0 con 0x555b19e55af0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5aa70 con 0x555b19e55af0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 started sync module instance, tier type = 2024-09-13T06:31:07.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:07.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.601+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e59b70 con 0x555b19e508b0 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93849764864112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e59b70 con 0x555b19e508b0 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5b4e0 con 0x555b19e4c610 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93849764868080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5bd80 con 0x555b19e4c610 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5c7c0 con 0x555b19e508b0 2024-09-13T06:31:07.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93849764868080] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.605+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93849764864112] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93849764872848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5b8d0 con 0x555b19e508b0 2024-09-13T06:31:07.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5d060 con 0x7f91380e4040 2024-09-13T06:31:07.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93849764875184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5b8d0 con 0x7f91380e4040 2024-09-13T06:31:07.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5db20 con 0x555b19e508b0 2024-09-13T06:31:07.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93849764872848] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93849764875184] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.609+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93849764876240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5dae0 con 0x555b19e508b0 2024-09-13T06:31:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5df10 con 0x555b19e55af0 2024-09-13T06:31:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93849764861632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5e7b0 con 0x555b19e55af0 2024-09-13T06:31:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5f1b0 con 0x555b19e55af0 2024-09-13T06:31:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93849764876240] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93849764861632] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93849764881152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5ecc0 con 0x555b19e55af0 2024-09-13T06:31:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.613+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5fa50 con 0x7f91380e4040 2024-09-13T06:31:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93849764881152] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93849764877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5fa50 con 0x7f91380e4040 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=0 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=1 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=2 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=3 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=4 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=5 2024-09-13T06:31:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=6 2024-09-13T06:31:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93849764877808] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 20 add_watcher() i=7 2024-09-13T06:31:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e62d10 con 0x555b19e4c610 2024-09-13T06:31:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.617+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93849764886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5ffe0 con 0x555b19e4c610 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93849764886288] v35'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f8ff67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 5 note: GC not initialized 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f8ff57e2640 20 reqs_thread_entry: start 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 20 Filter name: none 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f8feeffd640 20 reqs_thread_entry: start 2024-09-13T06:31:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e86010 con 0x555b19e4c610 2024-09-13T06:31:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:31:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b19e87560 con 0x555b19e55af0 2024-09-13T06:31:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f8ff67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.621+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93849764886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e46600 con 0x555b19e4c610 2024-09-13T06:31:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.625+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93849764886288] v35'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.625+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93849764864112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5f710 con 0x555b19e508b0 2024-09-13T06:31:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.625+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93849764864112] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.625+0000 7f9142349980 20 remove_watcher() i=0 2024-09-13T06:31:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.625+0000 7f9142349980 2 removed watcher, disabling cache 2024-09-13T06:31:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.625+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93849764868080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5a070 con 0x555b19e4c610 2024-09-13T06:31:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.629+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93849764868080] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x555b19e4c610 2024-09-13T06:31:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.629+0000 7f9142349980 20 remove_watcher() i=1 2024-09-13T06:31:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.629+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93849764872848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5a070 con 0x555b19e508b0 2024-09-13T06:31:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.629+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93849764872848] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.629+0000 7f9142349980 20 remove_watcher() i=2 2024-09-13T06:31:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.629+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93849764875184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5a070 con 0x7f91380e4040 2024-09-13T06:31:07.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.633+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93849764875184] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.633+0000 7f9142349980 20 remove_watcher() i=3 2024-09-13T06:31:07.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.633+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93849764876240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5cbb0 con 0x555b19e508b0 2024-09-13T06:31:07.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f913fe59640 1 -- 172.21.15.169:0/3913248348 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93849764876240] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91380f8030 con 0x555b19e508b0 2024-09-13T06:31:07.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f9142349980 20 remove_watcher() i=4 2024-09-13T06:31:07.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93849764861632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5a070 con 0x555b19e55af0 2024-09-13T06:31:07.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93849764861632] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f9142349980 20 remove_watcher() i=5 2024-09-13T06:31:07.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93849764881152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e596c0 con 0x555b19e55af0 2024-09-13T06:31:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f913f658640 1 -- 172.21.15.169:0/3913248348 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93849764881152] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f912800e620 con 0x555b19e55af0 2024-09-13T06:31:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f9142349980 20 remove_watcher() i=6 2024-09-13T06:31:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93849764877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b19e5a070 con 0x7f91380e4040 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.637+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93849764877808] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91300083f0 con 0x7f91380e4040 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 20 remove_watcher() i=7 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e508b0 msgr2=0x555b19e52d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e508b0 0x555b19e52d70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19e4c610 msgr2=0x555b19e4eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19e4c610 0x555b19e4eab0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f91380e4040 msgr2=0x7f91380a5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f91380e4040 0x7f91380a5140 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e55af0 msgr2=0x555b19e57ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e55af0 0x555b19e57ee0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90080346a0 msgr2=0x7f9008036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90080346a0 0x7f9008036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x555b19e122b0 tx=0x7f9128010000 comp rx=0 tx=0).stop 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 msgr2=0x555b19e416b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f914065a640 1 -- 172.21.15.169:0/3913248348 reap_dead start 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19e416b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f91380e6040 tx=0x7f91380c3170 comp rx=0 tx=0).stop 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 shutdown_connections 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/3913248348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19d1b520 0x555b19e416b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 >> 172.21.15.169:0/3913248348 conn(0x555b19e348a0 msgr2=0x555b19e32970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 shutdown_connections 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/3913248348 wait complete. 2024-09-13T06:31:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9018034650 msgr2=0x7f9018036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9018034650 0x7f9018036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f912800bf60 tx=0x7f912800f000 comp rx=0 tx=0).stop 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 msgr2=0x555b19e2bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 0x555b19e2bef0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f91380e3000 tx=0x7f91380c9d60 comp rx=0 tx=0).stop 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 shutdown_connections 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9018034650 0x7f9018036b10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/595489652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19e2bad0 0x555b19e2bef0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 >> 172.21.15.169:0/595489652 conn(0x555b19e20c20 msgr2=0x555b19e236a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 shutdown_connections 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/595489652 wait complete. 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e16160 msgr2=0x555b19e18550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x555b19e16160 0x555b19e18550 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19d1e870 msgr2=0x555b19e14dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x555b19d1e870 0x555b19e14dc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e1b7e0 msgr2=0x555b19e1dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x555b19e1b7e0 0x555b19e1dbd0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90280346a0 msgr2=0x7f9028036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f90280346a0 0x7f9028036b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9128000f70 tx=0x7f91280012c0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 msgr2=0x555b19e0dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 --2- 172.21.15.169:0/2357525960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555b19c8fb00 0x555b19e0dcc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f913801b870 tx=0x7f9138019810 comp rx=0 tx=0).stop 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f914065a640 1 -- 172.21.15.169:0/2357525960 reap_dead start 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 shutdown_connections 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 >> 172.21.15.169:0/2357525960 conn(0x555b19d16060 msgr2=0x555b19e01200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 shutdown_connections 2024-09-13T06:31:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.641+0000 7f9142349980 1 -- 172.21.15.169:0/2357525960 wait complete. 2024-09-13T06:31:07.656 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[],"summary":[]} 2024-09-13T06:31:07.656 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T06:31:07.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T06:31:07.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T06:31:07.656 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T06:31:07.737 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:07.737 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:07.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ec80c980 1 Processor -- start 2024-09-13T06:31:07.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ec80c980 1 -- start start 2024-09-13T06:31:07.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ec80c980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564da024a6a0 0x564da024aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ec80c980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564da00d2ae0 con 0x564da024aff0 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ec80c980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x564da00f6e30 con 0x564da024a6a0 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ea31c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564da024a6a0 0x564da024aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ea31c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x564da024a6a0 0x564da024aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45796/0 (socket says 172.21.15.169:45796) 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216048799 learned_addr learned my addr 172.21.15.169:0/2216048799 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.733+0000 7f40e9b1b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x564da024aff0 0x564da024fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:39148/0 (socket says 172.21.15.169:39148) 2024-09-13T06:31:07.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216048799 >> v1:172.21.15.112:6789/0 conn(0x564da024aff0 legacy=0x564da024fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216048799 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da0252270 con 0x564da024a6a0 2024-09-13T06:31:07.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2216048799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da024aa80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f40e400a4e0 tx=0x7f40e401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7826bd0c8df1ce9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40e931a640 1 -- 172.21.15.169:0/2216048799 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40aa540 con 0x564da024a6a0 2024-09-13T06:31:07.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40e931a640 1 -- 172.21.15.169:0/2216048799 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40aa6e0 con 0x564da024a6a0 2024-09-13T06:31:07.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40e931a640 1 -- 172.21.15.169:0/2216048799 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40aaa40 con 0x564da024a6a0 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216048799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 msgr2=0x564da024aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216048799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da024aa80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f40e400a4e0 tx=0x7f40e401b090 comp rx=0 tx=0).stop 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216048799 shutdown_connections 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216048799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da024aa80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216048799 >> 172.21.15.169:0/2216048799 conn(0x564da02461c0 msgr2=0x564da02485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216048799 shutdown_connections 2024-09-13T06:31:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.737+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216048799 wait complete. 2024-09-13T06:31:07.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ec80c980 1 Processor -- start 2024-09-13T06:31:07.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ec80c980 1 -- start start 2024-09-13T06:31:07.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ec80c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da0335a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ec80c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564da00f8200 con 0x564da024a6a0 2024-09-13T06:31:07.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da0335a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da0335a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45802/0 (socket says 172.21.15.169:45802) 2024-09-13T06:31:07.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.753+0000 7f40ea31c640 1 -- 172.21.15.169:0/980654604 learned_addr learned my addr 172.21.15.169:0/980654604 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 -- 172.21.15.169:0/980654604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da0336020 con 0x564da024a6a0 2024-09-13T06:31:07.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 --2- 172.21.15.169:0/980654604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da0335a50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f40e4017ca0 tx=0x7f40e40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eb623dbd52353d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f3fd8608640 1 -- 172.21.15.169:0/980654604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40b9030 con 0x564da024a6a0 2024-09-13T06:31:07.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f3fd8608640 1 -- 172.21.15.169:0/980654604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40aaac0 con 0x564da024a6a0 2024-09-13T06:31:07.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f3fd8608640 1 -- 172.21.15.169:0/980654604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40aada0 con 0x564da024a6a0 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- 172.21.15.169:0/980654604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 msgr2=0x564da0335a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 --2- 172.21.15.169:0/980654604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da0335a50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f40e4017ca0 tx=0x7f40e40033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- 172.21.15.169:0/980654604 shutdown_connections 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 --2- 172.21.15.169:0/980654604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da0335a50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- 172.21.15.169:0/980654604 >> 172.21.15.169:0/980654604 conn(0x564da02461c0 msgr2=0x564da0331680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- 172.21.15.169:0/980654604 shutdown_connections 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- 172.21.15.169:0/980654604 wait complete. 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 Processor -- start 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- start start 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da033cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ec80c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564da0251cb0 con 0x564da024a6a0 2024-09-13T06:31:07.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da033cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da033cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45818/0 (socket says 172.21.15.169:45818) 2024-09-13T06:31:07.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216206071 learned_addr learned my addr 172.21.15.169:0/2216206071 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da033d190 con 0x564da024a6a0 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.757+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da033cc50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f40e4005cc0 tx=0x7f40e4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f3fd6e05640 1 -- 172.21.15.169:0/2216206071 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40b9030 con 0x564da024a6a0 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da033d420 con 0x564da024a6a0 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f3fd6e05640 1 -- 172.21.15.169:0/2216206071 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40c3070 con 0x564da024a6a0 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da0340100 con 0x564da024a6a0 2024-09-13T06:31:07.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f3fd6e05640 1 -- 172.21.15.169:0/2216206071 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40cc060 con 0x564da024a6a0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f3fd6e05640 1 -- 172.21.15.169:0/2216206071 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40e40c5030 con 0x564da024a6a0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f3fd6e05640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fd0034650 0x7f3fd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f3fd6e05640 1 -- 172.21.15.169:0/2216206071 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f40e40ba070 con 0x564da024a6a0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fd0034650 0x7f3fd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da024aff0 0x564da0343be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0344250 con 0x564da024aff0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40eab1d640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da024aff0 0x564da0343be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fd0034650 0x7f3fd0036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000f70 tx=0x7f40e0001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40eab1d640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da024aff0 0x564da0343be0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40eab1d640 1 -- 172.21.15.169:0/2216206071 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da024aff0 2024-09-13T06:31:07.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da0345090 0x564da0347480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0347ab0 con 0x564da0345090 2024-09-13T06:31:07.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da0345090 0x564da0347480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.761+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da0345090 0x564da0347480 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216206071 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40e40c7410 con 0x564da0345090 2024-09-13T06:31:07.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0349360 con 0x564da0345090 2024-09-13T06:31:07.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216206071 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40e40c7410 con 0x564da0345090 2024-09-13T06:31:07.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0348590 con 0x564da0345090 2024-09-13T06:31:07.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ea31c640 1 -- 172.21.15.169:0/2216206071 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40e40c7410 con 0x564da0345090 2024-09-13T06:31:07.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da034a710 0x564da034cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da034d040 con 0x564da034a710 2024-09-13T06:31:07.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da034a710 0x564da034cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da034a710 0x564da034cb00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2216206071 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40e000f6a0 con 0x564da034a710 2024-09-13T06:31:07.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 Processor -- start 2024-09-13T06:31:07.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 -- start start 2024-09-13T06:31:07.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 0x564da035ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.765+0000 7f40ec80c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564da0151800 con 0x564da035aa40 2024-09-13T06:31:07.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 0x564da035ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 0x564da035ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45820/0 (socket says 172.21.15.169:45820) 2024-09-13T06:31:07.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 -- 172.21.15.169:0/2183744216 learned_addr learned my addr 172.21.15.169:0/2183744216 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 -- 172.21.15.169:0/2183744216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da035b3a0 con 0x564da035aa40 2024-09-13T06:31:07.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 0x564da035ae60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f40e40e5560 tx=0x7f40e40d0bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f3fcffff640 1 -- 172.21.15.169:0/2183744216 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40c6aa0 con 0x564da035aa40 2024-09-13T06:31:07.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da035b630 con 0x564da035aa40 2024-09-13T06:31:07.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f3fcffff640 1 -- 172.21.15.169:0/2183744216 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40c6c40 con 0x564da035aa40 2024-09-13T06:31:07.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f3fcffff640 1 -- 172.21.15.169:0/2183744216 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40dd030 con 0x564da035aa40 2024-09-13T06:31:07.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da035e2b0 con 0x564da035aa40 2024-09-13T06:31:07.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f3fcffff640 1 -- 172.21.15.169:0/2183744216 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40e40b3040 con 0x564da035aa40 2024-09-13T06:31:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f3fcffff640 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fc4034650 0x7f3fc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f3fcffff640 1 -- 172.21.15.169:0/2183744216 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f40e40efbe0 con 0x564da035aa40 2024-09-13T06:31:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fc4034650 0x7f3fc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ec80c980 1 Processor -- start 2024-09-13T06:31:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ec80c980 1 -- start start 2024-09-13T06:31:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fc4034650 0x7f3fc4036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x564da0341240 tx=0x7f40e000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ec80c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da01bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ec80c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564da03362e0 con 0x564da01bfbe0 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da01bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da01bffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45822/0 (socket says 172.21.15.169:45822) 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.769+0000 7f40ea31c640 1 -- 172.21.15.169:0/1359320601 learned_addr learned my addr 172.21.15.169:0/1359320601 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 -- 172.21.15.169:0/1359320601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da01c0590 con 0x564da01bfbe0 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 --2- 172.21.15.169:0/1359320601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da01bffc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f40e40d0fd0 tx=0x7f40e40e57b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d705621be8d0e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f3fcdffb640 1 -- 172.21.15.169:0/1359320601 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40f4040 con 0x564da01bfbe0 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f3fcdffb640 1 -- 172.21.15.169:0/1359320601 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40b4e10 con 0x564da01bfbe0 2024-09-13T06:31:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f3fcdffb640 1 -- 172.21.15.169:0/1359320601 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40b48f0 con 0x564da01bfbe0 2024-09-13T06:31:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/1359320601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 msgr2=0x564da01bffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 --2- 172.21.15.169:0/1359320601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da01bffc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f40e40d0fd0 tx=0x7f40e40e57b0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/1359320601 shutdown_connections 2024-09-13T06:31:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 --2- 172.21.15.169:0/1359320601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da01bffc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/1359320601 >> 172.21.15.169:0/1359320601 conn(0x564da0363770 msgr2=0x564da0361870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/1359320601 shutdown_connections 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/1359320601 wait complete. 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 Processor -- start 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- start start 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da0370740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564da01c0be0 con 0x564da01bfbe0 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da0370740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da0370740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45824/0 (socket says 172.21.15.169:45824) 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 learned_addr learned my addr 172.21.15.169:0/2472439316 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da0370c80 con 0x564da01bfbe0 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da0370740 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f40e40d0fd0 tx=0x7f40e40e3f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f3fbbfff640 1 -- 172.21.15.169:0/2472439316 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40ddea0 con 0x564da01bfbe0 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da0370c80 con 0x564da01bfbe0 2024-09-13T06:31:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f3fbbfff640 1 -- 172.21.15.169:0/2472439316 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40e3990 con 0x564da01bfbe0 2024-09-13T06:31:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f3fbbfff640 1 -- 172.21.15.169:0/2472439316 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4004610 con 0x564da01bfbe0 2024-09-13T06:31:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.773+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da03710f0 con 0x564da01bfbe0 2024-09-13T06:31:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f3fbbfff640 1 -- 172.21.15.169:0/2472439316 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40e40d3c80 con 0x564da01bfbe0 2024-09-13T06:31:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f3fbbfff640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fb4034650 0x7f3fb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f3fbbfff640 1 -- 172.21.15.169:0/2472439316 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f40e410ec10 con 0x564da01bfbe0 2024-09-13T06:31:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fb4034650 0x7f3fb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da037b700 0x564da037dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da037e310 con 0x564da037b700 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40eab1d640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da037b700 0x564da037dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fb4034650 0x7f3fb4036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f40e000ffd0 tx=0x7f40e0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40eab1d640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da037b700 0x564da037dbc0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 realm 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da037ab30 con 0x564da037b700 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da037eda0 con 0x564da037b700 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da037fb80 0x564da0381f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0382600 con 0x564da037fb80 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da037fb80 0x564da0381f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.777+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da037fb80 0x564da0381f70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0382e50 con 0x564da037fb80 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 20 searching for the correct realm 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da0384bc0 0x564da0386fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da0384bc0 0x564da0386fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40e9b1b640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da0384bc0 0x564da0386fb0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ea31c640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f40e40e0bb0 0x7f40e40d33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x7f40e40e0bb0 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40eab1d640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f40e40e0bb0 0x7f40e40d33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40eab1d640 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f40e40e0bb0 0x7f40e40d33e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.781+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x7f40e40e0bb0 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x7f40e40e0bb0 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.785+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x7f40e40e0bb0 2024-09-13T06:31:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037b700 2024-09-13T06:31:07.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x7f40e40e0bb0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.789+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x7f40e40e0bb0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da0384bc0 2024-09-13T06:31:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564da0387630 con 0x564da037fb80 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03837a0 con 0x564da037b700 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.793+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03833b0 con 0x564da037fb80 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0383400 con 0x564da0384bc0 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:07.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 zone default found 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 4 Realm: () 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 zonegroup default 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0384310 con 0x7f40e40e0bb0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0389e70 con 0x564da0384bc0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da038a210 con 0x564da0384bc0 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 started sync module instance, tier type = 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.797+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0389300 con 0x564da037fb80 2024-09-13T06:31:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94891400534064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0389300 con 0x564da037fb80 2024-09-13T06:31:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038abd0 con 0x564da037b700 2024-09-13T06:31:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94891400537888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038b470 con 0x564da037b700 2024-09-13T06:31:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038be70 con 0x564da037fb80 2024-09-13T06:31:07.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94891400534064] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.801+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94891400537888] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94891400531536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038afc0 con 0x564da037fb80 2024-09-13T06:31:07.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038c710 con 0x7f40e40e0bb0 2024-09-13T06:31:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94891400544864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038afc0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038d1e0 con 0x564da037fb80 2024-09-13T06:31:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94891400544864] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.805+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94891400531536] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94891400542592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038d1a0 con 0x564da037fb80 2024-09-13T06:31:07.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038d5d0 con 0x564da0384bc0 2024-09-13T06:31:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94891400545920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038de70 con 0x564da0384bc0 2024-09-13T06:31:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038e8b0 con 0x564da0384bc0 2024-09-13T06:31:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94891400542592] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94891400545920] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94891400553344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038eca0 con 0x564da0384bc0 2024-09-13T06:31:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.809+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038f4f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94891400553344] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94891400547536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038f360 con 0x7f40e40e0bb0 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=0 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=1 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=2 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=3 2024-09-13T06:31:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=4 2024-09-13T06:31:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=5 2024-09-13T06:31:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=6 2024-09-13T06:31:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94891400547536] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 20 add_watcher() i=7 2024-09-13T06:31:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0392940 con 0x564da037b700 2024-09-13T06:31:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.813+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94891400556576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da038fe60 con 0x564da037b700 2024-09-13T06:31:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94891400556576] v35'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f3fa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f40ec80c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f40ec80c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0392630 con 0x564da037fb80 2024-09-13T06:31:07.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.817+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03926b0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.821+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.821+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039b9b0 con 0x564da0384bc0 2024-09-13T06:31:07.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.821+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.821+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039b990 con 0x564da037b700 2024-09-13T06:31:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.825+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.825+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039b990 con 0x564da037fb80 2024-09-13T06:31:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.825+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.825+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039b990 con 0x564da0384bc0 2024-09-13T06:31:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.829+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.829+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039c960 con 0x564da037fb80 2024-09-13T06:31:07.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.829+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.829+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039c960 con 0x564da037b700 2024-09-13T06:31:07.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.833+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.833+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039ced0 con 0x564da037fb80 2024-09-13T06:31:07.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.833+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.833+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039ced0 con 0x564da037fb80 2024-09-13T06:31:07.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.837+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.837+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039ced0 con 0x564da037fb80 2024-09-13T06:31:07.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.837+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.837+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039ced0 con 0x564da0384bc0 2024-09-13T06:31:07.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.837+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.837+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039ced0 con 0x564da037fb80 2024-09-13T06:31:07.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.841+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.841+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039ced0 con 0x564da037b700 2024-09-13T06:31:07.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.841+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.841+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d460 con 0x564da037b700 2024-09-13T06:31:07.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.845+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.845+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.849+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.849+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.849+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.849+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da0384bc0 2024-09-13T06:31:07.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.853+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.853+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.853+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.853+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037b700 2024-09-13T06:31:07.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.857+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.857+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.857+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.857+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.861+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.861+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da0384bc0 2024-09-13T06:31:07.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.861+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.861+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.865+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.865+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da0384bc0 2024-09-13T06:31:07.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.865+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.865+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da0384bc0 2024-09-13T06:31:07.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.869+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.869+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da0384bc0 2024-09-13T06:31:07.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.869+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'32 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.869+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.873+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.873+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037b700 2024-09-13T06:31:07.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.873+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'51 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.873+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037fb80 2024-09-13T06:31:07.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.873+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.873+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x564da037b700 2024-09-13T06:31:07.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da039d380 con 0x7f40e40e0bb0 2024-09-13T06:31:07.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f3f1b7fe640 20 reqs_thread_entry: start 2024-09-13T06:31:07.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40ec80c980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:07.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40ec80c980 20 Filter name: none 2024-09-13T06:31:07.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f3f197fa640 20 reqs_thread_entry: start 2024-09-13T06:31:07.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40ec80c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:31:07.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da039b4f0 con 0x564da037b700 2024-09-13T06:31:07.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.877+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da039afd0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 : miss 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 8.14 8:2e8c76a3:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03bb1e0 con 0x564da037fb80 2024-09-13T06:31:07.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(96 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:31:07.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 info.flags=0x17 2024-09-13T06:31:07.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 to cache LRU end 2024-09-13T06:31:07.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:07.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:31:07.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 2024-09-13T06:31:07.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 4.1f 4:f8b52497:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da04382e0 con 0x564da037fb80 2024-09-13T06:31:07.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(97 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:98 4.39 4:9cf296de:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0438360 con 0x564da0384bc0 2024-09-13T06:31:07.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(98 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.881+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:99 4.3c 4:3cad0feb:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0438360 con 0x564da037b700 2024-09-13T06:31:07.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(99 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 4.39 4:9e774712:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0438360 con 0x564da0384bc0 2024-09-13T06:31:07.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(100 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:101 4.b 4:d023b74e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0438360 con 0x7f40e40e0bb0 2024-09-13T06:31:07.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(101 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 [call out=426b] v0'0 uv6 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T06:31:07.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:102 4.28 4:1776ecde:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0438360 con 0x564da037fb80 2024-09-13T06:31:07.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(102 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:103 4.34 4:2d4e00aa:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da0438360 con 0x7f40e40e0bb0 2024-09-13T06:31:07.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(103 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:104 4.c 4:33e0591c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da04389c0 con 0x564da037b700 2024-09-13T06:31:07.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(104 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:105 4.b 4:d0f2c1ad:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da04389c0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(105 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.885+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 4.a 4:50c98b0f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da04389c0 con 0x564da037fb80 2024-09-13T06:31:07.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(106 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e40f7040 con 0x564da037fb80 2024-09-13T06:31:07.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:107 4.0 4:01712c99:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da04389c0 con 0x564da0384bc0 2024-09-13T06:31:07.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(107 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 20 get_obj_state: octx=0x7f40e40e59e0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564da0436558 s->prefetch_data=0 2024-09-13T06:31:07.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:108 3.2 3:42aaa152:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da04374d0 con 0x564da0384bc0 2024-09-13T06:31:07.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(108 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 10 manifest: total_size = 6 2024-09-13T06:31:07.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 20 get_obj_state: setting s->obj_tag to 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.17633251677639535465 2024-09-13T06:31:07.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 20 get_obj_state: octx=0x7f40e40e59e0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564da0436558 s->prefetch_data=0 2024-09-13T06:31:07.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 20 prepare_atomic_modification: state is not atomic. state=0x564da0436558 2024-09-13T06:31:07.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 20 bucket index object: :.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 2024-09-13T06:31:07.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:109 4.b 4:d023b74e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf220 con 0x7f40e40e0bb0 2024-09-13T06:31:07.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(109 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.889+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 3.2 3:42aaa152:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03bd200 con 0x564da0384bc0 2024-09-13T06:31:07.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(110 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7_15f6f8dc036519d7fe15b39338f6e5db [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:111 4.b 4:d023b74e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf800 con 0x7f40e40e0bb0 2024-09-13T06:31:07.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:31:07.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:31:07.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 4.1f 4:f8b52497:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf800 con 0x564da037fb80 2024-09-13T06:31:07.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:113 4.39 4:9cf296de:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03c3b00 con 0x564da0384bc0 2024-09-13T06:31:07.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:114 4.3c 4:3cad0feb:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03c6410 con 0x564da037b700 2024-09-13T06:31:07.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:115 4.39 4:9e774712:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf800 con 0x564da0384bc0 2024-09-13T06:31:07.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:116 4.b 4:d023b74e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cb150 con 0x7f40e40e0bb0 2024-09-13T06:31:07.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:117 4.28 4:1776ecde:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03c6410 con 0x564da037fb80 2024-09-13T06:31:07.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:118 4.34 4:2d4e00aa:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03c6410 con 0x7f40e40e0bb0 2024-09-13T06:31:07.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:119 4.c 4:33e0591c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d2a20 con 0x564da037b700 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:120 4.b 4:d0f2c1ad:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d5430 con 0x7f40e40e0bb0 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:121 4.a 4:50c98b0f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d7e00 con 0x564da037fb80 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:122 4.0 4:01712c99:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03da810 con 0x564da0384bc0 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(114 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(113 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(115 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(119 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(112 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(118 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(122 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(120 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(117 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(121 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(111 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 [stat,call,call] v35'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.893+0000 7f3fcdffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== osd_op_reply(116 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7])"; uploads.size()=0; is_truncated=0 2024-09-13T06:31:07.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:123 4.1f 4:f8b52497:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf600 con 0x564da037fb80 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:124 4.39 4:9cf296de:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d6860 con 0x564da0384bc0 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:125 4.3c 4:3cad0feb:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cefb0 con 0x564da037b700 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:126 4.39 4:9e774712:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x564da0384bc0 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:127 4.b 4:d023b74e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf820 con 0x7f40e40e0bb0 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:128 4.28 4:1776ecde:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cfc40 con 0x564da037fb80 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:129 4.34 4:2d4e00aa:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d6860 con 0x7f40e40e0bb0 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:130 4.c 4:33e0591c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03da6d0 con 0x564da037b700 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:131 4.b 4:d0f2c1ad:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:132 4.a 4:50c98b0f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03be210 con 0x564da037fb80 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:133 4.0 4:01712c99:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cfc40 con 0x564da0384bc0 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(125 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(130 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== osd_op_reply(129 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 24 ==== osd_op_reply(127 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(123 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(124 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(133 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(128 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(126 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(132 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 25 ==== osd_op_reply(131 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 26 ==== osd_op_reply(134 foo.buckets [call] v35'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:31:07.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 27 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:31:07.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:31:07.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:31:07.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.897+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 28 ==== osd_op_reply(136 myfoo [call,call,delete] v35'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40ec80c980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40ec80c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94891401246928 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x564da0384bc0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== watch-notify(notify (1) cookie 94891400553344 notify 150323855399 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564da039c680 con 0x564da0384bc0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855399 cookie 94891400553344 notifier 4778 bl.length()=149 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(137 notify.6 [notify cookie 94891401246928 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f3fcd7fa640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3f20003330 con 0x564da0384bc0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== watch-notify(notify_complete (2) cookie 94891401246928 notify 150323855399 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564da0391d60 con 0x564da0384bc0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.901+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:139 8.14 8:2e8c76a3:root::.bucket.meta.myfoo%3a8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x564da037fb80 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(139 .bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 [call,call,delete] v35'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 from cache 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7, ofs0, ns] 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94891401246928 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03cf3a0 con 0x564da0384bc0 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== watch-notify(notify (1) cookie 94891400545920 notify 150323855400 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564da0391d60 con 0x564da0384bc0 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(140 notify.5 [notify cookie 94891401246928 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855400 cookie 94891400545920 notifier 4778 bl.length()=206 2024-09-13T06:31:07.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f3fcd7fa640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3f20003330 con 0x564da0384bc0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== watch-notify(notify_complete (2) cookie 94891401246928 notify 150323855400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564da0392880 con 0x564da0384bc0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:142 4.1f 4:f8b52497:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03ba6c0 con 0x564da037fb80 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:143 4.39 4:9cf296de:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03d22c0 con 0x564da0384bc0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:144 4.3c 4:3cad0feb:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03d16b0 con 0x564da037b700 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:145 4.39 4:9e774712:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03b92f0 con 0x564da0384bc0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:146 4.b 4:d023b74e:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03b9690 con 0x7f40e40e0bb0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:147 4.28 4:1776ecde:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03b9a70 con 0x564da037fb80 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:148 4.34 4:2d4e00aa:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03d16b0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:149 4.c 4:33e0591c:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03b92f0 con 0x564da037b700 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:150 4.b 4:d0f2c1ad:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03b9690 con 0x7f40e40e0bb0 2024-09-13T06:31:07.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:151 4.a 4:50c98b0f:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03d16b0 con 0x564da037fb80 2024-09-13T06:31:07.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.905+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:152 4.0 4:01712c99:::.dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03b9a70 con 0x564da0384bc0 2024-09-13T06:31:07.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 29 ==== osd_op_reply(146 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.4 [delete] v35'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 30 ==== osd_op_reply(150 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.8 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(147 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.5 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(151 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.9 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(144 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.2 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(142 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.0 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(152 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.10 [delete] v35'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 31 ==== osd_op_reply(148 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.6 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 43 ==== osd_op_reply(143 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.1 [delete] v35'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(149 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.7 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 44 ==== osd_op_reply(145 .dir.8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7.3 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ec80c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 : miss 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ec80c980 20 rados->read ofs=0 len=0 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:153 6.14 6:2a2da7ff:::pubsub..bucket.myfoo%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03b9690 con 0x7f40e40e0bb0 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 32 ==== osd_op_reply(153 pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ec80c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ec80c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 info.flags=0x0 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.909+0000 7f40ec80c980 10 adding default.rgw.log++pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 to cache LRU end 2024-09-13T06:31:07.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.913+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:154 6.14 6:2a2da7ff:::pubsub..bucket.myfoo%2f8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf600 con 0x7f40e40e0bb0 2024-09-13T06:31:07.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.913+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 33 ==== osd_op_reply(154 pubsub..bucket.myfoo/8744f35f-8918-4410-a77e-3a3ac7b40446.4225.7 [delete] v35'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.913+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03ba6c0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.913+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 34 ==== osd_op_reply(155 foo.buckets [call] v35'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.913+0000 7f40ec80c980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T06:31:07.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.913+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf600 con 0x564da037b700 2024-09-13T06:31:07.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40ec80c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T06:31:07.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94891400734400 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d22c0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 35 ==== watch-notify(notify (1) cookie 94891400544864 notify 150323855377 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564da039c4b0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f3fcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94891400544864 notifier 4778 bl.length()=170 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 36 ==== osd_op_reply(157 notify.3 [notify cookie 94891400734400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f3fcdffb640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3fb0003d70 con 0x7f40e40e0bb0 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 37 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 38 ==== watch-notify(notify_complete (2) cookie 94891400734400 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564da039cd00 con 0x7f40e40e0bb0 2024-09-13T06:31:07.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40ec80c980 10 removing email index: foo@foo.com 2024-09-13T06:31:07.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.917+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03ba6c0 con 0x564da037b700 2024-09-13T06:31:07.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(159 foo@foo.com [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94891400754688 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d22c0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 39 ==== watch-notify(notify (1) cookie 94891400544864 notify 150323855378 ret 0) ==== 204+0+0 (crc 0 0 0) 0x564da039cd00 con 0x7f40e40e0bb0 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 40 ==== osd_op_reply(160 notify.3 [notify cookie 94891400754688 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94891400544864 notifier 4778 bl.length()=162 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f3fcd7fa640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3f20003330 con 0x7f40e40e0bb0 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 41 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 42 ==== watch-notify(notify_complete (2) cookie 94891400754688 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564da039be10 con 0x7f40e40e0bb0 2024-09-13T06:31:07.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 10 removing user buckets index 2024-09-13T06:31:07.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03ba670 con 0x7f40e40e0bb0 2024-09-13T06:31:07.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 43 ==== osd_op_reply(162 foo.buckets [delete] v35'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94891400754688 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03d22c0 con 0x564da0384bc0 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 45 ==== watch-notify(notify (1) cookie 94891400545920 notify 150323855401 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564da0392880 con 0x564da0384bc0 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855401 cookie 94891400545920 notifier 4778 bl.length()=160 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 46 ==== osd_op_reply(163 notify.5 [notify cookie 94891400754688 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f3fcd7fa640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3f200032d0 con 0x564da0384bc0 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 47 ==== watch-notify(notify_complete (2) cookie 94891400754688 notify 150323855401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564da03926b0 con 0x564da0384bc0 2024-09-13T06:31:07.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 48 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 10 removing user index: foo 2024-09-13T06:31:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.921+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da03ba640 con 0x564da037b700 2024-09-13T06:31:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(165 foo [call,call,delete] v35'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ec80c980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T06:31:07.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ec80c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:31:07.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94891400734272 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564da03bf600 con 0x564da037fb80 2024-09-13T06:31:07.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== watch-notify(notify (1) cookie 94891400542592 notify 150323855402 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564da03ba300 con 0x564da037fb80 2024-09-13T06:31:07.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855402 cookie 94891400542592 notifier 4778 bl.length()=152 2024-09-13T06:31:07.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f3fcd7fa640 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3f200032d0 con 0x564da037fb80 2024-09-13T06:31:07.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(166 notify.4 [notify cookie 94891400734272 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== watch-notify(notify_complete (2) cookie 94891400734272 notify 150323855402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564da035b3a0 con 0x564da037fb80 2024-09-13T06:31:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.925+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.929+0000 7f3fa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:07.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.929+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94891400556576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da037b700 2024-09-13T06:31:07.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.929+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94891400556576] v35'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.929+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94891400534064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da037fb80 2024-09-13T06:31:07.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94891400534064] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40ec80c980 20 remove_watcher() i=0 2024-09-13T06:31:07.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40ec80c980 2 removed watcher, disabling cache 2024-09-13T06:31:07.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94891400537888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da037b700 2024-09-13T06:31:07.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94891400537888] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x564da037b700 2024-09-13T06:31:07.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40ec80c980 20 remove_watcher() i=1 2024-09-13T06:31:07.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.933+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94891400531536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da037fb80 2024-09-13T06:31:07.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.937+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94891400531536] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.937+0000 7f40ec80c980 20 remove_watcher() i=2 2024-09-13T06:31:07.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.937+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94891400544864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x7f40e40e0bb0 2024-09-13T06:31:07.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.937+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 44 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94891400544864] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.937+0000 7f40ec80c980 20 remove_watcher() i=3 2024-09-13T06:31:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.937+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94891400542592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da037fb80 2024-09-13T06:31:07.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.941+0000 7f40ea31c640 1 -- 172.21.15.169:0/2472439316 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94891400542592] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4137040 con 0x564da037fb80 2024-09-13T06:31:07.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.941+0000 7f40ec80c980 20 remove_watcher() i=4 2024-09-13T06:31:07.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.941+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94891400545920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da0384bc0 2024-09-13T06:31:07.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.941+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 49 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94891400545920] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.941+0000 7f40ec80c980 20 remove_watcher() i=5 2024-09-13T06:31:07.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.941+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94891400553344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x564da0384bc0 2024-09-13T06:31:07.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40e9b1b640 1 -- 172.21.15.169:0/2472439316 <== osd.3 v2:172.21.15.169:6800/747740583 50 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94891400553344] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e0037040 con 0x564da0384bc0 2024-09-13T06:31:07.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 20 remove_watcher() i=6 2024-09-13T06:31:07.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94891400547536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564da0437150 con 0x7f40e40e0bb0 2024-09-13T06:31:07.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 <== osd.2 v2:172.21.15.169:6816/1749135367 45 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94891400547536] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40e40e0bb0 2024-09-13T06:31:07.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 20 remove_watcher() i=7 2024-09-13T06:31:07.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da037fb80 msgr2=0x564da0381f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da037fb80 0x564da0381f70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da037b700 msgr2=0x564da037dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da037b700 0x564da037dbc0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f40e40e0bb0 msgr2=0x7f40e40d33e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f40e40e0bb0 0x7f40e40d33e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da0384bc0 msgr2=0x564da0386fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da0384bc0 0x564da0386fb0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fb4034650 msgr2=0x7f3fb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fb4034650 0x7f3fb4036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f40e000ffd0 tx=0x7f40e0010000 comp rx=0 tx=0).stop 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40eab1d640 1 -- 172.21.15.169:0/2472439316 reap_dead start 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 msgr2=0x564da0370740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da0370740 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f40e40d0fd0 tx=0x7f40e40e3f60 comp rx=0 tx=0).stop 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 shutdown_connections 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2472439316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da01bfbe0 0x564da0370740 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 >> 172.21.15.169:0/2472439316 conn(0x564da0363770 msgr2=0x564da0361840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 shutdown_connections 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2472439316 wait complete. 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fc4034650 msgr2=0x7f3fc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fc4034650 0x7f3fc4036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x564da0341240 tx=0x7f40e000f000 comp rx=0 tx=0).stop 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 msgr2=0x564da035ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.945+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 0x564da035ae60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f40e40e5560 tx=0x7f40e40d0bc0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 shutdown_connections 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fc4034650 0x7f3fc4036b10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2183744216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da035aa40 0x564da035ae60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 >> 172.21.15.169:0/2183744216 conn(0x564da034fb40 msgr2=0x564da0352610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 shutdown_connections 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2183744216 wait complete. 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da0345090 msgr2=0x564da0347480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x564da0345090 0x564da0347480 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da024aff0 msgr2=0x564da0343be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x564da024aff0 0x564da0343be0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da034a710 msgr2=0x564da034cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x564da034a710 0x564da034cb00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fd0034650 msgr2=0x7f3fd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3fd0034650 0x7f3fd0036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000f70 tx=0x7f40e0001380 comp rx=0 tx=0).stop 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 msgr2=0x564da033cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 --2- 172.21.15.169:0/2216206071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564da024a6a0 0x564da033cc50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f40e4005cc0 tx=0x7f40e4017e30 comp rx=0 tx=0).stop 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40eab1d640 1 -- 172.21.15.169:0/2216206071 reap_dead start 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 shutdown_connections 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 >> 172.21.15.169:0/2216206071 conn(0x564da02461c0 msgr2=0x564da0330200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 shutdown_connections 2024-09-13T06:31:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:07.949+0000 7f40ec80c980 1 -- 172.21.15.169:0/2216206071 wait complete. 2024-09-13T06:31:07.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:31:07.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:31:07.964 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:31:08.043 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.043 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2c991980 1 Processor -- start 2024-09-13T06:31:08.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2c991980 1 -- start start 2024-09-13T06:31:08.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2c991980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5629e03608e0 0x5629e0360cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2c991980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5629e01e6ae0 con 0x5629e0361230 2024-09-13T06:31:08.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2c991980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5629e020ae30 con 0x5629e03608e0 2024-09-13T06:31:08.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2a4a1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5629e03608e0 0x5629e0360cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d29ca0640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5629e0361230 0x5629e0365c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:39160/0 (socket says 172.21.15.169:39160) 2024-09-13T06:31:08.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d29ca0640 1 -- 172.21.15.169:0/1499023003 learned_addr learned my addr 172.21.15.169:0/1499023003 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:08.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/1499023003 >> v1:172.21.15.112:6789/0 conn(0x5629e0361230 legacy=0x5629e0365c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.041+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/1499023003 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e03684b0 con 0x5629e03608e0 2024-09-13T06:31:08.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/1499023003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0360cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a480 tx=0x7f7d1401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d675fed06311e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2949f640 1 -- 172.21.15.169:0/1499023003 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140b0070 con 0x5629e03608e0 2024-09-13T06:31:08.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2949f640 1 -- 172.21.15.169:0/1499023003 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140ab540 con 0x5629e03608e0 2024-09-13T06:31:08.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2949f640 1 -- 172.21.15.169:0/1499023003 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140ab840 con 0x5629e03608e0 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 -- 172.21.15.169:0/1499023003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 msgr2=0x5629e0360cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 --2- 172.21.15.169:0/1499023003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0360cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a480 tx=0x7f7d1401b280 comp rx=0 tx=0).stop 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 -- 172.21.15.169:0/1499023003 shutdown_connections 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 --2- 172.21.15.169:0/1499023003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0360cc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 -- 172.21.15.169:0/1499023003 >> 172.21.15.169:0/1499023003 conn(0x5629e02d4230 msgr2=0x5629e02d4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 -- 172.21.15.169:0/1499023003 shutdown_connections 2024-09-13T06:31:08.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.045+0000 7f7d2c991980 1 -- 172.21.15.169:0/1499023003 wait complete. 2024-09-13T06:31:08.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2c991980 1 Processor -- start 2024-09-13T06:31:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2c991980 1 -- start start 2024-09-13T06:31:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2c991980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e044bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2c991980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629e020c200 con 0x5629e03608e0 2024-09-13T06:31:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e044bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e044bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45840/0 (socket says 172.21.15.169:45840) 2024-09-13T06:31:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/3395400891 learned_addr learned my addr 172.21.15.169:0/3395400891 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/3395400891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e044c1a0 con 0x5629e03608e0 2024-09-13T06:31:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.061+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/3395400891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e044bbd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7d140ae040 tx=0x7f7d14003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdceaab09f18ba0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7c18608640 1 -- 172.21.15.169:0/3395400891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140b0040 con 0x5629e03608e0 2024-09-13T06:31:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7c18608640 1 -- 172.21.15.169:0/3395400891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140ab9b0 con 0x5629e03608e0 2024-09-13T06:31:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7c18608640 1 -- 172.21.15.169:0/3395400891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140abc90 con 0x5629e03608e0 2024-09-13T06:31:08.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/3395400891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 msgr2=0x5629e044bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 --2- 172.21.15.169:0/3395400891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e044bbd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7d140ae040 tx=0x7f7d14003030 comp rx=0 tx=0).stop 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/3395400891 shutdown_connections 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 --2- 172.21.15.169:0/3395400891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e044bbd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/3395400891 >> 172.21.15.169:0/3395400891 conn(0x5629e02d4230 msgr2=0x5629e0447800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/3395400891 shutdown_connections 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/3395400891 wait complete. 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 Processor -- start 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- start start 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0452e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629e0367ef0 con 0x5629e03608e0 2024-09-13T06:31:08.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0452e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0452e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45846/0 (socket says 172.21.15.169:45846) 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/2058453132 learned_addr learned my addr 172.21.15.169:0/2058453132 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e0453340 con 0x5629e03608e0 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0452e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7d140030b0 tx=0x7f7d14018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7c16e05640 1 -- 172.21.15.169:0/2058453132 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140c5070 con 0x5629e03608e0 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629e04535d0 con 0x5629e03608e0 2024-09-13T06:31:08.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7c16e05640 1 -- 172.21.15.169:0/2058453132 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140b6970 con 0x5629e03608e0 2024-09-13T06:31:08.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7c16e05640 1 -- 172.21.15.169:0/2058453132 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140b0050 con 0x5629e03608e0 2024-09-13T06:31:08.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.065+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e04562b0 con 0x5629e03608e0 2024-09-13T06:31:08.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7c16e05640 1 -- 172.21.15.169:0/2058453132 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d140c8070 con 0x5629e03608e0 2024-09-13T06:31:08.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7c16e05640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c100346a0 0x7f7c10036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7c16e05640 1 -- 172.21.15.169:0/2058453132 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f7d140bc070 con 0x5629e03608e0 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e0361230 0x5629e0459db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c100346a0 0x7f7c10036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e045a420 con 0x5629e0361230 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2aca2640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e0361230 0x5629e0459db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c100346a0 0x7f7c10036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0012f0 tx=0x7f7d1c006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2aca2640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e0361230 0x5629e0459db0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2aca2640 1 -- 172.21.15.169:0/2058453132 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e0361230 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e045b210 0x5629e045d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e045dc30 con 0x5629e045b210 2024-09-13T06:31:08.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e045b210 0x5629e045d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e045b210 0x5629e045d600 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/2058453132 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e045b210 2024-09-13T06:31:08.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.069+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e045f4e0 con 0x5629e045b210 2024-09-13T06:31:08.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/2058453132 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e045b210 2024-09-13T06:31:08.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e045e710 con 0x5629e045b210 2024-09-13T06:31:08.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/2058453132 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e045b210 2024-09-13T06:31:08.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0460890 0x5629e0462c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e04631c0 con 0x5629e0460890 2024-09-13T06:31:08.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0460890 0x5629e0462c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0460890 0x5629e0462c80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d29ca0640 1 -- 172.21.15.169:0/2058453132 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0460890 2024-09-13T06:31:08.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 Processor -- start 2024-09-13T06:31:08.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 -- start start 2024-09-13T06:31:08.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 0x5629e0470f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2c991980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629e0265800 con 0x5629e0470b70 2024-09-13T06:31:08.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 0x5629e0470f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 0x5629e0470f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45618/0 (socket says 172.21.15.169:45618) 2024-09-13T06:31:08.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.073+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/1490687445 learned_addr learned my addr 172.21.15.169:0/1490687445 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/1490687445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e04714d0 con 0x5629e0470b70 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 0x5629e0470f90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7d140e1f80 tx=0x7f7d140b4ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7c0ffff640 1 -- 172.21.15.169:0/1490687445 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140e7070 con 0x5629e0470b70 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629e0471760 con 0x5629e0470b70 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7c0ffff640 1 -- 172.21.15.169:0/1490687445 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140d9b20 con 0x5629e0470b70 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7c0ffff640 1 -- 172.21.15.169:0/1490687445 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140d9e00 con 0x5629e0470b70 2024-09-13T06:31:08.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e04743e0 con 0x5629e0470b70 2024-09-13T06:31:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7c0ffff640 1 -- 172.21.15.169:0/1490687445 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d140aa3b0 con 0x5629e0470b70 2024-09-13T06:31:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7c0ffff640 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c04034650 0x7f7c04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7c0ffff640 1 -- 172.21.15.169:0/1490687445 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f7d140d5040 con 0x5629e0470b70 2024-09-13T06:31:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c04034650 0x7f7c04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2c991980 1 Processor -- start 2024-09-13T06:31:08.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2c991980 1 -- start start 2024-09-13T06:31:08.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c04034650 0x7f7c04036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0062e0 tx=0x7f7d1c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2c991980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e047d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2c991980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629e044c460 con 0x5629e047d530 2024-09-13T06:31:08.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e047d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e047d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45622/0 (socket says 172.21.15.169:45622) 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/3420600782 learned_addr learned my addr 172.21.15.169:0/3420600782 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.077+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/3420600782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e047dee0 con 0x5629e047d530 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/3420600782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e047d910 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7d140ecb30 tx=0x7f7d140acfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e3e3ca0970ecdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7c0dffb640 1 -- 172.21.15.169:0/3420600782 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140ec590 con 0x5629e047d530 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7c0dffb640 1 -- 172.21.15.169:0/3420600782 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140d20f0 con 0x5629e047d530 2024-09-13T06:31:08.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7c0dffb640 1 -- 172.21.15.169:0/3420600782 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140d23d0 con 0x5629e047d530 2024-09-13T06:31:08.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/3420600782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 msgr2=0x5629e047d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 --2- 172.21.15.169:0/3420600782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e047d910 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7d140ecb30 tx=0x7f7d140acfb0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/3420600782 shutdown_connections 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 --2- 172.21.15.169:0/3420600782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e047d910 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/3420600782 >> 172.21.15.169:0/3420600782 conn(0x5629e0479910 msgr2=0x5629e0477a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/3420600782 shutdown_connections 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/3420600782 wait complete. 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 Processor -- start 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- start start 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e0484770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629e047e380 con 0x5629e047d530 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e0484770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2a4a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e0484770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45628/0 (socket says 172.21.15.169:45628) 2024-09-13T06:31:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 learned_addr learned my addr 172.21.15.169:0/4211798101 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e0484cb0 con 0x5629e047d530 2024-09-13T06:31:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e0484770 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7d140b54d0 tx=0x7f7d140f3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7bfbfff640 1 -- 172.21.15.169:0/4211798101 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d14108040 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629e0484cb0 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7bfbfff640 1 -- 172.21.15.169:0/4211798101 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d140e6170 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7bfbfff640 1 -- 172.21.15.169:0/4211798101 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d140e6470 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.081+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e0484cb0 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7bfbfff640 1 -- 172.21.15.169:0/4211798101 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d14115020 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7bfbfff640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7bf4034650 0x7f7bf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7bfbfff640 1 -- 172.21.15.169:0/4211798101 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f7d14113020 con 0x5629e047d530 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7bf4034650 0x7f7bf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e048f890 0x5629e0491d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0492480 con 0x5629e048f890 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2aca2640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e048f890 0x5629e0491d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7bf4034650 0x7f7bf4036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5629e045f450 tx=0x7f7d1c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2aca2640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e048f890 0x5629e0491d30 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 realm 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e048ed80 con 0x5629e048f890 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0492f40 con 0x5629e048f890 2024-09-13T06:31:08.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e0493d20 0x5629e0496110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e0493d20 0x5629e0496110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e0493d20 0x5629e0496110 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:08.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.085+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0497010 con 0x5629e0493d20 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2c991980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2c991980 20 searching for the correct realm 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0498840 0x5629e049ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e049b3d0 con 0x5629e0498840 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0498840 0x5629e049ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d29ca0640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0498840 0x5629e049ad00 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e049b3d0 con 0x5629e0493d20 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2a4a1640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7d140ca060 0x7f7d140c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x7f7d140ca060 2024-09-13T06:31:08.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7d140ca060 0x7f7d140c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7d140ca060 0x7f7d140c9830 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.089+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0498840 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x7f7d140ca060 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x7f7d140ca060 2024-09-13T06:31:08.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.093+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0498840 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0498840 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0498840 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x7f7d140ca060 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e048f890 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x7f7d140ca060 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.097+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0498840 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x7f7d140ca060 2024-09-13T06:31:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0498840 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629e0496770 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0497140 con 0x5629e048f890 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.101+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0497530 con 0x5629e0493d20 2024-09-13T06:31:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e0497530 con 0x5629e0498840 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 zone default found 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 4 Realm: () 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 zonegroup default 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e049b850 con 0x7f7d140ca060 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e049d5d0 con 0x5629e0498840 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e049d970 con 0x5629e0498840 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 started sync module instance, tier type = 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.105+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049ca70 con 0x5629e0493d20 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94737856581488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049ca70 con 0x5629e0493d20 2024-09-13T06:31:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049e410 con 0x5629e048f890 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94737856585504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049ecb0 con 0x5629e048f890 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049f6f0 con 0x5629e0493d20 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94737856581488] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94737856585504] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94737856590272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049e800 con 0x5629e0493d20 2024-09-13T06:31:08.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.109+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049ff90 con 0x7f7d140ca060 2024-09-13T06:31:08.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94737856592608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e049e800 con 0x7f7d140ca060 2024-09-13T06:31:08.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a0a50 con 0x5629e0493d20 2024-09-13T06:31:08.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94737856590272] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94737856592608] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94737856593664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a0a10 con 0x5629e0493d20 2024-09-13T06:31:08.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.113+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a0e40 con 0x5629e0498840 2024-09-13T06:31:08.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94737856579008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a16e0 con 0x5629e0498840 2024-09-13T06:31:08.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a20a0 con 0x5629e0498840 2024-09-13T06:31:08.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94737856593664] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94737856579008] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94737856601072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a2490 con 0x5629e0498840 2024-09-13T06:31:08.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a2ce0 con 0x7f7d140ca060 2024-09-13T06:31:08.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94737856601072] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94737856603280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a2d60 con 0x7f7d140ca060 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=0 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=1 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=2 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=3 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=4 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=5 2024-09-13T06:31:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.117+0000 7f7d2c991980 20 add_watcher() i=6 2024-09-13T06:31:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94737856603280] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 20 add_watcher() i=7 2024-09-13T06:31:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a60d0 con 0x5629e048f890 2024-09-13T06:31:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94737856617152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04a2ed0 con 0x5629e048f890 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94737856617152] v35'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7be0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 5 note: GC not initialized 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7b5b7fe640 20 reqs_thread_entry: start 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.121+0000 7f7d2c991980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2c991980 20 Filter name: none 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7b597fa640 20 reqs_thread_entry: start 2024-09-13T06:31:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2c991980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c93c0 con 0x5629e048f890 2024-09-13T06:31:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2c991980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:could not fetch user info: no user info saved 2024-09-13T06:31:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7be0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94737856617152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e048f890 2024-09-13T06:31:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94737856617152] v35'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.125+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94737856581488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e0493d20 2024-09-13T06:31:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94737856581488] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2c991980 20 remove_watcher() i=0 2024-09-13T06:31:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2c991980 2 removed watcher, disabling cache 2024-09-13T06:31:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94737856585504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e048f890 2024-09-13T06:31:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94737856585504] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x5629e048f890 2024-09-13T06:31:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2c991980 20 remove_watcher() i=1 2024-09-13T06:31:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.129+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94737856590272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e0493d20 2024-09-13T06:31:08.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.133+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94737856590272] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.133+0000 7f7d2c991980 20 remove_watcher() i=2 2024-09-13T06:31:08.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.133+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94737856592608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x7f7d140ca060 2024-09-13T06:31:08.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.133+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94737856592608] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.133+0000 7f7d2c991980 20 remove_watcher() i=3 2024-09-13T06:31:08.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.133+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94737856593664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e0493d20 2024-09-13T06:31:08.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.137+0000 7f7d2a4a1640 1 -- 172.21.15.169:0/4211798101 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94737856593664] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d140c7030 con 0x5629e0493d20 2024-09-13T06:31:08.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.137+0000 7f7d2c991980 20 remove_watcher() i=4 2024-09-13T06:31:08.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.137+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94737856579008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e0498840 2024-09-13T06:31:08.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.137+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94737856579008] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.137+0000 7f7d2c991980 20 remove_watcher() i=5 2024-09-13T06:31:08.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.137+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94737856601072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x5629e0498840 2024-09-13T06:31:08.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d29ca0640 1 -- 172.21.15.169:0/4211798101 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94737856601072] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c00f070 con 0x5629e0498840 2024-09-13T06:31:08.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 20 remove_watcher() i=6 2024-09-13T06:31:08.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94737856603280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629e04c9380 con 0x7f7d140ca060 2024-09-13T06:31:08.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94737856603280] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d240083f0 con 0x7f7d140ca060 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 20 remove_watcher() i=7 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e0493d20 msgr2=0x5629e0496110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e0493d20 0x5629e0496110 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e048f890 msgr2=0x5629e0491d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e048f890 0x5629e0491d30 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7d140ca060 msgr2=0x7f7d140c9830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f7d140ca060 0x7f7d140c9830 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0498840 msgr2=0x5629e049ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0498840 0x5629e049ad00 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7bf4034650 msgr2=0x7f7bf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7bf4034650 0x7f7bf4036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5629e045f450 tx=0x7f7d1c010000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 msgr2=0x5629e0484770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e0484770 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7d140b54d0 tx=0x7f7d140f3f90 comp rx=0 tx=0).stop 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2aca2640 1 -- 172.21.15.169:0/4211798101 reap_dead start 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 shutdown_connections 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/4211798101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e047d530 0x5629e0484770 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 >> 172.21.15.169:0/4211798101 conn(0x5629e0479910 msgr2=0x5629e04779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 shutdown_connections 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/4211798101 wait complete. 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c04034650 msgr2=0x7f7c04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c04034650 0x7f7c04036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0062e0 tx=0x7f7d1c00f000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 msgr2=0x5629e0470f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 0x5629e0470f90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7d140e1f80 tx=0x7f7d140b4ac0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 shutdown_connections 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c04034650 0x7f7c04036b10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/1490687445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e0470b70 0x5629e0470f90 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 >> 172.21.15.169:0/1490687445 conn(0x5629e0465cc0 msgr2=0x5629e0468740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 shutdown_connections 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/1490687445 wait complete. 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e045b210 msgr2=0x5629e045d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5629e045b210 0x5629e045d600 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e0361230 msgr2=0x5629e0459db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5629e0361230 0x5629e0459db0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0460890 msgr2=0x5629e0462c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5629e0460890 0x5629e0462c80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c100346a0 msgr2=0x7f7c10036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f7c100346a0 0x7f7c10036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0012f0 tx=0x7f7d1c006700 comp rx=0 tx=0).stop 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 msgr2=0x5629e0452e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 --2- 172.21.15.169:0/2058453132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629e03608e0 0x5629e0452e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7d140030b0 tx=0x7f7d14018020 comp rx=0 tx=0).stop 2024-09-13T06:31:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2aca2640 1 -- 172.21.15.169:0/2058453132 reap_dead start 2024-09-13T06:31:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 shutdown_connections 2024-09-13T06:31:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 >> 172.21.15.169:0/2058453132 conn(0x5629e02d4230 msgr2=0x5629e0446380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 shutdown_connections 2024-09-13T06:31:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.141+0000 7f7d2c991980 1 -- 172.21.15.169:0/2058453132 wait complete. 2024-09-13T06:31:08.157 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:31:08.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T06:31:08.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T06:31:08.158 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T06:31:08.229 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.229 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfcc586980 1 Processor -- start 2024-09-13T06:31:08.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfcc586980 1 -- start start 2024-09-13T06:31:08.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfcc586980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5582d8a0dc50 0x5582d8a9c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfcc586980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582d8921ae0 con 0x5582d8a9c880 2024-09-13T06:31:08.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfcc586980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5582d8945e30 con 0x5582d8a0dc50 2024-09-13T06:31:08.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfca096640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5582d8a0dc50 0x5582d8a9c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfca096640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5582d8a0dc50 0x5582d8a9c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45632/0 (socket says 172.21.15.169:45632) 2024-09-13T06:31:08.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfca096640 1 -- 172.21.15.169:0/3794687794 learned_addr learned my addr 172.21.15.169:0/3794687794 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.225+0000 7fcfc9895640 1 --1- 172.21.15.169:0/3794687794 >> v1:172.21.15.112:6789/0 conn(0x5582d8a9c880 0x5582d8a9ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48004/0 (socket says 172.21.15.169:48004) 2024-09-13T06:31:08.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfca096640 1 -- 172.21.15.169:0/3794687794 >> v1:172.21.15.112:6789/0 conn(0x5582d8a9c880 legacy=0x5582d8a9ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfca096640 1 -- 172.21.15.169:0/3794687794 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d8aa13a0 con 0x5582d8a0dc50 2024-09-13T06:31:08.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfca096640 1 --2- 172.21.15.169:0/3794687794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8a9c340 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00a5c0 tx=0x7fcfbc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c2efa094fa27f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfc9094640 1 -- 172.21.15.169:0/3794687794 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0a6070 con 0x5582d8a0dc50 2024-09-13T06:31:08.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfc9094640 1 -- 172.21.15.169:0/3794687794 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0af070 con 0x5582d8a0dc50 2024-09-13T06:31:08.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfc9094640 1 -- 172.21.15.169:0/3794687794 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0aa5c0 con 0x5582d8a0dc50 2024-09-13T06:31:08.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 -- 172.21.15.169:0/3794687794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 msgr2=0x5582d8a9c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 --2- 172.21.15.169:0/3794687794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8a9c340 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00a5c0 tx=0x7fcfbc01b340 comp rx=0 tx=0).stop 2024-09-13T06:31:08.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 -- 172.21.15.169:0/3794687794 shutdown_connections 2024-09-13T06:31:08.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 --2- 172.21.15.169:0/3794687794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8a9c340 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 -- 172.21.15.169:0/3794687794 >> 172.21.15.169:0/3794687794 conn(0x5582d8a94070 msgr2=0x5582d8a96490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 -- 172.21.15.169:0/3794687794 shutdown_connections 2024-09-13T06:31:08.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.229+0000 7fcfcc586980 1 -- 172.21.15.169:0/3794687794 wait complete. 2024-09-13T06:31:08.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfcc586980 1 Processor -- start 2024-09-13T06:31:08.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfcc586980 1 -- start start 2024-09-13T06:31:08.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfcc586980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfcc586980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582d8947200 con 0x5582d8a0dc50 2024-09-13T06:31:08.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfca096640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfca096640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b84b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45636/0 (socket says 172.21.15.169:45636) 2024-09-13T06:31:08.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.245+0000 7fcfca096640 1 -- 172.21.15.169:0/3412181427 learned_addr learned my addr 172.21.15.169:0/3412181427 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 -- 172.21.15.169:0/3412181427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d8b850d0 con 0x5582d8a0dc50 2024-09-13T06:31:08.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 --2- 172.21.15.169:0/3412181427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b84b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc018f70 tx=0x7fcfbc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542f05e1e59bb647 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fceb8608640 1 -- 172.21.15.169:0/3412181427 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0aa9e0 con 0x5582d8a0dc50 2024-09-13T06:31:08.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fceb8608640 1 -- 172.21.15.169:0/3412181427 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0aab80 con 0x5582d8a0dc50 2024-09-13T06:31:08.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fceb8608640 1 -- 172.21.15.169:0/3412181427 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0aae60 con 0x5582d8a0dc50 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- 172.21.15.169:0/3412181427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 msgr2=0x5582d8b84b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 --2- 172.21.15.169:0/3412181427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b84b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc018f70 tx=0x7fcfbc003030 comp rx=0 tx=0).stop 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- 172.21.15.169:0/3412181427 shutdown_connections 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 --2- 172.21.15.169:0/3412181427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b84b00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- 172.21.15.169:0/3412181427 >> 172.21.15.169:0/3412181427 conn(0x5582d8a94070 msgr2=0x5582d8b80730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- 172.21.15.169:0/3412181427 shutdown_connections 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- 172.21.15.169:0/3412181427 wait complete. 2024-09-13T06:31:08.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 Processor -- start 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- start start 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b8bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfcc586980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582d8aa0e40 con 0x5582d8a0dc50 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b8bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b8bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45642/0 (socket says 172.21.15.169:45642) 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 -- 172.21.15.169:0/958976207 learned_addr learned my addr 172.21.15.169:0/958976207 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 -- 172.21.15.169:0/958976207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d8b8c2f0 con 0x5582d8a0dc50 2024-09-13T06:31:08.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.249+0000 7fcfca096640 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b8bdb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc018f70 tx=0x7fcfbc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb6e05640 1 -- 172.21.15.169:0/958976207 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0bd7c0 con 0x5582d8a0dc50 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582d8b8c580 con 0x5582d8a0dc50 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb6e05640 1 -- 172.21.15.169:0/958976207 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0bd960 con 0x5582d8a0dc50 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb6e05640 1 -- 172.21.15.169:0/958976207 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0bdc80 con 0x5582d8a0dc50 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d8a98120 con 0x5582d8a0dc50 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 Processor -- start 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- start start 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b96d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582d89a0800 con 0x5582d8b96930 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb6e05640 1 -- 172.21.15.169:0/958976207 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcfbc0ce030 con 0x5582d8a0dc50 2024-09-13T06:31:08.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca897640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b96d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca897640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b96d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45644/0 (socket says 172.21.15.169:45644) 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca897640 1 -- 172.21.15.169:0/2912836586 learned_addr learned my addr 172.21.15.169:0/2912836586 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb6e05640 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fceb0038a60 0x7fceb003af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb6e05640 1 -- 172.21.15.169:0/958976207 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fcfbc0cc020 con 0x5582d8a0dc50 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca096640 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fceb0038a60 0x7fceb003af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca897640 1 -- 172.21.15.169:0/2912836586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d8b97270 con 0x5582d8b96930 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca096640 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fceb0038a60 0x7fceb003af20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0d0580 tx=0x7fcfbc0bc760 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfca897640 1 --2- 172.21.15.169:0/2912836586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b96d30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400a430 tx=0x7fcfc400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63772a86bb36cca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb4e01640 1 -- 172.21.15.169:0/2912836586 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc400f6e0 con 0x5582d8b96930 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb4e01640 1 -- 172.21.15.169:0/2912836586 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc4015070 con 0x5582d8b96930 2024-09-13T06:31:08.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fceb4e01640 1 -- 172.21.15.169:0/2912836586 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc400fa10 con 0x5582d8b96930 2024-09-13T06:31:08.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/2912836586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 msgr2=0x5582d8b96d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 --2- 172.21.15.169:0/2912836586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b96d30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400a430 tx=0x7fcfc400a8f0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/2912836586 shutdown_connections 2024-09-13T06:31:08.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 --2- 172.21.15.169:0/2912836586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b96d30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/2912836586 >> 172.21.15.169:0/2912836586 conn(0x5582d8a9c880 msgr2=0x5582d8b92240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/2912836586 shutdown_connections 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- 172.21.15.169:0/2912836586 wait complete. 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 Processor -- start 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- start start 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b9dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.253+0000 7fcfcc586980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582d8b97c50 con 0x5582d8b96930 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfca897640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b9dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfca897640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b9dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45660/0 (socket says 172.21.15.169:45660) 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfca897640 1 -- 172.21.15.169:0/1912935480 learned_addr learned my addr 172.21.15.169:0/1912935480 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfca897640 1 -- 172.21.15.169:0/1912935480 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d8b9e210 con 0x5582d8b96930 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfca897640 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b9dcd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x5582d8b976e0 tx=0x7fcfc4003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fceaeffd640 1 -- 172.21.15.169:0/1912935480 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc400fe00 con 0x5582d8b96930 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582d8b9e4a0 con 0x5582d8b96930 2024-09-13T06:31:08.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fceaeffd640 1 -- 172.21.15.169:0/1912935480 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc4010a20 con 0x5582d8b96930 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fceaeffd640 1 -- 172.21.15.169:0/1912935480 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc4010dc0 con 0x5582d8b96930 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d8ba1180 con 0x5582d8b96930 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fceaeffd640 1 -- 172.21.15.169:0/1912935480 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcfc401a480 con 0x5582d8b96930 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fceaeffd640 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcea4034650 0x7fcea4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fceaeffd640 1 -- 172.21.15.169:0/1912935480 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fcfc404a410 con 0x5582d8b96930 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfc9895640 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcea4034650 0x7fcea4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 1 Processor -- start 2024-09-13T06:31:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfc9895640 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcea4034650 0x7fcea4036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0000f70 tx=0x7fcfc0001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 1 -- start start 2024-09-13T06:31:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 0x5582d8bb7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.257+0000 7fcfcc586980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582d8b85390 con 0x5582d8bb7510 2024-09-13T06:31:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfca096640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 0x5582d8bb7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfca096640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 0x5582d8bb7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45674/0 (socket says 172.21.15.169:45674) 2024-09-13T06:31:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfca096640 1 -- 172.21.15.169:0/1891592405 learned_addr learned my addr 172.21.15.169:0/1891592405 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfca096640 1 -- 172.21.15.169:0/1891592405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d8bb7f00 con 0x5582d8bb7510 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfca096640 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 0x5582d8bb7930 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0bc8d0 tx=0x7fcfbc0c5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8f7e6640 1 -- 172.21.15.169:0/1891592405 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0e0070 con 0x5582d8bb7510 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582d8bbab80 con 0x5582d8bb7510 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8f7e6640 1 -- 172.21.15.169:0/1891592405 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0bbb50 con 0x5582d8bb7510 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8f7e6640 1 -- 172.21.15.169:0/1891592405 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc0bbe30 con 0x5582d8bb7510 2024-09-13T06:31:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d8bbaf30 con 0x5582d8bb7510 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8f7e6640 1 -- 172.21.15.169:0/1891592405 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcfbc0d8040 con 0x5582d8bb7510 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8f7e6640 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fce000345b0 0x7fce00036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8f7e6640 1 -- 172.21.15.169:0/1891592405 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fcfbc0c0120 con 0x5582d8bb7510 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfc9895640 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fce000345b0 0x7fce00036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fce8d7e2640 20 reqs_thread_entry: start 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582d8bbced0 0x5582d8bbf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfc9895640 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fce000345b0 0x7fce00036a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0001ee0 tx=0x7fcfc000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582d8bbfa60 con 0x5582d8bbced0 2024-09-13T06:31:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.261+0000 7fcfca897640 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582d8bbced0 0x5582d8bbf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfca897640 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582d8bbced0 0x5582d8bbf390 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfca897640 1 -- 172.21.15.169:0/958976207 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfc400e070 con 0x5582d8bbced0 2024-09-13T06:31:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582d8bc1370 con 0x5582d8bbced0 2024-09-13T06:31:08.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfca897640 1 -- 172.21.15.169:0/958976207 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(2 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfc400e070 con 0x5582d8bbced0 2024-09-13T06:31:08.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcea4034650 msgr2=0x7fcea4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcea4034650 0x7fcea4036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0000f70 tx=0x7fcfc0001300 comp rx=0 tx=0).stop 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 msgr2=0x5582d8b9dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b9dcd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x5582d8b976e0 tx=0x7fcfc4003380 comp rx=0 tx=0).stop 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 shutdown_connections 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcea4034650 0x7fcea4036b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1912935480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8b96930 0x5582d8b9dcd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 >> 172.21.15.169:0/1912935480 conn(0x5582d8a9c880 msgr2=0x5582d8b91e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 shutdown_connections 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1912935480 wait complete. 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fce000345b0 msgr2=0x7fce00036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fce000345b0 0x7fce00036a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0001ee0 tx=0x7fcfc000f000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 msgr2=0x5582d8bb7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 0x5582d8bb7930 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0bc8d0 tx=0x7fcfbc0c5790 comp rx=0 tx=0).stop 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 shutdown_connections 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fce000345b0 0x7fce00036a70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/1891592405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8bb7510 0x5582d8bb7930 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 >> 172.21.15.169:0/1891592405 conn(0x5582d8bac4d0 msgr2=0x5582d8baee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 shutdown_connections 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/1891592405 wait complete. 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582d8bbced0 msgr2=0x5582d8bbf390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582d8bbced0 0x5582d8bbf390 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fceb0038a60 msgr2=0x7fceb003af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fceb0038a60 0x7fceb003af20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0d0580 tx=0x7fcfbc0bc760 comp rx=0 tx=0).stop 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 msgr2=0x5582d8b8bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b8bdb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc018f70 tx=0x7fcfbc0180e0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 shutdown_connections 2024-09-13T06:31:08.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582d8bbced0 0x5582d8bbf390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fceb0038a60 0x7fceb003af20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 --2- 172.21.15.169:0/958976207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582d8a0dc50 0x5582d8b8bdb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 >> 172.21.15.169:0/958976207 conn(0x5582d8a94070 msgr2=0x5582d8b7f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.265+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 shutdown_connections 2024-09-13T06:31:08.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.269+0000 7fcfcc586980 1 -- 172.21.15.169:0/958976207 wait complete. 2024-09-13T06:31:08.282 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"8744f35f-8918-4410-a77e-3a3ac7b40446","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T06:31:08.283 DEBUG:tasks.util.rgw: json result: {'id': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T06:31:08.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T06:31:08.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T06:31:08.283 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T06:31:08.363 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.363 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c8e59980 1 Processor -- start 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c8e59980 1 -- start start 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c8e59980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561a9d9603a0 0x561a9d95eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c8e59980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a9d871ae0 con 0x561a9d9607b0 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c8e59980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x561a9d895e30 con 0x561a9d9603a0 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c6969640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561a9d9603a0 0x561a9d95eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c6969640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x561a9d9603a0 0x561a9d95eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45680/0 (socket says 172.21.15.169:45680) 2024-09-13T06:31:08.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c6168640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x561a9d9607b0 0x561a9d95f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48018/0 (socket says 172.21.15.169:48018) 2024-09-13T06:31:08.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c6969640 1 -- 172.21.15.169:0/1013771252 learned_addr learned my addr 172.21.15.169:0/1013771252 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c6969640 1 -- 172.21.15.169:0/1013771252 >> v1:172.21.15.112:6789/0 conn(0x561a9d9607b0 legacy=0x561a9d95f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.361+0000 7fe6c6969640 1 -- 172.21.15.169:0/1013771252 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9d95f8d0 con 0x561a9d9603a0 2024-09-13T06:31:08.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c6969640 1 --2- 172.21.15.169:0/1013771252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9d95eb60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000a4e0 tx=0x7fe6c001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ebcae31efb78d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c5967640 1 -- 172.21.15.169:0/1013771252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00aa540 con 0x561a9d9603a0 2024-09-13T06:31:08.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c5967640 1 -- 172.21.15.169:0/1013771252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00aa6e0 con 0x561a9d9603a0 2024-09-13T06:31:08.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c5967640 1 -- 172.21.15.169:0/1013771252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00aaa40 con 0x561a9d9603a0 2024-09-13T06:31:08.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1013771252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 msgr2=0x561a9d95eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/1013771252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9d95eb60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000a4e0 tx=0x7fe6c001b090 comp rx=0 tx=0).stop 2024-09-13T06:31:08.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1013771252 shutdown_connections 2024-09-13T06:31:08.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/1013771252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9d95eb60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1013771252 >> 172.21.15.169:0/1013771252 conn(0x561a9d9e51a0 msgr2=0x561a9d9e75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1013771252 shutdown_connections 2024-09-13T06:31:08.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.365+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1013771252 wait complete. 2024-09-13T06:31:08.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c8e59980 1 Processor -- start 2024-09-13T06:31:08.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c8e59980 1 -- start start 2024-09-13T06:31:08.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c8e59980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dad6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c8e59980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a9d897200 con 0x561a9d9603a0 2024-09-13T06:31:08.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c6969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dad6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c6969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dad6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45690/0 (socket says 172.21.15.169:45690) 2024-09-13T06:31:08.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c6969640 1 -- 172.21.15.169:0/2122382959 learned_addr learned my addr 172.21.15.169:0/2122382959 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c6969640 1 -- 172.21.15.169:0/2122382959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9dad7150 con 0x561a9d9603a0 2024-09-13T06:31:08.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe6c6969640 1 --2- 172.21.15.169:0/2122382959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dad6b80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0018cc0 tx=0x7fe6c00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c79953972a75eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe5b4e09640 1 -- 172.21.15.169:0/2122382959 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00b9070 con 0x561a9d9603a0 2024-09-13T06:31:08.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe5b4e09640 1 -- 172.21.15.169:0/2122382959 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00aab00 con 0x561a9d9603a0 2024-09-13T06:31:08.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.381+0000 7fe5b4e09640 1 -- 172.21.15.169:0/2122382959 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00aae20 con 0x561a9d9603a0 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2122382959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 msgr2=0x561a9dad6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/2122382959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dad6b80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0018cc0 tx=0x7fe6c00033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2122382959 shutdown_connections 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/2122382959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dad6b80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2122382959 >> 172.21.15.169:0/2122382959 conn(0x561a9d9e51a0 msgr2=0x561a9dad27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2122382959 shutdown_connections 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2122382959 wait complete. 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 Processor -- start 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- start start 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dadddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a9d9f51f0 con 0x561a9d9603a0 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c6969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dadddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c6969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dadddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45700/0 (socket says 172.21.15.169:45700) 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 learned_addr learned my addr 172.21.15.169:0/3437029959 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9dade310 con 0x561a9d9603a0 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c6969640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dadddd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000a4e0 tx=0x7fe6c0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe5b3606640 1 -- 172.21.15.169:0/3437029959 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00b9070 con 0x561a9d9603a0 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a9dade5a0 con 0x561a9d9603a0 2024-09-13T06:31:08.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe5b3606640 1 -- 172.21.15.169:0/3437029959 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00c7410 con 0x561a9d9603a0 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe5b3606640 1 -- 172.21.15.169:0/3437029959 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00c76f0 con 0x561a9d9603a0 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a9dae1280 con 0x561a9d9603a0 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 Processor -- start 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- start start 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daeaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c8e59980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a9d8f0800 con 0x561a9daeab90 2024-09-13T06:31:08.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe5b3606640 1 -- 172.21.15.169:0/3437029959 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6c00b3040 con 0x561a9d9603a0 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c716a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daeaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe5b3606640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5ac034650 0x7fe5ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c716a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daeaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45710/0 (socket says 172.21.15.169:45710) 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c716a640 1 -- 172.21.15.169:0/3166446790 learned_addr learned my addr 172.21.15.169:0/3166446790 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe5b3606640 1 -- 172.21.15.169:0/3437029959 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe6c00c4070 con 0x561a9d9603a0 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.385+0000 7fe6c6969640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5ac034650 0x7fe5ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 -- 172.21.15.169:0/3166446790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9daeb4d0 con 0x561a9daeab90 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c6969640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5ac034650 0x7fe5ac036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b5d40 tx=0x7fe6c00d2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 --2- 172.21.15.169:0/3166446790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daeaf90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800a440 tx=0x7fe6b800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40df644290e24bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe5b1602640 1 -- 172.21.15.169:0/3166446790 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8008850 con 0x561a9daeab90 2024-09-13T06:31:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe5b1602640 1 -- 172.21.15.169:0/3166446790 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8008a10 con 0x561a9daeab90 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe5b1602640 1 -- 172.21.15.169:0/3166446790 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8008d30 con 0x561a9daeab90 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3166446790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 msgr2=0x561a9daeaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3166446790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daeaf90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800a440 tx=0x7fe6b800a900 comp rx=0 tx=0).stop 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3166446790 shutdown_connections 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3166446790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daeaf90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3166446790 >> 172.21.15.169:0/3166446790 conn(0x561a9d9607b0 msgr2=0x561a9dae64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3166446790 shutdown_connections 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3166446790 wait complete. 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 Processor -- start 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- start start 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daf1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a9daebeb0 con 0x561a9daeab90 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daf1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daf1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45714/0 (socket says 172.21.15.169:45714) 2024-09-13T06:31:08.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 -- 172.21.15.169:0/1513036989 learned_addr learned my addr 172.21.15.169:0/1513036989 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 -- 172.21.15.169:0/1513036989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9daf24b0 con 0x561a9daeab90 2024-09-13T06:31:08.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c716a640 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daf1f70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x561a9daeb940 tx=0x7fe6b8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe5ab7fe640 1 -- 172.21.15.169:0/1513036989 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8013a70 con 0x561a9daeab90 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a9daf2740 con 0x561a9daeab90 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe5ab7fe640 1 -- 172.21.15.169:0/1513036989 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8023070 con 0x561a9daeab90 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a9daf5420 con 0x561a9daeab90 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.389+0000 7fe5ab7fe640 1 -- 172.21.15.169:0/1513036989 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8013d40 con 0x561a9daeab90 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:08.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe5ab7fe640 1 -- 172.21.15.169:0/1513036989 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6b8028460 con 0x561a9daeab90 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe5ab7fe640 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5a0034650 0x7fe5a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 1 Processor -- start 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe5ab7fe640 1 -- 172.21.15.169:0/1513036989 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe6b8049f10 con 0x561a9daeab90 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c716a640 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5a0034650 0x7fe5a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 1 -- start start 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 0x561a9db0bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561a9dad7410 con 0x561a9db0b790 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c716a640 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5a0034650 0x7fe5a0036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8027fd0 tx=0x7fe6b8013ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c6969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 0x561a9db0bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c6969640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 0x561a9db0bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45718/0 (socket says 172.21.15.169:45718) 2024-09-13T06:31:08.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c6969640 1 -- 172.21.15.169:0/2217740754 learned_addr learned my addr 172.21.15.169:0/2217740754 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c6969640 1 -- 172.21.15.169:0/2217740754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9db0c180 con 0x561a9db0b790 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c6969640 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 0x561a9db0bbb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe6c001b930 tx=0x7fe6c00a9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe586ffd640 1 -- 172.21.15.169:0/2217740754 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00bba00 con 0x561a9db0b790 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a9db0ece0 con 0x561a9db0b790 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe586ffd640 1 -- 172.21.15.169:0/2217740754 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00cf390 con 0x561a9db0b790 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe586ffd640 1 -- 172.21.15.169:0/2217740754 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00b4db0 con 0x561a9db0b790 2024-09-13T06:31:08.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.393+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a9db0f0e0 con 0x561a9db0b790 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe586ffd640 1 -- 172.21.15.169:0/2217740754 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6c00e46c0 con 0x561a9db0b790 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe586ffd640 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe500034650 0x7fe500036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe586ffd640 1 -- 172.21.15.169:0/2217740754 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe6c00e1030 con 0x561a9db0b790 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c6168640 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe500034650 0x7fe500036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe584ff9640 20 reqs_thread_entry: start 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a9db112a0 0x561a9db13690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c6168640 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe500034650 0x7fe500036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0000f70 tx=0x7fe6b0001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a9db13d10 con 0x561a9db112a0 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c716a640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a9db112a0 0x561a9db13690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c716a640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a9db112a0 0x561a9db13690 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b801e7a0 con 0x561a9db112a0 2024-09-13T06:31:08.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a9db14ad0 0x561a9db16ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a9db17470 con 0x561a9db14ad0 2024-09-13T06:31:08.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c6969640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a9db14ad0 0x561a9db16ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c6969640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a9db14ad0 0x561a9db16ec0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.397+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a9db18d20 con 0x561a9db14ad0 2024-09-13T06:31:08.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1f5c0 con 0x561a9db112a0 2024-09-13T06:31:08.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b801e7a0 con 0x561a9db112a0 2024-09-13T06:31:08.404 INFO:teuthology.orchestra.run.smithi169.stderr:NOTICE: set zone's realm_id= 2024-09-13T06:31:08.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a9db23620 0x561a9db1fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db23620 2024-09-13T06:31:08.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6168640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a9db23620 0x561a9db1fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6168640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a9db23620 0x561a9db1fa40 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db14ad0 2024-09-13T06:31:08.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6969640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe6c00bdc20 0x7fe6c00f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x7fe6c00bdc20 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe6c00bdc20 0x7fe6c00f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe6c00bdc20 0x7fe6c00f2040 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db112a0 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db112a0 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.401+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db23620 2024-09-13T06:31:08.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(10 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db112a0 2024-09-13T06:31:08.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db14ad0 2024-09-13T06:31:08.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db14ad0 2024-09-13T06:31:08.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db112a0 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x7fe6c00bdc20 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db112a0 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x7fe6c00bdc20 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(17 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6b804b040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db14ad0 2024-09-13T06:31:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1ee50 con 0x561a9db23620 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db112a0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.405+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db14ad0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db23620 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db112a0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db112a0 2024-09-13T06:31:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db112a0 2024-09-13T06:31:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db23620 2024-09-13T06:31:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db112a0 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db23620 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b804b040 con 0x7fe6c00bdc20 2024-09-13T06:31:08.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.409+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db23620 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f600 con 0x561a9db23620 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6168640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe6b001d040 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(36 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a9db20bf0 con 0x561a9db14ad0 2024-09-13T06:31:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:38 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a9db21470 con 0x561a9db14ad0 2024-09-13T06:31:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(38 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.413+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a9db21810 con 0x561a9db14ad0 2024-09-13T06:31:08.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.417+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(39 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [create,call,writefull 0~1155] v35'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.417+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a9db1e110 con 0x561a9db14ad0 2024-09-13T06:31:08.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c6969640 1 -- 172.21.15.169:0/3437029959 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v35'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fe6c00ea020 con 0x561a9db14ad0 2024-09-13T06:31:08.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a9db24070 con 0x561a9db112a0 2024-09-13T06:31:08.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v35'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fe6b804b040 con 0x561a9db112a0 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5a0034650 msgr2=0x7fe5a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5a0034650 0x7fe5a0036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8027fd0 tx=0x7fe6b8013ee0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 msgr2=0x561a9daf1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daf1f70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x561a9daeb940 tx=0x7fe6b8003000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 shutdown_connections 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5a0034650 0x7fe5a0036b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/1513036989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9daeab90 0x561a9daf1f70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 >> 172.21.15.169:0/1513036989 conn(0x561a9d9607b0 msgr2=0x561a9dae6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 shutdown_connections 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/1513036989 wait complete. 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe500034650 msgr2=0x7fe500036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe500034650 0x7fe500036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0000f70 tx=0x7fe6b0001300 comp rx=0 tx=0).stop 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 msgr2=0x561a9db0bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 0x561a9db0bbb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe6c001b930 tx=0x7fe6c00a9f60 comp rx=0 tx=0).stop 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 shutdown_connections 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe500034650 0x7fe500036b10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/2217740754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9db0b790 0x561a9db0bbb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 >> 172.21.15.169:0/2217740754 conn(0x561a9db007c0 msgr2=0x561a9db030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 shutdown_connections 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/2217740754 wait complete. 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a9db14ad0 msgr2=0x561a9db16ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x561a9db14ad0 0x561a9db16ec0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a9db112a0 msgr2=0x561a9db13690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x561a9db112a0 0x561a9db13690 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe6c00bdc20 msgr2=0x7fe6c00f2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe6c00bdc20 0x7fe6c00f2040 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a9db23620 msgr2=0x561a9db1fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x561a9db23620 0x561a9db1fa40 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5ac034650 msgr2=0x7fe5ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe5ac034650 0x7fe5ac036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b5d40 tx=0x7fe6c00d2040 comp rx=0 tx=0).stop 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 msgr2=0x561a9dadddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 --2- 172.21.15.169:0/3437029959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561a9d9603a0 0x561a9dadddd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000a4e0 tx=0x7fe6c0017e30 comp rx=0 tx=0).stop 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 reap_dead start 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c716a640 1 -- 172.21.15.169:0/3437029959 reap_dead start 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 shutdown_connections 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 >> 172.21.15.169:0/3437029959 conn(0x561a9d9e51a0 msgr2=0x561a9dad1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 shutdown_connections 2024-09-13T06:31:08.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.421+0000 7fe6c8e59980 1 -- 172.21.15.169:0/3437029959 wait complete. 2024-09-13T06:31:08.437 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"8744f35f-8918-4410-a77e-3a3ac7b40446","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T06:31:08.437 DEBUG:tasks.util.rgw: json result: {'id': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T06:31:08.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T06:31:08.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T06:31:08.437 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T06:31:08.514 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.515 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7b26d980 1 Processor -- start 2024-09-13T06:31:08.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7b26d980 1 -- start start 2024-09-13T06:31:08.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7b26d980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5622989f82c0 0x562298a88750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7b26d980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56229890bae0 con 0x562298a88c90 2024-09-13T06:31:08.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7b26d980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x56229892fe30 con 0x5622989f82c0 2024-09-13T06:31:08.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a78d7d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5622989f82c0 0x562298a88750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7857c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x562298a88c90 0x562298a8b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48020/0 (socket says 172.21.15.169:48020) 2024-09-13T06:31:08.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a78d7d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5622989f82c0 0x562298a88750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45722/0 (socket says 172.21.15.169:45722) 2024-09-13T06:31:08.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a7857c640 1 -- 172.21.15.169:0/3707636590 learned_addr learned my addr 172.21.15.169:0/3707636590 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:08.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3707636590 >> v1:172.21.15.112:6789/0 conn(0x562298a88c90 legacy=0x562298a8b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.513+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3707636590 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622989f86a0 con 0x5622989f82c0 2024-09-13T06:31:08.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3707636590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298a88750 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800a420 tx=0x7f9a6801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f79557c8ff49d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a77d7b640 1 -- 172.21.15.169:0/3707636590 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680af070 con 0x5622989f82c0 2024-09-13T06:31:08.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a77d7b640 1 -- 172.21.15.169:0/3707636590 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a680aa530 con 0x5622989f82c0 2024-09-13T06:31:08.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a77d7b640 1 -- 172.21.15.169:0/3707636590 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680aa850 con 0x5622989f82c0 2024-09-13T06:31:08.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3707636590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 msgr2=0x562298a88750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3707636590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298a88750 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800a420 tx=0x7f9a6801afd0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3707636590 shutdown_connections 2024-09-13T06:31:08.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3707636590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298a88750 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3707636590 >> 172.21.15.169:0/3707636590 conn(0x562298a7e080 msgr2=0x562298a804a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3707636590 shutdown_connections 2024-09-13T06:31:08.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.517+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3707636590 wait complete. 2024-09-13T06:31:08.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a7b26d980 1 Processor -- start 2024-09-13T06:31:08.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a7b26d980 1 -- start start 2024-09-13T06:31:08.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a7b26d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b70bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a7b26d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562298931200 con 0x5622989f82c0 2024-09-13T06:31:08.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a78d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b70bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a78d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b70bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45734/0 (socket says 172.21.15.169:45734) 2024-09-13T06:31:08.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3940556222 learned_addr learned my addr 172.21.15.169:0/3940556222 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3940556222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562298b71190 con 0x5622989f82c0 2024-09-13T06:31:08.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.533+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3940556222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b70bc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800a420 tx=0x7f9a680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bbab77ceff6ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9966e0d640 1 -- 172.21.15.169:0/3940556222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680af040 con 0x5622989f82c0 2024-09-13T06:31:08.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9966e0d640 1 -- 172.21.15.169:0/3940556222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a680aab30 con 0x5622989f82c0 2024-09-13T06:31:08.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9966e0d640 1 -- 172.21.15.169:0/3940556222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680aae10 con 0x5622989f82c0 2024-09-13T06:31:08.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3940556222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 msgr2=0x562298b70bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3940556222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b70bc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800a420 tx=0x7f9a680033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3940556222 shutdown_connections 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3940556222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b70bc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3940556222 >> 172.21.15.169:0/3940556222 conn(0x562298a7e080 msgr2=0x562298b6c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3940556222 shutdown_connections 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3940556222 wait complete. 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 Processor -- start 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- start start 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b77dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562298a8f200 con 0x5622989f82c0 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a78d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b77dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a78d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b77dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45744/0 (socket says 172.21.15.169:45744) 2024-09-13T06:31:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3569692764 learned_addr learned my addr 172.21.15.169:0/3569692764 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3569692764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562298b78310 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b77dd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9a6801b870 tx=0x7f9a68017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f996560a640 1 -- 172.21.15.169:0/3569692764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680c5070 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562298b785a0 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f996560a640 1 -- 172.21.15.169:0/3569692764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a680b5910 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f996560a640 1 -- 172.21.15.169:0/3569692764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680b5c30 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.537+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562298b7b280 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 Processor -- start 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- start start 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b84fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56229898a800 con 0x562298b84be0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f996560a640 1 -- 172.21.15.169:0/3569692764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a680c1480 con 0x5622989f82c0 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f996560a640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9960034650 0x7f9960036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b84fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f996560a640 1 -- 172.21.15.169:0/3569692764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f9a680bb070 con 0x5622989f82c0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b84fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45746/0 (socket says 172.21.15.169:45746) 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 -- 172.21.15.169:0/1172239978 learned_addr learned my addr 172.21.15.169:0/1172239978 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9960034650 0x7f9960036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 -- 172.21.15.169:0/1172239978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562298b85520 con 0x562298b84be0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9960034650 0x7f9960036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a68005790 tx=0x7f9a680b4e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 --2- 172.21.15.169:0/1172239978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b84fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000a440 tx=0x7f9a7000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cb50af8f106b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f995effd640 1 -- 172.21.15.169:0/1172239978 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70008850 con 0x562298b84be0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f995effd640 1 -- 172.21.15.169:0/1172239978 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a70008a10 con 0x562298b84be0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f995effd640 1 -- 172.21.15.169:0/1172239978 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70008d30 con 0x562298b84be0 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- 172.21.15.169:0/1172239978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 msgr2=0x562298b84fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/1172239978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b84fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000a440 tx=0x7f9a7000a900 comp rx=0 tx=0).stop 2024-09-13T06:31:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- 172.21.15.169:0/1172239978 shutdown_connections 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/1172239978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b84fe0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- 172.21.15.169:0/1172239978 >> 172.21.15.169:0/1172239978 conn(0x562298a88c90 msgr2=0x562298b804f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- 172.21.15.169:0/1172239978 shutdown_connections 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- 172.21.15.169:0/1172239978 wait complete. 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 Processor -- start 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- start start 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b8bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7b26d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562298b85750 con 0x562298b84be0 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b8bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b8bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45762/0 (socket says 172.21.15.169:45762) 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.541+0000 7f9a7957e640 1 -- 172.21.15.169:0/3721496246 learned_addr learned my addr 172.21.15.169:0/3721496246 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7957e640 1 -- 172.21.15.169:0/3721496246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562298b8c420 con 0x562298b84be0 2024-09-13T06:31:08.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7957e640 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b8bee0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x562298b85990 tx=0x7f9a70003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f995d7fa640 1 -- 172.21.15.169:0/3721496246 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70013a70 con 0x562298b84be0 2024-09-13T06:31:08.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562298b8c6b0 con 0x562298b84be0 2024-09-13T06:31:08.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f995d7fa640 1 -- 172.21.15.169:0/3721496246 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a70023070 con 0x562298b84be0 2024-09-13T06:31:08.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562298b8f390 con 0x562298b84be0 2024-09-13T06:31:08.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f995d7fa640 1 -- 172.21.15.169:0/3721496246 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70013c10 con 0x562298b84be0 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f995d7fa640 1 -- 172.21.15.169:0/3721496246 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a70028460 con 0x562298b84be0 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f995d7fa640 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9950034650 0x7f9950036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f995d7fa640 1 -- 172.21.15.169:0/3721496246 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f9a70049df0 con 0x562298b84be0 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 1 Processor -- start 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7957e640 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9950034650 0x7f9950036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 1 -- start start 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 0x562298ba5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7b26d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562298b71450 con 0x562298ba5790 2024-09-13T06:31:08.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a7957e640 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9950034650 0x7f9950036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a700056a0 tx=0x7f9a70013db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a78d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 0x562298ba5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a78d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 0x562298ba5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45774/0 (socket says 172.21.15.169:45774) 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.545+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3114674677 learned_addr learned my addr 172.21.15.169:0/3114674677 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3114674677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562298ba6180 con 0x562298ba5790 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 0x562298ba5bb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000f70 tx=0x7f9a68009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f993d7e2640 1 -- 172.21.15.169:0/3114674677 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680e8020 con 0x562298ba5790 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562298ba8ce0 con 0x562298ba5790 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f993d7e2640 1 -- 172.21.15.169:0/3114674677 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a68002290 con 0x562298ba5790 2024-09-13T06:31:08.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f993d7e2640 1 -- 172.21.15.169:0/3114674677 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a680e2070 con 0x562298ba5790 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562298ba90e0 con 0x562298ba5790 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f993d7e2640 1 -- 172.21.15.169:0/3114674677 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a680c1c90 con 0x562298ba5790 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f993d7e2640 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98b4034650 0x7f98b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f993d7e2640 1 -- 172.21.15.169:0/3114674677 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f9a680df070 con 0x562298ba5790 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7857c640 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98b4034650 0x7f98b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f98beffd640 20 reqs_thread_entry: start 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562298bab2a0 0x562298bad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562298badca0 con 0x562298bab2a0 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7857c640 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98b4034650 0x7f98b4036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c000f70 tx=0x7f9a6c001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7957e640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562298bab2a0 0x562298bad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7957e640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562298bab2a0 0x562298bad690 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7957e640 1 -- 172.21.15.169:0/3569692764 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a70028b20 con 0x562298bab2a0 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562298baea60 0x562298bb0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562298bb1460 con 0x562298baea60 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.549+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562298baea60 0x562298bb0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a78d7d640 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562298baea60 0x562298bb0e50 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3569692764 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a680ea020 con 0x562298baea60 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562298bb2d10 con 0x562298baea60 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a78d7d640 1 -- 172.21.15.169:0/3569692764 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f9a680ea020 con 0x562298baea60 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9950034650 msgr2=0x7f9950036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9950034650 0x7f9950036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a700056a0 tx=0x7f9a70013db0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 msgr2=0x562298b8bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b8bee0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x562298b85990 tx=0x7f9a70003000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 shutdown_connections 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9950034650 0x7f9950036b10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3721496246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298b84be0 0x562298b8bee0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 >> 172.21.15.169:0/3721496246 conn(0x562298a88c90 msgr2=0x562298b80060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 shutdown_connections 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3721496246 wait complete. 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98b4034650 msgr2=0x7f98b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98b4034650 0x7f98b4036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c000f70 tx=0x7f9a6c001240 comp rx=0 tx=0).stop 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 msgr2=0x562298ba5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 0x562298ba5bb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000f70 tx=0x7f9a68009ef0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 shutdown_connections 2024-09-13T06:31:08.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98b4034650 0x7f98b4036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3114674677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562298ba5790 0x562298ba5bb0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 >> 172.21.15.169:0/3114674677 conn(0x562298b9a7c0 msgr2=0x562298b9d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 shutdown_connections 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3114674677 wait complete. 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562298baea60 msgr2=0x562298bb0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562298baea60 0x562298bb0e50 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562298bab2a0 msgr2=0x562298bad690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562298bab2a0 0x562298bad690 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9960034650 msgr2=0x7f9960036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9960034650 0x7f9960036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a68005790 tx=0x7f9a680b4e40 comp rx=0 tx=0).stop 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 msgr2=0x562298b77dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b77dd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9a6801b870 tx=0x7f9a68017d70 comp rx=0 tx=0).stop 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 shutdown_connections 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x562298baea60 0x562298bb0e50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x562298bab2a0 0x562298bad690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9960034650 0x7f9960036b10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.553+0000 7f9a7b26d980 1 --2- 172.21.15.169:0/3569692764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5622989f82c0 0x562298b77dd0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.557+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 >> 172.21.15.169:0/3569692764 conn(0x562298a7e080 msgr2=0x562298b6b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.557+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 shutdown_connections 2024-09-13T06:31:08.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.557+0000 7f9a7b26d980 1 -- 172.21.15.169:0/3569692764 wait complete. 2024-09-13T06:31:08.569 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"8744f35f-8918-4410-a77e-3a3ac7b40446","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T06:31:08.570 DEBUG:tasks.util.rgw: json result: {'id': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T06:31:08.570 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:31:08.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:31:08.570 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T06:31:08.649 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.649 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe327153980 1 Processor -- start 2024-09-13T06:31:08.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe327153980 1 -- start start 2024-09-13T06:31:08.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe327153980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5643b92b3e80 0x5643b92b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe327153980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643b9135ae0 con 0x5643b9222380 2024-09-13T06:31:08.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe327153980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5643b9159e30 con 0x5643b92b3e80 2024-09-13T06:31:08.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe324462640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5643b92b3e80 0x5643b92b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe324462640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5643b92b3e80 0x5643b92b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45778/0 (socket says 172.21.15.169:45778) 2024-09-13T06:31:08.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe324462640 1 -- 172.21.15.169:0/2804124672 learned_addr learned my addr 172.21.15.169:0/2804124672 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.645+0000 7fe324c63640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5643b9222380 0x5643b92b2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48036/0 (socket says 172.21.15.169:48036) 2024-09-13T06:31:08.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe324462640 1 -- 172.21.15.169:0/2804124672 >> v1:172.21.15.112:6789/0 conn(0x5643b9222380 legacy=0x5643b92b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe324462640 1 -- 172.21.15.169:0/2804124672 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b9222760 con 0x5643b92b3e80 2024-09-13T06:31:08.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe324462640 1 --2- 172.21.15.169:0/2804124672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b92b3e80 0x5643b92b6270 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe31800a5c0 tx=0x7fe31801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdd16545a580df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe323c61640 1 -- 172.21.15.169:0/2804124672 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3180a6070 con 0x5643b92b3e80 2024-09-13T06:31:08.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe323c61640 1 -- 172.21.15.169:0/2804124672 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3180af070 con 0x5643b92b3e80 2024-09-13T06:31:08.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe323c61640 1 -- 172.21.15.169:0/2804124672 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3180aa5c0 con 0x5643b92b3e80 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 -- 172.21.15.169:0/2804124672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b92b3e80 msgr2=0x5643b92b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 --2- 172.21.15.169:0/2804124672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b92b3e80 0x5643b92b6270 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe31800a5c0 tx=0x7fe31801b340 comp rx=0 tx=0).stop 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 -- 172.21.15.169:0/2804124672 shutdown_connections 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 --2- 172.21.15.169:0/2804124672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b92b3e80 0x5643b92b6270 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 -- 172.21.15.169:0/2804124672 >> 172.21.15.169:0/2804124672 conn(0x5643b92a8050 msgr2=0x5643b92aa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 -- 172.21.15.169:0/2804124672 shutdown_connections 2024-09-13T06:31:08.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.649+0000 7fe327153980 1 -- 172.21.15.169:0/2804124672 wait complete. 2024-09-13T06:31:08.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe327153980 1 Processor -- start 2024-09-13T06:31:08.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe327153980 1 -- start start 2024-09-13T06:31:08.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe327153980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b939ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe327153980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5643b915b200 con 0x5643b9222380 2024-09-13T06:31:08.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe324c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b939ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe324c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b939ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45788/0 (socket says 172.21.15.169:45788) 2024-09-13T06:31:08.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.665+0000 7fe324c63640 1 -- 172.21.15.169:0/1970794186 learned_addr learned my addr 172.21.15.169:0/1970794186 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 -- 172.21.15.169:0/1970794186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b939b2d0 con 0x5643b9222380 2024-09-13T06:31:08.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 --2- 172.21.15.169:0/1970794186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b939ad00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe31400b240 tx=0x7fe31400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0109f62c6602b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe212e0d640 1 -- 172.21.15.169:0/1970794186 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31400e700 con 0x5643b9222380 2024-09-13T06:31:08.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe212e0d640 1 -- 172.21.15.169:0/1970794186 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31400e8a0 con 0x5643b9222380 2024-09-13T06:31:08.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe212e0d640 1 -- 172.21.15.169:0/1970794186 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31400eb80 con 0x5643b9222380 2024-09-13T06:31:08.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- 172.21.15.169:0/1970794186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 msgr2=0x5643b939ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 --2- 172.21.15.169:0/1970794186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b939ad00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe31400b240 tx=0x7fe31400b700 comp rx=0 tx=0).stop 2024-09-13T06:31:08.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- 172.21.15.169:0/1970794186 shutdown_connections 2024-09-13T06:31:08.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 --2- 172.21.15.169:0/1970794186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b939ad00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- 172.21.15.169:0/1970794186 >> 172.21.15.169:0/1970794186 conn(0x5643b92a8050 msgr2=0x5643b9396930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- 172.21.15.169:0/1970794186 shutdown_connections 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- 172.21.15.169:0/1970794186 wait complete. 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 Processor -- start 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- start start 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b93a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5643b92b91e0 con 0x5643b9222380 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b93a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b93a2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45798/0 (socket says 172.21.15.169:45798) 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 -- 172.21.15.169:0/2966571703 learned_addr learned my addr 172.21.15.169:0/2966571703 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 -- 172.21.15.169:0/2966571703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b93a25d0 con 0x5643b9222380 2024-09-13T06:31:08.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe324c63640 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b93a2090 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe314000fe0 tx=0x7fe314000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe21160a640 1 -- 172.21.15.169:0/2966571703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31400f9c0 con 0x5643b9222380 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643b93a2860 con 0x5643b9222380 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.669+0000 7fe21160a640 1 -- 172.21.15.169:0/2966571703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31400fb80 con 0x5643b9222380 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe21160a640 1 -- 172.21.15.169:0/2966571703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31402c060 con 0x5643b9222380 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b93a5540 con 0x5643b9222380 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 Processor -- start 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- start start 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5643b91b4800 con 0x5643b93aee20 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe21160a640 1 -- 172.21.15.169:0/2966571703 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe314017070 con 0x5643b9222380 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45810/0 (socket says 172.21.15.169:45810) 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 -- 172.21.15.169:0/1560983709 learned_addr learned my addr 172.21.15.169:0/1560983709 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe21160a640 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe20c034650 0x7fe20c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe21160a640 1 -- 172.21.15.169:0/2966571703 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe314015020 con 0x5643b9222380 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe324c63640 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe20c034650 0x7fe20c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 -- 172.21.15.169:0/1560983709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b93af760 con 0x5643b93aee20 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe324c63640 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe20c034650 0x7fe20c036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe314048f30 tx=0x7fe31400ef70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 --2- 172.21.15.169:0/1560983709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93af220 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00a430 tx=0x7fe31c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b8c0062fad3d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe20affd640 1 -- 172.21.15.169:0/1560983709 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31c00f6e0 con 0x5643b93aee20 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe20affd640 1 -- 172.21.15.169:0/1560983709 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c015070 con 0x5643b93aee20 2024-09-13T06:31:08.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe20affd640 1 -- 172.21.15.169:0/1560983709 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31c00fa10 con 0x5643b93aee20 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- 172.21.15.169:0/1560983709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 msgr2=0x5643b93af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 --2- 172.21.15.169:0/1560983709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93af220 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00a430 tx=0x7fe31c00a8f0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- 172.21.15.169:0/1560983709 shutdown_connections 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 --2- 172.21.15.169:0/1560983709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93af220 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- 172.21.15.169:0/1560983709 >> 172.21.15.169:0/1560983709 conn(0x5643b92b3e80 msgr2=0x5643b93aa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- 172.21.15.169:0/1560983709 shutdown_connections 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- 172.21.15.169:0/1560983709 wait complete. 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 Processor -- start 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- start start 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe327153980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5643b93b0140 con 0x5643b93aee20 2024-09-13T06:31:08.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45826/0 (socket says 172.21.15.169:45826) 2024-09-13T06:31:08.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.673+0000 7fe325464640 1 -- 172.21.15.169:0/4013501662 learned_addr learned my addr 172.21.15.169:0/4013501662 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe325464640 1 -- 172.21.15.169:0/4013501662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b93b66b0 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe325464640 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93b6170 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5643b93afbd0 tx=0x7fe31c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe2097fa640 1 -- 172.21.15.169:0/4013501662 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31c00fe00 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643b93b6940 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b93b9620 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe2097fa640 1 -- 172.21.15.169:0/4013501662 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c010a20 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe2097fa640 1 -- 172.21.15.169:0/4013501662 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe31c010d80 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe2097fa640 1 -- 172.21.15.169:0/4013501662 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe31c01a480 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe2097fa640 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1fc0346a0 0x7fe1fc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe2097fa640 1 -- 172.21.15.169:0/4013501662 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe31c04a350 con 0x5643b93aee20 2024-09-13T06:31:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 1 Processor -- start 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe325464640 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1fc0346a0 0x7fe1fc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 1 -- start start 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 0x5643b93cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe327153980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5643b939b650 con 0x5643b93cf9f0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe325464640 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1fc0346a0 0x7fe1fc036b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe31c01bfd0 tx=0x7fe31c010f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe324c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 0x5643b93cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe324c63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 0x5643b93cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45838/0 (socket says 172.21.15.169:45838) 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe324c63640 1 -- 172.21.15.169:0/2912258820 learned_addr learned my addr 172.21.15.169:0/2912258820 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.677+0000 7fe324c63640 1 -- 172.21.15.169:0/2912258820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b93d03e0 con 0x5643b93cf9f0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe324c63640 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 0x5643b93cfe10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe31401bfd0 tx=0x7fe314048e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe1e97e2640 1 -- 172.21.15.169:0/2912258820 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe314027e20 con 0x5643b93cf9f0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643b93d3060 con 0x5643b93cf9f0 2024-09-13T06:31:08.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe1e97e2640 1 -- 172.21.15.169:0/2912258820 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31401b5b0 con 0x5643b93cf9f0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe1e97e2640 1 -- 172.21.15.169:0/2912258820 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe314027430 con 0x5643b93cf9f0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b93d3060 con 0x5643b93cf9f0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe1e97e2640 1 -- 172.21.15.169:0/2912258820 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe314051020 con 0x5643b93cf9f0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe1e97e2640 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe160034650 0x7fe160036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe1e97e2640 1 -- 172.21.15.169:0/2912258820 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe314046070 con 0x5643b93cf9f0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe324462640 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe160034650 0x7fe160036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe16affd640 20 reqs_thread_entry: start 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5643b93d53a0 0x5643b93d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5643b93d7ec0 con 0x5643b93d53a0 2024-09-13T06:31:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe324462640 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe160034650 0x7fe160036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ae000 tx=0x7fe3180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe325464640 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5643b93d53a0 0x5643b93d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe325464640 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5643b93d53a0 0x5643b93d77f0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe325464640 1 -- 172.21.15.169:0/2966571703 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe31c00e070 con 0x5643b93d53a0 2024-09-13T06:31:08.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.681+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5643b93d9780 con 0x5643b93d53a0 2024-09-13T06:31:08.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.685+0000 7fe325464640 1 -- 172.21.15.169:0/2966571703 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(2 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fe31c00e070 con 0x5643b93d53a0 2024-09-13T06:31:08.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.685+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5643b93de2a0 con 0x5643b93d53a0 2024-09-13T06:31:08.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.685+0000 7fe325464640 1 -- 172.21.15.169:0/2966571703 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [stat,call,call,writefull 0~993] v35'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fe31c00e070 con 0x5643b93d53a0 2024-09-13T06:31:08.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1fc0346a0 msgr2=0x7fe1fc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1fc0346a0 0x7fe1fc036b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe31c01bfd0 tx=0x7fe31c010f20 comp rx=0 tx=0).stop 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 msgr2=0x5643b93b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93b6170 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5643b93afbd0 tx=0x7fe31c003380 comp rx=0 tx=0).stop 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 shutdown_connections 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1fc0346a0 0x7fe1fc036b60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/4013501662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93aee20 0x5643b93b6170 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 >> 172.21.15.169:0/4013501662 conn(0x5643b92b3e80 msgr2=0x5643b93aa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 shutdown_connections 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/4013501662 wait complete. 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe160034650 msgr2=0x7fe160036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe160034650 0x7fe160036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ae000 tx=0x7fe3180a6000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 msgr2=0x5643b93cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 0x5643b93cfe10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe31401bfd0 tx=0x7fe314048e00 comp rx=0 tx=0).stop 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 shutdown_connections 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe160034650 0x7fe160036b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2912258820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b93cf9f0 0x5643b93cfe10 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 >> 172.21.15.169:0/2912258820 conn(0x5643b93c4a60 msgr2=0x5643b93c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 shutdown_connections 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2912258820 wait complete. 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5643b93d53a0 msgr2=0x5643b93d77f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5643b93d53a0 0x5643b93d77f0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe20c034650 msgr2=0x7fe20c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe20c034650 0x7fe20c036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe314048f30 tx=0x7fe31400ef70 comp rx=0 tx=0).stop 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 msgr2=0x5643b93a2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b93a2090 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe314000fe0 tx=0x7fe314000ee0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 shutdown_connections 2024-09-13T06:31:08.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5643b93d53a0 0x5643b93d77f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe20c034650 0x7fe20c036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 --2- 172.21.15.169:0/2966571703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5643b9222380 0x5643b93a2090 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 >> 172.21.15.169:0/2966571703 conn(0x5643b92a8050 msgr2=0x5643b93954b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 shutdown_connections 2024-09-13T06:31:08.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.689+0000 7fe327153980 1 -- 172.21.15.169:0/2966571703 wait complete. 2024-09-13T06:31:08.702 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"8744f35f-8918-4410-a77e-3a3ac7b40446","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T06:31:08.702 DEBUG:tasks.util.rgw: json result: {'id': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T06:31:08.702 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T06:31:08.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T06:31:08.703 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T06:31:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb88680980 1 Processor -- start 2024-09-13T06:31:08.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb88680980 1 -- start start 2024-09-13T06:31:08.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb88680980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x563029939ab0 0x5630299c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb88680980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56302984dae0 con 0x5630299c88a0 2024-09-13T06:31:08.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb88680980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x563029871e30 con 0x563029939ab0 2024-09-13T06:31:08.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb86190640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x563029939ab0 0x5630299c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb86190640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x563029939ab0 0x5630299c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45848/0 (socket says 172.21.15.169:45848) 2024-09-13T06:31:08.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb8598f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5630299c88a0 0x5630299cac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48046/0 (socket says 172.21.15.169:48046) 2024-09-13T06:31:08.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb86190640 1 -- 172.21.15.169:0/3075403041 learned_addr learned my addr 172.21.15.169:0/3075403041 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb86190640 1 -- 172.21.15.169:0/3075403041 >> v1:172.21.15.112:6789/0 conn(0x5630299c88a0 legacy=0x5630299cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.773+0000 7fcb86190640 1 -- 172.21.15.169:0/3075403041 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630299cd3c0 con 0x563029939ab0 2024-09-13T06:31:08.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb86190640 1 --2- 172.21.15.169:0/3075403041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c8360 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800a5c0 tx=0x7fcb7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fd0dc1a732c12b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb8518e640 1 -- 172.21.15.169:0/3075403041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780a6070 con 0x563029939ab0 2024-09-13T06:31:08.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb8518e640 1 -- 172.21.15.169:0/3075403041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb780af070 con 0x563029939ab0 2024-09-13T06:31:08.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb8518e640 1 -- 172.21.15.169:0/3075403041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780aa5c0 con 0x563029939ab0 2024-09-13T06:31:08.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 -- 172.21.15.169:0/3075403041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 msgr2=0x5630299c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 --2- 172.21.15.169:0/3075403041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c8360 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800a5c0 tx=0x7fcb7801b340 comp rx=0 tx=0).stop 2024-09-13T06:31:08.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 -- 172.21.15.169:0/3075403041 shutdown_connections 2024-09-13T06:31:08.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 --2- 172.21.15.169:0/3075403041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c8360 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 -- 172.21.15.169:0/3075403041 >> 172.21.15.169:0/3075403041 conn(0x5630299c0050 msgr2=0x5630299c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 -- 172.21.15.169:0/3075403041 shutdown_connections 2024-09-13T06:31:08.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.777+0000 7fcb88680980 1 -- 172.21.15.169:0/3075403041 wait complete. 2024-09-13T06:31:08.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb88680980 1 Processor -- start 2024-09-13T06:31:08.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb88680980 1 -- start start 2024-09-13T06:31:08.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb88680980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb88680980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563029873200 con 0x563029939ab0 2024-09-13T06:31:08.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb86190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb86190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45858/0 (socket says 172.21.15.169:45858) 2024-09-13T06:31:08.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb86190640 1 -- 172.21.15.169:0/2926443493 learned_addr learned my addr 172.21.15.169:0/2926443493 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.793+0000 7fcb86190640 1 -- 172.21.15.169:0/2926443493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630299c6090 con 0x563029939ab0 2024-09-13T06:31:08.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb86190640 1 --2- 172.21.15.169:0/2926443493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c5ac0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcb780199f0 tx=0x7fcb78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a361d33d4961fb69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fca74608640 1 -- 172.21.15.169:0/2926443493 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780aaa00 con 0x563029939ab0 2024-09-13T06:31:08.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fca74608640 1 -- 172.21.15.169:0/2926443493 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb780aaba0 con 0x563029939ab0 2024-09-13T06:31:08.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fca74608640 1 -- 172.21.15.169:0/2926443493 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780bd3f0 con 0x563029939ab0 2024-09-13T06:31:08.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2926443493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 msgr2=0x5630299c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 --2- 172.21.15.169:0/2926443493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c5ac0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcb780199f0 tx=0x7fcb78003030 comp rx=0 tx=0).stop 2024-09-13T06:31:08.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2926443493 shutdown_connections 2024-09-13T06:31:08.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 --2- 172.21.15.169:0/2926443493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x5630299c5ac0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2926443493 >> 172.21.15.169:0/2926443493 conn(0x5630299c0050 msgr2=0x563029aac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2926443493 shutdown_connections 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2926443493 wait complete. 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 Processor -- start 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- start start 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x563029ab9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5630299cce00 con 0x563029939ab0 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb86190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x563029ab9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb86190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x563029ab9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45870/0 (socket says 172.21.15.169:45870) 2024-09-13T06:31:08.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb86190640 1 -- 172.21.15.169:0/2613316268 learned_addr learned my addr 172.21.15.169:0/2613316268 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb86190640 1 -- 172.21.15.169:0/2613316268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563029aba3d0 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb86190640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x563029ab9e90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcb780199f0 tx=0x7fcb780180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fca72e05640 1 -- 172.21.15.169:0/2613316268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780bd7c0 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fca72e05640 1 -- 172.21.15.169:0/2613316268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb780bd960 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563029aba660 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fca72e05640 1 -- 172.21.15.169:0/2613316268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780bdc40 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.797+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563029abd340 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 Processor -- start 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- start start 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ac7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5630298cc800 con 0x563029ac6c50 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fca72e05640 1 -- 172.21.15.169:0/2613316268 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb780ce020 con 0x563029939ab0 2024-09-13T06:31:08.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ac7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fca72e05640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca6c034650 0x7fca6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ac7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45880/0 (socket says 172.21.15.169:45880) 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fca72e05640 1 -- 172.21.15.169:0/2613316268 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fcb780cc020 con 0x563029939ab0 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 -- 172.21.15.169:0/265447405 learned_addr learned my addr 172.21.15.169:0/265447405 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86190640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca6c034650 0x7fca6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86190640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca6c034650 0x7fca6c036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcb780bdf50 tx=0x7fcb780bdde0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 -- 172.21.15.169:0/265447405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563029ac7590 con 0x563029ac6c50 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 --2- 172.21.15.169:0/265447405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ac7050 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000a430 tx=0x7fcb8000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d605067eefca49bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fca70e01640 1 -- 172.21.15.169:0/265447405 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb8000f6e0 con 0x563029ac6c50 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fca70e01640 1 -- 172.21.15.169:0/265447405 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb80015070 con 0x563029ac6c50 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fca70e01640 1 -- 172.21.15.169:0/265447405 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb8000fa10 con 0x563029ac6c50 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- 172.21.15.169:0/265447405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 msgr2=0x563029ac7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 --2- 172.21.15.169:0/265447405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ac7050 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000a430 tx=0x7fcb8000a8f0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- 172.21.15.169:0/265447405 shutdown_connections 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 --2- 172.21.15.169:0/265447405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ac7050 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- 172.21.15.169:0/265447405 >> 172.21.15.169:0/265447405 conn(0x5630299c88a0 msgr2=0x563029ac2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- 172.21.15.169:0/265447405 shutdown_connections 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- 172.21.15.169:0/265447405 wait complete. 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 Processor -- start 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- start start 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ace070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb88680980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563029ac7f70 con 0x563029ac6c50 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ace070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ace070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45882/0 (socket says 172.21.15.169:45882) 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.801+0000 7fcb86991640 1 -- 172.21.15.169:0/3156048982 learned_addr learned my addr 172.21.15.169:0/3156048982 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb86991640 1 -- 172.21.15.169:0/3156048982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563029ace5b0 con 0x563029ac6c50 2024-09-13T06:31:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb86991640 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ace070 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x563029ac7a00 tx=0x7fcb80003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fca6affd640 1 -- 172.21.15.169:0/3156048982 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb8000fe00 con 0x563029ac6c50 2024-09-13T06:31:08.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563029ace840 con 0x563029ac6c50 2024-09-13T06:31:08.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fca6affd640 1 -- 172.21.15.169:0/3156048982 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb80010a20 con 0x563029ac6c50 2024-09-13T06:31:08.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fca6affd640 1 -- 172.21.15.169:0/3156048982 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb80010dc0 con 0x563029ac6c50 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563029ad1520 con 0x563029ac6c50 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fca6affd640 1 -- 172.21.15.169:0/3156048982 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb8001a480 con 0x563029ac6c50 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fca6affd640 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca60034650 0x7fca60036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fca6affd640 1 -- 172.21.15.169:0/3156048982 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fcb8004a3e0 con 0x563029ac6c50 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb8598f640 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca60034650 0x7fca60036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:08.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb8598f640 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca60034650 0x7fca60036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c000f70 tx=0x7fcb7c001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 1 Processor -- start 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 1 -- start start 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 0x563029ae7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.805+0000 7fcb88680980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5630299c41f0 con 0x563029ae7810 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 0x563029ae7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 0x563029ae7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45896/0 (socket says 172.21.15.169:45896) 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86190640 1 -- 172.21.15.169:0/802696517 learned_addr learned my addr 172.21.15.169:0/802696517 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86190640 1 -- 172.21.15.169:0/802696517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563029ae8200 con 0x563029ae7810 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86190640 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 0x563029ae7c30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcb780c1040 tx=0x7fcb780bc750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca4afe5640 1 -- 172.21.15.169:0/802696517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780df070 con 0x563029ae7810 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca4afe5640 1 -- 172.21.15.169:0/802696517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb780bc3a0 con 0x563029ae7810 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca4afe5640 1 -- 172.21.15.169:0/802696517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb780e3310 con 0x563029ae7810 2024-09-13T06:31:08.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563029aeae80 con 0x563029ae7810 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563029aeb230 con 0x563029ae7810 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca4afe5640 1 -- 172.21.15.169:0/802696517 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb780e34b0 con 0x563029ae7810 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca4afe5640 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc9c8034650 0x7fc9c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca4afe5640 1 -- 172.21.15.169:0/802696517 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fcb780f0c30 con 0x563029ae7810 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb8598f640 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc9c8034650 0x7fc9c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb8598f640 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc9c8034650 0x7fc9c8036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001ee0 tx=0x7fcb7c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fca48fe1640 20 reqs_thread_entry: start 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x563029aed3f0 0x563029aef800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563029aefe80 con 0x563029aed3f0 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86991640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x563029aed3f0 0x563029aef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.809+0000 7fcb86991640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x563029aed3f0 0x563029aef800 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb86991640 1 -- 172.21.15.169:0/2613316268 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb8000e070 con 0x563029aed3f0 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x563029af0c40 0x563029af3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563029af36c0 con 0x563029af0c40 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb86190640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x563029af0c40 0x563029af3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb86190640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x563029af0c40 0x563029af3030 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb86190640 1 -- 172.21.15.169:0/2613316268 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb780f5020 con 0x563029af0c40 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x563029af5430 0x563029af7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:3 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563029af7ef0 con 0x563029af5430 2024-09-13T06:31:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb8598f640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x563029af5430 0x563029af7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb8598f640 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x563029af5430 0x563029af7820 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb8598f640 1 -- 172.21.15.169:0/2613316268 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(3 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb7c01e040 con 0x563029af5430 2024-09-13T06:31:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca60034650 msgr2=0x7fca60036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca60034650 0x7fca60036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c000f70 tx=0x7fcb7c001300 comp rx=0 tx=0).stop 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 msgr2=0x563029ace070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ace070 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x563029ac7a00 tx=0x7fcb80003380 comp rx=0 tx=0).stop 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 shutdown_connections 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.813+0000 7fcb88680980 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca60034650 0x7fca60036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/3156048982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ac6c50 0x563029ace070 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 >> 172.21.15.169:0/3156048982 conn(0x5630299c88a0 msgr2=0x563029ac2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 shutdown_connections 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/3156048982 wait complete. 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc9c8034650 msgr2=0x7fc9c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc9c8034650 0x7fc9c8036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001ee0 tx=0x7fcb7c00f000 comp rx=0 tx=0).stop 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 msgr2=0x563029ae7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 0x563029ae7c30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcb780c1040 tx=0x7fcb780bc750 comp rx=0 tx=0).stop 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 shutdown_connections 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc9c8034650 0x7fc9c8036b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/802696517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029ae7810 0x563029ae7c30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 >> 172.21.15.169:0/802696517 conn(0x563029adc7e0 msgr2=0x563029adf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 shutdown_connections 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/802696517 wait complete. 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x563029af0c40 msgr2=0x563029af3030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x563029af0c40 0x563029af3030 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x563029aed3f0 msgr2=0x563029aef800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x563029aed3f0 0x563029aef800 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x563029af5430 msgr2=0x563029af7820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x563029af5430 0x563029af7820 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca6c034650 msgr2=0x7fca6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fca6c034650 0x7fca6c036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcb780bdf50 tx=0x7fcb780bdde0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 msgr2=0x563029ab9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 --2- 172.21.15.169:0/2613316268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563029939ab0 0x563029ab9e90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcb780199f0 tx=0x7fcb780180e0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb86991640 1 -- 172.21.15.169:0/2613316268 reap_dead start 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 shutdown_connections 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 >> 172.21.15.169:0/2613316268 conn(0x5630299c0050 msgr2=0x5630299c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 shutdown_connections 2024-09-13T06:31:08.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.817+0000 7fcb88680980 1 -- 172.21.15.169:0/2613316268 wait complete. 2024-09-13T06:31:08.831 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"7fd9ecda-6337-4ce7-ac46-f04193654c7b","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"8744f35f-8918-4410-a77e-3a3ac7b40446","zones":[{"id":"8744f35f-8918-4410-a77e-3a3ac7b40446","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T06:31:08.832 DEBUG:tasks.util.rgw: json result: {'id': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'zones': [{'id': '8744f35f-8918-4410-a77e-3a3ac7b40446', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T06:31:08.835 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T06:31:08.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T06:31:08.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T06:31:08.862 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T06:31:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:08.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.913+0000 7f6a3d90b980 1 Processor -- start 2024-09-13T06:31:08.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.913+0000 7f6a3d90b980 1 -- start start 2024-09-13T06:31:08.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.913+0000 7f6a3d90b980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5599f0e07510 0x5599f0e078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.913+0000 7f6a3d90b980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5599f0c90ae0 con 0x5599f0e07e60 2024-09-13T06:31:08.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.913+0000 7f6a3d90b980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5599f0cb4e30 con 0x5599f0e07510 2024-09-13T06:31:08.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3b41b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5599f0e07510 0x5599f0e078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3b41b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5599f0e07510 0x5599f0e078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45900/0 (socket says 172.21.15.169:45900) 2024-09-13T06:31:08.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3b41b640 1 -- 172.21.15.169:0/1129299167 learned_addr learned my addr 172.21.15.169:0/1129299167 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3ac1a640 1 --1- 172.21.15.169:0/1129299167 >> v1:172.21.15.112:6789/0 conn(0x5599f0e07e60 0x5599f0e0c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48060/0 (socket says 172.21.15.169:48060) 2024-09-13T06:31:08.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3b41b640 1 -- 172.21.15.169:0/1129299167 >> v1:172.21.15.112:6789/0 conn(0x5599f0e07e60 legacy=0x5599f0e0c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3b41b640 1 -- 172.21.15.169:0/1129299167 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f0e0f0e0 con 0x5599f0e07510 2024-09-13T06:31:08.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.917+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/1129299167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0e078f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00a5c0 tx=0x7f6a2c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77cac1e361fd3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3a419640 1 -- 172.21.15.169:0/1129299167 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0a6070 con 0x5599f0e07510 2024-09-13T06:31:08.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3a419640 1 -- 172.21.15.169:0/1129299167 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0af070 con 0x5599f0e07510 2024-09-13T06:31:08.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3a419640 1 -- 172.21.15.169:0/1129299167 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0aa5c0 con 0x5599f0e07510 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1129299167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 msgr2=0x5599f0e078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/1129299167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0e078f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00a5c0 tx=0x7f6a2c01b340 comp rx=0 tx=0).stop 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1129299167 shutdown_connections 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/1129299167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0e078f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1129299167 >> 172.21.15.169:0/1129299167 conn(0x5599f0e03030 msgr2=0x5599f0e05450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1129299167 shutdown_connections 2024-09-13T06:31:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.921+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1129299167 wait complete. 2024-09-13T06:31:08.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.933+0000 7f6a3d90b980 1 Processor -- start 2024-09-13T06:31:08.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.933+0000 7f6a3d90b980 1 -- start start 2024-09-13T06:31:08.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.933+0000 7f6a3d90b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0ef5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.933+0000 7f6a3d90b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5599f0cb6200 con 0x5599f0e07510 2024-09-13T06:31:08.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0ef5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0ef5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45912/0 (socket says 172.21.15.169:45912) 2024-09-13T06:31:08.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2914442672 learned_addr learned my addr 172.21.15.169:0/2914442672 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2914442672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f0ef62d0 con 0x5599f0e07510 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/2914442672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0ef5d00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00a5c0 tx=0x7f6a2c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2973ac54ac9fbbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f692960a640 1 -- 172.21.15.169:0/2914442672 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0aa9b0 con 0x5599f0e07510 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f692960a640 1 -- 172.21.15.169:0/2914442672 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0aab50 con 0x5599f0e07510 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f692960a640 1 -- 172.21.15.169:0/2914442672 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0aae50 con 0x5599f0e07510 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2914442672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 msgr2=0x5599f0ef5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2914442672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0ef5d00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00a5c0 tx=0x7f6a2c003030 comp rx=0 tx=0).stop 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2914442672 shutdown_connections 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2914442672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0ef5d00 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2914442672 >> 172.21.15.169:0/2914442672 conn(0x5599f0e03030 msgr2=0x5599f0eed520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2914442672 shutdown_connections 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2914442672 wait complete. 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 Processor -- start 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- start start 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0efcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3d90b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5599f0e0eb20 con 0x5599f0e07510 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0efcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0efcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45922/0 (socket says 172.21.15.169:45922) 2024-09-13T06:31:08.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 -- 172.21.15.169:0/3568863584 learned_addr learned my addr 172.21.15.169:0/3568863584 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.937+0000 7f6a3b41b640 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f0efd480 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0efcf40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c01bbe0 tx=0x7f6a2c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6927e07640 1 -- 172.21.15.169:0/3568863584 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0c6750 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599f0efd710 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6927e07640 1 -- 172.21.15.169:0/3568863584 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0c68f0 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6927e07640 1 -- 172.21.15.169:0/3568863584 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0c6c10 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f0f003f0 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6927e07640 1 -- 172.21.15.169:0/3568863584 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a2c0ce020 con 0x5599f0e07510 2024-09-13T06:31:08.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6927e07640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6920034650 0x7f6920036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6927e07640 1 -- 172.21.15.169:0/3568863584 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f6a2c0cc020 con 0x5599f0e07510 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6920034650 0x7f6920036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0e07e60 0x5599f0f03ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f044f0 con 0x5599f0e07e60 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3bc1c640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0e07e60 0x5599f0f03ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6920034650 0x7f6920036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a30000f70 tx=0x7f6a30001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3bc1c640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0e07e60 0x5599f0f03ed0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/3568863584 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0e07e60 2024-09-13T06:31:08.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f052e0 0x5599f0f076d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f07d10 con 0x5599f0f052e0 2024-09-13T06:31:08.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.941+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f052e0 0x5599f0f076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f052e0 0x5599f0f076d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 -- 172.21.15.169:0/3568863584 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a2c0e5050 con 0x5599f0f052e0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f095c0 con 0x5599f0f052e0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 -- 172.21.15.169:0/3568863584 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a2c0e5050 con 0x5599f0f052e0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f087f0 con 0x5599f0f052e0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 -- 172.21.15.169:0/3568863584 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a2c0e5050 con 0x5599f0f052e0 2024-09-13T06:31:08.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f0a970 0x5599f0f0cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f0d2a0 con 0x5599f0f0a970 2024-09-13T06:31:08.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f0a970 0x5599f0f0cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f0a970 0x5599f0f0cd60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/3568863584 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a3000f6a0 con 0x5599f0f0a970 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 Processor -- start 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 -- start start 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 0x5599f0f1b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3d90b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5599f0d0f800 con 0x5599f0f1ad30 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 0x5599f0f1b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 0x5599f0f1b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45938/0 (socket says 172.21.15.169:45938) 2024-09-13T06:31:08.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.945+0000 7f6a3b41b640 1 -- 172.21.15.169:0/1604665040 learned_addr learned my addr 172.21.15.169:0/1604665040 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3b41b640 1 -- 172.21.15.169:0/1604665040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f0f1b690 con 0x5599f0f1ad30 2024-09-13T06:31:08.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 0x5599f0f1b150 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0d0520 tx=0x7f6a2c0bd4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6925602640 1 -- 172.21.15.169:0/1604665040 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0bc3a0 con 0x5599f0f1ad30 2024-09-13T06:31:08.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6925602640 1 -- 172.21.15.169:0/1604665040 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0bc540 con 0x5599f0f1ad30 2024-09-13T06:31:08.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599f0f1b920 con 0x5599f0f1ad30 2024-09-13T06:31:08.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6925602640 1 -- 172.21.15.169:0/1604665040 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0d2c90 con 0x5599f0f1ad30 2024-09-13T06:31:08.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f0f1e5a0 con 0x5599f0f1ad30 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6925602640 1 -- 172.21.15.169:0/1604665040 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a2c0cfb60 con 0x5599f0f1ad30 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6925602640 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f69140346a0 0x7f6914036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6925602640 1 -- 172.21.15.169:0/1604665040 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f6a2c0efc70 con 0x5599f0f1ad30 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f69140346a0 0x7f6914036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3d90b980 1 Processor -- start 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3d90b980 1 -- start start 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f69140346a0 0x7f6914036b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x5599f0f0d6a0 tx=0x7f6a3000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3d90b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f27a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3d90b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5599f0ef6590 con 0x5599f0f276a0 2024-09-13T06:31:08.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f27a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f27a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45946/0 (socket says 172.21.15.169:45946) 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.949+0000 7f6a3b41b640 1 -- 172.21.15.169:0/65871803 learned_addr learned my addr 172.21.15.169:0/65871803 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 -- 172.21.15.169:0/65871803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f0f28050 con 0x5599f0f276a0 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/65871803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f27a80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0c5a50 tx=0x7f6a2c0e3b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39be22d6fccad5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f691effd640 1 -- 172.21.15.169:0/65871803 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0f3030 con 0x5599f0f276a0 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f691effd640 1 -- 172.21.15.169:0/65871803 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0cceb0 con 0x5599f0f276a0 2024-09-13T06:31:08.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f691effd640 1 -- 172.21.15.169:0/65871803 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c006810 con 0x5599f0f276a0 2024-09-13T06:31:08.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/65871803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 msgr2=0x5599f0f27a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:08.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/65871803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f27a80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0c5a50 tx=0x7f6a2c0e3b20 comp rx=0 tx=0).stop 2024-09-13T06:31:08.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/65871803 shutdown_connections 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/65871803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f27a80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/65871803 >> 172.21.15.169:0/65871803 conn(0x5599f0f23a80 msgr2=0x5599f0f21b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/65871803 shutdown_connections 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/65871803 wait complete. 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 Processor -- start 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- start start 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f2e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5599f0f284f0 con 0x5599f0f276a0 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f2e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45952/0 (socket says 172.21.15.169:45952) 2024-09-13T06:31:08.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 learned_addr learned my addr 172.21.15.169:0/2520667855 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:08.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f0f2ed90 con 0x5599f0f276a0 2024-09-13T06:31:08.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f2e850 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c006be0 tx=0x7f6a2c0c6e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f691d7fa640 1 -- 172.21.15.169:0/2520667855 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0c0ea0 con 0x5599f0f276a0 2024-09-13T06:31:08.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f691d7fa640 1 -- 172.21.15.169:0/2520667855 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0d2060 con 0x5599f0f276a0 2024-09-13T06:31:08.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f691d7fa640 1 -- 172.21.15.169:0/2520667855 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c0e35c0 con 0x5599f0f276a0 2024-09-13T06:31:08.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599f0f2ed90 con 0x5599f0f276a0 2024-09-13T06:31:08.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.953+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f0f2ed90 con 0x5599f0f276a0 2024-09-13T06:31:08.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f691d7fa640 1 -- 172.21.15.169:0/2520667855 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a2c0c1ad0 con 0x5599f0f276a0 2024-09-13T06:31:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f691d7fa640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6904034650 0x7f6904036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f691d7fa640 1 -- 172.21.15.169:0/2520667855 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f6a2c0ff030 con 0x5599f0f276a0 2024-09-13T06:31:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6904034650 0x7f6904036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0f397a0 0x5599f0f3bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f3c3b0 con 0x5599f0f397a0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3bc1c640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0f397a0 0x5599f0f3bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6904034650 0x7f6904036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c010 tx=0x7f6a30010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3bc1c640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0f397a0 0x5599f0f3bc60 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 realm 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f38bd0 con 0x5599f0f397a0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f3ce80 con 0x5599f0f397a0 2024-09-13T06:31:08.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f3dc60 0x5599f0f40050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f406e0 con 0x5599f0f3dc60 2024-09-13T06:31:08.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f3dc60 0x5599f0f40050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.957+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f3dc60 0x5599f0f40050 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a2c0e5050 con 0x5599f0f3dc60 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f40f30 con 0x5599f0f3dc60 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a2c0e5050 con 0x5599f0f3dc60 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 20 searching for the correct realm 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f42ca0 0x5599f0f45090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f42ca0 0x5599f0f45090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3ac1a640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f42ca0 0x5599f0f45090 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a2c0e5050 con 0x5599f0f3dc60 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3b41b640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a2c009040 0x7f6a2c0da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x7f6a2c009040 2024-09-13T06:31:08.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3bc1c640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a2c009040 0x7f6a2c0da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3bc1c640 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a2c009040 0x7f6a2c0da3d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.961+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x7f6a2c009040 2024-09-13T06:31:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x7f6a2c009040 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.965+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x7f6a2c009040 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x7f6a2c009040 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.969+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x7f6a2c009040 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f42ca0 2024-09-13T06:31:08.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f45710 con 0x5599f0f3dc60 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:08.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f418e0 con 0x5599f0f397a0 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.973+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f41520 con 0x5599f0f3dc60 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f42200 con 0x5599f0f42ca0 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 zone default found 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 4 Realm: () 2024-09-13T06:31:08.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 zonegroup default 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f46040 con 0x7f6a2c009040 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f47dc0 con 0x5599f0f42ca0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:08.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f482e0 con 0x5599f0f42ca0 2024-09-13T06:31:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 started sync module instance, tier type = 2024-09-13T06:31:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.977+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f47260 con 0x5599f0f3dc60 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94119660910464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f47260 con 0x5599f0f3dc60 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f48da0 con 0x5599f0f397a0 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94119660914864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f49640 con 0x5599f0f397a0 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4a080 con 0x5599f0f3dc60 2024-09-13T06:31:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94119660910464] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.981+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94119660914864] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94119660919632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f49190 con 0x5599f0f3dc60 2024-09-13T06:31:08.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4a920 con 0x7f6a2c009040 2024-09-13T06:31:08.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94119660921968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f49190 con 0x7f6a2c009040 2024-09-13T06:31:08.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4b3e0 con 0x5599f0f3dc60 2024-09-13T06:31:08.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94119660921968] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94119660919632] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94119660907952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4b3a0 con 0x5599f0f3dc60 2024-09-13T06:31:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.985+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4b7d0 con 0x5599f0f42ca0 2024-09-13T06:31:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94119660923024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4c070 con 0x5599f0f42ca0 2024-09-13T06:31:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4ca30 con 0x5599f0f42ca0 2024-09-13T06:31:08.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94119660907952] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:08.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94119660923024] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94119660930432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4ce20 con 0x5599f0f42ca0 2024-09-13T06:31:08.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.989+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4d670 con 0x7f6a2c009040 2024-09-13T06:31:08.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94119660930432] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:08.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94119660932640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4d6f0 con 0x7f6a2c009040 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=0 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=1 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=2 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=3 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=4 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=5 2024-09-13T06:31:08.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=6 2024-09-13T06:31:08.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94119660932640] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:08.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 20 add_watcher() i=7 2024-09-13T06:31:08.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:08.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f509f0 con 0x5599f0f397a0 2024-09-13T06:31:08.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:08.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.993+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94119660934064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4dc80 con 0x5599f0f397a0 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94119660934064] v35'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f68f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 5 note: GC not initialized 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f68f0fe1640 20 reqs_thread_entry: start 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 Filter name: none 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f686a7fc640 20 reqs_thread_entry: start 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:09.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f74160 con 0x5599f0f397a0 2024-09-13T06:31:09.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T06:31:09.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:09.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f72900 con 0x5599f0f397a0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f732c0 con 0x5599f0f397a0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v35'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:09.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:09.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94119661088032 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f77c80 con 0x5599f0f3dc60 2024-09-13T06:31:09.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94119660907952 notify 150323855403 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5599f0f1b920 con 0x5599f0f3dc60 2024-09-13T06:31:09.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f691effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855403 cookie 94119660907952 notifier 4827 bl.length()=649 2024-09-13T06:31:09.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f691effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:09.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f691effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:09.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:08.997+0000 7f691effd640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6900003eb0 con 0x5599f0f3dc60 2024-09-13T06:31:09.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.4 [notify cookie 94119661088032 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94119661088032 notify 150323855403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5599f0f1b690 con 0x5599f0f3dc60 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f72d20 con 0x5599f0f397a0 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v35'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3d90b980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3d90b980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3d90b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T06:31:09.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94119661087904 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f780b0 con 0x5599f0f3dc60 2024-09-13T06:31:09.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== watch-notify(notify (1) cookie 94119660919632 notify 150323855404 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f6a2c130040 con 0x5599f0f3dc60 2024-09-13T06:31:09.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f691e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855404 cookie 94119660919632 notifier 4827 bl.length()=177 2024-09-13T06:31:09.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f691e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T06:31:09.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f691e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T06:31:09.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f691e7fc640 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6870003410 con 0x5599f0f3dc60 2024-09-13T06:31:09.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(68 notify.2 [notify cookie 94119661087904 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.001+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== watch-notify(notify_complete (2) cookie 94119661087904 notify 150323855404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5599f0f1b690 con 0x5599f0f3dc60 2024-09-13T06:31:09.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.005+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.008 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:09.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.005+0000 7f68f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.005+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94119660934064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f71f00 con 0x5599f0f397a0 2024-09-13T06:31:09.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.005+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94119660934064] v35'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.005+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94119660910464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f71f00 con 0x5599f0f3dc60 2024-09-13T06:31:09.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94119660910464] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3d90b980 20 remove_watcher() i=0 2024-09-13T06:31:09.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3d90b980 2 removed watcher, disabling cache 2024-09-13T06:31:09.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94119660914864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f71f00 con 0x5599f0f397a0 2024-09-13T06:31:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94119660914864] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x5599f0f397a0 2024-09-13T06:31:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3d90b980 20 remove_watcher() i=1 2024-09-13T06:31:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.009+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94119660919632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f71f00 con 0x5599f0f3dc60 2024-09-13T06:31:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94119660919632] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3d90b980 20 remove_watcher() i=2 2024-09-13T06:31:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94119660921968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f49b50 con 0x7f6a2c009040 2024-09-13T06:31:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94119660921968] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3d90b980 20 remove_watcher() i=3 2024-09-13T06:31:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94119660907952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f71f00 con 0x5599f0f3dc60 2024-09-13T06:31:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3b41b640 1 -- 172.21.15.169:0/2520667855 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94119660907952] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c126040 con 0x5599f0f3dc60 2024-09-13T06:31:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3d90b980 20 remove_watcher() i=4 2024-09-13T06:31:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.013+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94119660923024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f4a470 con 0x5599f0f42ca0 2024-09-13T06:31:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94119660923024] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 20 remove_watcher() i=5 2024-09-13T06:31:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94119660930432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f46db0 con 0x5599f0f42ca0 2024-09-13T06:31:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3ac1a640 1 -- 172.21.15.169:0/2520667855 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94119660930432] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a30037040 con 0x5599f0f42ca0 2024-09-13T06:31:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 20 remove_watcher() i=6 2024-09-13T06:31:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94119660932640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5599f0f71f00 con 0x7f6a2c009040 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94119660932640] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a3400a4d0 con 0x7f6a2c009040 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 20 remove_watcher() i=7 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f3dc60 msgr2=0x5599f0f40050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f3dc60 0x5599f0f40050 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0f397a0 msgr2=0x5599f0f3bc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0f397a0 0x5599f0f3bc60 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a2c009040 msgr2=0x7f6a2c0da3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f6a2c009040 0x7f6a2c0da3d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f42ca0 msgr2=0x5599f0f45090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f42ca0 0x5599f0f45090 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6904034650 msgr2=0x7f6904036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.017+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6904034650 0x7f6904036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c010 tx=0x7f6a30010000 comp rx=0 tx=0).stop 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 msgr2=0x5599f0f2e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/2520667855 reap_dead start 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f2e850 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c006be0 tx=0x7f6a2c0c6e50 comp rx=0 tx=0).stop 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 shutdown_connections 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/2520667855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f276a0 0x5599f0f2e850 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 >> 172.21.15.169:0/2520667855 conn(0x5599f0f23a80 msgr2=0x5599f0f21b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 shutdown_connections 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/2520667855 wait complete. 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f69140346a0 msgr2=0x7f6914036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f69140346a0 0x7f6914036b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x5599f0f0d6a0 tx=0x7f6a3000f000 comp rx=0 tx=0).stop 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 msgr2=0x5599f0f1b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 0x5599f0f1b150 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0d0520 tx=0x7f6a2c0bd4b0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 shutdown_connections 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f69140346a0 0x7f6914036b60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/1604665040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0f1ad30 0x5599f0f1b150 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 >> 172.21.15.169:0/1604665040 conn(0x5599f0f0fe80 msgr2=0x5599f0f12900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 shutdown_connections 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/1604665040 wait complete. 2024-09-13T06:31:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f052e0 msgr2=0x5599f0f076d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5599f0f052e0 0x5599f0f076d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0e07e60 msgr2=0x5599f0f03ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5599f0e07e60 0x5599f0f03ed0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f0a970 msgr2=0x5599f0f0cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5599f0f0a970 0x5599f0f0cd60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6920034650 msgr2=0x7f6920036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6920034650 0x7f6920036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a30000f70 tx=0x7f6a30001380 comp rx=0 tx=0).stop 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 msgr2=0x5599f0efcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 --2- 172.21.15.169:0/3568863584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5599f0e07510 0x5599f0efcf40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c01bbe0 tx=0x7f6a2c0180e0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3bc1c640 1 -- 172.21.15.169:0/3568863584 reap_dead start 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 shutdown_connections 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 >> 172.21.15.169:0/3568863584 conn(0x5599f0e03030 msgr2=0x5599f0eec0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 shutdown_connections 2024-09-13T06:31:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.021+0000 7f6a3d90b980 1 -- 172.21.15.169:0/3568863584 wait complete. 2024-09-13T06:31:09.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:09.035 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:09.035 ERROR:root:0 2024-09-13T06:31:09.037 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:09.052 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000001c89be7b3c4aa11f-0066e3dc2d-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:31:09.053 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T06:31:09.099 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:09.099 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T06:31:09.136 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T06:31:09.136 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T06:31:09.179 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T06:31:09.180 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T06:31:09.223 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T06:31:09.223 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:09.236 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:09.237 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T06:31:09.250 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:09.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:09.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:09.251 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T06:31:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7dd7a5980 1 Processor -- start 2024-09-13T06:31:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7dd7a5980 1 -- start start 2024-09-13T06:31:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7dd7a5980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558f0db80880 0x558f0db82ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7dd7a5980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f0da06ae0 con 0x558f0daf32e0 2024-09-13T06:31:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7dd7a5980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x558f0da2ae30 con 0x558f0db80880 2024-09-13T06:31:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7daab4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558f0db80880 0x558f0db82ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7daab4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x558f0db80880 0x558f0db82ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45966/0 (socket says 172.21.15.169:45966) 2024-09-13T06:31:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7db2b5640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x558f0daf32e0 0x558f0db7f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48072/0 (socket says 172.21.15.169:48072) 2024-09-13T06:31:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7daab4640 1 -- 172.21.15.169:0/3468554527 learned_addr learned my addr 172.21.15.169:0/3468554527 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7daab4640 1 -- 172.21.15.169:0/3468554527 >> v1:172.21.15.112:6789/0 conn(0x558f0daf32e0 legacy=0x558f0db7f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.289+0000 7fd7daab4640 1 -- 172.21.15.169:0/3468554527 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0db831e0 con 0x558f0db80880 2024-09-13T06:31:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7daab4640 1 --2- 172.21.15.169:0/3468554527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0db80880 0x558f0db82ca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000a5c0 tx=0x7fd7d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35eb98f5258d729 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7da2b3640 1 -- 172.21.15.169:0/3468554527 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00af070 con 0x558f0db80880 2024-09-13T06:31:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7da2b3640 1 -- 172.21.15.169:0/3468554527 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d00aa530 con 0x558f0db80880 2024-09-13T06:31:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7da2b3640 1 -- 172.21.15.169:0/3468554527 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00aa830 con 0x558f0db80880 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3468554527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0db80880 msgr2=0x558f0db82ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/3468554527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0db80880 0x558f0db82ca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000a5c0 tx=0x7fd7d001b340 comp rx=0 tx=0).stop 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3468554527 shutdown_connections 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/3468554527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0db80880 0x558f0db82ca0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3468554527 >> 172.21.15.169:0/3468554527 conn(0x558f0db790a0 msgr2=0x558f0db7b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3468554527 shutdown_connections 2024-09-13T06:31:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.293+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3468554527 wait complete. 2024-09-13T06:31:09.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7dd7a5980 1 Processor -- start 2024-09-13T06:31:09.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7dd7a5980 1 -- start start 2024-09-13T06:31:09.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7dd7a5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc70460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7dd7a5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558f0da2c200 con 0x558f0daf32e0 2024-09-13T06:31:09.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc70460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc70460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45982/0 (socket says 172.21.15.169:45982) 2024-09-13T06:31:09.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7db2b5640 1 -- 172.21.15.169:0/2797792613 learned_addr learned my addr 172.21.15.169:0/2797792613 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7db2b5640 1 -- 172.21.15.169:0/2797792613 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0dc70a30 con 0x558f0daf32e0 2024-09-13T06:31:09.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/2797792613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc70460 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0015f0 tx=0x7fd7cc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d634f29f83792cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd6c960a640 1 -- 172.21.15.169:0/2797792613 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc013420 con 0x558f0daf32e0 2024-09-13T06:31:09.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd6c960a640 1 -- 172.21.15.169:0/2797792613 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc0135e0 con 0x558f0daf32e0 2024-09-13T06:31:09.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.309+0000 7fd6c960a640 1 -- 172.21.15.169:0/2797792613 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc013940 con 0x558f0daf32e0 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/2797792613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 msgr2=0x558f0dc70460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/2797792613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc70460 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0015f0 tx=0x7fd7cc001ab0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/2797792613 shutdown_connections 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/2797792613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc70460 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/2797792613 >> 172.21.15.169:0/2797792613 conn(0x558f0db790a0 msgr2=0x558f0dc6c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/2797792613 shutdown_connections 2024-09-13T06:31:09.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/2797792613 wait complete. 2024-09-13T06:31:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 Processor -- start 2024-09-13T06:31:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- start start 2024-09-13T06:31:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc777d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558f0db8ea10 con 0x558f0daf32e0 2024-09-13T06:31:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc777d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45988/0 (socket says 172.21.15.169:45988) 2024-09-13T06:31:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7db2b5640 1 -- 172.21.15.169:0/959214548 learned_addr learned my addr 172.21.15.169:0/959214548 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7db2b5640 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0dc77d10 con 0x558f0daf32e0 2024-09-13T06:31:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc777d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc006640 tx=0x7fd7cc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd6c7e07640 1 -- 172.21.15.169:0/959214548 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc022020 con 0x558f0daf32e0 2024-09-13T06:31:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd6c7e07640 1 -- 172.21.15.169:0/959214548 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc006320 con 0x558f0daf32e0 2024-09-13T06:31:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f0dc77fa0 con 0x558f0daf32e0 2024-09-13T06:31:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd6c7e07640 1 -- 172.21.15.169:0/959214548 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc004af0 con 0x558f0daf32e0 2024-09-13T06:31:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.313+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0dc7ac80 con 0x558f0daf32e0 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd6c7e07640 1 -- 172.21.15.169:0/959214548 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7cc025020 con 0x558f0daf32e0 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd6c7e07640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6c00346a0 0x7fd6c0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd6c7e07640 1 -- 172.21.15.169:0/959214548 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd7cc018030 con 0x558f0daf32e0 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7daab4640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6c00346a0 0x7fd6c0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0db80880 0x558f0dc7e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dc7ee10 con 0x558f0db80880 2024-09-13T06:31:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dbab6640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0db80880 0x558f0dc7e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7daab4640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6c00346a0 0x7fd6c0036b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ac000 tx=0x7fd7d00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dbab6640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0db80880 0x558f0dc7e7a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dbab6640 1 -- 172.21.15.169:0/959214548 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0db80880 2024-09-13T06:31:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dc7fbe0 0x558f0dc81fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dc82610 con 0x558f0dc7fbe0 2024-09-13T06:31:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dc7fbe0 0x558f0dc81fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dc7fbe0 0x558f0dc81fd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7db2b5640 1 -- 172.21.15.169:0/959214548 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7cc01b070 con 0x558f0dc7fbe0 2024-09-13T06:31:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.317+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dc83ec0 con 0x558f0dc7fbe0 2024-09-13T06:31:09.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 -- 172.21.15.169:0/959214548 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd7cc01b070 con 0x558f0dc7fbe0 2024-09-13T06:31:09.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dc83030 con 0x558f0dc7fbe0 2024-09-13T06:31:09.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 -- 172.21.15.169:0/959214548 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7cc01b070 con 0x558f0dc7fbe0 2024-09-13T06:31:09.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dc85270 0x558f0dc87660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dc87ba0 con 0x558f0dc85270 2024-09-13T06:31:09.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7daab4640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dc85270 0x558f0dc87660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7daab4640 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dc85270 0x558f0dc87660 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7daab4640 1 -- 172.21.15.169:0/959214548 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7d00b2040 con 0x558f0dc85270 2024-09-13T06:31:09.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 Processor -- start 2024-09-13T06:31:09.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 -- start start 2024-09-13T06:31:09.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 0x558f0dc95970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558f0da85800 con 0x558f0dc95550 2024-09-13T06:31:09.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 0x558f0dc95970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 0x558f0dc95970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45992/0 (socket says 172.21.15.169:45992) 2024-09-13T06:31:09.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 -- 172.21.15.169:0/3807131976 learned_addr learned my addr 172.21.15.169:0/3807131976 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 -- 172.21.15.169:0/3807131976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0dc95eb0 con 0x558f0dc95550 2024-09-13T06:31:09.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 0x558f0dc95970 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc048470 tx=0x7fd7cc005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd6c5602640 1 -- 172.21.15.169:0/3807131976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc01d950 con 0x558f0dc95550 2024-09-13T06:31:09.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd6c5602640 1 -- 172.21.15.169:0/3807131976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc01daf0 con 0x558f0dc95550 2024-09-13T06:31:09.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f0dc96140 con 0x558f0dc95550 2024-09-13T06:31:09.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.321+0000 7fd6c5602640 1 -- 172.21.15.169:0/3807131976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc01ddd0 con 0x558f0dc95550 2024-09-13T06:31:09.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0dc98dc0 con 0x558f0dc95550 2024-09-13T06:31:09.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd6c5602640 1 -- 172.21.15.169:0/3807131976 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7cc046040 con 0x558f0dc95550 2024-09-13T06:31:09.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd6c5602640 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6b4034650 0x7fd6b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd6c5602640 1 -- 172.21.15.169:0/3807131976 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd7cc0350b0 con 0x558f0dc95550 2024-09-13T06:31:09.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7daab4640 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6b4034650 0x7fd6b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 Processor -- start 2024-09-13T06:31:09.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 -- start start 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7daab4640 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6b4034650 0x7fd6b4036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x558f0dc7bdc0 tx=0x7fd7d0005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558f0dc70db0 con 0x558f0dca2020 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:45996/0 (socket says 172.21.15.169:45996) 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1543506495 learned_addr learned my addr 172.21.15.169:0/1543506495 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1543506495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0dca29d0 con 0x558f0dca2020 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/1543506495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca2400 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc004d30 tx=0x7fd7cc0419d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5582476de2374e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd6beffd640 1 -- 172.21.15.169:0/1543506495 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc048d50 con 0x558f0dca2020 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd6beffd640 1 -- 172.21.15.169:0/1543506495 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc05f030 con 0x558f0dca2020 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd6beffd640 1 -- 172.21.15.169:0/1543506495 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc02ae30 con 0x558f0dca2020 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1543506495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 msgr2=0x558f0dca2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.325+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1543506495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca2400 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc004d30 tx=0x7fd7cc0419d0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1543506495 shutdown_connections 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1543506495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca2400 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1543506495 >> 172.21.15.169:0/1543506495 conn(0x558f0dc9e350 msgr2=0x558f0dc9c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1543506495 shutdown_connections 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1543506495 wait complete. 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 Processor -- start 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- start start 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558f0dca2ee0 con 0x558f0dca2020 2024-09-13T06:31:09.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7db2b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46012/0 (socket says 172.21.15.169:46012) 2024-09-13T06:31:09.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 learned_addr learned my addr 172.21.15.169:0/1999241809 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0dca9640 con 0x558f0dca2020 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca9100 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc03e7b0 tx=0x7fd7cc019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd6bd7fa640 1 -- 172.21.15.169:0/1999241809 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc072070 con 0x558f0dca2020 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd6bd7fa640 1 -- 172.21.15.169:0/1999241809 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc048e20 con 0x558f0dca2020 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd6bd7fa640 1 -- 172.21.15.169:0/1999241809 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc041f80 con 0x558f0dca2020 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f0dca9640 con 0x558f0dca2020 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0dca9ab0 con 0x558f0dca2020 2024-09-13T06:31:09.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd6bd7fa640 1 -- 172.21.15.169:0/1999241809 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7cc075070 con 0x558f0dca2020 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd6bd7fa640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6a4034600 0x7fd6a4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd6bd7fa640 1 -- 172.21.15.169:0/1999241809 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd7cc06a070 con 0x558f0dca2020 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7daab4640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6a4034600 0x7fd6a4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0dcb4280 0x558f0dcb6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcb6e90 con 0x558f0dcb4280 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.329+0000 7fd7dbab6640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0dcb4280 0x558f0dcb6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7daab4640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6a4034600 0x7fd6a4036ac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x558f0dc83e00 tx=0x7fd7d00b8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dbab6640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0dcb4280 0x558f0dcb6740 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 realm 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcb36b0 con 0x558f0dcb4280 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcb7920 con 0x558f0dcb4280 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dcb8700 0x558f0dcbaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbb180 con 0x558f0dcb8700 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dcb8700 0x558f0dcbaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dcb8700 0x558f0dcbaaf0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbb6c0 con 0x558f0dcb8700 2024-09-13T06:31:09.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:09.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 20 searching for the correct realm 2024-09-13T06:31:09.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dcbcea0 0x558f0dcbf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbfa30 con 0x558f0dcbcea0 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7daab4640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dcbcea0 0x558f0dcbf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.333+0000 7fd7daab4640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dcbcea0 0x558f0dcbf360 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbfa30 con 0x558f0dcb8700 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7db2b5640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd7cc077060 0x7fd7cc042af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x7fd7cc077060 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd7cc077060 0x7fd7cc042af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd7cc077060 0x7fd7cc042af0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcbcea0 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.337+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x7fd7cc077060 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x7fd7cc077060 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcbcea0 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcbcea0 2024-09-13T06:31:09.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.341+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcbcea0 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x7fd7cc077060 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb4280 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x7fd7cc077060 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcbcea0 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x7fd7cc077060 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.345+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcbcea0 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd7cc06d070 con 0x558f0dcb8700 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbb2d0 con 0x558f0dcb4280 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbb6c0 con 0x558f0dcb8700 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbb6c0 con 0x558f0dcbcea0 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 zone default found 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 4 Realm: () 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:09.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 zonegroup default 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbfeb0 con 0x7fd7cc077060 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.349+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcbbba0 con 0x558f0dcbcea0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc2130 con 0x558f0dcbcea0 2024-09-13T06:31:09.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 20 started sync module instance, tier type = 2024-09-13T06:31:09.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:09.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc1570 con 0x558f0dcb8700 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072900164288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc1570 con 0x558f0dcb8700 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.353+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc2c10 con 0x558f0dcb4280 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072900167424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc34b0 con 0x558f0dcb4280 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc3ed0 con 0x558f0dcb8700 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072900164288] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072900167424] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072900172224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc3000 con 0x558f0dcb8700 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc4770 con 0x7fd7cc077060 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072900174528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc3000 con 0x7fd7cc077060 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.357+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc5210 con 0x558f0dcb8700 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072900172224] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072900174528] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072900175584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc51d0 con 0x558f0dcb8700 2024-09-13T06:31:09.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc5640 con 0x558f0dcbcea0 2024-09-13T06:31:09.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072900161728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc5ee0 con 0x558f0dcbcea0 2024-09-13T06:31:09.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc68a0 con 0x558f0dcbcea0 2024-09-13T06:31:09.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.361+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072900175584] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072900161728] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072900177152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc68a0 con 0x558f0dcbcea0 2024-09-13T06:31:09.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc7140 con 0x7fd7cc077060 2024-09-13T06:31:09.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072900185232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc70b0 con 0x7fd7cc077060 2024-09-13T06:31:09.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=0 2024-09-13T06:31:09.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=1 2024-09-13T06:31:09.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=2 2024-09-13T06:31:09.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=3 2024-09-13T06:31:09.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=4 2024-09-13T06:31:09.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=5 2024-09-13T06:31:09.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072900177152] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=6 2024-09-13T06:31:09.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072900185232] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 20 add_watcher() i=7 2024-09-13T06:31:09.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:09.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc63f0 con 0x558f0dcb4280 2024-09-13T06:31:09.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.365+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072900183024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc7b90 con 0x558f0dcb4280 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072900183024] v35'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 5 note: GC not initialized 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd690fe1640 20 reqs_thread_entry: start 2024-09-13T06:31:09.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 20 Filter name: none 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd60a7fc640 20 reqs_thread_entry: start 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcedcf0 con 0x558f0dcb4280 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:09.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.369+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcf4610 con 0x558f0dcb4280 2024-09-13T06:31:09.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7dd7a5980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7dd7a5980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7dd7a5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94072900370560 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcefd00 con 0x558f0dcb8700 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94072900175584 notify 150323855406 ret 0) ==== 678+0+0 (crc 0 0 0) 0x558f0dc96140 con 0x558f0dcb8700 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd6beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855406 cookie 94072900175584 notifier 4834 bl.length()=636 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd6beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd6beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd6beffd640 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd6a0003eb0 con 0x558f0dcb8700 2024-09-13T06:31:09.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94072900370560 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify_complete (2) cookie 94072900370560 notify 150323855406 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558f0dc95eb0 con 0x558f0dcb8700 2024-09-13T06:31:09.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.378 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:09.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.373+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072900183024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcebaf0 con 0x558f0dcb4280 2024-09-13T06:31:09.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.377+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94072900183024] v35'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.377+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072900164288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcebaf0 con 0x558f0dcb8700 2024-09-13T06:31:09.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94072900164288] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7dd7a5980 20 remove_watcher() i=0 2024-09-13T06:31:09.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7dd7a5980 2 removed watcher, disabling cache 2024-09-13T06:31:09.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072900167424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcebaf0 con 0x558f0dcb4280 2024-09-13T06:31:09.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94072900167424] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x558f0dcb4280 2024-09-13T06:31:09.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7dd7a5980 20 remove_watcher() i=1 2024-09-13T06:31:09.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072900172224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcebaf0 con 0x558f0dcb8700 2024-09-13T06:31:09.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.381+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94072900172224] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dd7a5980 20 remove_watcher() i=2 2024-09-13T06:31:09.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072900174528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc39c0 con 0x7fd7cc077060 2024-09-13T06:31:09.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94072900174528] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dd7a5980 20 remove_watcher() i=3 2024-09-13T06:31:09.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072900175584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcebaf0 con 0x558f0dcb8700 2024-09-13T06:31:09.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7db2b5640 1 -- 172.21.15.169:0/1999241809 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94072900175584] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc074030 con 0x558f0dcb8700 2024-09-13T06:31:09.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dd7a5980 20 remove_watcher() i=4 2024-09-13T06:31:09.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.385+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072900161728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc39c0 con 0x558f0dcbcea0 2024-09-13T06:31:09.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94072900161728] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 20 remove_watcher() i=5 2024-09-13T06:31:09.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072900177152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc4740 con 0x558f0dcbcea0 2024-09-13T06:31:09.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7daab4640 1 -- 172.21.15.169:0/1999241809 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94072900177152] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d00d7070 con 0x558f0dcbcea0 2024-09-13T06:31:09.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 20 remove_watcher() i=6 2024-09-13T06:31:09.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072900185232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558f0dcc4720 con 0x7fd7cc077060 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94072900185232] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7d40083f0 con 0x7fd7cc077060 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 20 remove_watcher() i=7 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dcb8700 msgr2=0x558f0dcbaaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dcb8700 0x558f0dcbaaf0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0dcb4280 msgr2=0x558f0dcb6740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0dcb4280 0x558f0dcb6740 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd7cc077060 msgr2=0x7fd7cc042af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd7cc077060 0x7fd7cc042af0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dcbcea0 msgr2=0x558f0dcbf360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dcbcea0 0x558f0dcbf360 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6a4034600 msgr2=0x7fd6a4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.389+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6a4034600 0x7fd6a4036ac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x558f0dc83e00 tx=0x7fd7d00b8040 comp rx=0 tx=0).stop 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dbab6640 1 -- 172.21.15.169:0/1999241809 reap_dead start 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 msgr2=0x558f0dca9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca9100 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc03e7b0 tx=0x7fd7cc019f30 comp rx=0 tx=0).stop 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 shutdown_connections 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/1999241809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dca2020 0x558f0dca9100 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 >> 172.21.15.169:0/1999241809 conn(0x558f0dc9e350 msgr2=0x558f0dc9c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 shutdown_connections 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/1999241809 wait complete. 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6b4034650 msgr2=0x7fd6b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6b4034650 0x7fd6b4036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x558f0dc7bdc0 tx=0x7fd7d0005ad0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 msgr2=0x558f0dc95970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 0x558f0dc95970 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc048470 tx=0x7fd7cc005130 comp rx=0 tx=0).stop 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 shutdown_connections 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6b4034650 0x7fd6b4036b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/3807131976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0dc95550 0x558f0dc95970 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 >> 172.21.15.169:0/3807131976 conn(0x558f0dc8a6a0 msgr2=0x558f0dc8d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 shutdown_connections 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/3807131976 wait complete. 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dc7fbe0 msgr2=0x558f0dc81fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x558f0dc7fbe0 0x558f0dc81fd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0db80880 msgr2=0x558f0dc7e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x558f0db80880 0x558f0dc7e7a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dc85270 msgr2=0x558f0dc87660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x558f0dc85270 0x558f0dc87660 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6c00346a0 msgr2=0x7fd6c0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd6c00346a0 0x7fd6c0036b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ac000 tx=0x7fd7d00a5000 comp rx=0 tx=0).stop 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 msgr2=0x558f0dc777d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 --2- 172.21.15.169:0/959214548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f0daf32e0 0x558f0dc777d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc006640 tx=0x7fd7cc000f50 comp rx=0 tx=0).stop 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dbab6640 1 -- 172.21.15.169:0/959214548 reap_dead start 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 shutdown_connections 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 >> 172.21.15.169:0/959214548 conn(0x558f0db790a0 msgr2=0x558f0dc6ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 shutdown_connections 2024-09-13T06:31:09.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.393+0000 7fd7dd7a5980 1 -- 172.21.15.169:0/959214548 wait complete. 2024-09-13T06:31:09.407 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:09.407 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:09.407 ERROR:root:0 2024-09-13T06:31:09.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T06:31:09.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T06:31:09.408 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T06:31:09.496 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:09.496 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:09.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6fdd9980 1 Processor -- start 2024-09-13T06:31:09.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6fdd9980 1 -- start start 2024-09-13T06:31:09.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6fdd9980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557ec42cda30 0x557ec42cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6fdd9980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557ec4151ae0 con 0x557ec423da60 2024-09-13T06:31:09.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6fdd9980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x557ec4175e30 con 0x557ec42cda30 2024-09-13T06:31:09.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6d0e8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557ec42cda30 0x557ec42cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6d0e8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x557ec42cda30 0x557ec42cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46020/0 (socket says 172.21.15.169:46020) 2024-09-13T06:31:09.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/1880829409 learned_addr learned my addr 172.21.15.169:0/1880829409 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6d8e9640 1 --1- 172.21.15.169:0/1880829409 >> v1:172.21.15.112:6789/0 conn(0x557ec423da60 0x557ec42cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48082/0 (socket says 172.21.15.169:48082) 2024-09-13T06:31:09.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/1880829409 >> v1:172.21.15.112:6789/0 conn(0x557ec423da60 legacy=0x557ec42cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.493+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/1880829409 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec42d1370 con 0x557ec42cda30 2024-09-13T06:31:09.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/1880829409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42cda30 0x557ec42cfe20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800a4e0 tx=0x7f2c5801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ae493101d69485 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6c8e7640 1 -- 172.21.15.169:0/1880829409 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c580aa540 con 0x557ec42cda30 2024-09-13T06:31:09.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6c8e7640 1 -- 172.21.15.169:0/1880829409 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c580aa6e0 con 0x557ec42cda30 2024-09-13T06:31:09.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6c8e7640 1 -- 172.21.15.169:0/1880829409 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c580aaa40 con 0x557ec42cda30 2024-09-13T06:31:09.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1880829409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42cda30 msgr2=0x557ec42cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1880829409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42cda30 0x557ec42cfe20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800a4e0 tx=0x7f2c5801b090 comp rx=0 tx=0).stop 2024-09-13T06:31:09.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1880829409 shutdown_connections 2024-09-13T06:31:09.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1880829409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42cda30 0x557ec42cfe20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1880829409 >> 172.21.15.169:0/1880829409 conn(0x557ec42c4000 msgr2=0x557ec42c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1880829409 shutdown_connections 2024-09-13T06:31:09.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.497+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1880829409 wait complete. 2024-09-13T06:31:09.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 Processor -- start 2024-09-13T06:31:09.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- start start 2024-09-13T06:31:09.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557ec4177200 con 0x557ec423da60 2024-09-13T06:31:09.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46034/0 (socket says 172.21.15.169:46034) 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2678468520 learned_addr learned my addr 172.21.15.169:0/2678468520 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2678468520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec43b5030 con 0x557ec423da60 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/2678468520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43b4a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000b240 tx=0x7f2c6000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb293267ceb6e94c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2b5be07640 1 -- 172.21.15.169:0/2678468520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6000e700 con 0x557ec423da60 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2b5be07640 1 -- 172.21.15.169:0/2678468520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6000e8a0 con 0x557ec423da60 2024-09-13T06:31:09.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2b5be07640 1 -- 172.21.15.169:0/2678468520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6000eb80 con 0x557ec423da60 2024-09-13T06:31:09.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2678468520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 msgr2=0x557ec43b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2678468520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43b4a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000b240 tx=0x7f2c6000b700 comp rx=0 tx=0).stop 2024-09-13T06:31:09.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2678468520 shutdown_connections 2024-09-13T06:31:09.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2678468520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43b4a60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2678468520 >> 172.21.15.169:0/2678468520 conn(0x557ec42c4000 msgr2=0x557ec43b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2678468520 shutdown_connections 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.513+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2678468520 wait complete. 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 Processor -- start 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 -- start start 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557ec42d0db0 con 0x557ec423da60 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46036/0 (socket says 172.21.15.169:46036) 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1572377339 learned_addr learned my addr 172.21.15.169:0/1572377339 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec43bc330 con 0x557ec423da60 2024-09-13T06:31:09.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43bbdf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2c60000fe0 tx=0x7f2c60000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2b5a604640 1 -- 172.21.15.169:0/1572377339 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6000f9c0 con 0x557ec423da60 2024-09-13T06:31:09.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ec43bc5c0 con 0x557ec423da60 2024-09-13T06:31:09.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2b5a604640 1 -- 172.21.15.169:0/1572377339 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6000fb80 con 0x557ec423da60 2024-09-13T06:31:09.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2b5a604640 1 -- 172.21.15.169:0/1572377339 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6001a480 con 0x557ec423da60 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec43bf2a0 con 0x557ec423da60 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2b5a604640 1 -- 172.21.15.169:0/1572377339 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2c60017070 con 0x557ec423da60 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2b5a604640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b54034650 0x7f2b54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2b5a604640 1 -- 172.21.15.169:0/1572377339 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f2c60015020 con 0x557ec423da60 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b54034650 0x7f2b54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec42cda30 0x557ec43c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43c3430 con 0x557ec42cda30 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6e0ea640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec42cda30 0x557ec43c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.517+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b54034650 0x7f2b54036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2c580ab000 tx=0x7f2c580a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6e0ea640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec42cda30 0x557ec43c2ef0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/1572377339 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec42cda30 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43c4210 0x557ec43c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43c6c10 con 0x557ec43c4210 2024-09-13T06:31:09.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43c4210 0x557ec43c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43c4210 0x557ec43c6600 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1572377339 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c6002e070 con 0x557ec43c4210 2024-09-13T06:31:09.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43c8470 con 0x557ec43c4210 2024-09-13T06:31:09.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1572377339 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c6002e070 con 0x557ec43c4210 2024-09-13T06:31:09.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43c76a0 con 0x557ec43c4210 2024-09-13T06:31:09.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1572377339 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c6002e070 con 0x557ec43c4210 2024-09-13T06:31:09.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec43c9820 0x557ec43cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43cc150 con 0x557ec43c9820 2024-09-13T06:31:09.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.521+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec43c9820 0x557ec43cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec43c9820 0x557ec43cbc10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/1572377339 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c580bc040 con 0x557ec43c9820 2024-09-13T06:31:09.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6fdd9980 1 Processor -- start 2024-09-13T06:31:09.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6fdd9980 1 -- start start 2024-09-13T06:31:09.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6fdd9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 0x557ec42c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6fdd9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557ec41d0800 con 0x557ec42c9c90 2024-09-13T06:31:09.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 0x557ec42c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 0x557ec42c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46046/0 (socket says 172.21.15.169:46046) 2024-09-13T06:31:09.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2928138454 learned_addr learned my addr 172.21.15.169:0/2928138454 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2928138454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec42ca0b0 con 0x557ec42c9c90 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 0x557ec42c8310 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2c600178c0 tx=0x7f2c60017f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2b537fe640 1 -- 172.21.15.169:0/2928138454 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6004f070 con 0x557ec42c9c90 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2b537fe640 1 -- 172.21.15.169:0/2928138454 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6001aab0 con 0x557ec42c9c90 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ec42c88b0 con 0x557ec42c9c90 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2b537fe640 1 -- 172.21.15.169:0/2928138454 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6002c040 con 0x557ec42c9c90 2024-09-13T06:31:09.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.525+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec42c88b0 con 0x557ec42c9c90 2024-09-13T06:31:09.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2b537fe640 1 -- 172.21.15.169:0/2928138454 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2c60052070 con 0x557ec42c9c90 2024-09-13T06:31:09.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2b537fe640 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b480346a0 0x7f2b48036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2b537fe640 1 -- 172.21.15.169:0/2928138454 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f2c6003d040 con 0x557ec42c9c90 2024-09-13T06:31:09.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b480346a0 0x7f2b48036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 Processor -- start 2024-09-13T06:31:09.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- start start 2024-09-13T06:31:09.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43e8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557ec43b53b0 con 0x557ec43e8440 2024-09-13T06:31:09.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b480346a0 0x7f2b48036b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2c580aa6b0 tx=0x7f2c58005e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43e8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43e8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46056/0 (socket says 172.21.15.169:46056) 2024-09-13T06:31:09.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1357760826 learned_addr learned my addr 172.21.15.169:0/1357760826 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/1357760826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec43e8df0 con 0x557ec43e8440 2024-09-13T06:31:09.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/1357760826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43e8820 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2c6004a010 tx=0x7f2c60004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74d669757e29ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2b517fa640 1 -- 172.21.15.169:0/1357760826 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60067070 con 0x557ec43e8440 2024-09-13T06:31:09.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2b517fa640 1 -- 172.21.15.169:0/1357760826 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c600429e0 con 0x557ec43e8440 2024-09-13T06:31:09.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2b517fa640 1 -- 172.21.15.169:0/1357760826 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60031450 con 0x557ec43e8440 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1357760826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 msgr2=0x557ec43e8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1357760826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43e8820 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2c6004a010 tx=0x7f2c60004510 comp rx=0 tx=0).stop 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1357760826 shutdown_connections 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1357760826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43e8820 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1357760826 >> 172.21.15.169:0/1357760826 conn(0x557ec43e4820 msgr2=0x557ec43e2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1357760826 shutdown_connections 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1357760826 wait complete. 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 Processor -- start 2024-09-13T06:31:09.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- start start 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6fdd9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557ec43e9290 con 0x557ec43e8440 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.529+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6d8e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46058/0 (socket says 172.21.15.169:46058) 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 learned_addr learned my addr 172.21.15.169:0/2275139996 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec43efbf0 con 0x557ec43e8440 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43ef6b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2c6004ab40 tx=0x7f2c60051ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2b3f7fe640 1 -- 172.21.15.169:0/2275139996 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60072020 con 0x557ec43e8440 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ec43efbf0 con 0x557ec43e8440 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2b3f7fe640 1 -- 172.21.15.169:0/2275139996 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6001bde0 con 0x557ec43e8440 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2b3f7fe640 1 -- 172.21.15.169:0/2275139996 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60067030 con 0x557ec43e8440 2024-09-13T06:31:09.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec43efbf0 con 0x557ec43e8440 2024-09-13T06:31:09.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2b3f7fe640 1 -- 172.21.15.169:0/2275139996 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2c60075020 con 0x557ec43e8440 2024-09-13T06:31:09.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2b3f7fe640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b380346a0 0x7f2b38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2b3f7fe640 1 -- 172.21.15.169:0/2275139996 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f2c60068070 con 0x557ec43e8440 2024-09-13T06:31:09.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b380346a0 0x7f2b38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec43fa6f0 0x557ec43fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43fd300 con 0x557ec43fa6f0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6e0ea640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec43fa6f0 0x557ec43fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b380346a0 0x7f2b38036b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2c58017ca0 tx=0x7f2c580a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6e0ea640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec43fa6f0 0x557ec43fcbb0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 20 realm 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43f9b20 con 0x557ec43fa6f0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.533+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec43fdd90 con 0x557ec43fa6f0 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43feb70 0x557ec4400f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec44015f0 con 0x557ec43feb70 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43feb70 0x557ec4400f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43feb70 0x557ec4400f60 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4401e40 con 0x557ec43feb70 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 20 searching for the correct realm 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec4403bb0 0x557ec4405fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec4403bb0 0x557ec4405fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d0e8640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec4403bb0 0x557ec4405fa0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.537+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2c60077020 0x7f2c60037920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x7f2c60077020 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2c60077020 0x7f2c60037920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2c60077020 0x7f2c60037920 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x7f2c60077020 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.541+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x7f2c60077020 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x7f2c60077020 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.545+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x7f2c60077020 2024-09-13T06:31:09.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x7f2c60077020 2024-09-13T06:31:09.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec4403bb0 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557ec4406620 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.549+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec44027c0 con 0x557ec43fa6f0 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4402400 con 0x557ec43feb70 2024-09-13T06:31:09.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4402410 con 0x557ec4403bb0 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 zone default found 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 4 Realm: () 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 zonegroup default 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4403300 con 0x7f2c60077020 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4408e60 con 0x557ec4403bb0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409200 con 0x557ec4403bb0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 started sync module instance, tier type = 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:09.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.553+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec44082a0 con 0x557ec43feb70 2024-09-13T06:31:09.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002946803616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec44082a0 con 0x557ec43feb70 2024-09-13T06:31:09.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409bc0 con 0x557ec43fa6f0 2024-09-13T06:31:09.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002946807568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440a410 con 0x557ec43fa6f0 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440ae10 con 0x557ec43feb70 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002946803616] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.557+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002946807568] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002946801136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409f60 con 0x557ec43feb70 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440b6b0 con 0x7f2c60077020 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002946814464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409f60 con 0x7f2c60077020 2024-09-13T06:31:09.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440c180 con 0x557ec43feb70 2024-09-13T06:31:09.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002946801136] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002946814464] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.561+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002946815520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440a920 con 0x557ec43feb70 2024-09-13T06:31:09.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440c5f0 con 0x557ec4403bb0 2024-09-13T06:31:09.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002946818368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440ce90 con 0x557ec4403bb0 2024-09-13T06:31:09.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440d890 con 0x557ec4403bb0 2024-09-13T06:31:09.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002946815520] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002946818368] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002946817136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440dc80 con 0x557ec4403bb0 2024-09-13T06:31:09.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.565+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440e4d0 con 0x7f2c60077020 2024-09-13T06:31:09.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002946817136] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002946826272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440e440 con 0x7f2c60077020 2024-09-13T06:31:09.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=0 2024-09-13T06:31:09.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=1 2024-09-13T06:31:09.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=2 2024-09-13T06:31:09.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=3 2024-09-13T06:31:09.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=4 2024-09-13T06:31:09.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=5 2024-09-13T06:31:09.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=6 2024-09-13T06:31:09.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002946826272] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 20 add_watcher() i=7 2024-09-13T06:31:09.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:09.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4411da0 con 0x557ec43fa6f0 2024-09-13T06:31:09.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002946828400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440f220 con 0x557ec43fa6f0 2024-09-13T06:31:09.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.569+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002946828400] v35'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2b1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:09.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:09.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 5 note: GC not initialized 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2b1e7fc640 20 reqs_thread_entry: start 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 Filter name: none 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2a8ffff640 20 reqs_thread_entry: start 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4435460 con 0x557ec4403bb0 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4433c00 con 0x557ec4403bb0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T06:31:09.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.573+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec44344a0 con 0x557ec4403bb0 2024-09-13T06:31:09.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v35'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6fdd9980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T06:31:09.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6fdd9980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:31:09.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6fdd9980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T06:31:09.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94002946981872 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4438f00 con 0x557ec43feb70 2024-09-13T06:31:09.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94002946803616 notify 150323855407 ret 0) ==== 575+0+0 (crc 0 0 0) 0x557ec42ca0b0 con 0x557ec43feb70 2024-09-13T06:31:09.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2b517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855407 cookie 94002946803616 notifier 4841 bl.length()=533 2024-09-13T06:31:09.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2b517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T06:31:09.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2b517fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:31:09.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2b517fa640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2b30003eb0 con 0x557ec43feb70 2024-09-13T06:31:09.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(65 notify.0 [notify cookie 94002946981872 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94002946981872 notify 150323855407 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557ec43bf2a0 con 0x557ec43feb70 2024-09-13T06:31:09.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.577+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4433ff0 con 0x557ec4403bb0 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v35'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6fdd9980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6fdd9980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6fdd9980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94002946981760 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557ec4438f00 con 0x557ec43fa6f0 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== watch-notify(notify (1) cookie 94002946807568 notify 150323855362 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f2c6802a7e0 con 0x557ec43fa6f0 2024-09-13T06:31:09.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2b50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94002946807568 notifier 4841 bl.length()=176 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2b50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2b50ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(68 notify.1 [notify cookie 94002946981760 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2b50ff9640 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2a98003410 con 0x557ec43fa6f0 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== watch-notify(notify_complete (2) cookie 94002946981760 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2c6802aa80 con 0x557ec43fa6f0 2024-09-13T06:31:09.585 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T06:31:09.578396Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.578374Z","tags":[],"group_ids":[]} 2024-09-13T06:31:09.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2b1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.581+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002946828400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4433260 con 0x557ec43fa6f0 2024-09-13T06:31:09.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94002946828400] v35'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002946803616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4433260 con 0x557ec43feb70 2024-09-13T06:31:09.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94002946803616] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6fdd9980 20 remove_watcher() i=0 2024-09-13T06:31:09.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6fdd9980 2 removed watcher, disabling cache 2024-09-13T06:31:09.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002946807568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec44087a0 con 0x557ec43fa6f0 2024-09-13T06:31:09.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94002946807568] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x557ec43fa6f0 2024-09-13T06:31:09.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6fdd9980 20 remove_watcher() i=1 2024-09-13T06:31:09.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.585+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002946801136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4433260 con 0x557ec43feb70 2024-09-13T06:31:09.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.589+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94002946801136] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.589+0000 7f2c6fdd9980 20 remove_watcher() i=2 2024-09-13T06:31:09.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.589+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002946814464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409710 con 0x7f2c60077020 2024-09-13T06:31:09.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.589+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94002946814464] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.589+0000 7f2c6fdd9980 20 remove_watcher() i=3 2024-09-13T06:31:09.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.589+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002946815520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440b200 con 0x557ec43feb70 2024-09-13T06:31:09.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6d8e9640 1 -- 172.21.15.169:0/2275139996 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94002946815520] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60051030 con 0x557ec43feb70 2024-09-13T06:31:09.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6fdd9980 20 remove_watcher() i=4 2024-09-13T06:31:09.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002946818368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409710 con 0x557ec4403bb0 2024-09-13T06:31:09.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94002946818368] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6fdd9980 20 remove_watcher() i=5 2024-09-13T06:31:09.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002946817136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec4409710 con 0x557ec4403bb0 2024-09-13T06:31:09.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6d0e8640 1 -- 172.21.15.169:0/2275139996 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94002946817136] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c580ca070 con 0x557ec4403bb0 2024-09-13T06:31:09.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6fdd9980 20 remove_watcher() i=6 2024-09-13T06:31:09.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.593+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002946826272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557ec440bc70 con 0x7f2c60077020 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94002946826272] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c680083f0 con 0x7f2c60077020 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 20 remove_watcher() i=7 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43feb70 msgr2=0x557ec4400f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43feb70 0x557ec4400f60 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec43fa6f0 msgr2=0x557ec43fcbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec43fa6f0 0x557ec43fcbb0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2c60077020 msgr2=0x7f2c60037920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f2c60077020 0x7f2c60037920 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec4403bb0 msgr2=0x557ec4405fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec4403bb0 0x557ec4405fa0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b380346a0 msgr2=0x7f2b38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b380346a0 0x7f2b38036b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2c58017ca0 tx=0x7f2c580a6000 comp rx=0 tx=0).stop 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 msgr2=0x557ec43ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2275139996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec43e8440 0x557ec43ef6b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2c6004ab40 tx=0x7f2c60051ee0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/2275139996 reap_dead start 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 shutdown_connections 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 >> 172.21.15.169:0/2275139996 conn(0x557ec43e4820 msgr2=0x557ec43e28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 shutdown_connections 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2275139996 wait complete. 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b480346a0 msgr2=0x7f2b48036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b480346a0 0x7f2b48036b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2c580aa6b0 tx=0x7f2c58005e50 comp rx=0 tx=0).stop 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 msgr2=0x557ec42c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 0x557ec42c8310 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2c600178c0 tx=0x7f2c60017f30 comp rx=0 tx=0).stop 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 shutdown_connections 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b480346a0 0x7f2b48036b60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/2928138454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec42c9c90 0x557ec42c8310 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 >> 172.21.15.169:0/2928138454 conn(0x557ec43cec60 msgr2=0x557ec43d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 shutdown_connections 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/2928138454 wait complete. 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43c4210 msgr2=0x557ec43c6600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x557ec43c4210 0x557ec43c6600 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec42cda30 msgr2=0x557ec43c2ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x557ec42cda30 0x557ec43c2ef0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec43c9820 msgr2=0x557ec43cbc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x557ec43c9820 0x557ec43cbc10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b54034650 msgr2=0x7f2b54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f2b54034650 0x7f2b54036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2c580ab000 tx=0x7f2c580a5000 comp rx=0 tx=0).stop 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 msgr2=0x557ec43bbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 --2- 172.21.15.169:0/1572377339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557ec423da60 0x557ec43bbdf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2c60000fe0 tx=0x7f2c60000ee0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6e0ea640 1 -- 172.21.15.169:0/1572377339 reap_dead start 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 shutdown_connections 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 >> 172.21.15.169:0/1572377339 conn(0x557ec42c4000 msgr2=0x557ec43af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 shutdown_connections 2024-09-13T06:31:09.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.597+0000 7f2c6fdd9980 1 -- 172.21.15.169:0/1572377339 wait complete. 2024-09-13T06:31:09.612 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T06:31:09.578396Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.578374Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:09.613 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T06:31:09.578396Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.578374Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:09.613 ERROR:root:0 2024-09-13T06:31:09.613 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:09.626 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:09.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T06:31:09.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T06:31:09.627 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T06:31:09.658 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:09.658 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed420a980 1 Processor -- start 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed420a980 1 -- start start 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed420a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5578847b6c60 0x5578847b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed420a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557884638ae0 con 0x5578847b28e0 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed420a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55788465ce30 con 0x5578847b6c60 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed1519640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5578847b6c60 0x5578847b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed1519640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5578847b6c60 0x5578847b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46072/0 (socket says 172.21.15.169:46072) 2024-09-13T06:31:09.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed1519640 1 -- 172.21.15.169:0/3044100145 learned_addr learned my addr 172.21.15.169:0/3044100145 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed1519640 1 -- 172.21.15.169:0/3044100145 >> v1:172.21.15.112:6789/0 conn(0x5578847b28e0 legacy=0x5578847b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.657+0000 7fbed1519640 1 -- 172.21.15.169:0/3044100145 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578847ba5a0 con 0x5578847b6c60 2024-09-13T06:31:09.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed1519640 1 --2- 172.21.15.169:0/3044100145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b6c60 0x5578847b9050 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00a5c0 tx=0x7fbebc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee36c44ae26b769 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed0d18640 1 -- 172.21.15.169:0/3044100145 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0a6070 con 0x5578847b6c60 2024-09-13T06:31:09.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed0d18640 1 -- 172.21.15.169:0/3044100145 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc0af070 con 0x5578847b6c60 2024-09-13T06:31:09.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed0d18640 1 -- 172.21.15.169:0/3044100145 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0aa5c0 con 0x5578847b6c60 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 -- 172.21.15.169:0/3044100145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b6c60 msgr2=0x5578847b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 --2- 172.21.15.169:0/3044100145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b6c60 0x5578847b9050 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00a5c0 tx=0x7fbebc01b340 comp rx=0 tx=0).stop 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 -- 172.21.15.169:0/3044100145 shutdown_connections 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 --2- 172.21.15.169:0/3044100145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b6c60 0x5578847b9050 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 -- 172.21.15.169:0/3044100145 >> 172.21.15.169:0/3044100145 conn(0x557884726230 msgr2=0x557884726640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 -- 172.21.15.169:0/3044100145 shutdown_connections 2024-09-13T06:31:09.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.661+0000 7fbed420a980 1 -- 172.21.15.169:0/3044100145 wait complete. 2024-09-13T06:31:09.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 Processor -- start 2024-09-13T06:31:09.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- start start 2024-09-13T06:31:09.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x55788489dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55788465e200 con 0x5578847b28e0 2024-09-13T06:31:09.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x55788489dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x55788489dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46076/0 (socket says 172.21.15.169:46076) 2024-09-13T06:31:09.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2744908993 learned_addr learned my addr 172.21.15.169:0/2744908993 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2744908993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788489e200 con 0x5578847b28e0 2024-09-13T06:31:09.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/2744908993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x55788489dc30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbec400b1f0 tx=0x7fbec400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8928ba3c7d152339 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbdbfe07640 1 -- 172.21.15.169:0/2744908993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec400a040 con 0x5578847b28e0 2024-09-13T06:31:09.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbdbfe07640 1 -- 172.21.15.169:0/2744908993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec400f750 con 0x5578847b28e0 2024-09-13T06:31:09.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbdbfe07640 1 -- 172.21.15.169:0/2744908993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec400fa70 con 0x5578847b28e0 2024-09-13T06:31:09.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- 172.21.15.169:0/2744908993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 msgr2=0x55788489dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 --2- 172.21.15.169:0/2744908993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x55788489dc30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbec400b1f0 tx=0x7fbec400b6b0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- 172.21.15.169:0/2744908993 shutdown_connections 2024-09-13T06:31:09.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 --2- 172.21.15.169:0/2744908993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x55788489dc30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- 172.21.15.169:0/2744908993 >> 172.21.15.169:0/2744908993 conn(0x557884726230 msgr2=0x557884899860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- 172.21.15.169:0/2744908993 shutdown_connections 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 -- 172.21.15.169:0/2744908993 wait complete. 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.677+0000 7fbed420a980 1 Processor -- start 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 -- start start 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x5578848a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5578847ba0a0 con 0x5578847b28e0 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x5578848a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x5578848a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46086/0 (socket says 172.21.15.169:46086) 2024-09-13T06:31:09.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1d1a640 1 -- 172.21.15.169:0/3328873745 learned_addr learned my addr 172.21.15.169:0/3328873745 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1d1a640 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578848a5500 con 0x5578847b28e0 2024-09-13T06:31:09.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x5578848a4fc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbec400b6f0 tx=0x7fbec4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbdbe604640 1 -- 172.21.15.169:0/3328873745 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4001300 con 0x5578847b28e0 2024-09-13T06:31:09.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578848a5790 con 0x5578847b28e0 2024-09-13T06:31:09.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbdbe604640 1 -- 172.21.15.169:0/3328873745 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec401c9c0 con 0x5578847b28e0 2024-09-13T06:31:09.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578848a8470 con 0x5578847b28e0 2024-09-13T06:31:09.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbdbe604640 1 -- 172.21.15.169:0/3328873745 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec401cca0 con 0x5578847b28e0 2024-09-13T06:31:09.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbdbe604640 1 -- 172.21.15.169:0/3328873745 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbec4017050 con 0x5578847b28e0 2024-09-13T06:31:09.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbdbe604640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdb8034650 0x7fbdb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbdbe604640 1 -- 172.21.15.169:0/3328873745 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fbec4015020 con 0x5578847b28e0 2024-09-13T06:31:09.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1519640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdb8034650 0x7fbdb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578847b6c60 0x5578848ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848ac640 con 0x5578847b6c60 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed251b640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578847b6c60 0x5578848ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed1519640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdb8034650 0x7fbdb8036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.681+0000 7fbed251b640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578847b6c60 0x5578848ac0c0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed251b640 1 -- 172.21.15.169:0/3328873745 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578847b6c60 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848ad410 0x5578848af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848afe30 con 0x5578848ad410 2024-09-13T06:31:09.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848ad410 0x5578848af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848ad410 0x5578848af800 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed1d1a640 1 -- 172.21.15.169:0/3328873745 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbec402e070 con 0x5578848ad410 2024-09-13T06:31:09.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848b16e0 con 0x5578848ad410 2024-09-13T06:31:09.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed1d1a640 1 -- 172.21.15.169:0/3328873745 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbec402e070 con 0x5578848ad410 2024-09-13T06:31:09.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848b0910 con 0x5578848ad410 2024-09-13T06:31:09.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed1d1a640 1 -- 172.21.15.169:0/3328873745 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbec402e070 con 0x5578848ad410 2024-09-13T06:31:09.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848b2a90 0x5578848b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848b53c0 con 0x5578848b2a90 2024-09-13T06:31:09.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.685+0000 7fbed1519640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848b2a90 0x5578848b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1519640 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848b2a90 0x5578848b4e80 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1519640 1 -- 172.21.15.169:0/3328873745 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848b2a90 2024-09-13T06:31:09.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed420a980 1 Processor -- start 2024-09-13T06:31:09.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed420a980 1 -- start start 2024-09-13T06:31:09.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed420a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 0x5578848c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed420a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5578846b7800 con 0x5578848c2e30 2024-09-13T06:31:09.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 0x5578848c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 0x5578848c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46090/0 (socket says 172.21.15.169:46090) 2024-09-13T06:31:09.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1d1a640 1 -- 172.21.15.169:0/699335221 learned_addr learned my addr 172.21.15.169:0/699335221 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1d1a640 1 -- 172.21.15.169:0/699335221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578848c3790 con 0x5578848c2e30 2024-09-13T06:31:09.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 0x5578848c3250 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbec4000c10 tx=0x7fbec402fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbdb77fe640 1 -- 172.21.15.169:0/699335221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4018cc0 con 0x5578848c2e30 2024-09-13T06:31:09.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578848c3a20 con 0x5578848c2e30 2024-09-13T06:31:09.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbdb77fe640 1 -- 172.21.15.169:0/699335221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec401a480 con 0x5578848c2e30 2024-09-13T06:31:09.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbdb77fe640 1 -- 172.21.15.169:0/699335221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4018e60 con 0x5578848c2e30 2024-09-13T06:31:09.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578848c66a0 con 0x5578848c2e30 2024-09-13T06:31:09.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbdb77fe640 1 -- 172.21.15.169:0/699335221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbec401a760 con 0x5578848c2e30 2024-09-13T06:31:09.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.689+0000 7fbdb77fe640 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdac034650 0x7fbdac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbdb77fe640 1 -- 172.21.15.169:0/699335221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fbec404bcf0 con 0x5578848c2e30 2024-09-13T06:31:09.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1519640 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdac034650 0x7fbdac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 Processor -- start 2024-09-13T06:31:09.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- start start 2024-09-13T06:31:09.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1519640 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdac034650 0x7fbdac036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbebc017f50 tx=0x7fbebc005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55788489e580 con 0x5578848cf630 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46094/0 (socket says 172.21.15.169:46094) 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 -- 172.21.15.169:0/398555501 learned_addr learned my addr 172.21.15.169:0/398555501 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 -- 172.21.15.169:0/398555501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578848d0000 con 0x5578848cf630 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/398555501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848cfa30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbec401ab10 tx=0x7fbec4045860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78369fb033833e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbdb57fa640 1 -- 172.21.15.169:0/398555501 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec40488c0 con 0x5578848cf630 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbdb57fa640 1 -- 172.21.15.169:0/398555501 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec40421f0 con 0x5578848cf630 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbdb57fa640 1 -- 172.21.15.169:0/398555501 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4048a60 con 0x5578848cf630 2024-09-13T06:31:09.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- 172.21.15.169:0/398555501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 msgr2=0x5578848cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 --2- 172.21.15.169:0/398555501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848cfa30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbec401ab10 tx=0x7fbec4045860 comp rx=0 tx=0).stop 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- 172.21.15.169:0/398555501 shutdown_connections 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 --2- 172.21.15.169:0/398555501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848cfa30 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- 172.21.15.169:0/398555501 >> 172.21.15.169:0/398555501 conn(0x5578848cb9c0 msgr2=0x5578848c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- 172.21.15.169:0/398555501 shutdown_connections 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- 172.21.15.169:0/398555501 wait complete. 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 Processor -- start 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- start start 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.699 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed420a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5578848d0550 con 0x5578848cf630 2024-09-13T06:31:09.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848d67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46102/0 (socket says 172.21.15.169:46102) 2024-09-13T06:31:09.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.693+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 learned_addr learned my addr 172.21.15.169:0/2126229082 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578848d6cf0 con 0x5578848cf630 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848d67b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbec403ef70 tx=0x7fbec4038f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbda37fe640 1 -- 172.21.15.169:0/2126229082 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4042be0 con 0x5578848cf630 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578848d6cf0 con 0x5578848cf630 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbda37fe640 1 -- 172.21.15.169:0/2126229082 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4042d80 con 0x5578848cf630 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbda37fe640 1 -- 172.21.15.169:0/2126229082 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec403e460 con 0x5578848cf630 2024-09-13T06:31:09.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578848d6cf0 con 0x5578848cf630 2024-09-13T06:31:09.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbda37fe640 1 -- 172.21.15.169:0/2126229082 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbec403e600 con 0x5578848cf630 2024-09-13T06:31:09.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbda37fe640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbd9c034650 0x7fbd9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbda37fe640 1 -- 172.21.15.169:0/2126229082 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fbec4066070 con 0x5578848cf630 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed1519640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbd9c034650 0x7fbd9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578848e18f0 0x5578848e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e4500 con 0x5578848e18f0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed251b640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578848e18f0 0x5578848e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed1519640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbd9c034650 0x7fbd9c036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbebc000c10 tx=0x7fbebc0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed251b640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578848e18f0 0x5578848e3db0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 20 realm 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e0d20 con 0x5578848e18f0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e4f90 con 0x5578848e18f0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.697+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848e5d70 0x5578848e8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e87f0 con 0x5578848e5d70 2024-09-13T06:31:09.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848e5d70 0x5578848e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848e5d70 0x5578848e8160 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbec402e070 con 0x5578848e5d70 2024-09-13T06:31:09.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbec402e070 con 0x5578848e5d70 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 20 searching for the correct realm 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848eadb0 0x5578848ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848ed850 con 0x5578848eadb0 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1519640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848eadb0 0x5578848ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1519640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848eadb0 0x5578848ed1a0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.701+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848ed850 con 0x5578848e5d70 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbec402e070 con 0x5578848e5d70 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbec4007be0 0x7fbec40198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x7fbec4007be0 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbec4007be0 0x7fbec40198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbec4007be0 0x7fbec40198c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848eadb0 2024-09-13T06:31:09.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec402e070 con 0x5578848e5d70 2024-09-13T06:31:09.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec402e070 con 0x5578848e5d70 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x7fbec4007be0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.705+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x7fbec4007be0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848eadb0 2024-09-13T06:31:09.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848eadb0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848eadb0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.709+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x7fbec4007be0 2024-09-13T06:31:09.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e18f0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x7fbec4007be0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848eadb0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x7fbec4007be0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848eadb0 2024-09-13T06:31:09.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.713+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9040 con 0x5578848e5d70 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9890 con 0x5578848e18f0 2024-09-13T06:31:09.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9c80 con 0x5578848e5d70 2024-09-13T06:31:09.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848e9c80 con 0x5578848eadb0 2024-09-13T06:31:09.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 zone default found 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 4 Realm: () 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 zonegroup default 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848edcb0 con 0x7fbec4007be0 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848ea300 con 0x5578848eadb0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848eff90 con 0x5578848eadb0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 started sync module instance, tier type = 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.717+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848ef370 con 0x5578848e5d70 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93976108398704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848ef370 con 0x5578848e5d70 2024-09-13T06:31:09.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f09f0 con 0x5578848e18f0 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93976108401984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f1290 con 0x5578848e18f0 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f1cd0 con 0x5578848e5d70 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93976108398704] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.721+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93976108401984] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93976108406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f0de0 con 0x5578848e5d70 2024-09-13T06:31:09.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f2570 con 0x7fbec4007be0 2024-09-13T06:31:09.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93976108409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f0de0 con 0x7fbec4007be0 2024-09-13T06:31:09.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f3010 con 0x5578848e5d70 2024-09-13T06:31:09.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93976108409024] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.725+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93976108406688] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93976108396224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f2fd0 con 0x5578848e5d70 2024-09-13T06:31:09.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f3400 con 0x5578848eadb0 2024-09-13T06:31:09.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93976108410080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f3ca0 con 0x5578848eadb0 2024-09-13T06:31:09.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f46a0 con 0x5578848eadb0 2024-09-13T06:31:09.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93976108396224] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93976108410080] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93976108414960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f41b0 con 0x5578848eadb0 2024-09-13T06:31:09.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.729+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f4f40 con 0x7fbec4007be0 2024-09-13T06:31:09.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93976108414960] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93976108411648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f4f40 con 0x7fbec4007be0 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=0 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=1 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=2 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=3 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=4 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=5 2024-09-13T06:31:09.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=6 2024-09-13T06:31:09.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93976108411648] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 20 add_watcher() i=7 2024-09-13T06:31:09.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:09.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848f82b0 con 0x5578848e18f0 2024-09-13T06:31:09.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.733+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93976108420096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f54d0 con 0x5578848e18f0 2024-09-13T06:31:09.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93976108420096] v35'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbd7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed420a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:09.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed420a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:09.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f7a00 con 0x5578848e5d70 2024-09-13T06:31:09.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f7b10 con 0x7fbec4007be0 2024-09-13T06:31:09.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.737+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884901540 con 0x5578848eadb0 2024-09-13T06:31:09.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.741+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.741+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578849019f0 con 0x5578848e18f0 2024-09-13T06:31:09.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.741+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.741+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578849009e0 con 0x5578848e5d70 2024-09-13T06:31:09.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.745+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.745+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578849009e0 con 0x5578848eadb0 2024-09-13T06:31:09.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.745+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.745+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578849009e0 con 0x5578848e5d70 2024-09-13T06:31:09.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.749+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.749+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902550 con 0x5578848e18f0 2024-09-13T06:31:09.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.749+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.749+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902a00 con 0x5578848e5d70 2024-09-13T06:31:09.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.753+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.753+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902a00 con 0x5578848e5d70 2024-09-13T06:31:09.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.753+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.753+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902a00 con 0x5578848e5d70 2024-09-13T06:31:09.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.757+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.757+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902a00 con 0x5578848eadb0 2024-09-13T06:31:09.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.757+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.757+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902c60 con 0x5578848e5d70 2024-09-13T06:31:09.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.761+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.761+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884902c60 con 0x5578848e18f0 2024-09-13T06:31:09.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.761+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.761+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903290 con 0x5578848e18f0 2024-09-13T06:31:09.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.761+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.761+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e5d70 2024-09-13T06:31:09.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.765+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.765+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e5d70 2024-09-13T06:31:09.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.765+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.769+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848eadb0 2024-09-13T06:31:09.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.769+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.769+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e5d70 2024-09-13T06:31:09.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.773+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.773+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e18f0 2024-09-13T06:31:09.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.773+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.773+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e5d70 2024-09-13T06:31:09.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.777+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.777+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e5d70 2024-09-13T06:31:09.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.781+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.781+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848eadb0 2024-09-13T06:31:09.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.781+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.781+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848e5d70 2024-09-13T06:31:09.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.781+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.785+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903230 con 0x5578848eadb0 2024-09-13T06:31:09.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.785+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.785+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903800 con 0x5578848eadb0 2024-09-13T06:31:09.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.785+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.785+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578849037e0 con 0x5578848eadb0 2024-09-13T06:31:09.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.789+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'33 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.789+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903610 con 0x5578848e5d70 2024-09-13T06:31:09.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.793+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.793+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903610 con 0x5578848e18f0 2024-09-13T06:31:09.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.793+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'53 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.793+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903610 con 0x5578848e5d70 2024-09-13T06:31:09.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.797+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.797+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903610 con 0x5578848e18f0 2024-09-13T06:31:09.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.797+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.797+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557884903610 con 0x7fbec4007be0 2024-09-13T06:31:09.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.797+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbd7a7fc640 20 reqs_thread_entry: start 2024-09-13T06:31:09.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:09.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 20 Filter name: none 2024-09-13T06:31:09.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbcf3fff640 20 reqs_thread_entry: start 2024-09-13T06:31:09.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T06:31:09.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55788491e640 con 0x5578848eadb0 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578848ffcc0 con 0x5578848eadb0 2024-09-13T06:31:09.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 10 removing key index: system_akey 2024-09-13T06:31:09.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848ffcc0 con 0x5578848eadb0 2024-09-13T06:31:09.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(96 system_akey [delete] v35'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.801+0000 7fbed420a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T06:31:09.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 93976108595808 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557884921490 con 0x5578848e18f0 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== watch-notify(notify (1) cookie 93976108401984 notify 150323855363 ret 0) ==== 203+0+0 (crc 0 0 0) 0x557884901100 con 0x5578848e18f0 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbdb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 93976108401984 notifier 4848 bl.length()=161 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(97 notify.1 [notify cookie 93976108595808 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbdb57fa640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbd94003d70 con 0x5578848e18f0 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== watch-notify(notify_complete (2) cookie 93976108595808 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557884900a70 con 0x5578848e18f0 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed420a980 10 removing email index: 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed420a980 10 removing user buckets index 2024-09-13T06:31:09.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55788491ef00 con 0x5578848eadb0 2024-09-13T06:31:09.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(99 system_user.buckets [delete] v35'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed420a980 10 removing user index: system_user 2024-09-13T06:31:09.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.805+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55788491ef00 con 0x5578848eadb0 2024-09-13T06:31:09.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(100 system_user [call,call,delete] v35'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed420a980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T06:31:09.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed420a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T06:31:09.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93976108591696 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55788491ee70 con 0x5578848e5d70 2024-09-13T06:31:09.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== watch-notify(notify (1) cookie 93976108398704 notify 150323855408 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557884902550 con 0x5578848e5d70 2024-09-13T06:31:09.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbdb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855408 cookie 93976108398704 notifier 4848 bl.length()=160 2024-09-13T06:31:09.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbdb57fa640 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbd94003d70 con 0x5578848e5d70 2024-09-13T06:31:09.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(101 notify.0 [notify cookie 93976108591696 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== watch-notify(notify_complete (2) cookie 93976108591696 notify 150323855408 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbec4037070 con 0x5578848e5d70 2024-09-13T06:31:09.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbd7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:09.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.809+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93976108420096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55788491ea30 con 0x5578848e18f0 2024-09-13T06:31:09.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.813+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93976108420096] v35'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.813+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93976108398704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f4c00 con 0x5578848e5d70 2024-09-13T06:31:09.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93976108398704] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed420a980 20 remove_watcher() i=0 2024-09-13T06:31:09.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed420a980 2 removed watcher, disabling cache 2024-09-13T06:31:09.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93976108401984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f4c00 con 0x5578848e18f0 2024-09-13T06:31:09.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93976108401984] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x5578848e18f0 2024-09-13T06:31:09.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed420a980 20 remove_watcher() i=1 2024-09-13T06:31:09.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.817+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93976108406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f0540 con 0x5578848e5d70 2024-09-13T06:31:09.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93976108406688] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed420a980 20 remove_watcher() i=2 2024-09-13T06:31:09.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93976108409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f17a0 con 0x7fbec4007be0 2024-09-13T06:31:09.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93976108409024] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed420a980 20 remove_watcher() i=3 2024-09-13T06:31:09.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93976108396224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848f17a0 con 0x5578848e5d70 2024-09-13T06:31:09.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed1d1a640 1 -- 172.21.15.169:0/2126229082 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93976108396224] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4083040 con 0x5578848e5d70 2024-09-13T06:31:09.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed420a980 20 remove_watcher() i=4 2024-09-13T06:31:09.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.821+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93976108410080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848eeec0 con 0x5578848eadb0 2024-09-13T06:31:09.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93976108410080] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed420a980 20 remove_watcher() i=5 2024-09-13T06:31:09.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93976108414960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848eeec0 con 0x5578848eadb0 2024-09-13T06:31:09.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed1519640 1 -- 172.21.15.169:0/2126229082 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93976108414960] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0aaad0 con 0x5578848eadb0 2024-09-13T06:31:09.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed420a980 20 remove_watcher() i=6 2024-09-13T06:31:09.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93976108411648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578848eeec0 con 0x7fbec4007be0 2024-09-13T06:31:09.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93976108411648] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc00a4d0 con 0x7fbec4007be0 2024-09-13T06:31:09.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.825+0000 7fbed420a980 20 remove_watcher() i=7 2024-09-13T06:31:09.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848e5d70 msgr2=0x5578848e8160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848e5d70 0x5578848e8160 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578848e18f0 msgr2=0x5578848e3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578848e18f0 0x5578848e3db0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbec4007be0 msgr2=0x7fbec40198c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fbec4007be0 0x7fbec40198c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848eadb0 msgr2=0x5578848ed1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848eadb0 0x5578848ed1a0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbd9c034650 msgr2=0x7fbd9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbd9c034650 0x7fbd9c036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbebc000c10 tx=0x7fbebc0c1040 comp rx=0 tx=0).stop 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 msgr2=0x5578848d67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed251b640 1 -- 172.21.15.169:0/2126229082 reap_dead start 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848d67b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbec403ef70 tx=0x7fbec4038f20 comp rx=0 tx=0).stop 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 shutdown_connections 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/2126229082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848cf630 0x5578848d67b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 >> 172.21.15.169:0/2126229082 conn(0x5578848cb9c0 msgr2=0x5578848c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 shutdown_connections 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/2126229082 wait complete. 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdac034650 msgr2=0x7fbdac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdac034650 0x7fbdac036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbebc017f50 tx=0x7fbebc005ad0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 msgr2=0x5578848c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 0x5578848c3250 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbec4000c10 tx=0x7fbec402fe70 comp rx=0 tx=0).stop 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 shutdown_connections 2024-09-13T06:31:09.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdac034650 0x7fbdac036b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/699335221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578848c2e30 0x5578848c3250 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 >> 172.21.15.169:0/699335221 conn(0x5578848b7f80 msgr2=0x5578848baa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 shutdown_connections 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/699335221 wait complete. 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848ad410 msgr2=0x5578848af800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5578848ad410 0x5578848af800 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578847b6c60 msgr2=0x5578848ac0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5578847b6c60 0x5578848ac0c0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848b2a90 msgr2=0x5578848b4e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5578848b2a90 0x5578848b4e80 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdb8034650 msgr2=0x7fbdb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fbdb8034650 0x7fbdb8036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 msgr2=0x5578848a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 --2- 172.21.15.169:0/3328873745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5578847b28e0 0x5578848a4fc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbec400b6f0 tx=0x7fbec4000ee0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed251b640 1 -- 172.21.15.169:0/3328873745 reap_dead start 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 shutdown_connections 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 >> 172.21.15.169:0/3328873745 conn(0x557884726230 msgr2=0x5578848983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 shutdown_connections 2024-09-13T06:31:09.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.829+0000 7fbed420a980 1 -- 172.21.15.169:0/3328873745 wait complete. 2024-09-13T06:31:09.845 ERROR:root:None 2024-09-13T06:31:09.845 ERROR:root:0 2024-09-13T06:31:09.845 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T06:31:09.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T06:31:09.846 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T06:31:09.929 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:09.929 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:09.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c75cf980 1 Processor -- start 2024-09-13T06:31:09.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c75cf980 1 -- start start 2024-09-13T06:31:09.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c75cf980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55944c596270 0x55944c624300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c75cf980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55944c4a9ae0 con 0x55944c624840 2024-09-13T06:31:09.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c75cf980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55944c4cde30 con 0x55944c596270 2024-09-13T06:31:09.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c50df640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55944c596270 0x55944c624300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c48de640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55944c624840 0x55944c626c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48092/0 (socket says 172.21.15.169:48092) 2024-09-13T06:31:09.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.925+0000 7f99c48de640 1 -- 172.21.15.169:0/1591253842 learned_addr learned my addr 172.21.15.169:0/1591253842 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:09.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c50df640 1 -- 172.21.15.169:0/1591253842 >> v1:172.21.15.112:6789/0 conn(0x55944c624840 legacy=0x55944c626c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c50df640 1 -- 172.21.15.169:0/1591253842 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944c629360 con 0x55944c596270 2024-09-13T06:31:09.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c50df640 1 --2- 172.21.15.169:0/1591253842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c624300 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f99b800a420 tx=0x7f99b801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6710b126d57b9a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99bffff640 1 -- 172.21.15.169:0/1591253842 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80af070 con 0x55944c596270 2024-09-13T06:31:09.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99bffff640 1 -- 172.21.15.169:0/1591253842 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b80aa530 con 0x55944c596270 2024-09-13T06:31:09.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99bffff640 1 -- 172.21.15.169:0/1591253842 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80aa850 con 0x55944c596270 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 -- 172.21.15.169:0/1591253842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 msgr2=0x55944c624300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1591253842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c624300 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f99b800a420 tx=0x7f99b801afd0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 -- 172.21.15.169:0/1591253842 shutdown_connections 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1591253842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c624300 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 -- 172.21.15.169:0/1591253842 >> 172.21.15.169:0/1591253842 conn(0x55944c61c030 msgr2=0x55944c61e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 -- 172.21.15.169:0/1591253842 shutdown_connections 2024-09-13T06:31:09.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.929+0000 7f99c75cf980 1 -- 172.21.15.169:0/1591253842 wait complete. 2024-09-13T06:31:09.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c75cf980 1 Processor -- start 2024-09-13T06:31:09.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c75cf980 1 -- start start 2024-09-13T06:31:09.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c75cf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c70c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c75cf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55944c4cf200 con 0x55944c596270 2024-09-13T06:31:09.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c70c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c70c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46112/0 (socket says 172.21.15.169:46112) 2024-09-13T06:31:09.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.945+0000 7f99c50df640 1 -- 172.21.15.169:0/334202809 learned_addr learned my addr 172.21.15.169:0/334202809 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 -- 172.21.15.169:0/334202809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944c70cfc0 con 0x55944c596270 2024-09-13T06:31:09.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 --2- 172.21.15.169:0/334202809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c70c9f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f99b800a420 tx=0x7f99b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356e7db97c46fe3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f98b3606640 1 -- 172.21.15.169:0/334202809 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80af050 con 0x55944c596270 2024-09-13T06:31:09.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f98b3606640 1 -- 172.21.15.169:0/334202809 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b80b0040 con 0x55944c596270 2024-09-13T06:31:09.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f98b3606640 1 -- 172.21.15.169:0/334202809 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80aac60 con 0x55944c596270 2024-09-13T06:31:09.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- 172.21.15.169:0/334202809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 msgr2=0x55944c70c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 --2- 172.21.15.169:0/334202809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c70c9f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f99b800a420 tx=0x7f99b80033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- 172.21.15.169:0/334202809 shutdown_connections 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 --2- 172.21.15.169:0/334202809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c70c9f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- 172.21.15.169:0/334202809 >> 172.21.15.169:0/334202809 conn(0x55944c61c030 msgr2=0x55944c708620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- 172.21.15.169:0/334202809 shutdown_connections 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- 172.21.15.169:0/334202809 wait complete. 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 Processor -- start 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- start start 2024-09-13T06:31:09.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c713c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c75cf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55944c628dd0 con 0x55944c596270 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c713c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c713c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46120/0 (socket says 172.21.15.169:46120) 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 -- 172.21.15.169:0/1372882469 learned_addr learned my addr 172.21.15.169:0/1372882469 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944c714140 con 0x55944c596270 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.949+0000 7f99c50df640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c713c00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f99b801b870 tx=0x7f99b8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f98b1e03640 1 -- 172.21.15.169:0/1372882469 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80c5020 con 0x55944c596270 2024-09-13T06:31:09.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f98b1e03640 1 -- 172.21.15.169:0/1372882469 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b80b6cb0 con 0x55944c596270 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f98b1e03640 1 -- 172.21.15.169:0/1372882469 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80c1480 con 0x55944c596270 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55944c7143d0 con 0x55944c596270 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944c7170b0 con 0x55944c596270 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f98b1e03640 1 -- 172.21.15.169:0/1372882469 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f99b80b4400 con 0x55944c596270 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f98b1e03640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98ac0346a0 0x7f98ac036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f98b1e03640 1 -- 172.21.15.169:0/1372882469 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f99b80bb070 con 0x55944c596270 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c48de640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98ac0346a0 0x7f98ac036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c624840 0x55944c71ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c71b240 con 0x55944c624840 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c58e0640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c624840 0x55944c71ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c48de640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98ac0346a0 0x7f98ac036b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f99b0000f70 tx=0x7f99b00012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c58e0640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c624840 0x55944c71ad00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c58e0640 1 -- 172.21.15.169:0/1372882469 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c624840 2024-09-13T06:31:09.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c71c010 0x55944c71e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c71ea40 con 0x55944c71c010 2024-09-13T06:31:09.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.953+0000 7f99c50df640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c71c010 0x55944c71e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c50df640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c71c010 0x55944c71e400 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c50df640 1 -- 172.21.15.169:0/1372882469 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99b80c7070 con 0x55944c71c010 2024-09-13T06:31:09.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c7202f0 con 0x55944c71c010 2024-09-13T06:31:09.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c50df640 1 -- 172.21.15.169:0/1372882469 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99b80c7070 con 0x55944c71c010 2024-09-13T06:31:09.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c71f520 con 0x55944c71c010 2024-09-13T06:31:09.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c50df640 1 -- 172.21.15.169:0/1372882469 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99b80c7070 con 0x55944c71c010 2024-09-13T06:31:09.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c7216a0 0x55944c723a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c724010 con 0x55944c7216a0 2024-09-13T06:31:09.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c48de640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c7216a0 0x55944c723a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c48de640 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c7216a0 0x55944c723a90 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c48de640 1 -- 172.21.15.169:0/1372882469 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99b000e620 con 0x55944c7216a0 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c75cf980 1 Processor -- start 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.957+0000 7f99c75cf980 1 -- start start 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 0x55944c731f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55944c528800 con 0x55944c731ae0 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 0x55944c731f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 0x55944c731f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46136/0 (socket says 172.21.15.169:46136) 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c50df640 1 -- 172.21.15.169:0/3894347940 learned_addr learned my addr 172.21.15.169:0/3894347940 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c50df640 1 -- 172.21.15.169:0/3894347940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944c732440 con 0x55944c731ae0 2024-09-13T06:31:09.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c50df640 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 0x55944c731f00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f99b80e2ca0 tx=0x7f99b80a9a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f98aaffd640 1 -- 172.21.15.169:0/3894347940 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80bfc20 con 0x55944c731ae0 2024-09-13T06:31:09.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55944c7326d0 con 0x55944c731ae0 2024-09-13T06:31:09.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f98aaffd640 1 -- 172.21.15.169:0/3894347940 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b80bfdc0 con 0x55944c731ae0 2024-09-13T06:31:09.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f98aaffd640 1 -- 172.21.15.169:0/3894347940 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80dcb60 con 0x55944c731ae0 2024-09-13T06:31:09.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944c735350 con 0x55944c731ae0 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f98aaffd640 1 -- 172.21.15.169:0/3894347940 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f99b80dcd00 con 0x55944c731ae0 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f98aaffd640 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98a0034650 0x7f98a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f98aaffd640 1 -- 172.21.15.169:0/3894347940 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f99b80ab240 con 0x55944c731ae0 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c48de640 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98a0034650 0x7f98a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 Processor -- start 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 -- start start 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c48de640 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98a0034650 0x7f98a0036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f99b000bf60 tx=0x7f99b000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c73e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.961+0000 7f99c75cf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55944c70d280 con 0x55944c73e380 2024-09-13T06:31:09.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c73e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c73e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46150/0 (socket says 172.21.15.169:46150) 2024-09-13T06:31:09.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 -- 172.21.15.169:0/2691729531 learned_addr learned my addr 172.21.15.169:0/2691729531 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 -- 172.21.15.169:0/2691729531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944c73ed50 con 0x55944c73e380 2024-09-13T06:31:09.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 --2- 172.21.15.169:0/2691729531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c73e780 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99b80e2f20 tx=0x7f99b80e11a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3e49f235dc4a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f98a8ff9640 1 -- 172.21.15.169:0/2691729531 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80e1360 con 0x55944c73e380 2024-09-13T06:31:09.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f98a8ff9640 1 -- 172.21.15.169:0/2691729531 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b80b4c50 con 0x55944c73e380 2024-09-13T06:31:09.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f98a8ff9640 1 -- 172.21.15.169:0/2691729531 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80b6fb0 con 0x55944c73e380 2024-09-13T06:31:09.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- 172.21.15.169:0/2691729531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 msgr2=0x55944c73e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:09.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 --2- 172.21.15.169:0/2691729531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c73e780 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99b80e2f20 tx=0x7f99b80e11a0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- 172.21.15.169:0/2691729531 shutdown_connections 2024-09-13T06:31:09.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 --2- 172.21.15.169:0/2691729531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c73e780 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- 172.21.15.169:0/2691729531 >> 172.21.15.169:0/2691729531 conn(0x55944c73a7b0 msgr2=0x55944c7388b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- 172.21.15.169:0/2691729531 shutdown_connections 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- 172.21.15.169:0/2691729531 wait complete. 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 Processor -- start 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- start start 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c745580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c75cf980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55944c73f220 con 0x55944c73e380 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c745580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c745580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46160/0 (socket says 172.21.15.169:46160) 2024-09-13T06:31:09.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.965+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 learned_addr learned my addr 172.21.15.169:0/879998907 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:09.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944c745ac0 con 0x55944c73e380 2024-09-13T06:31:09.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c50df640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c745580 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f99b80dc260 tx=0x7f99b80b2f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f9896ffd640 1 -- 172.21.15.169:0/879998907 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80e15f0 con 0x55944c73e380 2024-09-13T06:31:09.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55944c745ac0 con 0x55944c73e380 2024-09-13T06:31:09.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f9896ffd640 1 -- 172.21.15.169:0/879998907 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b8105070 con 0x55944c73e380 2024-09-13T06:31:09.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f9896ffd640 1 -- 172.21.15.169:0/879998907 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b80cda60 con 0x55944c73e380 2024-09-13T06:31:09.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944c745ac0 con 0x55944c73e380 2024-09-13T06:31:09.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f9896ffd640 1 -- 172.21.15.169:0/879998907 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f99b80cdc00 con 0x55944c73e380 2024-09-13T06:31:09.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f9896ffd640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9890034650 0x7f9890036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f9896ffd640 1 -- 172.21.15.169:0/879998907 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f99b810bc60 con 0x55944c73e380 2024-09-13T06:31:09.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c48de640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9890034650 0x7f9890036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c7505b0 0x55944c752a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c7531c0 con 0x55944c7505b0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c58e0640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c7505b0 0x55944c752a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c48de640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9890034650 0x7f9890036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55944c7243f0 tx=0x7f99b0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c58e0640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c7505b0 0x55944c752a70 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 20 realm 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c74f9e0 con 0x55944c7505b0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.969+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c753c80 con 0x55944c7505b0 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c754a60 0x55944c756e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c7574e0 con 0x55944c754a60 2024-09-13T06:31:09.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c50df640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c754a60 0x55944c756e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c50df640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c754a60 0x55944c756e50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 20 searching for the correct realm 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c759aa0 0x55944c75be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c75c510 con 0x55944c759aa0 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c48de640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c759aa0 0x55944c75be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c48de640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c759aa0 0x55944c75be90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.973+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c75c510 con 0x55944c754a60 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f99b80b6070 0x7f99b80ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x7f99b80b6070 2024-09-13T06:31:09.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f99b80b6070 0x7f99b80ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:09.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f99b80b6070 0x7f99b80ed440 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:09.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c759aa0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.977+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x7f99b80b6070 2024-09-13T06:31:09.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x7f99b80b6070 2024-09-13T06:31:09.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c759aa0 2024-09-13T06:31:09.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c759aa0 2024-09-13T06:31:09.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.981+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c759aa0 2024-09-13T06:31:09.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x7f99b80b6070 2024-09-13T06:31:09.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c7505b0 2024-09-13T06:31:09.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x7f99b80b6070 2024-09-13T06:31:09.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c759aa0 2024-09-13T06:31:09.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x7f99b80b6070 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c759aa0 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.985+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55944c757d30 con 0x55944c754a60 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c758580 con 0x55944c7505b0 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c758970 con 0x55944c754a60 2024-09-13T06:31:09.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c758970 con 0x55944c759aa0 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 zone default found 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 4 Realm: () 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:09.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 zonegroup default 2024-09-13T06:31:09.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c75c970 con 0x7f99b80b6070 2024-09-13T06:31:09.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:09.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c758eb0 con 0x55944c759aa0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c75ecd0 con 0x55944c759aa0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 started sync module instance, tier type = 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:09.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.989+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75e030 con 0x55944c754a60 2024-09-13T06:31:09.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.993+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:09.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.993+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095426315568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75e030 con 0x55944c754a60 2024-09-13T06:31:09.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.993+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75f750 con 0x55944c7505b0 2024-09-13T06:31:10.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.993+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:10.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.993+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095426319008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75ffa0 con 0x55944c7505b0 2024-09-13T06:31:10.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.993+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7609c0 con 0x55944c754a60 2024-09-13T06:31:10.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.997+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095426315568] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.997+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095426319008] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:10.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.997+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.997+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095426323632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75faf0 con 0x55944c754a60 2024-09-13T06:31:10.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:09.997+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c761260 con 0x7f99b80b6070 2024-09-13T06:31:10.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095426323632] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:10.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095426313088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75faf0 con 0x7f99b80b6070 2024-09-13T06:31:10.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c761880 con 0x55944c754a60 2024-09-13T06:31:10.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095426313088] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:10.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095426325856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c761880 con 0x55944c754a60 2024-09-13T06:31:10.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c762130 con 0x55944c759aa0 2024-09-13T06:31:10.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095426325856] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095426328976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c762520 con 0x55944c759aa0 2024-09-13T06:31:10.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.001+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c762ee0 con 0x55944c759aa0 2024-09-13T06:31:10.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095426328976] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095426333232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c763300 con 0x55944c759aa0 2024-09-13T06:31:10.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c763bd0 con 0x7f99b80b6070 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095426333232] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095426334288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c763720 con 0x7f99b80b6070 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=0 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=1 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=2 2024-09-13T06:31:10.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=3 2024-09-13T06:31:10.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=4 2024-09-13T06:31:10.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=5 2024-09-13T06:31:10.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=6 2024-09-13T06:31:10.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095426334288] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:10.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 20 add_watcher() i=7 2024-09-13T06:31:10.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.005+0000 7f99c75cf980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:10.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c7670e0 con 0x55944c7505b0 2024-09-13T06:31:10.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:10.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095426335888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c764630 con 0x55944c7505b0 2024-09-13T06:31:10.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095426335888] v35'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:10.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f987b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 5 note: GC not initialized 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f987a7e4640 20 reqs_thread_entry: start 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 20 Filter name: none 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f97ebfff640 20 reqs_thread_entry: start 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.009+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c78a7d0 con 0x55944c754a60 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c788f70 con 0x55944c759aa0 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T06:31:10.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T06:31:10.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T06:31:10.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T06:31:10.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c789810 con 0x55944c754a60 2024-09-13T06:31:10.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v35'7 uv7 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T06:31:10.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:31:10.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T06:31:10.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94095426491232 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c78ddc0 con 0x55944c754a60 2024-09-13T06:31:10.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify (1) cookie 94095426323632 notify 150323855409 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55944c78a220 con 0x55944c754a60 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f98a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855409 cookie 94095426323632 notifier 4855 bl.length()=542 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f98a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f98a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(65 notify.2 [notify cookie 94095426491232 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f98a8ff9640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9888003eb0 con 0x55944c754a60 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.013+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== watch-notify(notify_complete (2) cookie 94095426491232 notify 150323855409 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55944c732440 con 0x55944c754a60 2024-09-13T06:31:10.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c789810 con 0x55944c759aa0 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v35'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c75cf980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c75cf980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c75cf980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94095426491232 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55944c789780 con 0x55944c759aa0 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== watch-notify(notify (1) cookie 94095426328976 notify 150323855402 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55944c4a9ae0 con 0x55944c759aa0 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f9897fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855402 cookie 94095426328976 notifier 4855 bl.length()=175 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f9897fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f9897fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f9897fff640 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f97f8003410 con 0x55944c759aa0 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(68 notify.5 [notify cookie 94095426491232 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== watch-notify(notify_complete (2) cookie 94095426491232 notify 150323855402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f99b0038860 con 0x55944c759aa0 2024-09-13T06:31:10.023 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T06:31:10.017310Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:10.017297Z","tags":[],"group_ids":[]} 2024-09-13T06:31:10.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f987b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.017+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095426335888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x55944c7505b0 2024-09-13T06:31:10.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.021+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94095426335888] v35'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:10.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.021+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095426315568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x55944c754a60 2024-09-13T06:31:10.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.021+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94095426315568] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.021+0000 7f99c75cf980 20 remove_watcher() i=0 2024-09-13T06:31:10.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.021+0000 7f99c75cf980 2 removed watcher, disabling cache 2024-09-13T06:31:10.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.021+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095426319008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x55944c7505b0 2024-09-13T06:31:10.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94095426319008] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x55944c7505b0 2024-09-13T06:31:10.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c75cf980 20 remove_watcher() i=1 2024-09-13T06:31:10.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095426323632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x55944c754a60 2024-09-13T06:31:10.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94095426323632] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c75cf980 20 remove_watcher() i=2 2024-09-13T06:31:10.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095426313088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x7f99b80b6070 2024-09-13T06:31:10.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94095426313088] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:10.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c75cf980 20 remove_watcher() i=3 2024-09-13T06:31:10.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.025+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095426325856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c75db80 con 0x55944c754a60 2024-09-13T06:31:10.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.029+0000 7f99c50df640 1 -- 172.21.15.169:0/879998907 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94095426325856] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b80ea020 con 0x55944c754a60 2024-09-13T06:31:10.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.029+0000 7f99c75cf980 20 remove_watcher() i=4 2024-09-13T06:31:10.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.029+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095426328976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x55944c759aa0 2024-09-13T06:31:10.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.029+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94095426328976] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.029+0000 7f99c75cf980 20 remove_watcher() i=5 2024-09-13T06:31:10.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.029+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095426333232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c7885d0 con 0x55944c759aa0 2024-09-13T06:31:10.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c48de640 1 -- 172.21.15.169:0/879998907 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94095426333232] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b000e620 con 0x55944c759aa0 2024-09-13T06:31:10.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 20 remove_watcher() i=6 2024-09-13T06:31:10.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095426334288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55944c762a30 con 0x7f99b80b6070 2024-09-13T06:31:10.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94095426334288] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c00083f0 con 0x7f99b80b6070 2024-09-13T06:31:10.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 20 remove_watcher() i=7 2024-09-13T06:31:10.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c754a60 msgr2=0x55944c756e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c754a60 0x55944c756e50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c7505b0 msgr2=0x55944c752a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c7505b0 0x55944c752a70 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f99b80b6070 msgr2=0x7f99b80ed440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f99b80b6070 0x7f99b80ed440 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c759aa0 msgr2=0x55944c75be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c759aa0 0x55944c75be90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9890034650 msgr2=0x7f9890036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f9890034650 0x7f9890036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55944c7243f0 tx=0x7f99b0010000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 msgr2=0x55944c745580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/879998907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c73e380 0x55944c745580 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f99b80dc260 tx=0x7f99b80b2f00 comp rx=0 tx=0).stop 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 reap_dead start 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c58e0640 1 -- 172.21.15.169:0/879998907 reap_dead start 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 shutdown_connections 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 >> 172.21.15.169:0/879998907 conn(0x55944c73a7b0 msgr2=0x55944c738880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 shutdown_connections 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/879998907 wait complete. 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98a0034650 msgr2=0x7f98a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98a0034650 0x7f98a0036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f99b000bf60 tx=0x7f99b000f000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 msgr2=0x55944c731f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 0x55944c731f00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f99b80e2ca0 tx=0x7f99b80a9a20 comp rx=0 tx=0).stop 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 shutdown_connections 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98a0034650 0x7f98a0036b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/3894347940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c731ae0 0x55944c731f00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 >> 172.21.15.169:0/3894347940 conn(0x55944c726be0 msgr2=0x55944c7296b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 shutdown_connections 2024-09-13T06:31:10.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/3894347940 wait complete. 2024-09-13T06:31:10.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c71c010 msgr2=0x55944c71e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55944c71c010 0x55944c71e400 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c624840 msgr2=0x55944c71ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55944c624840 0x55944c71ad00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c7216a0 msgr2=0x55944c723a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55944c7216a0 0x55944c723a90 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98ac0346a0 msgr2=0x7f98ac036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f98ac0346a0 0x7f98ac036b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f99b0000f70 tx=0x7f99b00012c0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 msgr2=0x55944c713c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 --2- 172.21.15.169:0/1372882469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55944c596270 0x55944c713c00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f99b801b870 tx=0x7f99b8019810 comp rx=0 tx=0).stop 2024-09-13T06:31:10.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c58e0640 1 -- 172.21.15.169:0/1372882469 reap_dead start 2024-09-13T06:31:10.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 shutdown_connections 2024-09-13T06:31:10.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 >> 172.21.15.169:0/1372882469 conn(0x55944c61c030 msgr2=0x55944c7071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 shutdown_connections 2024-09-13T06:31:10.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.033+0000 7f99c75cf980 1 -- 172.21.15.169:0/1372882469 wait complete. 2024-09-13T06:31:10.049 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T06:31:10.017310Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:10.017297Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.050 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T06:31:10.017310Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:10.017297Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.050 ERROR:root:0 2024-09-13T06:31:10.051 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:10.064 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:10.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T06:31:10.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T06:31:10.065 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T06:31:10.130 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:10.130 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:10.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f4001fdd980 1 Processor -- start 2024-09-13T06:31:10.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f4001fdd980 1 -- start start 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f4001fdd980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560fbfd793b0 0x560fbfd77b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f4001fdd980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560fbfc8aae0 con 0x560fbfd797c0 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f4001fdd980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x560fbfcaee30 con 0x560fbfd793b0 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f3fffaed640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560fbfd793b0 0x560fbfd77b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f3fffaed640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x560fbfd793b0 0x560fbfd77b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46164/0 (socket says 172.21.15.169:46164) 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f3fff2ec640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x560fbfd797c0 0x560fbfd780b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48100/0 (socket says 172.21.15.169:48100) 2024-09-13T06:31:10.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f3fffaed640 1 -- 172.21.15.169:0/269635347 learned_addr learned my addr 172.21.15.169:0/269635347 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f3fffaed640 1 -- 172.21.15.169:0/269635347 >> v1:172.21.15.112:6789/0 conn(0x560fbfd797c0 legacy=0x560fbfd780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.129+0000 7f3fffaed640 1 -- 172.21.15.169:0/269635347 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbfd788e0 con 0x560fbfd793b0 2024-09-13T06:31:10.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f3fffaed640 1 --2- 172.21.15.169:0/269635347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfd77b70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000a4e0 tx=0x7f3ff001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76820670cae37178 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f3ffeaeb640 1 -- 172.21.15.169:0/269635347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00aa540 con 0x560fbfd793b0 2024-09-13T06:31:10.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f3ffeaeb640 1 -- 172.21.15.169:0/269635347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff00aa6e0 con 0x560fbfd793b0 2024-09-13T06:31:10.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f3ffeaeb640 1 -- 172.21.15.169:0/269635347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00aaa40 con 0x560fbfd793b0 2024-09-13T06:31:10.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 -- 172.21.15.169:0/269635347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 msgr2=0x560fbfd77b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 --2- 172.21.15.169:0/269635347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfd77b70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000a4e0 tx=0x7f3ff001b090 comp rx=0 tx=0).stop 2024-09-13T06:31:10.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 -- 172.21.15.169:0/269635347 shutdown_connections 2024-09-13T06:31:10.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 --2- 172.21.15.169:0/269635347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfd77b70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 -- 172.21.15.169:0/269635347 >> 172.21.15.169:0/269635347 conn(0x560fbfdfe1b0 msgr2=0x560fbfe005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 -- 172.21.15.169:0/269635347 shutdown_connections 2024-09-13T06:31:10.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.133+0000 7f4001fdd980 1 -- 172.21.15.169:0/269635347 wait complete. 2024-09-13T06:31:10.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 Processor -- start 2024-09-13T06:31:10.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- start start 2024-09-13T06:31:10.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfeefb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560fbfcb0200 con 0x560fbfd793b0 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfeefb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfeefb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46176/0 (socket says 172.21.15.169:46176) 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 -- 172.21.15.169:0/3440675233 learned_addr learned my addr 172.21.15.169:0/3440675233 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 -- 172.21.15.169:0/3440675233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbfef0160 con 0x560fbfd793b0 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 --2- 172.21.15.169:0/3440675233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfeefb90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0018cc0 tx=0x7f3ff00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bb2f4b294fc2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3eede0b640 1 -- 172.21.15.169:0/3440675233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00b9070 con 0x560fbfd793b0 2024-09-13T06:31:10.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3eede0b640 1 -- 172.21.15.169:0/3440675233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff00aab00 con 0x560fbfd793b0 2024-09-13T06:31:10.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3eede0b640 1 -- 172.21.15.169:0/3440675233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00aae20 con 0x560fbfd793b0 2024-09-13T06:31:10.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- 172.21.15.169:0/3440675233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 msgr2=0x560fbfeefb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 --2- 172.21.15.169:0/3440675233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfeefb90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0018cc0 tx=0x7f3ff00033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- 172.21.15.169:0/3440675233 shutdown_connections 2024-09-13T06:31:10.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 --2- 172.21.15.169:0/3440675233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfeefb90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- 172.21.15.169:0/3440675233 >> 172.21.15.169:0/3440675233 conn(0x560fbfdfe1b0 msgr2=0x560fbfeeb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- 172.21.15.169:0/3440675233 shutdown_connections 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- 172.21.15.169:0/3440675233 wait complete. 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 Processor -- start 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- start start 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfef6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f4001fdd980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560fbfe0e200 con 0x560fbfd793b0 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfef6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfef6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46180/0 (socket says 172.21.15.169:46180) 2024-09-13T06:31:10.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.149+0000 7f3fffaed640 1 -- 172.21.15.169:0/1525140248 learned_addr learned my addr 172.21.15.169:0/1525140248 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3fffaed640 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbfef72e0 con 0x560fbfd793b0 2024-09-13T06:31:10.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3fffaed640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfef6da0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000a4e0 tx=0x7f3ff0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3ee7fff640 1 -- 172.21.15.169:0/1525140248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00b9070 con 0x560fbfd793b0 2024-09-13T06:31:10.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fbfef7570 con 0x560fbfd793b0 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3ee7fff640 1 -- 172.21.15.169:0/1525140248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff00c7410 con 0x560fbfd793b0 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3ee7fff640 1 -- 172.21.15.169:0/1525140248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00c76f0 con 0x560fbfd793b0 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fbfefa250 con 0x560fbfd793b0 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3ee7fff640 1 -- 172.21.15.169:0/1525140248 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ff00b3040 con 0x560fbfd793b0 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3ee7fff640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ee8034650 0x7f3ee8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3ee7fff640 1 -- 172.21.15.169:0/1525140248 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f3ff00c4070 con 0x560fbfd793b0 2024-09-13T06:31:10.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ee8034650 0x7f3ee8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbfd797c0 0x560fbfefdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbfefe390 con 0x560fbfd797c0 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f40002ee640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbfd797c0 0x560fbfefdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ee8034650 0x7f3ee8036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8001e50 tx=0x7f3fe80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f40002ee640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbfd797c0 0x560fbfefdd50 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f40002ee640 1 -- 172.21.15.169:0/1525140248 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbfd797c0 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbfeff180 0x560fbff01570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.153+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff01bd0 con 0x560fbfeff180 2024-09-13T06:31:10.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fffaed640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbfeff180 0x560fbff01570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fffaed640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbfeff180 0x560fbff01570 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fffaed640 1 -- 172.21.15.169:0/1525140248 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ff00cf3a0 con 0x560fbfeff180 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff03480 con 0x560fbfeff180 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fffaed640 1 -- 172.21.15.169:0/1525140248 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ff00cf3a0 con 0x560fbfeff180 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff026b0 con 0x560fbfeff180 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fffaed640 1 -- 172.21.15.169:0/1525140248 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ff00cf3a0 con 0x560fbfeff180 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff04830 0x560fbff06c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff07160 con 0x560fbff04830 2024-09-13T06:31:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff04830 0x560fbff06c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff04830 0x560fbff06c20 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f3fff2ec640 1 -- 172.21.15.169:0/1525140248 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fe800f700 con 0x560fbff04830 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.157+0000 7f4001fdd980 1 Processor -- start 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 -- start start 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 0x560fbff15010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560fbfd09800 con 0x560fbff14bf0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 0x560fbff15010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 0x560fbff15010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46188/0 (socket says 172.21.15.169:46188) 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3fffaed640 1 -- 172.21.15.169:0/1941708270 learned_addr learned my addr 172.21.15.169:0/1941708270 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3fffaed640 1 -- 172.21.15.169:0/1941708270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbff15550 con 0x560fbff14bf0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3fffaed640 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 0x560fbff15010 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3ff001b930 tx=0x7f3ff00b4690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3ee57fa640 1 -- 172.21.15.169:0/1941708270 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00e9070 con 0x560fbff14bf0 2024-09-13T06:31:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3ee57fa640 1 -- 172.21.15.169:0/1941708270 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff00c79c0 con 0x560fbff14bf0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fbff157e0 con 0x560fbff14bf0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3ee57fa640 1 -- 172.21.15.169:0/1941708270 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00c7ca0 con 0x560fbff14bf0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fbff18460 con 0x560fbff14bf0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3ee57fa640 1 -- 172.21.15.169:0/1941708270 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ff00ec070 con 0x560fbff14bf0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3ee57fa640 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ed80346a0 0x7f3ed8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3ee57fa640 1 -- 172.21.15.169:0/1941708270 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f3ff00efc30 con 0x560fbff14bf0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ed80346a0 0x7f3ed8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 Processor -- start 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.161+0000 7f4001fdd980 1 -- start start 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff21910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ed80346a0 0x7f3ed8036b60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x560fbff07560 tx=0x7f3fe800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560fbfef0420 con 0x560fbff21530 2024-09-13T06:31:10.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff21910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff21910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46194/0 (socket says 172.21.15.169:46194) 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 -- 172.21.15.169:0/1444984447 learned_addr learned my addr 172.21.15.169:0/1444984447 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 -- 172.21.15.169:0/1444984447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbff21ee0 con 0x560fbff21530 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 --2- 172.21.15.169:0/1444984447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff21910 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00b5d40 tx=0x7f3ff00d7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce14d6063bb8e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3edeffd640 1 -- 172.21.15.169:0/1444984447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00e3e50 con 0x560fbff21530 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3edeffd640 1 -- 172.21.15.169:0/1444984447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff00f2e20 con 0x560fbff21530 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3edeffd640 1 -- 172.21.15.169:0/1444984447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00cf800 con 0x560fbff21530 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- 172.21.15.169:0/1444984447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 msgr2=0x560fbff21910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1444984447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff21910 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00b5d40 tx=0x7f3ff00d7f30 comp rx=0 tx=0).stop 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- 172.21.15.169:0/1444984447 shutdown_connections 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1444984447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff21910 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- 172.21.15.169:0/1444984447 >> 172.21.15.169:0/1444984447 conn(0x560fbff1d910 msgr2=0x560fbff1ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- 172.21.15.169:0/1444984447 shutdown_connections 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- 172.21.15.169:0/1444984447 wait complete. 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 Processor -- start 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- start start 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff286b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f4001fdd980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560fbff22380 con 0x560fbff21530 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff286b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46202/0 (socket says 172.21.15.169:46202) 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 learned_addr learned my addr 172.21.15.169:0/758082470 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.165+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbff28bf0 con 0x560fbff21530 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3fffaed640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff286b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00f2fd0 tx=0x7f3ff00bf0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3edd7fa640 1 -- 172.21.15.169:0/758082470 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff010e020 con 0x560fbff21530 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fbff28bf0 con 0x560fbff21530 2024-09-13T06:31:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3edd7fa640 1 -- 172.21.15.169:0/758082470 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff00e3e50 con 0x560fbff21530 2024-09-13T06:31:10.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3edd7fa640 1 -- 172.21.15.169:0/758082470 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff00ed3b0 con 0x560fbff21530 2024-09-13T06:31:10.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fbff29060 con 0x560fbff21530 2024-09-13T06:31:10.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3edd7fa640 1 -- 172.21.15.169:0/758082470 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ff0111020 con 0x560fbff21530 2024-09-13T06:31:10.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3edd7fa640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ec8034650 0x7f3ec8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3edd7fa640 1 -- 172.21.15.169:0/758082470 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f3ff0114bf0 con 0x560fbff21530 2024-09-13T06:31:10.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ec8034650 0x7f3ec8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbff33830 0x560fbff35cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff36440 con 0x560fbff33830 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f40002ee640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbff33830 0x560fbff35cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ec8034650 0x7f3ec8036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800baa0 tx=0x7f3fe8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f40002ee640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbff33830 0x560fbff35cf0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 realm 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff32cb0 con 0x560fbff33830 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff36f00 con 0x560fbff33830 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbff37ce0 0x560fbff3a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.169+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3a780 con 0x560fbff37ce0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fffaed640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbff37ce0 0x560fbff3a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fffaed640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbff37ce0 0x560fbff3a0d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 20 searching for the correct realm 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff3cd40 0x560fbff3f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3f7e0 con 0x560fbff3cd40 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff3cd40 0x560fbff3f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fff2ec640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff3cd40 0x560fbff3f130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.173+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3f7e0 con 0x560fbff37ce0 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ff0113020 0x7f3ff00dc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x7f3ff0113020 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ff0113020 0x7f3ff00dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ff0113020 0x7f3ff00dc480 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff3cd40 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.177+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x7f3ff0113020 2024-09-13T06:31:10.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x7f3ff0113020 2024-09-13T06:31:10.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff3cd40 2024-09-13T06:31:10.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff3cd40 2024-09-13T06:31:10.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.181+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff3cd40 2024-09-13T06:31:10.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x7f3ff0113020 2024-09-13T06:31:10.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff33830 2024-09-13T06:31:10.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x7f3ff0113020 2024-09-13T06:31:10.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff3cd40 2024-09-13T06:31:10.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x7f3ff0113020 2024-09-13T06:31:10.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff3cd40 2024-09-13T06:31:10.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.185+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3afd0 con 0x560fbff37ce0 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3b820 con 0x560fbff33830 2024-09-13T06:31:10.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3bc10 con 0x560fbff37ce0 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3bc10 con 0x560fbff3cd40 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 zone default found 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 4 Realm: () 2024-09-13T06:31:10.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 zonegroup default 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff3fc40 con 0x7f3ff0113020 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff41e70 con 0x560fbff3cd40 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff42210 con 0x560fbff3cd40 2024-09-13T06:31:10.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 started sync module instance, tier type = 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.189+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff412b0 con 0x560fbff37ce0 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.193+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.193+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94625644943056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff412b0 con 0x560fbff37ce0 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.193+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff42a60 con 0x560fbff33830 2024-09-13T06:31:10.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.193+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.193+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94625644946864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff432b0 con 0x560fbff33830 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.193+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff43c70 con 0x560fbff37ce0 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94625644943056] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94625644946864] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94625644951488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff432b0 con 0x560fbff37ce0 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff43be0 con 0x7f3ff0113020 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94625644953696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff43be0 con 0x7f3ff0113020 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff44fb0 con 0x560fbff37ce0 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.197+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94625644951488] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94625644953696] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94625644954752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff44f70 con 0x560fbff37ce0 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff453a0 con 0x560fbff3cd40 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94625644948992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff45c40 con 0x560fbff3cd40 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff46660 con 0x560fbff3cd40 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.201+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94625644954752] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94625644948992] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94625644962128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff458a0 con 0x560fbff3cd40 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff471a0 con 0x7f3ff0113020 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94625644962128] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94625644964976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff47160 con 0x7f3ff0113020 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=0 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=1 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=2 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=3 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=4 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=5 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=6 2024-09-13T06:31:10.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94625644964976] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 20 add_watcher() i=7 2024-09-13T06:31:10.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:10.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff4a620 con 0x560fbff33830 2024-09-13T06:31:10.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.205+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94625644956320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff47b40 con 0x560fbff33830 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94625644956320] v35'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f3eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f4001fdd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f4001fdd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff4a300 con 0x560fbff37ce0 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.209+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff4a410 con 0x7f3ff0113020 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.213+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.213+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff53840 con 0x560fbff3cd40 2024-09-13T06:31:10.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.213+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.213+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff53cf0 con 0x560fbff33830 2024-09-13T06:31:10.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.217+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.217+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff52d70 con 0x560fbff37ce0 2024-09-13T06:31:10.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.217+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.217+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff52d70 con 0x560fbff3cd40 2024-09-13T06:31:10.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.221+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.221+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff52d70 con 0x560fbff37ce0 2024-09-13T06:31:10.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.221+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.221+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff52d70 con 0x560fbff33830 2024-09-13T06:31:10.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.225+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.225+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff54a80 con 0x560fbff37ce0 2024-09-13T06:31:10.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.225+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.225+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff54a80 con 0x560fbff37ce0 2024-09-13T06:31:10.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.229+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.229+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff54a80 con 0x560fbff37ce0 2024-09-13T06:31:10.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.229+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.229+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff54a80 con 0x560fbff3cd40 2024-09-13T06:31:10.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.233+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.233+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff54b10 con 0x560fbff37ce0 2024-09-13T06:31:10.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.233+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.233+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff54ce0 con 0x560fbff33830 2024-09-13T06:31:10.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.237+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.237+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff33830 2024-09-13T06:31:10.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.237+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.237+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff37ce0 2024-09-13T06:31:10.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.241+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.241+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff37ce0 2024-09-13T06:31:10.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.241+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.241+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff3cd40 2024-09-13T06:31:10.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.245+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.245+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff37ce0 2024-09-13T06:31:10.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.245+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.245+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff33830 2024-09-13T06:31:10.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.249+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.249+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff37ce0 2024-09-13T06:31:10.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.249+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.249+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff37ce0 2024-09-13T06:31:10.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.253+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.253+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55100 con 0x560fbff3cd40 2024-09-13T06:31:10.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.257+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.257+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55190 con 0x560fbff37ce0 2024-09-13T06:31:10.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.257+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.257+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55190 con 0x560fbff3cd40 2024-09-13T06:31:10.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.261+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.261+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x560fbff3cd40 2024-09-13T06:31:10.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.261+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.261+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x560fbff3cd40 2024-09-13T06:31:10.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.265+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'34 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.265+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x560fbff37ce0 2024-09-13T06:31:10.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.265+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.265+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x560fbff33830 2024-09-13T06:31:10.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.265+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'55 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.265+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x560fbff37ce0 2024-09-13T06:31:10.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.269+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.269+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x560fbff33830 2024-09-13T06:31:10.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.269+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.269+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff55220 con 0x7f3ff0113020 2024-09-13T06:31:10.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f3eb4fe1640 20 reqs_thread_entry: start 2024-09-13T06:31:10.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:10.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 20 Filter name: none 2024-09-13T06:31:10.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f3e2e7fc640 20 reqs_thread_entry: start 2024-09-13T06:31:10.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T06:31:10.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff70330 con 0x560fbff37ce0 2024-09-13T06:31:10.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff72dc0 con 0x560fbff37ce0 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 10 removing key index: true_admin_akey 2024-09-13T06:31:10.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.273+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff70da0 con 0x560fbff3cd40 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(96 true_admin_akey [delete] v35'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f4001fdd980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94625645140224 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff73380 con 0x560fbff3cd40 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== watch-notify(notify (1) cookie 94625644948992 notify 150323855403 ret 0) ==== 207+0+0 (crc 0 0 0) 0x560fbff533c0 con 0x560fbff3cd40 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3edeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855403 cookie 94625644948992 notifier 4862 bl.length()=165 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(97 notify.5 [notify cookie 94625645140224 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3edeffd640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3ec4003d70 con 0x560fbff3cd40 2024-09-13T06:31:10.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== watch-notify(notify_complete (2) cookie 94625645140224 notify 150323855403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560fbff49ac0 con 0x560fbff3cd40 2024-09-13T06:31:10.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f4001fdd980 10 removing email index: 2024-09-13T06:31:10.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f4001fdd980 10 removing user buckets index 2024-09-13T06:31:10.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.277+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff732e0 con 0x560fbff37ce0 2024-09-13T06:31:10.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(99 a_user.buckets [delete] v35'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f4001fdd980 10 removing user index: a_user 2024-09-13T06:31:10.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff728c0 con 0x560fbff37ce0 2024-09-13T06:31:10.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(100 a_user [call,call,delete] v35'8 uv8 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f4001fdd980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T06:31:10.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f4001fdd980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T06:31:10.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94625645145552 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560fbff71d60 con 0x560fbff37ce0 2024-09-13T06:31:10.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== watch-notify(notify (1) cookie 94625644951488 notify 150323855410 ret 0) ==== 197+0+0 (crc 0 0 0) 0x560fbff530d0 con 0x560fbff37ce0 2024-09-13T06:31:10.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f3edeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855410 cookie 94625644951488 notifier 4862 bl.length()=155 2024-09-13T06:31:10.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(101 notify.2 [notify cookie 94625645145552 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.281+0000 7f3edeffd640 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3ec4003d70 con 0x560fbff37ce0 2024-09-13T06:31:10.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.285+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== watch-notify(notify_complete (2) cookie 94625645145552 notify 150323855410 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560fbff15550 con 0x560fbff37ce0 2024-09-13T06:31:10.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.285+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.285+0000 7f3eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.285+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94625644956320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff33830 2024-09-13T06:31:10.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94625644956320] v35'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94625644943056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff37ce0 2024-09-13T06:31:10.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94625644943056] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f4001fdd980 20 remove_watcher() i=0 2024-09-13T06:31:10.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f4001fdd980 2 removed watcher, disabling cache 2024-09-13T06:31:10.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94625644946864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff33830 2024-09-13T06:31:10.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94625644946864] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x560fbff33830 2024-09-13T06:31:10.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f4001fdd980 20 remove_watcher() i=1 2024-09-13T06:31:10.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.289+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94625644951488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff37ce0 2024-09-13T06:31:10.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.293+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94625644951488] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.293+0000 7f4001fdd980 20 remove_watcher() i=2 2024-09-13T06:31:10.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.293+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94625644953696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x7f3ff0113020 2024-09-13T06:31:10.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.297+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94625644953696] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.297+0000 7f4001fdd980 20 remove_watcher() i=3 2024-09-13T06:31:10.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.297+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94625644954752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff37ce0 2024-09-13T06:31:10.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.297+0000 7f3fffaed640 1 -- 172.21.15.169:0/758082470 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94625644954752] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff00fa070 con 0x560fbff37ce0 2024-09-13T06:31:10.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.297+0000 7f4001fdd980 20 remove_watcher() i=4 2024-09-13T06:31:10.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.297+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94625644948992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff3cd40 2024-09-13T06:31:10.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94625644948992] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 20 remove_watcher() i=5 2024-09-13T06:31:10.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94625644962128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x560fbff3cd40 2024-09-13T06:31:10.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f3fff2ec640 1 -- 172.21.15.169:0/758082470 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94625644962128] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe8037040 con 0x560fbff3cd40 2024-09-13T06:31:10.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 20 remove_watcher() i=6 2024-09-13T06:31:10.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94625644964976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560fbff505c0 con 0x7f3ff0113020 2024-09-13T06:31:10.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94625644964976] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff80083f0 con 0x7f3ff0113020 2024-09-13T06:31:10.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 20 remove_watcher() i=7 2024-09-13T06:31:10.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbff37ce0 msgr2=0x560fbff3a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbff37ce0 0x560fbff3a0d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbff33830 msgr2=0x560fbff35cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbff33830 0x560fbff35cf0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ff0113020 msgr2=0x7f3ff00dc480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3ff0113020 0x7f3ff00dc480 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff3cd40 msgr2=0x560fbff3f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff3cd40 0x560fbff3f130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ec8034650 msgr2=0x7f3ec8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ec8034650 0x7f3ec8036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800baa0 tx=0x7f3fe8010000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 msgr2=0x560fbff286b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f40002ee640 1 -- 172.21.15.169:0/758082470 reap_dead start 2024-09-13T06:31:10.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff286b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00f2fd0 tx=0x7f3ff00bf0d0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 shutdown_connections 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 --2- 172.21.15.169:0/758082470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff21530 0x560fbff286b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 >> 172.21.15.169:0/758082470 conn(0x560fbff1d910 msgr2=0x560fbff1b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 shutdown_connections 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.301+0000 7f4001fdd980 1 -- 172.21.15.169:0/758082470 wait complete. 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ed80346a0 msgr2=0x7f3ed8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ed80346a0 0x7f3ed8036b60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x560fbff07560 tx=0x7f3fe800f000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 msgr2=0x560fbff15010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 0x560fbff15010 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3ff001b930 tx=0x7f3ff00b4690 comp rx=0 tx=0).stop 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 shutdown_connections 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ed80346a0 0x7f3ed8036b60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1941708270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbff14bf0 0x560fbff15010 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 >> 172.21.15.169:0/1941708270 conn(0x560fbff09d40 msgr2=0x560fbff0c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 shutdown_connections 2024-09-13T06:31:10.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1941708270 wait complete. 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbfeff180 msgr2=0x560fbff01570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x560fbfeff180 0x560fbff01570 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbfd797c0 msgr2=0x560fbfefdd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x560fbfd797c0 0x560fbfefdd50 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff04830 msgr2=0x560fbff06c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x560fbff04830 0x560fbff06c20 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ee8034650 msgr2=0x7f3ee8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3ee8034650 0x7f3ee8036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8001e50 tx=0x7f3fe80013b0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 msgr2=0x560fbfef6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 --2- 172.21.15.169:0/1525140248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560fbfd793b0 0x560fbfef6da0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000a4e0 tx=0x7f3ff0017e30 comp rx=0 tx=0).stop 2024-09-13T06:31:10.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f40002ee640 1 -- 172.21.15.169:0/1525140248 reap_dead start 2024-09-13T06:31:10.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 shutdown_connections 2024-09-13T06:31:10.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 >> 172.21.15.169:0/1525140248 conn(0x560fbfdfe1b0 msgr2=0x560fbfeea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 shutdown_connections 2024-09-13T06:31:10.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.305+0000 7f4001fdd980 1 -- 172.21.15.169:0/1525140248 wait complete. 2024-09-13T06:31:10.320 ERROR:root:None 2024-09-13T06:31:10.320 ERROR:root:0 2024-09-13T06:31:10.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T06:31:10.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T06:31:10.321 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T06:31:10.403 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:10.403 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:10.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e2982980 1 Processor -- start 2024-09-13T06:31:10.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e2982980 1 -- start start 2024-09-13T06:31:10.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e2982980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f6616948f0 0x55f661694cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e2982980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f66151aae0 con 0x55f661695240 2024-09-13T06:31:10.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e2982980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55f66153ee30 con 0x55f6616948f0 2024-09-13T06:31:10.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e0492640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f6616948f0 0x55f661694cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e0492640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55f6616948f0 0x55f661694cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46214/0 (socket says 172.21.15.169:46214) 2024-09-13T06:31:10.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e0492640 1 -- 172.21.15.169:0/1167768063 learned_addr learned my addr 172.21.15.169:0/1167768063 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2dfc91640 1 --1- 172.21.15.169:0/1167768063 >> v1:172.21.15.112:6789/0 conn(0x55f661695240 0x55f661699c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48110/0 (socket says 172.21.15.169:48110) 2024-09-13T06:31:10.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e0492640 1 -- 172.21.15.169:0/1167768063 >> v1:172.21.15.112:6789/0 conn(0x55f661695240 legacy=0x55f661699c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.401+0000 7fe2e0492640 1 -- 172.21.15.169:0/1167768063 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66169c4c0 con 0x55f6616948f0 2024-09-13T06:31:10.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1167768063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6616948f0 0x55f661694cd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800a5c0 tx=0x7fe2d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57de57e6ad41fe81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2df490640 1 -- 172.21.15.169:0/1167768063 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80a6070 con 0x55f6616948f0 2024-09-13T06:31:10.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2df490640 1 -- 172.21.15.169:0/1167768063 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d80af070 con 0x55f6616948f0 2024-09-13T06:31:10.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2df490640 1 -- 172.21.15.169:0/1167768063 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80aa5c0 con 0x55f6616948f0 2024-09-13T06:31:10.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 -- 172.21.15.169:0/1167768063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6616948f0 msgr2=0x55f661694cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1167768063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6616948f0 0x55f661694cd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800a5c0 tx=0x7fe2d801b340 comp rx=0 tx=0).stop 2024-09-13T06:31:10.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 -- 172.21.15.169:0/1167768063 shutdown_connections 2024-09-13T06:31:10.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1167768063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6616948f0 0x55f661694cd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 -- 172.21.15.169:0/1167768063 >> 172.21.15.169:0/1167768063 conn(0x55f661608240 msgr2=0x55f661608650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 -- 172.21.15.169:0/1167768063 shutdown_connections 2024-09-13T06:31:10.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.405+0000 7fe2e2982980 1 -- 172.21.15.169:0/1167768063 wait complete. 2024-09-13T06:31:10.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.421+0000 7fe2e2982980 1 Processor -- start 2024-09-13T06:31:10.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.421+0000 7fe2e2982980 1 -- start start 2024-09-13T06:31:10.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.421+0000 7fe2e2982980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 0x55f66177fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.421+0000 7fe2e2982980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f661540200 con 0x55f661695240 2024-09-13T06:31:10.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 0x55f66177fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 0x55f66177fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46228/0 (socket says 172.21.15.169:46228) 2024-09-13T06:31:10.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 -- 172.21.15.169:0/2010327390 learned_addr learned my addr 172.21.15.169:0/2010327390 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 -- 172.21.15.169:0/2010327390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f661780370 con 0x55f661695240 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 --2- 172.21.15.169:0/2010327390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 0x55f66177fda0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8018f70 tx=0x7fe2d8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c607dcf74819af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe1ce60c640 1 -- 172.21.15.169:0/2010327390 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80aa990 con 0x55f661695240 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe1ce60c640 1 -- 172.21.15.169:0/2010327390 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d80aab30 con 0x55f661695240 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe1ce60c640 1 -- 172.21.15.169:0/2010327390 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80aae10 con 0x55f661695240 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- 172.21.15.169:0/2010327390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 msgr2=0x55f66177fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 --2- 172.21.15.169:0/2010327390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 0x55f66177fda0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8018f70 tx=0x7fe2d8003030 comp rx=0 tx=0).stop 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- 172.21.15.169:0/2010327390 shutdown_connections 2024-09-13T06:31:10.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 --2- 172.21.15.169:0/2010327390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661695240 0x55f66177fda0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- 172.21.15.169:0/2010327390 >> 172.21.15.169:0/2010327390 conn(0x55f661608240 msgr2=0x55f66177b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- 172.21.15.169:0/2010327390 shutdown_connections 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- 172.21.15.169:0/2010327390 wait complete. 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 Processor -- start 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- start start 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661787210 0x55f661787630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e2982980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f66169bf00 con 0x55f661787210 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661787210 0x55f661787630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661787210 0x55f661787630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46230/0 (socket says 172.21.15.169:46230) 2024-09-13T06:31:10.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 -- 172.21.15.169:0/1513585752 learned_addr learned my addr 172.21.15.169:0/1513585752 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f661787b70 con 0x55f661787210 2024-09-13T06:31:10.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.425+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661787210 0x55f661787630 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8005aa0 tx=0x7fe2d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe1cce09640 1 -- 172.21.15.169:0/1513585752 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80cb030 con 0x55f661787210 2024-09-13T06:31:10.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f661787e00 con 0x55f661787210 2024-09-13T06:31:10.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe1cce09640 1 -- 172.21.15.169:0/1513585752 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d8000e50 con 0x55f661787210 2024-09-13T06:31:10.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe1cce09640 1 -- 172.21.15.169:0/1513585752 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80c68d0 con 0x55f661787210 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66178a8e0 con 0x55f661787210 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe1cce09640 1 -- 172.21.15.169:0/1513585752 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2d80ce070 con 0x55f661787210 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe1cce09640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe1cce09640 1 -- 172.21.15.169:0/1513585752 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe2d80cc070 con 0x55f661787210 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f66178c690 0x55f66178ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f66178f0a0 con 0x55f66178c690 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e0c93640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f66178c690 0x55f66178ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1c8034650 0x7fe1c8036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4001e50 tx=0x7fe2d40013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e0c93640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f66178c690 0x55f66178ea80 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1513585752 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f66178c690 2024-09-13T06:31:10.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f66178fe70 0x55f661792260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f661792890 con 0x55f66178fe70 2024-09-13T06:31:10.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.429+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f66178fe70 0x55f661792260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f66178fe70 0x55f661792260 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e0492640 1 -- 172.21.15.169:0/1513585752 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f66178fe70 2024-09-13T06:31:10.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f661794140 con 0x55f66178fe70 2024-09-13T06:31:10.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e0492640 1 -- 172.21.15.169:0/1513585752 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f66178fe70 2024-09-13T06:31:10.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f661793370 con 0x55f66178fe70 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e0492640 1 -- 172.21.15.169:0/1513585752 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f66178fe70 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617954f0 0x55f6617978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f661797e20 con 0x55f6617954f0 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617954f0 0x55f6617978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617954f0 0x55f6617978e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.433+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1513585752 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2d400f700 con 0x55f6617954f0 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 Processor -- start 2024-09-13T06:31:10.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 -- start start 2024-09-13T06:31:10.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 0x55f6617a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f661599800 con 0x55f6617a58b0 2024-09-13T06:31:10.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 0x55f6617a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 0x55f6617a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46246/0 (socket says 172.21.15.169:46246) 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e0492640 1 -- 172.21.15.169:0/2692339853 learned_addr learned my addr 172.21.15.169:0/2692339853 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e0492640 1 -- 172.21.15.169:0/2692339853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6617a6210 con 0x55f6617a58b0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e0492640 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 0x55f6617a5cd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80c6fd0 tx=0x7fe2d80b3ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe1c5ffb640 1 -- 172.21.15.169:0/2692339853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80bde20 con 0x55f6617a58b0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6617a64a0 con 0x55f6617a58b0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6617a64a0 con 0x55f6617a58b0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe1c5ffb640 1 -- 172.21.15.169:0/2692339853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d80b5b40 con 0x55f6617a58b0 2024-09-13T06:31:10.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe1c5ffb640 1 -- 172.21.15.169:0/2692339853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80b5e20 con 0x55f6617a58b0 2024-09-13T06:31:10.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe1c5ffb640 1 -- 172.21.15.169:0/2692339853 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2d80c5720 con 0x55f6617a58b0 2024-09-13T06:31:10.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe1c5ffb640 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe1c5ffb640 1 -- 172.21.15.169:0/2692339853 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe2d80ec070 con 0x55f6617a58b0 2024-09-13T06:31:10.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 Processor -- start 2024-09-13T06:31:10.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.437+0000 7fe2e2982980 1 -- start start 2024-09-13T06:31:10.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f661780630 con 0x55f6617b1fd0 2024-09-13T06:31:10.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b8034650 0x7fe1b8036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55f661798220 tx=0x7fe2d400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46250/0 (socket says 172.21.15.169:46250) 2024-09-13T06:31:10.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 -- 172.21.15.169:0/1086882045 learned_addr learned my addr 172.21.15.169:0/1086882045 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 -- 172.21.15.169:0/1086882045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6617b2980 con 0x55f6617b1fd0 2024-09-13T06:31:10.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1086882045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b23b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80d0720 tx=0x7fe2d80e0f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23dbf225eab915 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe1bf7fe640 1 -- 172.21.15.169:0/1086882045 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80c5a10 con 0x55f6617b1fd0 2024-09-13T06:31:10.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe1bf7fe640 1 -- 172.21.15.169:0/1086882045 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d8101070 con 0x55f6617b1fd0 2024-09-13T06:31:10.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe1bf7fe640 1 -- 172.21.15.169:0/1086882045 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80d2e20 con 0x55f6617b1fd0 2024-09-13T06:31:10.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- 172.21.15.169:0/1086882045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 msgr2=0x55f6617b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1086882045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b23b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80d0720 tx=0x7fe2d80e0f80 comp rx=0 tx=0).stop 2024-09-13T06:31:10.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- 172.21.15.169:0/1086882045 shutdown_connections 2024-09-13T06:31:10.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1086882045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b23b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- 172.21.15.169:0/1086882045 >> 172.21.15.169:0/1086882045 conn(0x55f6617ae3b0 msgr2=0x55f6617ac4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- 172.21.15.169:0/1086882045 shutdown_connections 2024-09-13T06:31:10.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- 172.21.15.169:0/1086882045 wait complete. 2024-09-13T06:31:10.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 Processor -- start 2024-09-13T06:31:10.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- start start 2024-09-13T06:31:10.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e2982980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f6617b2e20 con 0x55f6617b1fd0 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46254/0 (socket says 172.21.15.169:46254) 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 learned_addr learned my addr 172.21.15.169:0/1001031837 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.441+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6617b96b0 con 0x55f6617b1fd0 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b9170 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80e5ed0 tx=0x7fe2d80ff070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe1bdffb640 1 -- 172.21.15.169:0/1001031837 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80e09a0 con 0x55f6617b1fd0 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe1bdffb640 1 -- 172.21.15.169:0/1001031837 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d80c5a10 con 0x55f6617b1fd0 2024-09-13T06:31:10.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe1bdffb640 1 -- 172.21.15.169:0/1001031837 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80a8460 con 0x55f6617b1fd0 2024-09-13T06:31:10.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6617b96b0 con 0x55f6617b1fd0 2024-09-13T06:31:10.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6617b96b0 con 0x55f6617b1fd0 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe1bdffb640 1 -- 172.21.15.169:0/1001031837 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2d8112020 con 0x55f6617b1fd0 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe1bdffb640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b0034650 0x7fe1b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe1bdffb640 1 -- 172.21.15.169:0/1001031837 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe2d8100350 con 0x55f6617b1fd0 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b0034650 0x7fe1b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f6617c40d0 0x55f6617c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617c6ce0 con 0x55f6617c40d0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e0c93640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f6617c40d0 0x55f6617c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b0034650 0x7fe1b0036b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400baa0 tx=0x7fe2d4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e0c93640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f6617c40d0 0x55f6617c6590 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 realm 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617c3500 con 0x55f6617c40d0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617c7770 con 0x55f6617c40d0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f6617c8550 0x55f6617ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.445+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cafd0 con 0x55f6617c8550 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f6617c8550 0x55f6617ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f6617c8550 0x55f6617ca940 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 20 searching for the correct realm 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617cd590 0x55f6617cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d0000 con 0x55f6617cd590 2024-09-13T06:31:10.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617cd590 0x55f6617cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2dfc91640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617cd590 0x55f6617cf980 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d0000 con 0x55f6617c8550 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe2d80d0030 0x7fe2d80d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x7fe2d80d0030 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.449+0000 7fe2e0c93640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe2d80d0030 0x7fe2d80d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe2d80d0030 0x7fe2d80d20c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617cd590 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x7fe2d80d0030 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.453+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x7fe2d80d0030 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617cd590 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617cd590 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.457+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617cd590 2024-09-13T06:31:10.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x7fe2d80d0030 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c40d0 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x7fe2d80d0030 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617cd590 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x7fe2d80d0030 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617cd590 2024-09-13T06:31:10.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.461+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cb820 con 0x55f6617c8550 2024-09-13T06:31:10.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cc070 con 0x55f6617c40d0 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cc460 con 0x55f6617c8550 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617cc460 con 0x55f6617cd590 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 zone default found 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 4 Realm: () 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 zonegroup default 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d0460 con 0x7fe2d80d0030 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d2690 con 0x55f6617cd590 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d2a30 con 0x55f6617cd590 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 started sync module instance, tier type = 2024-09-13T06:31:10.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.465+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d1ad0 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94516685905920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d1ad0 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d3280 con 0x55f6617c40d0 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94516685909456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d3ad0 con 0x55f6617c40d0 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d44d0 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.469+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94516685905920] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94516685909456] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94516685903392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d3620 con 0x55f6617c8550 2024-09-13T06:31:10.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d4d70 con 0x7fe2d80d0030 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94516685916352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d3620 con 0x7fe2d80d0030 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.473+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d5840 con 0x55f6617c8550 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94516685916352] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94516685903392] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94516685914080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d5800 con 0x55f6617c8550 2024-09-13T06:31:10.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d5c30 con 0x55f6617cd590 2024-09-13T06:31:10.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94516685917408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d64d0 con 0x55f6617cd590 2024-09-13T06:31:10.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.477+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d6f10 con 0x55f6617cd590 2024-09-13T06:31:10.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94516685914080] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94516685917408] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94516685924832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d6130 con 0x55f6617cd590 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d7a50 con 0x7fe2d80d0030 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94516685924832] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94516685927712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d7a10 con 0x7fe2d80d0030 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=0 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=1 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=2 2024-09-13T06:31:10.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=3 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=4 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=5 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=6 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94516685927712] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x7fe2d80d0030 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 20 add_watcher() i=7 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617daed0 con 0x55f6617c40d0 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.481+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94516685919024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d83f0 con 0x55f6617c40d0 2024-09-13T06:31:10.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94516685919024] v35'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe1967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:10.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 5 note: GC not initialized 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe1957e2640 20 reqs_thread_entry: start 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 20 Filter name: none 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe106ffd640 20 reqs_thread_entry: start 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fe5a0 con 0x55f6617c40d0 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fe2d000a4d0 con 0x55f6617c40d0 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T06:31:10.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.485+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f661804ba0 con 0x55f6617c40d0 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe2d0039040 con 0x55f6617c40d0 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e2982980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e2982980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e2982980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:10.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94516686112272 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f661800290 con 0x55f6617c8550 2024-09-13T06:31:10.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94516685914080 notify 150323855411 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55f6617a6210 con 0x55f6617c8550 2024-09-13T06:31:10.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe1bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855411 cookie 94516685914080 notifier 4869 bl.length()=666 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe1bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe1bf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe1bf7fe640 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fe1a4003eb0 con 0x55f6617c8550 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94516686112272 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== watch-notify(notify_complete (2) cookie 94516686112272 notify 150323855411 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f66178a8e0 con 0x55f6617c8550 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.489+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.496 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:10.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.493+0000 7fe1967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.493+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94516685919024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fc3a0 con 0x55f6617c40d0 2024-09-13T06:31:10.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.493+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94516685919024] v35'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2d0039040 con 0x55f6617c40d0 2024-09-13T06:31:10.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.493+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94516685905920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fc3a0 con 0x55f6617c8550 2024-09-13T06:31:10.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94516685905920] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e2982980 20 remove_watcher() i=0 2024-09-13T06:31:10.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e2982980 2 removed watcher, disabling cache 2024-09-13T06:31:10.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94516685909456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fc3a0 con 0x55f6617c40d0 2024-09-13T06:31:10.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94516685909456] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d0039040 con 0x55f6617c40d0 2024-09-13T06:31:10.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e2982980 20 remove_watcher() i=1 2024-09-13T06:31:10.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.497+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94516685903392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fc3a0 con 0x55f6617c8550 2024-09-13T06:31:10.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.501+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94516685903392] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.501+0000 7fe2e2982980 20 remove_watcher() i=2 2024-09-13T06:31:10.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.501+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94516685916352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d1620 con 0x7fe2d80d0030 2024-09-13T06:31:10.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.501+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94516685916352] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d0039040 con 0x7fe2d80d0030 2024-09-13T06:31:10.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.501+0000 7fe2e2982980 20 remove_watcher() i=3 2024-09-13T06:31:10.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.501+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94516685914080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fc3a0 con 0x55f6617c8550 2024-09-13T06:31:10.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e0492640 1 -- 172.21.15.169:0/1001031837 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94516685914080] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80c6d20 con 0x55f6617c8550 2024-09-13T06:31:10.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e2982980 20 remove_watcher() i=4 2024-09-13T06:31:10.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94516685917408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d48c0 con 0x55f6617cd590 2024-09-13T06:31:10.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94516685917408] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e2982980 20 remove_watcher() i=5 2024-09-13T06:31:10.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94516685924832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617d3fe0 con 0x55f6617cd590 2024-09-13T06:31:10.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2dfc91640 1 -- 172.21.15.169:0/1001031837 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94516685924832] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4037040 con 0x55f6617cd590 2024-09-13T06:31:10.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e2982980 20 remove_watcher() i=6 2024-09-13T06:31:10.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.505+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94516685927712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6617fc3a0 con 0x7fe2d80d0030 2024-09-13T06:31:10.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94516685927712] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d0039040 con 0x7fe2d80d0030 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 20 remove_watcher() i=7 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f6617c8550 msgr2=0x55f6617ca940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f6617c8550 0x55f6617ca940 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f6617c40d0 msgr2=0x55f6617c6590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f6617c40d0 0x55f6617c6590 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe2d80d0030 msgr2=0x7fe2d80d20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fe2d80d0030 0x7fe2d80d20c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617cd590 msgr2=0x55f6617cf980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617cd590 0x55f6617cf980 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b0034650 msgr2=0x7fe1b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b0034650 0x7fe1b0036b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400baa0 tx=0x7fe2d4010000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1001031837 reap_dead start 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 msgr2=0x55f6617b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b9170 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80e5ed0 tx=0x7fe2d80ff070 comp rx=0 tx=0).stop 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 shutdown_connections 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1001031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617b1fd0 0x55f6617b9170 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 >> 172.21.15.169:0/1001031837 conn(0x55f6617ae3b0 msgr2=0x55f6617ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 shutdown_connections 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1001031837 wait complete. 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b8034650 msgr2=0x7fe1b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b8034650 0x7fe1b8036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55f661798220 tx=0x7fe2d400f000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 msgr2=0x55f6617a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 0x55f6617a5cd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80c6fd0 tx=0x7fe2d80b3ea0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 shutdown_connections 2024-09-13T06:31:10.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/2692339853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f6617a58b0 0x55f6617a5cd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 >> 172.21.15.169:0/2692339853 conn(0x55f66179aa00 msgr2=0x55f66179d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 shutdown_connections 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/2692339853 wait complete. 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f66178fe70 msgr2=0x55f661792260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55f66178fe70 0x55f661792260 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f66178c690 msgr2=0x55f66178ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55f66178c690 0x55f66178ea80 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617954f0 msgr2=0x55f6617978e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55f6617954f0 0x55f6617978e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1c8034650 msgr2=0x7fe1c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe1c8034650 0x7fe1c8036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4001e50 tx=0x7fe2d40013b0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661787210 msgr2=0x55f661787630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 --2- 172.21.15.169:0/1513585752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f661787210 0x55f661787630 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8005aa0 tx=0x7fe2d80180e0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e0c93640 1 -- 172.21.15.169:0/1513585752 reap_dead start 2024-09-13T06:31:10.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 shutdown_connections 2024-09-13T06:31:10.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 >> 172.21.15.169:0/1513585752 conn(0x55f661608240 msgr2=0x55f66177a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 shutdown_connections 2024-09-13T06:31:10.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.509+0000 7fe2e2982980 1 -- 172.21.15.169:0/1513585752 wait complete. 2024-09-13T06:31:10.525 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.525 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.525 ERROR:root:0 2024-09-13T06:31:10.525 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:10.537 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:10.538 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T06:31:10.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T06:31:10.538 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T06:31:10.605 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:10.606 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:10.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.601+0000 7fd4e3ad4980 1 Processor -- start 2024-09-13T06:31:10.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.601+0000 7fd4e3ad4980 1 -- start start 2024-09-13T06:31:10.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.601+0000 7fd4e3ad4980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55de92866e90 0x55de92869280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.601+0000 7fd4e3ad4980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de926e8ae0 con 0x55de927d52e0 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.601+0000 7fd4e3ad4980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55de9270ce30 con 0x55de92866e90 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e0de3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55de92866e90 0x55de92869280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e0de3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55de92866e90 0x55de92869280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46268/0 (socket says 172.21.15.169:46268) 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e15e4640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x55de927d52e0 0x55de92865770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48120/0 (socket says 172.21.15.169:48120) 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e0de3640 1 -- 172.21.15.169:0/3067106665 learned_addr learned my addr 172.21.15.169:0/3067106665 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e0de3640 1 -- 172.21.15.169:0/3067106665 >> v1:172.21.15.112:6789/0 conn(0x55de927d52e0 legacy=0x55de92865770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e0de3640 1 -- 172.21.15.169:0/3067106665 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de927d56c0 con 0x55de92866e90 2024-09-13T06:31:10.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3067106665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92866e90 0x55de92869280 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00a5c0 tx=0x7fd4cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9a3a989a91aba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4dbfff640 1 -- 172.21.15.169:0/3067106665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc0a6070 con 0x55de92866e90 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4dbfff640 1 -- 172.21.15.169:0/3067106665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0af070 con 0x55de92866e90 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4dbfff640 1 -- 172.21.15.169:0/3067106665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc0aa5c0 con 0x55de92866e90 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3067106665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92866e90 msgr2=0x55de92869280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.605+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3067106665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92866e90 0x55de92869280 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00a5c0 tx=0x7fd4cc01b340 comp rx=0 tx=0).stop 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.609+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3067106665 shutdown_connections 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.609+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3067106665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92866e90 0x55de92869280 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.609+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3067106665 >> 172.21.15.169:0/3067106665 conn(0x55de9285b0a0 msgr2=0x55de9285d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.609+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3067106665 shutdown_connections 2024-09-13T06:31:10.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.609+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3067106665 wait complete. 2024-09-13T06:31:10.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.621+0000 7fd4e3ad4980 1 Processor -- start 2024-09-13T06:31:10.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.621+0000 7fd4e3ad4980 1 -- start start 2024-09-13T06:31:10.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.621+0000 7fd4e3ad4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de9294dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.621+0000 7fd4e3ad4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de9270e200 con 0x55de927d52e0 2024-09-13T06:31:10.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de9294dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de9294dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46284/0 (socket says 172.21.15.169:46284) 2024-09-13T06:31:10.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2749266353 learned_addr learned my addr 172.21.15.169:0/2749266353 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2749266353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9294e220 con 0x55de927d52e0 2024-09-13T06:31:10.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/2749266353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de9294dc50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40015f0 tx=0x7fd4d4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51844f67c4e28647 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd3cf606640 1 -- 172.21.15.169:0/2749266353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4013420 con 0x55de927d52e0 2024-09-13T06:31:10.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd3cf606640 1 -- 172.21.15.169:0/2749266353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d40135e0 con 0x55de927d52e0 2024-09-13T06:31:10.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd3cf606640 1 -- 172.21.15.169:0/2749266353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4013940 con 0x55de927d52e0 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2749266353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 msgr2=0x55de9294dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2749266353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de9294dc50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40015f0 tx=0x7fd4d4001ab0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2749266353 shutdown_connections 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2749266353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de9294dc50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2749266353 >> 172.21.15.169:0/2749266353 conn(0x55de9285b0a0 msgr2=0x55de92949880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2749266353 shutdown_connections 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2749266353 wait complete. 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 Processor -- start 2024-09-13T06:31:10.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- start start 2024-09-13T06:31:10.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de92954fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e3ad4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de9286c220 con 0x55de927d52e0 2024-09-13T06:31:10.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de92954fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de92954fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46296/0 (socket says 172.21.15.169:46296) 2024-09-13T06:31:10.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3084017732 learned_addr learned my addr 172.21.15.169:0/3084017732 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.625+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de929554e0 con 0x55de927d52e0 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de92954fa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4006640 tx=0x7fd4d4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd3cde03640 1 -- 172.21.15.169:0/3084017732 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4022020 con 0x55de927d52e0 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de92955770 con 0x55de927d52e0 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd3cde03640 1 -- 172.21.15.169:0/3084017732 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4006320 con 0x55de927d52e0 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd3cde03640 1 -- 172.21.15.169:0/3084017732 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4004af0 con 0x55de927d52e0 2024-09-13T06:31:10.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de92958450 con 0x55de927d52e0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd3cde03640 1 -- 172.21.15.169:0/3084017732 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4d4025020 con 0x55de927d52e0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd3cde03640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3c80346a0 0x7fd3c8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd3cde03640 1 -- 172.21.15.169:0/3084017732 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd4d4018030 con 0x55de927d52e0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3c80346a0 0x7fd3c8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de92866e90 0x55de9295c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de9295c620 con 0x55de92866e90 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e1de5640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de92866e90 0x55de9295c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3c80346a0 0x7fd3c8036b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0ae000 tx=0x7fd4cc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e1de5640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de92866e90 0x55de9295c0a0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e1de5640 1 -- 172.21.15.169:0/3084017732 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de92866e90 2024-09-13T06:31:10.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de9295d3f0 0x55de9295f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de9295fe10 con 0x55de9295d3f0 2024-09-13T06:31:10.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.629+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de9295d3f0 0x55de9295f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de9295d3f0 0x55de9295f7e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3084017732 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4d401b070 con 0x55de9295d3f0 2024-09-13T06:31:10.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929616c0 con 0x55de9295d3f0 2024-09-13T06:31:10.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3084017732 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4d401b070 con 0x55de9295d3f0 2024-09-13T06:31:10.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929608f0 con 0x55de9295d3f0 2024-09-13T06:31:10.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3084017732 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4d401b070 con 0x55de9295d3f0 2024-09-13T06:31:10.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de92962a70 0x55de92964e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929653a0 con 0x55de92962a70 2024-09-13T06:31:10.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de92962a70 0x55de92964e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de92962a70 0x55de92964e60 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e0de3640 1 -- 172.21.15.169:0/3084017732 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de92962a70 2024-09-13T06:31:10.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.633+0000 7fd4e3ad4980 1 Processor -- start 2024-09-13T06:31:10.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 -- start start 2024-09-13T06:31:10.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 0x55de929731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de92767800 con 0x55de92972da0 2024-09-13T06:31:10.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 0x55de929731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 0x55de929731c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46298/0 (socket says 172.21.15.169:46298) 2024-09-13T06:31:10.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3814445643 learned_addr learned my addr 172.21.15.169:0/3814445643 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e15e4640 1 -- 172.21.15.169:0/3814445643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de92973700 con 0x55de92972da0 2024-09-13T06:31:10.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 0x55de929731c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4004e00 tx=0x7fd4d401ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd3c6ffd640 1 -- 172.21.15.169:0/3814445643 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4041dc0 con 0x55de92972da0 2024-09-13T06:31:10.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd3c6ffd640 1 -- 172.21.15.169:0/3814445643 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d401d560 con 0x55de92972da0 2024-09-13T06:31:10.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd3c6ffd640 1 -- 172.21.15.169:0/3814445643 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d401d840 con 0x55de92972da0 2024-09-13T06:31:10.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de92973930 con 0x55de92972da0 2024-09-13T06:31:10.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de92973930 con 0x55de92972da0 2024-09-13T06:31:10.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd3c6ffd640 1 -- 172.21.15.169:0/3814445643 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4d4010070 con 0x55de92972da0 2024-09-13T06:31:10.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd3c6ffd640 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3b8034650 0x7fd3b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd3c6ffd640 1 -- 172.21.15.169:0/3814445643 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd4d403fc50 con 0x55de92972da0 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3b8034650 0x7fd3b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 Processor -- start 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 -- start start 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de9297f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e3ad4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de9294e5a0 con 0x55de9297f300 2024-09-13T06:31:10.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.637+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3b8034650 0x7fd3b8036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55de92959590 tx=0x7fd4cc005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de9297f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de9297f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46314/0 (socket says 172.21.15.169:46314) 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 -- 172.21.15.169:0/890048233 learned_addr learned my addr 172.21.15.169:0/890048233 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 -- 172.21.15.169:0/890048233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9297fcd0 con 0x55de9297f300 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/890048233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de9297f700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400afd0 tx=0x7fd4d401d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93a8db7a1753c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd3c4ff9640 1 -- 172.21.15.169:0/890048233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4063070 con 0x55de9297f300 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd3c4ff9640 1 -- 172.21.15.169:0/890048233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4026c10 con 0x55de9297f300 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd3c4ff9640 1 -- 172.21.15.169:0/890048233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4048870 con 0x55de9297f300 2024-09-13T06:31:10.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/890048233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 msgr2=0x55de9297f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/890048233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de9297f700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400afd0 tx=0x7fd4d401d9e0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/890048233 shutdown_connections 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/890048233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de9297f700 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/890048233 >> 172.21.15.169:0/890048233 conn(0x55de9297b6e0 msgr2=0x55de929797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/890048233 shutdown_connections 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/890048233 wait complete. 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 Processor -- start 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- start start 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de92986580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e3ad4980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de92980150 con 0x55de9297f300 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de92986580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de92986580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46320/0 (socket says 172.21.15.169:46320) 2024-09-13T06:31:10.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 learned_addr learned my addr 172.21.15.169:0/2334440128 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de92986ac0 con 0x55de9297f300 2024-09-13T06:31:10.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.641+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de92986580 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4061040 tx=0x7fd4d400ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd3b6ffd640 1 -- 172.21.15.169:0/2334440128 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d406c070 con 0x55de9297f300 2024-09-13T06:31:10.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de92986ac0 con 0x55de9297f300 2024-09-13T06:31:10.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd3b6ffd640 1 -- 172.21.15.169:0/2334440128 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4048c60 con 0x55de9297f300 2024-09-13T06:31:10.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd3b6ffd640 1 -- 172.21.15.169:0/2334440128 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4063040 con 0x55de9297f300 2024-09-13T06:31:10.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de92986f30 con 0x55de9297f300 2024-09-13T06:31:10.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd3b6ffd640 1 -- 172.21.15.169:0/2334440128 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4d406f070 con 0x55de9297f300 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd3b6ffd640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3ac034650 0x7fd3ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd3b6ffd640 1 -- 172.21.15.169:0/2334440128 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd4d4072c40 con 0x55de9297f300 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3ac034650 0x7fd3ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de929915b0 0x55de92993a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929941c0 con 0x55de929915b0 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e1de5640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de929915b0 0x55de92993a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.645+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3ac034650 0x7fd3ac036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc000c10 tx=0x7fd4cc0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e1de5640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de929915b0 0x55de92993a70 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 realm 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929909e0 con 0x55de929915b0 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de92994c50 con 0x55de929915b0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de92995a30 0x55de92997e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de92995a30 0x55de92997e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de92995a30 0x55de92997e20 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de92998d00 con 0x55de92995a30 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 20 searching for the correct realm 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de9299a570 0x55de9299ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de9299d100 con 0x55de9299a570 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de9299a570 0x55de9299ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.649+0000 7fd4e0de3640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de9299a570 0x55de9299ca30 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de9299d100 con 0x55de92995a30 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e15e4640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd4d4071070 0x7fd4d40525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x7fd4d4071070 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd4d4071070 0x7fd4d40525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd4d4071070 0x7fd4d40525e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de9299a570 2024-09-13T06:31:10.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.653+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x7fd4d4071070 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x7fd4d4071070 2024-09-13T06:31:10.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de9299a570 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de9299a570 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.657+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de9299a570 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x7fd4d4071070 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x7fd4d4071070 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de9299a570 2024-09-13T06:31:10.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x7fd4d4071070 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.661+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de9299a570 2024-09-13T06:31:10.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de929984b0 con 0x55de92995a30 2024-09-13T06:31:10.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929989a0 con 0x55de929915b0 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de92998d90 con 0x55de92995a30 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de92998d90 con 0x55de9299a570 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 zone default found 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 4 Realm: () 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:10.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 zonegroup default 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de9299d580 con 0x7fd4d4071070 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de9299f390 con 0x55de9299a570 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.665+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de9299f7d0 con 0x55de9299a570 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 20 started sync module instance, tier type = 2024-09-13T06:31:10.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:10.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de9299e7a0 con 0x55de92995a30 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94414430661792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de9299e7a0 con 0x55de92995a30 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a0280 con 0x55de929915b0 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94414430666096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a0b20 con 0x55de929915b0 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.669+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a1540 con 0x55de92995a30 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94414430661792] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94414430666096] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94414430670896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a0670 con 0x55de92995a30 2024-09-13T06:31:10.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a1e10 con 0x7fd4d4071070 2024-09-13T06:31:10.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94414430673248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a0670 con 0x7fd4d4071070 2024-09-13T06:31:10.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.673+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a2890 con 0x55de92995a30 2024-09-13T06:31:10.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94414430673248] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94414430670896] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94414430659312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a23a0 con 0x55de92995a30 2024-09-13T06:31:10.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a3130 con 0x55de9299a570 2024-09-13T06:31:10.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94414430678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a23a0 con 0x55de9299a570 2024-09-13T06:31:10.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a3fa0 con 0x55de9299a570 2024-09-13T06:31:10.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94414430659312] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.677+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94414430678144] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94414430674304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a3fa0 con 0x55de9299a570 2024-09-13T06:31:10.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a4830 con 0x7fd4d4071070 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94414430674304] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94414430681840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a43c0 con 0x7fd4d4071070 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=0 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=1 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=2 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=3 2024-09-13T06:31:10.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=4 2024-09-13T06:31:10.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=5 2024-09-13T06:31:10.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.681+0000 7fd4e3ad4980 20 add_watcher() i=6 2024-09-13T06:31:10.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94414430681840] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 20 add_watcher() i=7 2024-09-13T06:31:10.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:10.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929a7c80 con 0x55de929915b0 2024-09-13T06:31:10.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94414430683440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a51d0 con 0x55de929915b0 2024-09-13T06:31:10.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94414430683440] v35'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd397fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 5 note: GC not initialized 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd396fe5640 20 reqs_thread_entry: start 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 20 Filter name: none 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd394fe1640 20 reqs_thread_entry: start 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.685+0000 7fd4e3ad4980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929cb390 con 0x55de929915b0 2024-09-13T06:31:10.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T06:31:10.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:10.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:10.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929d1d20 con 0x55de929915b0 2024-09-13T06:31:10.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:10.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:10.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94414430869392 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de929cd3d0 con 0x55de92995a30 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94414430659312 notify 150323855412 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fd4d4045040 con 0x55de92995a30 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd3c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855412 cookie 94414430659312 notifier 4876 bl.length()=666 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd3c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd3c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94414430869392 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd3c4ff9640 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd3a4003eb0 con 0x55de92995a30 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.689+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94414430869392 notify 150323855412 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd4d4045420 con 0x55de92995a30 2024-09-13T06:31:10.696 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:10.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.693+0000 7fd397fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.693+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94414430683440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929c9190 con 0x55de929915b0 2024-09-13T06:31:10.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.693+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94414430683440] v35'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.693+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94414430661792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929c9190 con 0x55de92995a30 2024-09-13T06:31:10.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94414430661792] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e3ad4980 20 remove_watcher() i=0 2024-09-13T06:31:10.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e3ad4980 2 removed watcher, disabling cache 2024-09-13T06:31:10.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94414430666096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929c9190 con 0x55de929915b0 2024-09-13T06:31:10.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94414430666096] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x55de929915b0 2024-09-13T06:31:10.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e3ad4980 20 remove_watcher() i=1 2024-09-13T06:31:10.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.697+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94414430670896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929c9190 con 0x55de92995a30 2024-09-13T06:31:10.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.701+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94414430670896] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.701+0000 7fd4e3ad4980 20 remove_watcher() i=2 2024-09-13T06:31:10.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.701+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94414430673248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a1030 con 0x7fd4d4071070 2024-09-13T06:31:10.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.701+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94414430673248] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.701+0000 7fd4e3ad4980 20 remove_watcher() i=3 2024-09-13T06:31:10.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.701+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94414430659312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929c9190 con 0x55de92995a30 2024-09-13T06:31:10.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e15e4640 1 -- 172.21.15.169:0/2334440128 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94414430659312] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d4078070 con 0x55de92995a30 2024-09-13T06:31:10.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 20 remove_watcher() i=4 2024-09-13T06:31:10.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94414430678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929a1960 con 0x55de9299a570 2024-09-13T06:31:10.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94414430678144] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 20 remove_watcher() i=5 2024-09-13T06:31:10.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94414430674304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de9299e2f0 con 0x55de9299a570 2024-09-13T06:31:10.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e0de3640 1 -- 172.21.15.169:0/2334440128 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94414430674304] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4cc0aaae0 con 0x55de9299a570 2024-09-13T06:31:10.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 20 remove_watcher() i=6 2024-09-13T06:31:10.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94414430681840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de929c9190 con 0x7fd4d4071070 2024-09-13T06:31:10.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94414430681840] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4dc0083f0 con 0x7fd4d4071070 2024-09-13T06:31:10.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.705+0000 7fd4e3ad4980 20 remove_watcher() i=7 2024-09-13T06:31:10.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de92995a30 msgr2=0x55de92997e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de92995a30 0x55de92997e20 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de929915b0 msgr2=0x55de92993a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de929915b0 0x55de92993a70 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd4d4071070 msgr2=0x7fd4d40525e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fd4d4071070 0x7fd4d40525e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de9299a570 msgr2=0x55de9299ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de9299a570 0x55de9299ca30 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3ac034650 msgr2=0x7fd3ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3ac034650 0x7fd3ac036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc000c10 tx=0x7fd4cc0c1040 comp rx=0 tx=0).stop 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 msgr2=0x55de92986580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/2334440128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9297f300 0x55de92986580 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4061040 tx=0x7fd4d400ae70 comp rx=0 tx=0).stop 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 reap_dead start 2024-09-13T06:31:10.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e1de5640 1 -- 172.21.15.169:0/2334440128 reap_dead start 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 shutdown_connections 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 >> 172.21.15.169:0/2334440128 conn(0x55de9297b6e0 msgr2=0x55de929797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 shutdown_connections 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/2334440128 wait complete. 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3b8034650 msgr2=0x7fd3b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3b8034650 0x7fd3b8036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55de92959590 tx=0x7fd4cc005ad0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 msgr2=0x55de929731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 0x55de929731c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4004e00 tx=0x7fd4d401ef80 comp rx=0 tx=0).stop 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 shutdown_connections 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3b8034650 0x7fd3b8036b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3814445643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de92972da0 0x55de929731c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 >> 172.21.15.169:0/3814445643 conn(0x55de92967ef0 msgr2=0x55de9296a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 shutdown_connections 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3814445643 wait complete. 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de9295d3f0 msgr2=0x55de9295f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55de9295d3f0 0x55de9295f7e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de92866e90 msgr2=0x55de9295c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55de92866e90 0x55de9295c0a0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de92962a70 msgr2=0x55de92964e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55de92962a70 0x55de92964e60 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3c80346a0 msgr2=0x7fd3c8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd3c80346a0 0x7fd3c8036b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0ae000 tx=0x7fd4cc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 msgr2=0x55de92954fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 --2- 172.21.15.169:0/3084017732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de927d52e0 0x55de92954fa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4006640 tx=0x7fd4d4000f50 comp rx=0 tx=0).stop 2024-09-13T06:31:10.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e1de5640 1 -- 172.21.15.169:0/3084017732 reap_dead start 2024-09-13T06:31:10.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 shutdown_connections 2024-09-13T06:31:10.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 >> 172.21.15.169:0/3084017732 conn(0x55de9285b0a0 msgr2=0x55de92948400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 shutdown_connections 2024-09-13T06:31:10.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.709+0000 7fd4e3ad4980 1 -- 172.21.15.169:0/3084017732 wait complete. 2024-09-13T06:31:10.724 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.724 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.724 ERROR:root:0 2024-09-13T06:31:10.725 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:10.737 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:10.738 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:10.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:10.738 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T06:31:10.801 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:10.801 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:10.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a8f29980 1 Processor -- start 2024-09-13T06:31:10.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a8f29980 1 -- start start 2024-09-13T06:31:10.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a8f29980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5581f14e2660 0x5581f14e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a8f29980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581f136aae0 con 0x5581f14e2fb0 2024-09-13T06:31:10.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a8f29980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5581f138ee30 con 0x5581f14e2660 2024-09-13T06:31:10.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a6a39640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5581f14e2660 0x5581f14e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a6238640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5581f14e2fb0 0x5581f14e79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48134/0 (socket says 172.21.15.169:48134) 2024-09-13T06:31:10.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.797+0000 7f41a6238640 1 -- 172.21.15.169:0/3578186336 learned_addr learned my addr 172.21.15.169:0/3578186336 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:10.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.801+0000 7f41a6a39640 1 -- 172.21.15.169:0/3578186336 >> v1:172.21.15.112:6789/0 conn(0x5581f14e2fb0 legacy=0x5581f14e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.801+0000 7f41a6a39640 1 -- 172.21.15.169:0/3578186336 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f14ea230 con 0x5581f14e2660 2024-09-13T06:31:10.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a6a39640 1 --2- 172.21.15.169:0/3578186336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2660 0x5581f14e2a40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f419800a480 tx=0x7f419801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94c1a96a19e11f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a5a37640 1 -- 172.21.15.169:0/3578186336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980af070 con 0x5581f14e2660 2024-09-13T06:31:10.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a5a37640 1 -- 172.21.15.169:0/3578186336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980a3e50 con 0x5581f14e2660 2024-09-13T06:31:10.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a5a37640 1 -- 172.21.15.169:0/3578186336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980aa680 con 0x5581f14e2660 2024-09-13T06:31:10.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 -- 172.21.15.169:0/3578186336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2660 msgr2=0x5581f14e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3578186336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2660 0x5581f14e2a40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f419800a480 tx=0x7f419801b110 comp rx=0 tx=0).stop 2024-09-13T06:31:10.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 -- 172.21.15.169:0/3578186336 shutdown_connections 2024-09-13T06:31:10.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3578186336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2660 0x5581f14e2a40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 -- 172.21.15.169:0/3578186336 >> 172.21.15.169:0/3578186336 conn(0x5581f14de180 msgr2=0x5581f14e05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 -- 172.21.15.169:0/3578186336 shutdown_connections 2024-09-13T06:31:10.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.805+0000 7f41a8f29980 1 -- 172.21.15.169:0/3578186336 wait complete. 2024-09-13T06:31:10.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a8f29980 1 Processor -- start 2024-09-13T06:31:10.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a8f29980 1 -- start start 2024-09-13T06:31:10.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a8f29980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f15cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a8f29980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581f1390200 con 0x5581f14e2fb0 2024-09-13T06:31:10.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f15cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f15cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46338/0 (socket says 172.21.15.169:46338) 2024-09-13T06:31:10.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a6a39640 1 -- 172.21.15.169:0/2619675703 learned_addr learned my addr 172.21.15.169:0/2619675703 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a6a39640 1 -- 172.21.15.169:0/2619675703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f15ce1e0 con 0x5581f14e2fb0 2024-09-13T06:31:10.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f41a6a39640 1 --2- 172.21.15.169:0/2619675703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f15cdc10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f41980ad040 tx=0x7f4198003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd5a1e8859e7e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f4094e09640 1 -- 172.21.15.169:0/2619675703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980af040 con 0x5581f14e2fb0 2024-09-13T06:31:10.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f4094e09640 1 -- 172.21.15.169:0/2619675703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980ba070 con 0x5581f14e2fb0 2024-09-13T06:31:10.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.821+0000 7f4094e09640 1 -- 172.21.15.169:0/2619675703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980aa9e0 con 0x5581f14e2fb0 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/2619675703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 msgr2=0x5581f15cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2619675703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f15cdc10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f41980ad040 tx=0x7f4198003030 comp rx=0 tx=0).stop 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/2619675703 shutdown_connections 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2619675703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f15cdc10 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/2619675703 >> 172.21.15.169:0/2619675703 conn(0x5581f14de180 msgr2=0x5581f15c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/2619675703 shutdown_connections 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/2619675703 wait complete. 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 Processor -- start 2024-09-13T06:31:10.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- start start 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f1458ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581f14e9c70 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f1458ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f1458ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46352/0 (socket says 172.21.15.169:46352) 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a6a39640 1 -- 172.21.15.169:0/71598531 learned_addr learned my addr 172.21.15.169:0/71598531 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a6a39640 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f1459220 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a6a39640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f1458ce0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f419801b9b0 tx=0x7f4198017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f4093606640 1 -- 172.21.15.169:0/71598531 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980c3070 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581f1457400 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f14578f0 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f4093606640 1 -- 172.21.15.169:0/71598531 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198000e50 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f4093606640 1 -- 172.21.15.169:0/71598531 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980af070 con 0x5581f14e2fb0 2024-09-13T06:31:10.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.825+0000 7f4093606640 1 -- 172.21.15.169:0/71598531 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41980b59a0 con 0x5581f14e2fb0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f4093606640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f408c0346a0 0x7f408c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f4093606640 1 -- 172.21.15.169:0/71598531 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f41980e4ae0 con 0x5581f14e2fb0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a6238640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f408c0346a0 0x7f408c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f15dc2a0 0x5581f15de690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f15debd0 con 0x5581f15dc2a0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a723a640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f15dc2a0 0x5581f15de690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a6238640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f408c0346a0 0x7f408c036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4190006fd0 tx=0x7f4190006680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a723a640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f15dc2a0 0x5581f15de690 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a723a640 1 -- 172.21.15.169:0/71598531 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f15dc2a0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f15df640 0x5581f15e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f15e2230 con 0x5581f15df640 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a6a39640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f15df640 0x5581f15e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a6a39640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f15df640 0x5581f15e1ac0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a6a39640 1 -- 172.21.15.169:0/71598531 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41980b2040 con 0x5581f15df640 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f15e3ae0 con 0x5581f15df640 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a6a39640 1 -- 172.21.15.169:0/71598531 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41980b2040 con 0x5581f15df640 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.829+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f15e2d10 con 0x5581f15df640 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6a39640 1 -- 172.21.15.169:0/71598531 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41980b2040 con 0x5581f15df640 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f15e4e90 0x5581f15e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f15e77c0 con 0x5581f15e4e90 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6238640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f15e4e90 0x5581f15e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6238640 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f15e4e90 0x5581f15e7280 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6238640 1 -- 172.21.15.169:0/71598531 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f419000f070 con 0x5581f15e4e90 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 Processor -- start 2024-09-13T06:31:10.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 -- start start 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 0x5581f15f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581f13e9800 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 0x5581f15f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 0x5581f15f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46366/0 (socket says 172.21.15.169:46366) 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6a39640 1 -- 172.21.15.169:0/2806588182 learned_addr learned my addr 172.21.15.169:0/2806588182 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6a39640 1 -- 172.21.15.169:0/2806588182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f15f5ac0 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a6a39640 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 0x5581f15f5580 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f41980c7c30 tx=0x7f41980bff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f4090e01640 1 -- 172.21.15.169:0/2806588182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980f2070 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f4090e01640 1 -- 172.21.15.169:0/2806588182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980e4760 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581f15f5d50 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f4090e01640 1 -- 172.21.15.169:0/2806588182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980d03f0 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.833+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f15f89d0 con 0x5581f15f5160 2024-09-13T06:31:10.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f4090e01640 1 -- 172.21.15.169:0/2806588182 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41980f5070 con 0x5581f15f5160 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f4090e01640 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f40800346a0 0x7f4080036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f4090e01640 1 -- 172.21.15.169:0/2806588182 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f41980ea070 con 0x5581f15f5160 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6238640 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f40800346a0 0x7f4080036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 Processor -- start 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- start start 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6238640 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f40800346a0 0x7f4080036b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4190006320 tx=0x7f419000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1601d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581f15ce4a0 con 0x5581f1601920 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1601d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1601d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46372/0 (socket says 172.21.15.169:46372) 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6a39640 1 -- 172.21.15.169:0/2321814171 learned_addr learned my addr 172.21.15.169:0/2321814171 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6a39640 1 -- 172.21.15.169:0/2321814171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f16022d0 con 0x5581f1601920 2024-09-13T06:31:10.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a6a39640 1 --2- 172.21.15.169:0/2321814171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1601d00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f41980c3e20 tx=0x7f41980c37c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4497ed659323dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f408a7fc640 1 -- 172.21.15.169:0/2321814171 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980b3580 con 0x5581f1601920 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f408a7fc640 1 -- 172.21.15.169:0/2321814171 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980e01b0 con 0x5581f1601920 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f408a7fc640 1 -- 172.21.15.169:0/2321814171 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980b3720 con 0x5581f1601920 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- 172.21.15.169:0/2321814171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 msgr2=0x5581f1601d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2321814171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1601d00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f41980c3e20 tx=0x7f41980c37c0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- 172.21.15.169:0/2321814171 shutdown_connections 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2321814171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1601d00 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- 172.21.15.169:0/2321814171 >> 172.21.15.169:0/2321814171 conn(0x5581f15fdd00 msgr2=0x5581f15fbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- 172.21.15.169:0/2321814171 shutdown_connections 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- 172.21.15.169:0/2321814171 wait complete. 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 Processor -- start 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- start start 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1608aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.837+0000 7f41a8f29980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581f1602770 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1608aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1608aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46388/0 (socket says 172.21.15.169:46388) 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 learned_addr learned my addr 172.21.15.169:0/3148665692 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f1608fe0 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6a39640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1608aa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f41980c3e20 tx=0x7f41980faea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f4088ff9640 1 -- 172.21.15.169:0/3148665692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198114070 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f4088ff9640 1 -- 172.21.15.169:0/3148665692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980e1b10 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581f1608fe0 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f4088ff9640 1 -- 172.21.15.169:0/3148665692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41980ed410 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f1608fe0 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f4088ff9640 1 -- 172.21.15.169:0/3148665692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f419810d040 con 0x5581f1601920 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f4088ff9640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4070034650 0x7f4070036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f4088ff9640 1 -- 172.21.15.169:0/3148665692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f4198102070 con 0x5581f1601920 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6238640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4070034650 0x7f4070036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f1613c00 0x5581f16160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f1616810 con 0x5581f1613c00 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a723a640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f1613c00 0x5581f16160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a6238640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4070034650 0x7f4070036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5581f14583d0 tx=0x7f4190010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.841+0000 7f41a723a640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f1613c00 0x5581f16160c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 realm 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f1613030 con 0x5581f1613c00 2024-09-13T06:31:10.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f16172e0 con 0x5581f1613c00 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f16180c0 0x5581f161a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161ab30 con 0x5581f16180c0 2024-09-13T06:31:10.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a6a39640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f16180c0 0x5581f161a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a6a39640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f16180c0 0x5581f161a4b0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161b380 con 0x5581f16180c0 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 20 searching for the correct realm 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f161cc20 0x5581f161f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581f161f7b0 con 0x5581f161cc20 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a6238640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f161cc20 0x5581f161f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.845+0000 7f41a6238640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f161cc20 0x5581f161f0e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581f161f7b0 con 0x5581f16180c0 2024-09-13T06:31:10.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6a39640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4198110040 0x7f41980dc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x7f4198110040 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4198110040 0x7f41980dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4198110040 0x7f41980dc850 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f161cc20 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.849+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x7f4198110040 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x7f4198110040 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f161cc20 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f161cc20 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.853+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f161cc20 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x7f4198110040 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f1613c00 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x7f4198110040 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f161cc20 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x7f4198110040 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f161cc20 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.857+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f419812d040 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:10.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161b050 con 0x5581f1613c00 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161b440 con 0x5581f16180c0 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161b440 con 0x5581f161cc20 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 zone default found 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 4 Realm: () 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 zonegroup default 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161fc30 con 0x7f4198110040 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f161b9b0 con 0x5581f161cc20 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f1621fa0 con 0x5581f161cc20 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 started sync module instance, tier type = 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:10.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.861+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f16212f0 con 0x5581f16180c0 2024-09-13T06:31:10.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.865+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.865+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94016588879856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f16212f0 con 0x5581f16180c0 2024-09-13T06:31:10.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.865+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1622a60 con 0x5581f1613c00 2024-09-13T06:31:10.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.865+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.865+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94016588883312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1623300 con 0x5581f1613c00 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.865+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1623d40 con 0x5581f16180c0 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94016588879856] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94016588883312] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94016588888080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1622e50 con 0x5581f16180c0 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f16245e0 con 0x7f4198110040 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94016588890416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1622e50 con 0x7f4198110040 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1625060 con 0x5581f16180c0 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.869+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94016588888080] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94016588890416] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94016588891472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1624b70 con 0x5581f16180c0 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1625900 con 0x5581f161cc20 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94016588895312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1624b70 con 0x5581f161cc20 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1626770 con 0x5581f161cc20 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.873+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94016588891472] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94016588895312] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94016588899008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1626b10 con 0x5581f161cc20 2024-09-13T06:31:10.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1627360 con 0x7f4198110040 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94016588901616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1627760 con 0x7f4198110040 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94016588899008] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=0 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=1 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=2 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=3 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=4 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=5 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=6 2024-09-13T06:31:10.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94016588901616] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 20 add_watcher() i=7 2024-09-13T06:31:10.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:10.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f1620f00 con 0x5581f1613c00 2024-09-13T06:31:10.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.877+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94016588902896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1620f00 con 0x5581f1613c00 2024-09-13T06:31:10.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94016588902896] v35'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f405d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:10.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 5 note: GC not initialized 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f3fd7fff640 20 reqs_thread_entry: start 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 20 Filter name: none 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f3fd5ffb640 20 reqs_thread_entry: start 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 20 rados->read ofs=0 len=0 2024-09-13T06:31:10.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f164dea0 con 0x5581f1613c00 2024-09-13T06:31:10.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T06:31:10.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:10.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:10.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.881+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1654800 con 0x5581f1613c00 2024-09-13T06:31:10.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a8f29980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:10.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a8f29980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a8f29980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:10.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94016589087344 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581f164feb0 con 0x5581f16180c0 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94016588891472 notify 150323855413 ret 0) ==== 721+0+0 (crc 0 0 0) 0x5581f15f5ac0 con 0x5581f16180c0 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f408a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855413 cookie 94016588891472 notifier 4883 bl.length()=679 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f408a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f408a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f408a7fc640 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f406c003eb0 con 0x5581f16180c0 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94016589087344 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94016589087344 notify 150323855413 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5581f14578f0 con 0x5581f16180c0 2024-09-13T06:31:10.890 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:10.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f405d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:10.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.885+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94016588902896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f164bca0 con 0x5581f1613c00 2024-09-13T06:31:10.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.889+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94016588902896] v35'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.889+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94016588879856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f164bca0 con 0x5581f16180c0 2024-09-13T06:31:10.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.889+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94016588879856] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.889+0000 7f41a8f29980 20 remove_watcher() i=0 2024-09-13T06:31:10.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.889+0000 7f41a8f29980 2 removed watcher, disabling cache 2024-09-13T06:31:10.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.889+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94016588883312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f164bca0 con 0x5581f1613c00 2024-09-13T06:31:10.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.893+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94016588883312] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x5581f1613c00 2024-09-13T06:31:10.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.893+0000 7f41a8f29980 20 remove_watcher() i=1 2024-09-13T06:31:10.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.893+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94016588888080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f164bca0 con 0x5581f16180c0 2024-09-13T06:31:10.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.893+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94016588888080] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.893+0000 7f41a8f29980 20 remove_watcher() i=2 2024-09-13T06:31:10.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.893+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94016588890416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1623810 con 0x7f4198110040 2024-09-13T06:31:10.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94016588890416] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a8f29980 20 remove_watcher() i=3 2024-09-13T06:31:10.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94016588891472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f164bca0 con 0x5581f16180c0 2024-09-13T06:31:10.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a6a39640 1 -- 172.21.15.169:0/3148665692 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94016588891472] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41980f4030 con 0x5581f16180c0 2024-09-13T06:31:10.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a8f29980 20 remove_watcher() i=4 2024-09-13T06:31:10.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94016588895312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1623810 con 0x5581f161cc20 2024-09-13T06:31:10.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94016588895312] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a8f29980 20 remove_watcher() i=5 2024-09-13T06:31:10.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.897+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94016588899008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f164bca0 con 0x5581f161cc20 2024-09-13T06:31:10.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a6238640 1 -- 172.21.15.169:0/3148665692 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94016588899008] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419000f070 con 0x5581f161cc20 2024-09-13T06:31:10.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 20 remove_watcher() i=6 2024-09-13T06:31:10.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94016588901616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581f1623810 con 0x7f4198110040 2024-09-13T06:31:10.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94016588901616] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a00083f0 con 0x7f4198110040 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 20 remove_watcher() i=7 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f16180c0 msgr2=0x5581f161a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f16180c0 0x5581f161a4b0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f1613c00 msgr2=0x5581f16160c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f1613c00 0x5581f16160c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4198110040 msgr2=0x7f41980dc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f4198110040 0x7f41980dc850 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f161cc20 msgr2=0x5581f161f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f161cc20 0x5581f161f0e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4070034650 msgr2=0x7f4070036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f4070034650 0x7f4070036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5581f14583d0 tx=0x7f4190010000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a723a640 1 -- 172.21.15.169:0/3148665692 reap_dead start 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 msgr2=0x5581f1608aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1608aa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f41980c3e20 tx=0x7f41980faea0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 shutdown_connections 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/3148665692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f1601920 0x5581f1608aa0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 >> 172.21.15.169:0/3148665692 conn(0x5581f15fdd00 msgr2=0x5581f15fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 shutdown_connections 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/3148665692 wait complete. 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f40800346a0 msgr2=0x7f4080036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f40800346a0 0x7f4080036b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4190006320 tx=0x7f419000f000 comp rx=0 tx=0).stop 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 msgr2=0x5581f15f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 0x5581f15f5580 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f41980c7c30 tx=0x7f41980bff10 comp rx=0 tx=0).stop 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 shutdown_connections 2024-09-13T06:31:10.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f40800346a0 0x7f4080036b60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/2806588182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f15f5160 0x5581f15f5580 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 >> 172.21.15.169:0/2806588182 conn(0x5581f15ea260 msgr2=0x5581f15ecd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 shutdown_connections 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/2806588182 wait complete. 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f15df640 msgr2=0x5581f15e1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5581f15df640 0x5581f15e1ac0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f15dc2a0 msgr2=0x5581f15de690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5581f15dc2a0 0x5581f15de690 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f15e4e90 msgr2=0x5581f15e7280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5581f15e4e90 0x5581f15e7280 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f408c0346a0 msgr2=0x7f408c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f408c0346a0 0x7f408c036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4190006fd0 tx=0x7f4190006680 comp rx=0 tx=0).stop 2024-09-13T06:31:10.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 msgr2=0x5581f1458ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 --2- 172.21.15.169:0/71598531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581f14e2fb0 0x5581f1458ce0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f419801b9b0 tx=0x7f4198017eb0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a723a640 1 -- 172.21.15.169:0/71598531 reap_dead start 2024-09-13T06:31:10.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 shutdown_connections 2024-09-13T06:31:10.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 >> 172.21.15.169:0/71598531 conn(0x5581f14de180 msgr2=0x5581f15c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 shutdown_connections 2024-09-13T06:31:10.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.901+0000 7f41a8f29980 1 -- 172.21.15.169:0/71598531 wait complete. 2024-09-13T06:31:10.916 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.917 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:10.917 ERROR:root:0 2024-09-13T06:31:10.917 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:10.930 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:10.930 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T06:31:10.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T06:31:10.931 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T06:31:10.992 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:10.992 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:10.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe36b1980 1 Processor -- start 2024-09-13T06:31:10.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe36b1980 1 -- start start 2024-09-13T06:31:10.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe36b1980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a9a0c798f0 0x55a9a0c79cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:10.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe36b1980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9a0affae0 con 0x55a9a0c7a240 2024-09-13T06:31:10.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe36b1980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55a9a0b23e30 con 0x55a9a0c798f0 2024-09-13T06:31:10.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe11c1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a9a0c798f0 0x55a9a0c79cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:10.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe11c1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55a9a0c798f0 0x55a9a0c79cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46392/0 (socket says 172.21.15.169:46392) 2024-09-13T06:31:10.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe11c1640 1 -- 172.21.15.169:0/528268129 learned_addr learned my addr 172.21.15.169:0/528268129 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:10.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe09c0640 1 --1- 172.21.15.169:0/528268129 >> v1:172.21.15.112:6789/0 conn(0x55a9a0c7a240 0x55a9a0c7ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48150/0 (socket says 172.21.15.169:48150) 2024-09-13T06:31:10.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe11c1640 1 -- 172.21.15.169:0/528268129 >> v1:172.21.15.112:6789/0 conn(0x55a9a0c7a240 legacy=0x55a9a0c7ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.989+0000 7ffbe11c1640 1 -- 172.21.15.169:0/528268129 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0c814c0 con 0x55a9a0c798f0 2024-09-13T06:31:10.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/528268129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0c79cd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400a5c0 tx=0x7ffbd401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90baeb957cbe710 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:10.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbdbfff640 1 -- 172.21.15.169:0/528268129 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40a6070 con 0x55a9a0c798f0 2024-09-13T06:31:10.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbdbfff640 1 -- 172.21.15.169:0/528268129 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40af070 con 0x55a9a0c798f0 2024-09-13T06:31:10.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbdbfff640 1 -- 172.21.15.169:0/528268129 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40aa5c0 con 0x55a9a0c798f0 2024-09-13T06:31:10.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 -- 172.21.15.169:0/528268129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 msgr2=0x55a9a0c79cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:10.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/528268129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0c79cd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400a5c0 tx=0x7ffbd401b340 comp rx=0 tx=0).stop 2024-09-13T06:31:10.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 -- 172.21.15.169:0/528268129 shutdown_connections 2024-09-13T06:31:10.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/528268129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0c79cd0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:10.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 -- 172.21.15.169:0/528268129 >> 172.21.15.169:0/528268129 conn(0x55a9a0bed240 msgr2=0x55a9a0bed650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:10.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 -- 172.21.15.169:0/528268129 shutdown_connections 2024-09-13T06:31:10.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:10.993+0000 7ffbe36b1980 1 -- 172.21.15.169:0/528268129 wait complete. 2024-09-13T06:31:11.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 Processor -- start 2024-09-13T06:31:11.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- start start 2024-09-13T06:31:11.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d64c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0b25200 con 0x55a9a0c798f0 2024-09-13T06:31:11.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d64c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d64c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46404/0 (socket says 172.21.15.169:46404) 2024-09-13T06:31:11.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe11c1640 1 -- 172.21.15.169:0/800051617 learned_addr learned my addr 172.21.15.169:0/800051617 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe11c1640 1 -- 172.21.15.169:0/800051617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0d65240 con 0x55a9a0c798f0 2024-09-13T06:31:11.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/800051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d64c70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400a5c0 tx=0x7ffbd4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5f1156c35e0c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffacf606640 1 -- 172.21.15.169:0/800051617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40aa9b0 con 0x55a9a0c798f0 2024-09-13T06:31:11.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffacf606640 1 -- 172.21.15.169:0/800051617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40aab50 con 0x55a9a0c798f0 2024-09-13T06:31:11.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffacf606640 1 -- 172.21.15.169:0/800051617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40aae50 con 0x55a9a0c798f0 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- 172.21.15.169:0/800051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 msgr2=0x55a9a0d64c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/800051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d64c70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400a5c0 tx=0x7ffbd4003030 comp rx=0 tx=0).stop 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- 172.21.15.169:0/800051617 shutdown_connections 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/800051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d64c70 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- 172.21.15.169:0/800051617 >> 172.21.15.169:0/800051617 conn(0x55a9a0bed240 msgr2=0x55a9a0d608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- 172.21.15.169:0/800051617 shutdown_connections 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 -- 172.21.15.169:0/800051617 wait complete. 2024-09-13T06:31:11.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.009+0000 7ffbe36b1980 1 Processor -- start 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 -- start start 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d6bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0c80f00 con 0x55a9a0c798f0 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d6bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d6bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46414/0 (socket says 172.21.15.169:46414) 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe11c1640 1 -- 172.21.15.169:0/2223707347 learned_addr learned my addr 172.21.15.169:0/2223707347 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe11c1640 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0d6c420 con 0x55a9a0c798f0 2024-09-13T06:31:11.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d6bee0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffbd401bbe0 tx=0x7ffbd40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffacde03640 1 -- 172.21.15.169:0/2223707347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40c6750 con 0x55a9a0c798f0 2024-09-13T06:31:11.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9a0d6c6b0 con 0x55a9a0c798f0 2024-09-13T06:31:11.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffacde03640 1 -- 172.21.15.169:0/2223707347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40c68f0 con 0x55a9a0c798f0 2024-09-13T06:31:11.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffacde03640 1 -- 172.21.15.169:0/2223707347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40c6c10 con 0x55a9a0c798f0 2024-09-13T06:31:11.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a0d6f390 con 0x55a9a0c798f0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffacde03640 1 -- 172.21.15.169:0/2223707347 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbd40ce020 con 0x55a9a0c798f0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffacde03640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffac8034650 0x7ffac8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffacde03640 1 -- 172.21.15.169:0/2223707347 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7ffbd40cc020 con 0x55a9a0c798f0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffac8034650 0x7ffac8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0c7a240 0x55a9a0d72fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0d73520 con 0x55a9a0c7a240 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe19c2640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0c7a240 0x55a9a0d72fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffac8034650 0x7ffac8036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0012f0 tx=0x7ffbcc006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.013+0000 7ffbe19c2640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0c7a240 0x55a9a0d72fe0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe19c2640 1 -- 172.21.15.169:0/2223707347 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0c7a240 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0d742d0 0x55a9a0d766c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0d76d00 con 0x55a9a0d742d0 2024-09-13T06:31:11.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0d742d0 0x55a9a0d766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0d742d0 0x55a9a0d766c0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe11c1640 1 -- 172.21.15.169:0/2223707347 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbd40e50b0 con 0x55a9a0d742d0 2024-09-13T06:31:11.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0d785b0 con 0x55a9a0d742d0 2024-09-13T06:31:11.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe11c1640 1 -- 172.21.15.169:0/2223707347 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffbd40e50b0 con 0x55a9a0d742d0 2024-09-13T06:31:11.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0d777e0 con 0x55a9a0d742d0 2024-09-13T06:31:11.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe11c1640 1 -- 172.21.15.169:0/2223707347 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbd40e50b0 con 0x55a9a0d742d0 2024-09-13T06:31:11.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0d79960 0x55a9a0d7bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0d7c290 con 0x55a9a0d79960 2024-09-13T06:31:11.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.017+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0d79960 0x55a9a0d7bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0d79960 0x55a9a0d7bd50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe09c0640 1 -- 172.21.15.169:0/2223707347 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0d79960 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe36b1980 1 Processor -- start 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe36b1980 1 -- start start 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe36b1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 0x55a9a0d8a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe36b1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0b7e800 con 0x55a9a0d89d20 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 0x55a9a0d8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 0x55a9a0d8a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46416/0 (socket says 172.21.15.169:46416) 2024-09-13T06:31:11.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe11c1640 1 -- 172.21.15.169:0/232272474 learned_addr learned my addr 172.21.15.169:0/232272474 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe11c1640 1 -- 172.21.15.169:0/232272474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0d8a680 con 0x55a9a0d89d20 2024-09-13T06:31:11.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 0x55a9a0d8a140 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40bcb30 tx=0x7ffbd40c5e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffac6ffd640 1 -- 172.21.15.169:0/232272474 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40e9070 con 0x55a9a0d89d20 2024-09-13T06:31:11.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9a0d8a910 con 0x55a9a0d89d20 2024-09-13T06:31:11.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffac6ffd640 1 -- 172.21.15.169:0/232272474 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40c5580 con 0x55a9a0d89d20 2024-09-13T06:31:11.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffac6ffd640 1 -- 172.21.15.169:0/232272474 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40bcba0 con 0x55a9a0d89d20 2024-09-13T06:31:11.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a0d8d590 con 0x55a9a0d89d20 2024-09-13T06:31:11.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.021+0000 7ffac6ffd640 1 -- 172.21.15.169:0/232272474 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbd40b3ad0 con 0x55a9a0d89d20 2024-09-13T06:31:11.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffac6ffd640 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffab8034650 0x7ffab8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffac6ffd640 1 -- 172.21.15.169:0/232272474 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7ffbd40d20b0 con 0x55a9a0d89d20 2024-09-13T06:31:11.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffab8034650 0x7ffab8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 Processor -- start 2024-09-13T06:31:11.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- start start 2024-09-13T06:31:11.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffab8034650 0x7ffab8036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55a9a0d7c690 tx=0x7ffbcc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d96ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0d65500 con 0x55a9a0d966e0 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d96ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d96ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46426/0 (socket says 172.21.15.169:46426) 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3861609728 learned_addr learned my addr 172.21.15.169:0/3861609728 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3861609728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0d97090 con 0x55a9a0d966e0 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/3861609728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d96ac0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40e37b0 tx=0x7ffbd40bce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747dbc7803cba26c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffac4ff9640 1 -- 172.21.15.169:0/3861609728 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40c5770 con 0x55a9a0d966e0 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffac4ff9640 1 -- 172.21.15.169:0/3861609728 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40ee450 con 0x55a9a0d966e0 2024-09-13T06:31:11.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffac4ff9640 1 -- 172.21.15.169:0/3861609728 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40c5910 con 0x55a9a0d966e0 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3861609728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 msgr2=0x55a9a0d96ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3861609728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d96ac0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40e37b0 tx=0x7ffbd40bce00 comp rx=0 tx=0).stop 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3861609728 shutdown_connections 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3861609728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d96ac0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3861609728 >> 172.21.15.169:0/3861609728 conn(0x55a9a0d92ac0 msgr2=0x55a9a0d90bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3861609728 shutdown_connections 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3861609728 wait complete. 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 Processor -- start 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- start start 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d9d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe36b1980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0d97530 con 0x55a9a0d966e0 2024-09-13T06:31:11.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d9d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d9d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46428/0 (socket says 172.21.15.169:46428) 2024-09-13T06:31:11.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.025+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 learned_addr learned my addr 172.21.15.169:0/3638896738 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0d9de20 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d9d8e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40e37b0 tx=0x7ffbd40a9f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffab6ffd640 1 -- 172.21.15.169:0/3638896738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40e57f0 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9a0d9de20 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffab6ffd640 1 -- 172.21.15.169:0/3638896738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40e5990 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffab6ffd640 1 -- 172.21.15.169:0/3638896738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbd40cf7d0 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a0d9de20 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffab6ffd640 1 -- 172.21.15.169:0/3638896738 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbd4101020 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffab6ffd640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffaac034650 0x7ffaac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffab6ffd640 1 -- 172.21.15.169:0/3638896738 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7ffbd410fc30 con 0x55a9a0d966e0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffaac034650 0x7ffaac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0da8760 0x55a9a0daac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dab370 con 0x55a9a0da8760 2024-09-13T06:31:11.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe19c2640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0da8760 0x55a9a0daac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffaac034650 0x7ffaac036b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc004fd0 tx=0x7ffbcc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe19c2640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0da8760 0x55a9a0daac20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 realm 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0da7b90 con 0x55a9a0da8760 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:11.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dabe30 con 0x55a9a0da8760 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0dacc10 0x55a9a0daf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.029+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daf6b0 con 0x55a9a0dacc10 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0dacc10 0x55a9a0daf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0dacc10 0x55a9a0daf000 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 20 searching for the correct realm 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0db1c70 0x55a9a0db4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db4710 con 0x55a9a0db1c70 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0db1c70 0x55a9a0db4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe09c0640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0db1c70 0x55a9a0db4060 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db4710 con 0x55a9a0dacc10 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffbd40ee070 0x7ffbd40cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x7ffbd40ee070 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe19c2640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffbd40ee070 0x7ffbd40cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.033+0000 7ffbe19c2640 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffbd40ee070 0x7ffbd40cc220 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0db1c70 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x7ffbd40ee070 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x7ffbd40ee070 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.037+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0db1c70 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0db1c70 2024-09-13T06:31:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0db1c70 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x7ffbd40ee070 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0da8760 2024-09-13T06:31:11.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x7ffbd40ee070 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0db1c70 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x7ffbd40ee070 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.041+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0db1c70 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0daff00 con 0x55a9a0dacc10 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db0750 con 0x55a9a0da8760 2024-09-13T06:31:11.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db0b40 con 0x55a9a0dacc10 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db0b40 con 0x55a9a0db1c70 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 zone default found 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 4 Realm: () 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:11.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 zonegroup default 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db4b70 con 0x7ffbd40ee070 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.045+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db6da0 con 0x55a9a0db1c70 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db7140 con 0x55a9a0db1c70 2024-09-13T06:31:11.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 20 started sync module instance, tier type = 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db61e0 con 0x55a9a0dacc10 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94187036566992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db61e0 con 0x55a9a0dacc10 2024-09-13T06:31:11.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db7990 con 0x55a9a0da8760 2024-09-13T06:31:11.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94187036570848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db81e0 con 0x55a9a0da8760 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.049+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db8c00 con 0x55a9a0dacc10 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94187036566992] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94187036570848] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94187036575472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db7d30 con 0x55a9a0dacc10 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db94a0 con 0x7ffbd40ee070 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94187036577776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db7d30 con 0x7ffbd40ee070 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db9f40 con 0x55a9a0dacc10 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94187036575472] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.053+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94187036577776] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94187036578832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db9f00 con 0x55a9a0dacc10 2024-09-13T06:31:11.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dba330 con 0x55a9a0db1c70 2024-09-13T06:31:11.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94187036564784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbabd0 con 0x55a9a0db1c70 2024-09-13T06:31:11.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbb5d0 con 0x55a9a0db1c70 2024-09-13T06:31:11.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94187036578832] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94187036564784] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94187036580400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbb9c0 con 0x55a9a0db1c70 2024-09-13T06:31:11.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.057+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbc210 con 0x7ffbd40ee070 2024-09-13T06:31:11.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94187036580400] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94187036588480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbc290 con 0x7ffbd40ee070 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=0 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=1 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=2 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=3 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=4 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=5 2024-09-13T06:31:11.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=6 2024-09-13T06:31:11.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94187036588480] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 add_watcher() i=7 2024-09-13T06:31:11.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:11.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbf520 con 0x55a9a0da8760 2024-09-13T06:31:11.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94187036589904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0dbc820 con 0x55a9a0da8760 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94187036589904] v35'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffa977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 5 note: GC not initialized 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffa967e4640 20 reqs_thread_entry: start 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.061+0000 7ffbe36b1980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 20 Filter name: none 2024-09-13T06:31:11.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffa07fff640 20 reqs_thread_entry: start 2024-09-13T06:31:11.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:11.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de2c40 con 0x55a9a0da8760 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de9620 con 0x55a9a0da8760 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:11.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94187036774544 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de4cf0 con 0x55a9a0dacc10 2024-09-13T06:31:11.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94187036578832 notify 150323855414 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55a9a0d8a910 con 0x55a9a0dacc10 2024-09-13T06:31:11.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffac4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855414 cookie 94187036578832 notifier 4890 bl.length()=636 2024-09-13T06:31:11.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffac4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffac4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94187036774544 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffac4ff9640 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ffaa4003eb0 con 0x55a9a0dacc10 2024-09-13T06:31:11.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.065+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94187036774544 notify 150323855414 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9a0d8a680 con 0x55a9a0dacc10 2024-09-13T06:31:11.071 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:11.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.069+0000 7ffa977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.069+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94187036589904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de0a30 con 0x55a9a0da8760 2024-09-13T06:31:11.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.069+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94187036589904] v35'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.069+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94187036566992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de0a30 con 0x55a9a0dacc10 2024-09-13T06:31:11.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94187036566992] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 20 remove_watcher() i=0 2024-09-13T06:31:11.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 2 removed watcher, disabling cache 2024-09-13T06:31:11.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94187036570848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de0a30 con 0x55a9a0da8760 2024-09-13T06:31:11.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94187036570848] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x55a9a0da8760 2024-09-13T06:31:11.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 20 remove_watcher() i=1 2024-09-13T06:31:11.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94187036575472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de0a30 con 0x55a9a0dacc10 2024-09-13T06:31:11.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94187036575472] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 20 remove_watcher() i=2 2024-09-13T06:31:11.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.073+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94187036577776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db86f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94187036577776] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe36b1980 20 remove_watcher() i=3 2024-09-13T06:31:11.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94187036578832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de0a30 con 0x55a9a0dacc10 2024-09-13T06:31:11.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe11c1640 1 -- 172.21.15.169:0/3638896738 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94187036578832] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbd40eb070 con 0x55a9a0dacc10 2024-09-13T06:31:11.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe36b1980 20 remove_watcher() i=4 2024-09-13T06:31:11.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94187036564784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db86f0 con 0x55a9a0db1c70 2024-09-13T06:31:11.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94187036564784] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe36b1980 20 remove_watcher() i=5 2024-09-13T06:31:11.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.077+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94187036580400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0de0a30 con 0x55a9a0db1c70 2024-09-13T06:31:11.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe09c0640 1 -- 172.21.15.169:0/3638896738 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94187036580400] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbcc00f070 con 0x55a9a0db1c70 2024-09-13T06:31:11.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 20 remove_watcher() i=6 2024-09-13T06:31:11.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94187036588480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9a0db86f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94187036588480] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc0083f0 con 0x7ffbd40ee070 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 20 remove_watcher() i=7 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0dacc10 msgr2=0x55a9a0daf000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0dacc10 0x55a9a0daf000 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0da8760 msgr2=0x55a9a0daac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0da8760 0x55a9a0daac20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffbd40ee070 msgr2=0x7ffbd40cc220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7ffbd40ee070 0x7ffbd40cc220 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0db1c70 msgr2=0x55a9a0db4060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0db1c70 0x55a9a0db4060 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffaac034650 msgr2=0x7ffaac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffaac034650 0x7ffaac036b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc004fd0 tx=0x7ffbcc010000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 msgr2=0x55a9a0d9d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe19c2640 1 -- 172.21.15.169:0/3638896738 reap_dead start 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d9d8e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40e37b0 tx=0x7ffbd40a9f80 comp rx=0 tx=0).stop 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 shutdown_connections 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/3638896738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d966e0 0x55a9a0d9d8e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 >> 172.21.15.169:0/3638896738 conn(0x55a9a0d92ac0 msgr2=0x55a9a0d90b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 shutdown_connections 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/3638896738 wait complete. 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffab8034650 msgr2=0x7ffab8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffab8034650 0x7ffab8036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55a9a0d7c690 tx=0x7ffbcc00f000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 msgr2=0x55a9a0d8a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 0x55a9a0d8a140 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40bcb30 tx=0x7ffbd40c5e40 comp rx=0 tx=0).stop 2024-09-13T06:31:11.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 shutdown_connections 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffab8034650 0x7ffab8036b10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/232272474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0d89d20 0x55a9a0d8a140 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 >> 172.21.15.169:0/232272474 conn(0x55a9a0d7ee70 msgr2=0x55a9a0d818f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 shutdown_connections 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/232272474 wait complete. 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0d742d0 msgr2=0x55a9a0d766c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55a9a0d742d0 0x55a9a0d766c0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0c7a240 msgr2=0x55a9a0d72fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55a9a0c7a240 0x55a9a0d72fe0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0d79960 msgr2=0x55a9a0d7bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55a9a0d79960 0x55a9a0d7bd50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffac8034650 msgr2=0x7ffac8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7ffac8034650 0x7ffac8036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0012f0 tx=0x7ffbcc006700 comp rx=0 tx=0).stop 2024-09-13T06:31:11.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 msgr2=0x55a9a0d6bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 --2- 172.21.15.169:0/2223707347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a9a0c798f0 0x55a9a0d6bee0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffbd401bbe0 tx=0x7ffbd40180e0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe19c2640 1 -- 172.21.15.169:0/2223707347 reap_dead start 2024-09-13T06:31:11.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 shutdown_connections 2024-09-13T06:31:11.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 >> 172.21.15.169:0/2223707347 conn(0x55a9a0bed240 msgr2=0x55a9a0d5f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 shutdown_connections 2024-09-13T06:31:11.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.081+0000 7ffbe36b1980 1 -- 172.21.15.169:0/2223707347 wait complete. 2024-09-13T06:31:11.095 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.095 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.096 ERROR:root:0 2024-09-13T06:31:11.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:31:11.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:31:11.096 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T06:31:11.174 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:11.174 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:11.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.169+0000 7f5d445c9980 1 Processor -- start 2024-09-13T06:31:11.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d445c9980 1 -- start start 2024-09-13T06:31:11.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d445c9980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55c6a1cfc2a0 0x55c6a1d8a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d445c9980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c6a1c0fae0 con 0x55c6a1d8a8f0 2024-09-13T06:31:11.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d445c9980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x55c6a1c33e30 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d420d9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55c6a1cfc2a0 0x55c6a1d8a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d420d9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x55c6a1cfc2a0 0x55c6a1d8a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46444/0 (socket says 172.21.15.169:46444) 2024-09-13T06:31:11.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d420d9640 1 -- 172.21.15.169:0/434042952 learned_addr learned my addr 172.21.15.169:0/434042952 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d420d9640 1 -- 172.21.15.169:0/434042952 >> v1:172.21.15.112:6789/0 conn(0x55c6a1d8a8f0 legacy=0x55c6a1d8cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d420d9640 1 -- 172.21.15.169:0/434042952 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1cfc830 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d420d9640 1 --2- 172.21.15.169:0/434042952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1d8a3b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00a4e0 tx=0x7f5d3c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175777d001986bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d410d7640 1 -- 172.21.15.169:0/434042952 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0aa540 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d410d7640 1 -- 172.21.15.169:0/434042952 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0aa6e0 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.173+0000 7f5d410d7640 1 -- 172.21.15.169:0/434042952 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0aaa40 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 -- 172.21.15.169:0/434042952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 msgr2=0x55c6a1d8a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 --2- 172.21.15.169:0/434042952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1d8a3b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00a4e0 tx=0x7f5d3c01b090 comp rx=0 tx=0).stop 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 -- 172.21.15.169:0/434042952 shutdown_connections 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 --2- 172.21.15.169:0/434042952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1d8a3b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 -- 172.21.15.169:0/434042952 >> 172.21.15.169:0/434042952 conn(0x55c6a1d820a0 msgr2=0x55c6a1d844c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 -- 172.21.15.169:0/434042952 shutdown_connections 2024-09-13T06:31:11.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.177+0000 7f5d445c9980 1 -- 172.21.15.169:0/434042952 wait complete. 2024-09-13T06:31:11.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 Processor -- start 2024-09-13T06:31:11.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- start start 2024-09-13T06:31:11.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e72a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c6a1c35200 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e72a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e72a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46448/0 (socket says 172.21.15.169:46448) 2024-09-13T06:31:11.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d420d9640 1 -- 172.21.15.169:0/3896430266 learned_addr learned my addr 172.21.15.169:0/3896430266 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d420d9640 1 -- 172.21.15.169:0/3896430266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1e73040 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d420d9640 1 --2- 172.21.15.169:0/3896430266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e72a70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c017ca0 tx=0x7f5d3c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45a3e276fe787d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5c30608640 1 -- 172.21.15.169:0/3896430266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0b9030 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5c30608640 1 -- 172.21.15.169:0/3896430266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0aaac0 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5c30608640 1 -- 172.21.15.169:0/3896430266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0aada0 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- 172.21.15.169:0/3896430266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 msgr2=0x55c6a1e72a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 --2- 172.21.15.169:0/3896430266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e72a70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c017ca0 tx=0x7f5d3c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- 172.21.15.169:0/3896430266 shutdown_connections 2024-09-13T06:31:11.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 --2- 172.21.15.169:0/3896430266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e72a70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- 172.21.15.169:0/3896430266 >> 172.21.15.169:0/3896430266 conn(0x55c6a1d820a0 msgr2=0x55c6a1e6e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- 172.21.15.169:0/3896430266 shutdown_connections 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.189+0000 7f5d445c9980 1 -- 172.21.15.169:0/3896430266 wait complete. 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 Processor -- start 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 -- start start 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e79c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c6a1d8ef10 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e79c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e79c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46450/0 (socket says 172.21.15.169:46450) 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d420d9640 1 -- 172.21.15.169:0/2349607301 learned_addr learned my addr 172.21.15.169:0/2349607301 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d420d9640 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1e7a1c0 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d420d9640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e79c80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005cc0 tx=0x7f5d3c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5c2ee05640 1 -- 172.21.15.169:0/2349607301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0b9030 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6a1e7a450 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5c2ee05640 1 -- 172.21.15.169:0/2349607301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0c3070 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a1e7d130 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5c2ee05640 1 -- 172.21.15.169:0/2349607301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0cc060 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5c2ee05640 1 -- 172.21.15.169:0/2349607301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d3c0c5030 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5c2ee05640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c28034650 0x7f5c28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5c2ee05640 1 -- 172.21.15.169:0/2349607301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f5d3c0ba070 con 0x55c6a1cfc2a0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d418d8640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c28034650 0x7f5c28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1d8a8f0 0x55c6a1e80c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1e81250 con 0x55c6a1d8a8f0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d428da640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1d8a8f0 0x55c6a1e80c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.193+0000 7f5d418d8640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c28034650 0x7f5c28036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5d38001e20 tx=0x7f5d380013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d428da640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1d8a8f0 0x55c6a1e80c10 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d428da640 1 -- 172.21.15.169:0/2349607301 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1d8a8f0 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1e82040 0x55c6a1e84430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1e84a70 con 0x55c6a1e82040 2024-09-13T06:31:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d420d9640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1e82040 0x55c6a1e84430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d420d9640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1e82040 0x55c6a1e84430 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d420d9640 1 -- 172.21.15.169:0/2349607301 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d3c0c7410 con 0x55c6a1e82040 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1e86320 con 0x55c6a1e82040 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d420d9640 1 -- 172.21.15.169:0/2349607301 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d3c0c7410 con 0x55c6a1e82040 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1e85550 con 0x55c6a1e82040 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d420d9640 1 -- 172.21.15.169:0/2349607301 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d3c0c7410 con 0x55c6a1e82040 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1e876d0 0x55c6a1e89ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1e8a000 con 0x55c6a1e876d0 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d418d8640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1e876d0 0x55c6a1e89ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.197+0000 7f5d418d8640 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1e876d0 0x55c6a1e89ac0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d418d8640 1 -- 172.21.15.169:0/2349607301 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d3800d040 con 0x55c6a1e876d0 2024-09-13T06:31:11.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d445c9980 1 Processor -- start 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d445c9980 1 -- start start 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d445c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 0x55c6a1e97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d445c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c6a1c8e800 con 0x55c6a1e97a90 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 0x55c6a1e97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 0x55c6a1e97eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46460/0 (socket says 172.21.15.169:46460) 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d420d9640 1 -- 172.21.15.169:0/3492161025 learned_addr learned my addr 172.21.15.169:0/3492161025 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d420d9640 1 -- 172.21.15.169:0/3492161025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1e983f0 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d420d9640 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 0x55c6a1e97eb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0ac010 tx=0x7f5d3c0e50b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5c27fff640 1 -- 172.21.15.169:0/3492161025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0e21a0 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6a1e98680 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5c27fff640 1 -- 172.21.15.169:0/3492161025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0e2340 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5c27fff640 1 -- 172.21.15.169:0/3492161025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0c6aa0 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a1e9b300 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5c27fff640 1 -- 172.21.15.169:0/3492161025 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d3c0ec060 con 0x55c6a1e97a90 2024-09-13T06:31:11.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5c27fff640 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c1c034650 0x7f5c1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.201+0000 7f5c27fff640 1 -- 172.21.15.169:0/3492161025 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f5d3c0e6d70 con 0x55c6a1e97a90 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d418d8640 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c1c034650 0x7f5c1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 Processor -- start 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- start start 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d418d8640 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c1c034650 0x7f5c1c036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55c6a1e8a400 tx=0x7f5d38006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1d86770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c6a1e73300 con 0x55c6a1d86370 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1d86770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1d86770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46472/0 (socket says 172.21.15.169:46472) 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 -- 172.21.15.169:0/922647452 learned_addr learned my addr 172.21.15.169:0/922647452 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 -- 172.21.15.169:0/922647452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1d86d40 con 0x55c6a1d86370 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 --2- 172.21.15.169:0/922647452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1d86770 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0d0920 tx=0x7f5d3c0e0610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55142ecc6bc98a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5c25ffb640 1 -- 172.21.15.169:0/922647452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0fb020 con 0x55c6a1d86370 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5c25ffb640 1 -- 172.21.15.169:0/922647452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0dd070 con 0x55c6a1d86370 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5c25ffb640 1 -- 172.21.15.169:0/922647452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0c6c60 con 0x55c6a1d86370 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- 172.21.15.169:0/922647452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 msgr2=0x55c6a1d86770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 --2- 172.21.15.169:0/922647452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1d86770 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0d0920 tx=0x7f5d3c0e0610 comp rx=0 tx=0).stop 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- 172.21.15.169:0/922647452 shutdown_connections 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 --2- 172.21.15.169:0/922647452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1d86770 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- 172.21.15.169:0/922647452 >> 172.21.15.169:0/922647452 conn(0x55c6a1ea07d0 msgr2=0x55c6a1e9e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- 172.21.15.169:0/922647452 shutdown_connections 2024-09-13T06:31:11.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- 172.21.15.169:0/922647452 wait complete. 2024-09-13T06:31:11.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 Processor -- start 2024-09-13T06:31:11.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- start start 2024-09-13T06:31:11.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1ead7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d445c9980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c6a1d87370 con 0x55c6a1d86370 2024-09-13T06:31:11.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1ead7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1ead7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46486/0 (socket says 172.21.15.169:46486) 2024-09-13T06:31:11.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.205+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 learned_addr learned my addr 172.21.15.169:0/1470668170 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1eadcf0 con 0x55c6a1d86370 2024-09-13T06:31:11.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d420d9640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1ead7b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0e0650 tx=0x7f5d3c0d7f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5c13fff640 1 -- 172.21.15.169:0/1470668170 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c110070 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6a1eadcf0 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5c13fff640 1 -- 172.21.15.169:0/1470668170 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0c0980 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5c13fff640 1 -- 172.21.15.169:0/1470668170 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3c0c0c60 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a1eadcf0 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5c13fff640 1 -- 172.21.15.169:0/1470668170 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d3c113070 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5c13fff640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c0c0346a0 0x7f5c0c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5c13fff640 1 -- 172.21.15.169:0/1470668170 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f5d3c106030 con 0x55c6a1d86370 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d418d8640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c0c0346a0 0x7f5c0c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1eb88a0 0x55c6a1ebad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ebb4b0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d428da640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1eb88a0 0x55c6a1ebad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d418d8640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c0c0346a0 0x7f5c0c036b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5d380207d0 tx=0x7f5d38011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d428da640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1eb88a0 0x55c6a1ebad60 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 realm 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1eb7d90 con 0x55c6a1eb88a0 2024-09-13T06:31:11.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:11.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ebbf80 con 0x55c6a1eb88a0 2024-09-13T06:31:11.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1ebcd60 0x55c6a1ebf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ebf7d0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.209+0000 7f5d420d9640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1ebcd60 0x55c6a1ebf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d420d9640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1ebcd60 0x55c6a1ebf150 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec0020 con 0x55c6a1ebcd60 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 20 searching for the correct realm 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1ec1d90 0x55c6a1ec4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d418d8640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1ec1d90 0x55c6a1ec4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d418d8640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1ec1d90 0x55c6a1ec4180 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d420d9640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5d3c115060 0x7f5d3c0b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x7f5d3c115060 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d428da640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5d3c115060 0x7f5d3c0b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d428da640 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5d3c115060 0x7f5d3c0b9780 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.213+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x7f5d3c115060 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x7f5d3c115060 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.217+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x7f5d3c115060 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1eb88a0 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x7f5d3c115060 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x7f5d3c115060 2024-09-13T06:31:11.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.221+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ec1d90 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec4800 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:11.236 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec09d0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec05e0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec12c0 con 0x55c6a1ec1d90 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 zone default found 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 4 Realm: () 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 zonegroup default 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.225+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec5130 con 0x7f5d3c115060 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec6eb0 con 0x55c6a1ec1d90 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec7350 con 0x55c6a1ec1d90 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 started sync module instance, tier type = 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:11.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec6350 con 0x55c6a1ebcd60 2024-09-13T06:31:11.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94311608510576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec6350 con 0x55c6a1ebcd60 2024-09-13T06:31:11.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec7e50 con 0x55c6a1eb88a0 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.229+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94311608514848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec86f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec9130 con 0x55c6a1ebcd60 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94311608510576] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94311608514848] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94311608519680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec8240 con 0x55c6a1ebcd60 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec99d0 con 0x7f5d3c115060 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94311608522016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec8240 con 0x7f5d3c115060 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.233+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1eca4a0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94311608522016] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94311608519680] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94311608508064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1eca460 con 0x55c6a1ebcd60 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1eca890 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94311608523072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecb130 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecbb30 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94311608508064] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94311608523072] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94311608524688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecac80 con 0x55c6a1ec1d90 2024-09-13T06:31:11.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.237+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecc3d0 con 0x7f5d3c115060 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94311608532768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecac80 con 0x7f5d3c115060 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=0 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=1 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=2 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=3 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=4 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=5 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94311608524688] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=6 2024-09-13T06:31:11.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94311608532768] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x7f5d3c115060 2024-09-13T06:31:11.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 20 add_watcher() i=7 2024-09-13T06:31:11.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:11.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecb640 con 0x55c6a1eb88a0 2024-09-13T06:31:11.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.241+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94311608533824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ecb640 con 0x55c6a1eb88a0 2024-09-13T06:31:11.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94311608533824] v35'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5bf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 5 note: GC not initialized 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5b737fe640 20 reqs_thread_entry: start 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 20 Filter name: none 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5b717fa640 20 reqs_thread_entry: start 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef2ad0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f5d340083f0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T06:31:11.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:11.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:11.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef9100 con 0x55c6a1eb88a0 2024-09-13T06:31:11.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5d3403a040 con 0x55c6a1eb88a0 2024-09-13T06:31:11.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:11.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94311608716144 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef47f0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94311608508064 notify 150323855415 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55c6a1e98680 con 0x55c6a1ebcd60 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5c25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855415 cookie 94311608508064 notifier 4897 bl.length()=666 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5c25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5c25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5c25ffb640 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5c08003eb0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94311608716144 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.245+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.249+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94311608716144 notify 150323855415 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c6a1e983f0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.252 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:11.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.249+0000 7f5bf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.249+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94311608533824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef08d0 con 0x55c6a1eb88a0 2024-09-13T06:31:11.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.249+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94311608533824] v35'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d3403a040 con 0x55c6a1eb88a0 2024-09-13T06:31:11.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.249+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94311608510576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef08d0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94311608510576] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d445c9980 20 remove_watcher() i=0 2024-09-13T06:31:11.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d445c9980 2 removed watcher, disabling cache 2024-09-13T06:31:11.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94311608514848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec6870 con 0x55c6a1eb88a0 2024-09-13T06:31:11.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94311608514848] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3403a040 con 0x55c6a1eb88a0 2024-09-13T06:31:11.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d445c9980 20 remove_watcher() i=1 2024-09-13T06:31:11.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.253+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94311608519680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef08d0 con 0x55c6a1ebcd60 2024-09-13T06:31:11.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94311608519680] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d445c9980 20 remove_watcher() i=2 2024-09-13T06:31:11.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94311608522016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec6870 con 0x7f5d3c115060 2024-09-13T06:31:11.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94311608522016] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3403a040 con 0x7f5d3c115060 2024-09-13T06:31:11.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d445c9980 20 remove_watcher() i=3 2024-09-13T06:31:11.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94311608508064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec8c00 con 0x55c6a1ebcd60 2024-09-13T06:31:11.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d420d9640 1 -- 172.21.15.169:0/1470668170 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94311608508064] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3c112030 con 0x55c6a1ebcd60 2024-09-13T06:31:11.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d445c9980 20 remove_watcher() i=4 2024-09-13T06:31:11.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.257+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94311608523072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ef08d0 con 0x55c6a1ec1d90 2024-09-13T06:31:11.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94311608523072] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 20 remove_watcher() i=5 2024-09-13T06:31:11.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94311608524688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec6870 con 0x55c6a1ec1d90 2024-09-13T06:31:11.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d418d8640 1 -- 172.21.15.169:0/1470668170 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94311608524688] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d38036040 con 0x55c6a1ec1d90 2024-09-13T06:31:11.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 20 remove_watcher() i=6 2024-09-13T06:31:11.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94311608532768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c6a1ec5ea0 con 0x7f5d3c115060 2024-09-13T06:31:11.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94311608532768] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3403a040 con 0x7f5d3c115060 2024-09-13T06:31:11.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 20 remove_watcher() i=7 2024-09-13T06:31:11.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1ebcd60 msgr2=0x55c6a1ebf150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1ebcd60 0x55c6a1ebf150 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1eb88a0 msgr2=0x55c6a1ebad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1eb88a0 0x55c6a1ebad60 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5d3c115060 msgr2=0x7f5d3c0b9780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f5d3c115060 0x7f5d3c0b9780 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1ec1d90 msgr2=0x55c6a1ec4180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1ec1d90 0x55c6a1ec4180 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c0c0346a0 msgr2=0x7f5c0c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c0c0346a0 0x7f5c0c036b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5d380207d0 tx=0x7f5d38011000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 msgr2=0x55c6a1ead7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d428da640 1 -- 172.21.15.169:0/1470668170 reap_dead start 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1ead7b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0e0650 tx=0x7f5d3c0d7f20 comp rx=0 tx=0).stop 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 shutdown_connections 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/1470668170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1d86370 0x55c6a1ead7b0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 >> 172.21.15.169:0/1470668170 conn(0x55c6a1ea07d0 msgr2=0x55c6a1e9e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 shutdown_connections 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/1470668170 wait complete. 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c1c034650 msgr2=0x7f5c1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c1c034650 0x7f5c1c036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55c6a1e8a400 tx=0x7f5d38006000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 msgr2=0x55c6a1e97eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 0x55c6a1e97eb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0ac010 tx=0x7f5d3c0e50b0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 shutdown_connections 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c1c034650 0x7f5c1c036b10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/3492161025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1e97a90 0x55c6a1e97eb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 >> 172.21.15.169:0/3492161025 conn(0x55c6a1e8cbe0 msgr2=0x55c6a1e8f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 shutdown_connections 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/3492161025 wait complete. 2024-09-13T06:31:11.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1e82040 msgr2=0x55c6a1e84430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x55c6a1e82040 0x55c6a1e84430 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1d8a8f0 msgr2=0x55c6a1e80c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x55c6a1d8a8f0 0x55c6a1e80c10 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1e876d0 msgr2=0x55c6a1e89ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x55c6a1e876d0 0x55c6a1e89ac0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c28034650 msgr2=0x7f5c28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f5c28034650 0x7f5c28036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5d38001e20 tx=0x7f5d380013a0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 msgr2=0x55c6a1e79c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 --2- 172.21.15.169:0/2349607301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c6a1cfc2a0 0x55c6a1e79c80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005cc0 tx=0x7f5d3c017e30 comp rx=0 tx=0).stop 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d428da640 1 -- 172.21.15.169:0/2349607301 reap_dead start 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 shutdown_connections 2024-09-13T06:31:11.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 >> 172.21.15.169:0/2349607301 conn(0x55c6a1d820a0 msgr2=0x55c6a1e6d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 shutdown_connections 2024-09-13T06:31:11.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.261+0000 7f5d445c9980 1 -- 172.21.15.169:0/2349607301 wait complete. 2024-09-13T06:31:11.275 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.276 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.276 ERROR:root:0 2024-09-13T06:31:11.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:11.289 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000040eb471da967f036-0066e3dc2f-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:31:11.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:31:11.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:31:11.290 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T06:31:11.351 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:11.352 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:11.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc69aab980 1 Processor -- start 2024-09-13T06:31:11.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc69aab980 1 -- start start 2024-09-13T06:31:11.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc69aab980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5584aca832a0 0x5584acb113b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc69aab980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584ac996ae0 con 0x5584acb118f0 2024-09-13T06:31:11.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc69aab980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5584ac9bae30 con 0x5584aca832a0 2024-09-13T06:31:11.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc675bb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5584aca832a0 0x5584acb113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc675bb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5584aca832a0 0x5584acb113b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46502/0 (socket says 172.21.15.169:46502) 2024-09-13T06:31:11.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc675bb640 1 -- 172.21.15.169:0/3996200951 learned_addr learned my addr 172.21.15.169:0/3996200951 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc66dba640 1 --1- 172.21.15.169:0/3996200951 >> v1:172.21.15.112:6789/0 conn(0x5584acb118f0 0x5584acb13ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48176/0 (socket says 172.21.15.169:48176) 2024-09-13T06:31:11.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc675bb640 1 -- 172.21.15.169:0/3996200951 >> v1:172.21.15.112:6789/0 conn(0x5584acb118f0 legacy=0x5584acb13ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.349+0000 7fdc675bb640 1 -- 172.21.15.169:0/3996200951 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584aca83830 con 0x5584aca832a0 2024-09-13T06:31:11.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc675bb640 1 --2- 172.21.15.169:0/3996200951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acb113b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000a4e0 tx=0x7fdc6001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eac403902b2a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc665b9640 1 -- 172.21.15.169:0/3996200951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600aa540 con 0x5584aca832a0 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc665b9640 1 -- 172.21.15.169:0/3996200951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600aa6e0 con 0x5584aca832a0 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc665b9640 1 -- 172.21.15.169:0/3996200951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600aaa40 con 0x5584aca832a0 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 -- 172.21.15.169:0/3996200951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 msgr2=0x5584acb113b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3996200951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acb113b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000a4e0 tx=0x7fdc6001b090 comp rx=0 tx=0).stop 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 -- 172.21.15.169:0/3996200951 shutdown_connections 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3996200951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acb113b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 -- 172.21.15.169:0/3996200951 >> 172.21.15.169:0/3996200951 conn(0x5584acb090a0 msgr2=0x5584acb0b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 -- 172.21.15.169:0/3996200951 shutdown_connections 2024-09-13T06:31:11.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.353+0000 7fdc69aab980 1 -- 172.21.15.169:0/3996200951 wait complete. 2024-09-13T06:31:11.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.365+0000 7fdc69aab980 1 Processor -- start 2024-09-13T06:31:11.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.365+0000 7fdc69aab980 1 -- start start 2024-09-13T06:31:11.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.365+0000 7fdc69aab980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbf7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.365+0000 7fdc69aab980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584ac9bc200 con 0x5584aca832a0 2024-09-13T06:31:11.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbf7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbf7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46518/0 (socket says 172.21.15.169:46518) 2024-09-13T06:31:11.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 -- 172.21.15.169:0/148582955 learned_addr learned my addr 172.21.15.169:0/148582955 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 -- 172.21.15.169:0/148582955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584acbf7e30 con 0x5584aca832a0 2024-09-13T06:31:11.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 --2- 172.21.15.169:0/148582955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbf7860 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdc60017ca0 tx=0x7fdc600033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc32922c479ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdb54618640 1 -- 172.21.15.169:0/148582955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600b9070 con 0x5584aca832a0 2024-09-13T06:31:11.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdb54618640 1 -- 172.21.15.169:0/148582955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600aaa80 con 0x5584aca832a0 2024-09-13T06:31:11.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdb54618640 1 -- 172.21.15.169:0/148582955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600aad60 con 0x5584aca832a0 2024-09-13T06:31:11.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- 172.21.15.169:0/148582955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 msgr2=0x5584acbf7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 --2- 172.21.15.169:0/148582955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbf7860 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdc60017ca0 tx=0x7fdc600033b0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- 172.21.15.169:0/148582955 shutdown_connections 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 --2- 172.21.15.169:0/148582955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbf7860 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- 172.21.15.169:0/148582955 >> 172.21.15.169:0/148582955 conn(0x5584acb090a0 msgr2=0x5584acbf3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- 172.21.15.169:0/148582955 shutdown_connections 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- 172.21.15.169:0/148582955 wait complete. 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 Processor -- start 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- start start 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbfea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc69aab980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584acb15f10 con 0x5584aca832a0 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbfea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbfea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46524/0 (socket says 172.21.15.169:46524) 2024-09-13T06:31:11.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 -- 172.21.15.169:0/6754563 learned_addr learned my addr 172.21.15.169:0/6754563 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584acbfefb0 con 0x5584aca832a0 2024-09-13T06:31:11.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.369+0000 7fdc675bb640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbfea70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdc6001aec0 tx=0x7fdc60017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdb52e15640 1 -- 172.21.15.169:0/6754563 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600cc070 con 0x5584aca832a0 2024-09-13T06:31:11.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584acbff240 con 0x5584aca832a0 2024-09-13T06:31:11.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdb52e15640 1 -- 172.21.15.169:0/6754563 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600c7410 con 0x5584aca832a0 2024-09-13T06:31:11.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdb52e15640 1 -- 172.21.15.169:0/6754563 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600b9070 con 0x5584aca832a0 2024-09-13T06:31:11.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584acc01f20 con 0x5584aca832a0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdb52e15640 1 -- 172.21.15.169:0/6754563 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdc600b3040 con 0x5584aca832a0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdb52e15640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb4c034650 0x7fdb4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdb52e15640 1 -- 172.21.15.169:0/6754563 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fdc600c4070 con 0x5584aca832a0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc66dba640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb4c034650 0x7fdb4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acb118f0 0x5584acc05b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc06140 con 0x5584acb118f0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc67dbc640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acb118f0 0x5584acc05b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc66dba640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb4c034650 0x7fdb4c036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdc58000f70 tx=0x7fdc58001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc67dbc640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acb118f0 0x5584acc05b70 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc67dbc640 1 -- 172.21.15.169:0/6754563 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acb118f0 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc06f40 0x5584acc09330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc09970 con 0x5584acc06f40 2024-09-13T06:31:11.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc675bb640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc06f40 0x5584acc09330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.373+0000 7fdc675bb640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc06f40 0x5584acc09330 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc675bb640 1 -- 172.21.15.169:0/6754563 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc600b43a0 con 0x5584acc06f40 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc0b220 con 0x5584acc06f40 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc675bb640 1 -- 172.21.15.169:0/6754563 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc600b43a0 con 0x5584acc06f40 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc0a450 con 0x5584acc06f40 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc675bb640 1 -- 172.21.15.169:0/6754563 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc600b43a0 con 0x5584acc06f40 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc0c5d0 0x5584acc0e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc0ef00 con 0x5584acc0c5d0 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc66dba640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc0c5d0 0x5584acc0e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc66dba640 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc0c5d0 0x5584acc0e9c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc66dba640 1 -- 172.21.15.169:0/6754563 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc5800f6a0 con 0x5584acc0c5d0 2024-09-13T06:31:11.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 Processor -- start 2024-09-13T06:31:11.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 -- start start 2024-09-13T06:31:11.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 0x5584acc1cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc69aab980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584aca15800 con 0x5584acc1c8c0 2024-09-13T06:31:11.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 0x5584acc1cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 0x5584acc1cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46528/0 (socket says 172.21.15.169:46528) 2024-09-13T06:31:11.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.377+0000 7fdc675bb640 1 -- 172.21.15.169:0/2519915596 learned_addr learned my addr 172.21.15.169:0/2519915596 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 -- 172.21.15.169:0/2519915596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584acc1d220 con 0x5584acc1c8c0 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 0x5584acc1cce0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdc60000f90 tx=0x7fdc600cf920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdb4bfff640 1 -- 172.21.15.169:0/2519915596 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600d1df0 con 0x5584acc1c8c0 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584acc1d4b0 con 0x5584acc1c8c0 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdb4bfff640 1 -- 172.21.15.169:0/2519915596 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc60005020 con 0x5584acc1c8c0 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdb4bfff640 1 -- 172.21.15.169:0/2519915596 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc60005320 con 0x5584acc1c8c0 2024-09-13T06:31:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584acc20130 con 0x5584acc1c8c0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdb4bfff640 1 -- 172.21.15.169:0/2519915596 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdc600e1050 con 0x5584acc1c8c0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdb4bfff640 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb40034650 0x7fdb40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdb4bfff640 1 -- 172.21.15.169:0/2519915596 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fdc600d6040 con 0x5584acc1c8c0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc66dba640 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb40034650 0x7fdb40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc69aab980 1 Processor -- start 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc69aab980 1 -- start start 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc69aab980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc295d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc66dba640 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb40034650 0x7fdb40036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5584acc03060 tx=0x7fdc5800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc69aab980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584acbf80f0 con 0x5584acc291f0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc295d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc295d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46534/0 (socket says 172.21.15.169:46534) 2024-09-13T06:31:11.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 -- 172.21.15.169:0/2135582701 learned_addr learned my addr 172.21.15.169:0/2135582701 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 -- 172.21.15.169:0/2135582701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584acc29ba0 con 0x5584acc291f0 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.381+0000 7fdc675bb640 1 --2- 172.21.15.169:0/2135582701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc295d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ee030 tx=0x7fdc60005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c2c33cea3873d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdb49ffb640 1 -- 172.21.15.169:0/2135582701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600e1520 con 0x5584acc291f0 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdb49ffb640 1 -- 172.21.15.169:0/2135582701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600a6e90 con 0x5584acc291f0 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdb49ffb640 1 -- 172.21.15.169:0/2135582701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600e1340 con 0x5584acc291f0 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/2135582701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 msgr2=0x5584acc295d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 --2- 172.21.15.169:0/2135582701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc295d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ee030 tx=0x7fdc60005580 comp rx=0 tx=0).stop 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/2135582701 shutdown_connections 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 --2- 172.21.15.169:0/2135582701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc295d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/2135582701 >> 172.21.15.169:0/2135582701 conn(0x5584acc255d0 msgr2=0x5584acc236d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/2135582701 shutdown_connections 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/2135582701 wait complete. 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 Processor -- start 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- start start 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc303f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584acc2a040 con 0x5584acc291f0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc675bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc303f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46536/0 (socket says 172.21.15.169:46536) 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 learned_addr learned my addr 172.21.15.169:0/3380154408 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584acc30930 con 0x5584acc291f0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc675bb640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc303f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ee030 tx=0x7fdc600da1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdb37fff640 1 -- 172.21.15.169:0/3380154408 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc6010e070 con 0x5584acc291f0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584acc30930 con 0x5584acc291f0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdb37fff640 1 -- 172.21.15.169:0/3380154408 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600ce9b0 con 0x5584acc291f0 2024-09-13T06:31:11.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdb37fff640 1 -- 172.21.15.169:0/3380154408 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc600e1520 con 0x5584acc291f0 2024-09-13T06:31:11.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.385+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584acc30da0 con 0x5584acc291f0 2024-09-13T06:31:11.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdb37fff640 1 -- 172.21.15.169:0/3380154408 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdc60111070 con 0x5584acc291f0 2024-09-13T06:31:11.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdb37fff640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb300345b0 0x7fdb30036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdb37fff640 1 -- 172.21.15.169:0/3380154408 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fdc60106070 con 0x5584acc291f0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc66dba640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb300345b0 0x7fdb30036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acc3b480 0x5584acc3d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc3e070 con 0x5584acc3b480 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc67dbc640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acc3b480 0x5584acc3d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc66dba640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb300345b0 0x7fdb30036a70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800ffd0 tx=0x7fdc58010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc67dbc640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acc3b480 0x5584acc3d920 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 realm 2024-09-13T06:31:11.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc3a970 con 0x5584acc3b480 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc3eb40 con 0x5584acc3b480 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc3f920 0x5584acc41d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc675bb640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc3f920 0x5584acc41d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc675bb640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc3f920 0x5584acc41d10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.389+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42be0 con 0x5584acc3f920 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc69aab980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc69aab980 20 searching for the correct realm 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc44490 0x5584acc46950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc47020 con 0x5584acc44490 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc66dba640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc44490 0x5584acc46950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc66dba640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc44490 0x5584acc46950 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc47020 con 0x5584acc3f920 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc675bb640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdc60113060 0x7fdc600d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x7fdc60113060 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdc60113060 0x7fdc600d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdc60113060 0x7fdc600d1050 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc44490 2024-09-13T06:31:11.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.393+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x7fdc60113060 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x7fdc60113060 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc44490 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc44490 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.397+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc44490 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x7fdc60113060 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x7fdc60113060 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc44490 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x7fdc60113060 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc44490 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.401+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42390 con 0x5584acc3f920 2024-09-13T06:31:11.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42880 con 0x5584acc3b480 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42c70 con 0x5584acc3f920 2024-09-13T06:31:11.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc42c70 con 0x5584acc44490 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 zone default found 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 4 Realm: () 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 zonegroup default 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc474a0 con 0x7fdc60113060 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc43210 con 0x5584acc44490 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc49850 con 0x5584acc44490 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 started sync module instance, tier type = 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:11.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.405+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc48b60 con 0x5584acc3f920 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94028322607200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc48b60 con 0x5584acc3f920 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4a2d0 con 0x5584acc3b480 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94028322610720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4ab20 con 0x5584acc3b480 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4b520 con 0x5584acc3f920 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94028322607200] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.409+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94028322610720] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94028322604720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4a670 con 0x5584acc3f920 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4bdf0 con 0x7fdc60113060 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94028322617664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4a670 con 0x7fdc60113060 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4c890 con 0x5584acc3f920 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94028322617664] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94028322604720] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94028322615344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4c850 con 0x5584acc3f920 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.413+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4cc80 con 0x5584acc44490 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94028322618720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4d4d0 con 0x5584acc44490 2024-09-13T06:31:11.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4def0 con 0x5584acc44490 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94028322615344] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94028322618720] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94028322626016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4e2e0 con 0x5584acc44490 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4eb70 con 0x7fdc60113060 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94028322626016] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94028322620288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4e790 con 0x7fdc60113060 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=0 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=1 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=2 2024-09-13T06:31:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=3 2024-09-13T06:31:11.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=4 2024-09-13T06:31:11.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=5 2024-09-13T06:31:11.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.417+0000 7fdc69aab980 20 add_watcher() i=6 2024-09-13T06:31:11.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94028322620288] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 20 add_watcher() i=7 2024-09-13T06:31:11.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:11.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc52020 con 0x5584acc3b480 2024-09-13T06:31:11.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94028322628864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4f4a0 con 0x5584acc3b480 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94028322628864] v35'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdb1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 5 note: GC not initialized 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fda977fe640 20 reqs_thread_entry: start 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fdc69aab980 20 Filter name: none 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.421+0000 7fda957fa640 20 reqs_thread_entry: start 2024-09-13T06:31:11.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:11.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc756e0 con 0x5584acc3b480 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc7c090 con 0x5584acc3b480 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:11.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94028322814720 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584acc77720 con 0x5584acc3f920 2024-09-13T06:31:11.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94028322615344 notify 150323855416 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5584acc1d4b0 con 0x5584acc3f920 2024-09-13T06:31:11.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdb49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855416 cookie 94028322615344 notifier 4904 bl.length()=636 2024-09-13T06:31:11.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdb49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94028322814720 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdb49ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdb49ffb640 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fdb2c003eb0 con 0x5584acc3f920 2024-09-13T06:31:11.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.425+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94028322814720 notify 150323855416 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5584acc1d220 con 0x5584acc3f920 2024-09-13T06:31:11.431 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:11.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.429+0000 7fdb1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.429+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94028322628864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x5584acc3b480 2024-09-13T06:31:11.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.429+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94028322628864] v35'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.429+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94028322607200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x5584acc3f920 2024-09-13T06:31:11.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94028322607200] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 20 remove_watcher() i=0 2024-09-13T06:31:11.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 2 removed watcher, disabling cache 2024-09-13T06:31:11.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94028322610720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x5584acc3b480 2024-09-13T06:31:11.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94028322610720] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x5584acc3b480 2024-09-13T06:31:11.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 20 remove_watcher() i=1 2024-09-13T06:31:11.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94028322604720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x5584acc3f920 2024-09-13T06:31:11.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94028322604720] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 20 remove_watcher() i=2 2024-09-13T06:31:11.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.433+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94028322617664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x7fdc60113060 2024-09-13T06:31:11.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94028322617664] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc69aab980 20 remove_watcher() i=3 2024-09-13T06:31:11.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94028322615344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4b940 con 0x5584acc3f920 2024-09-13T06:31:11.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc675bb640 1 -- 172.21.15.169:0/3380154408 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94028322615344] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc60110030 con 0x5584acc3f920 2024-09-13T06:31:11.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc69aab980 20 remove_watcher() i=4 2024-09-13T06:31:11.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94028322618720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x5584acc44490 2024-09-13T06:31:11.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94028322618720] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc69aab980 20 remove_watcher() i=5 2024-09-13T06:31:11.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.437+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94028322626016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc4b030 con 0x5584acc44490 2024-09-13T06:31:11.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc66dba640 1 -- 172.21.15.169:0/3380154408 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94028322626016] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc58037040 con 0x5584acc44490 2024-09-13T06:31:11.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 20 remove_watcher() i=6 2024-09-13T06:31:11.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94028322620288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584acc734e0 con 0x7fdc60113060 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94028322620288] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc500083f0 con 0x7fdc60113060 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 20 remove_watcher() i=7 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc3f920 msgr2=0x5584acc41d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc3f920 0x5584acc41d10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acc3b480 msgr2=0x5584acc3d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acc3b480 0x5584acc3d920 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdc60113060 msgr2=0x7fdc600d1050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fdc60113060 0x7fdc600d1050 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc44490 msgr2=0x5584acc46950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc44490 0x5584acc46950 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb300345b0 msgr2=0x7fdb30036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb300345b0 0x7fdb30036a70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800ffd0 tx=0x7fdc58010000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 msgr2=0x5584acc303f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc67dbc640 1 -- 172.21.15.169:0/3380154408 reap_dead start 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc303f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ee030 tx=0x7fdc600da1b0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 shutdown_connections 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/3380154408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc291f0 0x5584acc303f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 >> 172.21.15.169:0/3380154408 conn(0x5584acc255d0 msgr2=0x5584acc236a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 shutdown_connections 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/3380154408 wait complete. 2024-09-13T06:31:11.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb40034650 msgr2=0x7fdb40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb40034650 0x7fdb40036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5584acc03060 tx=0x7fdc5800f000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 msgr2=0x5584acc1cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 0x5584acc1cce0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdc60000f90 tx=0x7fdc600cf920 comp rx=0 tx=0).stop 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 shutdown_connections 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb40034650 0x7fdb40036b10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/2519915596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584acc1c8c0 0x5584acc1cce0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 >> 172.21.15.169:0/2519915596 conn(0x5584acc11a10 msgr2=0x5584acc14490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 shutdown_connections 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/2519915596 wait complete. 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc06f40 msgr2=0x5584acc09330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5584acc06f40 0x5584acc09330 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acb118f0 msgr2=0x5584acc05b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5584acb118f0 0x5584acc05b70 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc0c5d0 msgr2=0x5584acc0e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5584acc0c5d0 0x5584acc0e9c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb4c034650 msgr2=0x7fdb4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fdb4c034650 0x7fdb4c036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdc58000f70 tx=0x7fdc58001380 comp rx=0 tx=0).stop 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 msgr2=0x5584acbfea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 --2- 172.21.15.169:0/6754563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584aca832a0 0x5584acbfea70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdc6001aec0 tx=0x7fdc60017e30 comp rx=0 tx=0).stop 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc67dbc640 1 -- 172.21.15.169:0/6754563 reap_dead start 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 shutdown_connections 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 >> 172.21.15.169:0/6754563 conn(0x5584acb090a0 msgr2=0x5584acbf2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 shutdown_connections 2024-09-13T06:31:11.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.441+0000 7fdc69aab980 1 -- 172.21.15.169:0/6754563 wait complete. 2024-09-13T06:31:11.455 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.456 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.456 ERROR:root:0 2024-09-13T06:31:11.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:11.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:11.456 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T06:31:11.530 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:11.530 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:11.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.525+0000 7f376a03a980 1 Processor -- start 2024-09-13T06:31:11.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f376a03a980 1 -- start start 2024-09-13T06:31:11.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f376a03a980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5582fbcbba90 0x5582fbcbde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f376a03a980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582fbb3fae0 con 0x5582fbc2c2e0 2024-09-13T06:31:11.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f376a03a980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5582fbb63e30 con 0x5582fbcbba90 2024-09-13T06:31:11.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3767b4a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5582fbc2c2e0 0x5582fbcba370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48182/0 (socket says 172.21.15.169:48182) 2024-09-13T06:31:11.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3767b4a640 1 -- 172.21.15.169:0/449165738 learned_addr learned my addr 172.21.15.169:0/449165738 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:11.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3767349640 1 --2- 172.21.15.169:0/449165738 >> v2:172.21.15.112:3300/0 conn(0x5582fbcbba90 0x5582fbcbde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3766b48640 1 -- 172.21.15.169:0/449165738 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402891989 0 0) 0x5582fbb3fae0 con 0x5582fbc2c2e0 2024-09-13T06:31:11.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3766b48640 1 -- 172.21.15.169:0/449165738 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3750001e20 con 0x5582fbc2c2e0 2024-09-13T06:31:11.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3767349640 1 -- 172.21.15.169:0/449165738 >> v1:172.21.15.112:6789/0 conn(0x5582fbc2c2e0 legacy=0x5582fbcba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3766b48640 1 -- 172.21.15.169:0/449165738 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2590905941 0 0) 0x7f3750001e20 con 0x5582fbc2c2e0 2024-09-13T06:31:11.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3767349640 1 -- 172.21.15.169:0/449165738 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fbcbf3d0 con 0x5582fbcbba90 2024-09-13T06:31:11.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3767349640 1 --2- 172.21.15.169:0/449165738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbcbba90 0x5582fbcbde80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a480 tx=0x7f375c01b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb503c183427be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3766b48640 1 -- 172.21.15.169:0/449165738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0af070 con 0x5582fbcbba90 2024-09-13T06:31:11.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3766b48640 1 -- 172.21.15.169:0/449165738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0aa400 con 0x5582fbcbba90 2024-09-13T06:31:11.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.529+0000 7f3766b48640 1 -- 172.21.15.169:0/449165738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760001930 con 0x5582fbcbba90 2024-09-13T06:31:11.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 -- 172.21.15.169:0/449165738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbcbba90 msgr2=0x5582fbcbde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 --2- 172.21.15.169:0/449165738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbcbba90 0x5582fbcbde80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a480 tx=0x7f375c01b1a0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 -- 172.21.15.169:0/449165738 shutdown_connections 2024-09-13T06:31:11.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 --2- 172.21.15.169:0/449165738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbcbba90 0x5582fbcbde80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 -- 172.21.15.169:0/449165738 >> 172.21.15.169:0/449165738 conn(0x5582fbcb20a0 msgr2=0x5582fbcb44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 -- 172.21.15.169:0/449165738 shutdown_connections 2024-09-13T06:31:11.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.533+0000 7f376a03a980 1 -- 172.21.15.169:0/449165738 wait complete. 2024-09-13T06:31:11.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f376a03a980 1 Processor -- start 2024-09-13T06:31:11.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f376a03a980 1 -- start start 2024-09-13T06:31:11.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f376a03a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f376a03a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582fbb65200 con 0x5582fbc2c2e0 2024-09-13T06:31:11.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46556/0 (socket says 172.21.15.169:46556) 2024-09-13T06:31:11.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3767b4a640 1 -- 172.21.15.169:0/1292753745 learned_addr learned my addr 172.21.15.169:0/1292753745 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3767b4a640 1 -- 172.21.15.169:0/1292753745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fbda2e20 con 0x5582fbc2c2e0 2024-09-13T06:31:11.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3767b4a640 1 --2- 172.21.15.169:0/1292753745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda2850 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3760002260 tx=0x7f3760006a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17df8c884bbead5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3655e0b640 1 -- 172.21.15.169:0/1292753745 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760016070 con 0x5582fbc2c2e0 2024-09-13T06:31:11.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3655e0b640 1 -- 172.21.15.169:0/1292753745 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760004550 con 0x5582fbc2c2e0 2024-09-13T06:31:11.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.545+0000 7f3655e0b640 1 -- 172.21.15.169:0/1292753745 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760004870 con 0x5582fbc2c2e0 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/1292753745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 msgr2=0x5582fbda2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 --2- 172.21.15.169:0/1292753745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda2850 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3760002260 tx=0x7f3760006a00 comp rx=0 tx=0).stop 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/1292753745 shutdown_connections 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 --2- 172.21.15.169:0/1292753745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda2850 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/1292753745 >> 172.21.15.169:0/1292753745 conn(0x5582fbcb20a0 msgr2=0x5582fbd9e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/1292753745 shutdown_connections 2024-09-13T06:31:11.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/1292753745 wait complete. 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 Processor -- start 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- start start 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582fbcbee40 con 0x5582fbc2c2e0 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46568/0 (socket says 172.21.15.169:46568) 2024-09-13T06:31:11.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f3767b4a640 1 -- 172.21.15.169:0/973900171 learned_addr learned my addr 172.21.15.169:0/973900171 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f3767b4a640 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fbdaa150 con 0x5582fbc2c2e0 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f3767b4a640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda9c10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3760000f90 tx=0x7f3760001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f364ffff640 1 -- 172.21.15.169:0/973900171 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760021020 con 0x5582fbc2c2e0 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582fbdaa3e0 con 0x5582fbc2c2e0 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f364ffff640 1 -- 172.21.15.169:0/973900171 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760017040 con 0x5582fbc2c2e0 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f364ffff640 1 -- 172.21.15.169:0/973900171 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760016070 con 0x5582fbc2c2e0 2024-09-13T06:31:11.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582fbdad0c0 con 0x5582fbc2c2e0 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.549+0000 7f364ffff640 1 -- 172.21.15.169:0/973900171 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3760024020 con 0x5582fbc2c2e0 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f364ffff640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f364ffff640 1 -- 172.21.15.169:0/973900171 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f37600495c0 con 0x5582fbc2c2e0 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f3767349640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbcbba90 0x5582fbdb0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdb1230 con 0x5582fbcbba90 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376834b640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbcbba90 0x5582fbdb0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f3767349640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ac000 tx=0x7f375c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376834b640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbcbba90 0x5582fbdb0bc0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376834b640 1 -- 172.21.15.169:0/973900171 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbcbba90 2024-09-13T06:31:11.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdb2020 0x5582fbdb4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdb4a70 con 0x5582fbdb2020 2024-09-13T06:31:11.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f3767b4a640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdb2020 0x5582fbdb4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f3767b4a640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdb2020 0x5582fbdb4410 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f3767b4a640 1 -- 172.21.15.169:0/973900171 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f376000f070 con 0x5582fbdb2020 2024-09-13T06:31:11.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdb6320 con 0x5582fbdb2020 2024-09-13T06:31:11.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f3767b4a640 1 -- 172.21.15.169:0/973900171 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f376000f070 con 0x5582fbdb2020 2024-09-13T06:31:11.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.553+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdb5550 con 0x5582fbdb2020 2024-09-13T06:31:11.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767b4a640 1 -- 172.21.15.169:0/973900171 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f376000f070 con 0x5582fbdb2020 2024-09-13T06:31:11.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdb76d0 0x5582fbdb9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdba000 con 0x5582fbdb76d0 2024-09-13T06:31:11.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767349640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdb76d0 0x5582fbdb9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767349640 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdb76d0 0x5582fbdb9ac0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767349640 1 -- 172.21.15.169:0/973900171 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f375c0b2040 con 0x5582fbdb76d0 2024-09-13T06:31:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 Processor -- start 2024-09-13T06:31:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 -- start start 2024-09-13T06:31:11.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 0x5582fbdc7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582fbbbe800 con 0x5582fbdc7a90 2024-09-13T06:31:11.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 0x5582fbdc7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 0x5582fbdc7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46578/0 (socket says 172.21.15.169:46578) 2024-09-13T06:31:11.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767b4a640 1 -- 172.21.15.169:0/2014768587 learned_addr learned my addr 172.21.15.169:0/2014768587 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767b4a640 1 -- 172.21.15.169:0/2014768587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fbdc83f0 con 0x5582fbdc7a90 2024-09-13T06:31:11.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f3767b4a640 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 0x5582fbdc7eb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3760047a80 tx=0x7f3760047f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f364d7fa640 1 -- 172.21.15.169:0/2014768587 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37600462d0 con 0x5582fbdc7a90 2024-09-13T06:31:11.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582fbdc8680 con 0x5582fbdc7a90 2024-09-13T06:31:11.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f364d7fa640 1 -- 172.21.15.169:0/2014768587 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760046470 con 0x5582fbdc7a90 2024-09-13T06:31:11.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f364d7fa640 1 -- 172.21.15.169:0/2014768587 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37600410b0 con 0x5582fbdc7a90 2024-09-13T06:31:11.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.557+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582fbdcb300 con 0x5582fbdc7a90 2024-09-13T06:31:11.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f364d7fa640 1 -- 172.21.15.169:0/2014768587 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3760041250 con 0x5582fbdc7a90 2024-09-13T06:31:11.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f364d7fa640 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3640034650 0x7f3640036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f364d7fa640 1 -- 172.21.15.169:0/2014768587 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f37600477a0 con 0x5582fbdc7a90 2024-09-13T06:31:11.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767349640 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3640034650 0x7f3640036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 Processor -- start 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- start start 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767349640 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3640034650 0x7f3640036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f375c000c10 tx=0x7f375c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbdd4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582fbda31a0 con 0x5582fbdd4590 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbdd4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbdd4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46592/0 (socket says 172.21.15.169:46592) 2024-09-13T06:31:11.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767b4a640 1 -- 172.21.15.169:0/1755259065 learned_addr learned my addr 172.21.15.169:0/1755259065 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767b4a640 1 -- 172.21.15.169:0/1755259065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fbdd4f40 con 0x5582fbdd4590 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3767b4a640 1 --2- 172.21.15.169:0/1755259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbdd4970 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3760001800 tx=0x7f3760026400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fd8bd797db66bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3646ffd640 1 -- 172.21.15.169:0/1755259065 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f376000b880 con 0x5582fbdd4590 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3646ffd640 1 -- 172.21.15.169:0/1755259065 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760041d20 con 0x5582fbdd4590 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f3646ffd640 1 -- 172.21.15.169:0/1755259065 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f376000b360 con 0x5582fbdd4590 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- 172.21.15.169:0/1755259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 msgr2=0x5582fbdd4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 --2- 172.21.15.169:0/1755259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbdd4970 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3760001800 tx=0x7f3760026400 comp rx=0 tx=0).stop 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- 172.21.15.169:0/1755259065 shutdown_connections 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 --2- 172.21.15.169:0/1755259065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbdd4970 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- 172.21.15.169:0/1755259065 >> 172.21.15.169:0/1755259065 conn(0x5582fbdd0970 msgr2=0x5582fbdcea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- 172.21.15.169:0/1755259065 shutdown_connections 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- 172.21.15.169:0/1755259065 wait complete. 2024-09-13T06:31:11.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 Processor -- start 2024-09-13T06:31:11.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- start start 2024-09-13T06:31:11.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbddb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.561+0000 7f376a03a980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582fbdd53e0 con 0x5582fbdd4590 2024-09-13T06:31:11.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbddb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767b4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbddb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46594/0 (socket says 172.21.15.169:46594) 2024-09-13T06:31:11.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 learned_addr learned my addr 172.21.15.169:0/2171101547 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fbddbcb0 con 0x5582fbdd4590 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767b4a640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbddb770 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3760001800 tx=0x7f3760047440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f36457fa640 1 -- 172.21.15.169:0/2171101547 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f376006d070 con 0x5582fbdd4590 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582fbddbcb0 con 0x5582fbdd4590 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f36457fa640 1 -- 172.21.15.169:0/2171101547 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760034dd0 con 0x5582fbdd4590 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f36457fa640 1 -- 172.21.15.169:0/2171101547 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760049ad0 con 0x5582fbdd4590 2024-09-13T06:31:11.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582fbddbcb0 con 0x5582fbdd4590 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f36457fa640 1 -- 172.21.15.169:0/2171101547 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3760070070 con 0x5582fbdd4590 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f36457fa640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3630034650 0x7f3630036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f36457fa640 1 -- 172.21.15.169:0/2171101547 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f3760059030 con 0x5582fbdd4590 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767349640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3630034650 0x7f3630036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbde6770 0x5582fbde8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbde9360 con 0x5582fbde6770 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376834b640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbde6770 0x5582fbde8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f3767349640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3630034650 0x7f3630036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ab2a0 tx=0x7f375c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376834b640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbde6770 0x5582fbde8c10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 20 realm 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbde5c60 con 0x5582fbde6770 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.565+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbde9e30 con 0x5582fbde6770 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdeabe0 0x5582fbdecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbded650 con 0x5582fbdeabe0 2024-09-13T06:31:11.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767b4a640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdeabe0 0x5582fbdecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767b4a640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdeabe0 0x5582fbdecfd0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdedea0 con 0x5582fbdeabe0 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 20 searching for the correct realm 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdefc10 0x5582fbdf2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767349640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdefc10 0x5582fbdf2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767349640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdefc10 0x5582fbdf2000 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.569+0000 7f3767b4a640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3760072060 0x7f37600080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x7f3760072060 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3760072060 0x7f37600080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3760072060 0x7f37600080c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x7f3760072060 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x7f3760072060 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.573+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x7f3760072060 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbde6770 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x7f3760072060 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.577+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x7f3760072060 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdefc10 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2680 con 0x5582fbdeabe0 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdee7f0 con 0x5582fbde6770 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdef090 con 0x5582fbdeabe0 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdee430 con 0x5582fbdefc10 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.581+0000 7f376a03a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 zone default found 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 4 Realm: () 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:11.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 zonegroup default 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf2f90 con 0x7f3760072060 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf4d10 con 0x5582fbdefc10 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf5100 con 0x5582fbdefc10 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 started sync module instance, tier type = 2024-09-13T06:31:11.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:11.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf41b0 con 0x5582fbdeabe0 2024-09-13T06:31:11.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021059823280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf41b0 con 0x5582fbdeabe0 2024-09-13T06:31:11.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf5bb0 con 0x5582fbde6770 2024-09-13T06:31:11.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021059827456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf6450 con 0x5582fbde6770 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.585+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf6e70 con 0x5582fbdeabe0 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021059823280] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021059827456] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021059832160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf5fa0 con 0x5582fbdeabe0 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf7710 con 0x7f3760072060 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021059834464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf5fa0 con 0x7f3760072060 2024-09-13T06:31:11.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.589+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf81b0 con 0x5582fbdeabe0 2024-09-13T06:31:11.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021059834464] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021059832160] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021059820800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf8170 con 0x5582fbdeabe0 2024-09-13T06:31:11.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf85a0 con 0x5582fbdefc10 2024-09-13T06:31:11.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021059835520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf8e40 con 0x5582fbdefc10 2024-09-13T06:31:11.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf9800 con 0x5582fbdefc10 2024-09-13T06:31:11.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021059820800] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021059835520] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021059837088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf9800 con 0x5582fbdefc10 2024-09-13T06:31:11.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.593+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdfa0d0 con 0x7f3760072060 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021059837088] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021059843376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdfa0d0 con 0x7f3760072060 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=0 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=1 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=2 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=3 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=4 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=5 2024-09-13T06:31:11.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=6 2024-09-13T06:31:11.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021059843376] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x7f3760072060 2024-09-13T06:31:11.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 20 add_watcher() i=7 2024-09-13T06:31:11.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:11.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdfd420 con 0x5582fbde6770 2024-09-13T06:31:11.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.597+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021059857904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdfa240 con 0x5582fbde6770 2024-09-13T06:31:11.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021059857904] v35'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f361dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:11.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:11.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 5 note: GC not initialized 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f361cfe1640 20 reqs_thread_entry: start 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 20 Filter name: none 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f35967fc640 20 reqs_thread_entry: start 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe20c30 con 0x5582fbde6770 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f37580083f0 con 0x5582fbde6770 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:11.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe271c0 con 0x5582fbde6770 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f375803a040 con 0x5582fbde6770 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94021060029488 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe228b0 con 0x5582fbdeabe0 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94021059820800 notify 150323855417 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5582fbdcb300 con 0x5582fbdeabe0 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3646ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855417 cookie 94021059820800 notifier 4911 bl.length()=649 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3646ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3646ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94021060029488 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3646ffd640 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f362c003eb0 con 0x5582fbdeabe0 2024-09-13T06:31:11.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.601+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.605+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94021060029488 notify 150323855417 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fbdc8680 con 0x5582fbdeabe0 2024-09-13T06:31:11.608 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:11.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.605+0000 7f361dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.605+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021059857904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe26510 con 0x5582fbde6770 2024-09-13T06:31:11.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.605+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94021059857904] v35'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f375803a040 con 0x5582fbde6770 2024-09-13T06:31:11.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.605+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021059823280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe26510 con 0x5582fbdeabe0 2024-09-13T06:31:11.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94021059823280] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f376a03a980 20 remove_watcher() i=0 2024-09-13T06:31:11.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f376a03a980 2 removed watcher, disabling cache 2024-09-13T06:31:11.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021059827456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe26510 con 0x5582fbde6770 2024-09-13T06:31:11.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94021059827456] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375803a040 con 0x5582fbde6770 2024-09-13T06:31:11.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f376a03a980 20 remove_watcher() i=1 2024-09-13T06:31:11.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.609+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021059832160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe26510 con 0x5582fbdeabe0 2024-09-13T06:31:11.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94021059832160] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376a03a980 20 remove_watcher() i=2 2024-09-13T06:31:11.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021059834464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe26510 con 0x7f3760072060 2024-09-13T06:31:11.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94021059834464] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375803a040 con 0x7f3760072060 2024-09-13T06:31:11.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376a03a980 20 remove_watcher() i=3 2024-09-13T06:31:11.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021059820800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbe26510 con 0x5582fbdeabe0 2024-09-13T06:31:11.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f3767b4a640 1 -- 172.21.15.169:0/2171101547 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94021059820800] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376006f030 con 0x5582fbdeabe0 2024-09-13T06:31:11.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376a03a980 20 remove_watcher() i=4 2024-09-13T06:31:11.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.613+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021059835520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf7260 con 0x5582fbdefc10 2024-09-13T06:31:11.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94021059835520] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 20 remove_watcher() i=5 2024-09-13T06:31:11.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021059837088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf3d00 con 0x5582fbdefc10 2024-09-13T06:31:11.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f3767349640 1 -- 172.21.15.169:0/2171101547 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94021059837088] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0c9030 con 0x5582fbdefc10 2024-09-13T06:31:11.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 20 remove_watcher() i=6 2024-09-13T06:31:11.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021059843376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582fbdf3d00 con 0x7f3760072060 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94021059843376] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375803a040 con 0x7f3760072060 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 20 remove_watcher() i=7 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdeabe0 msgr2=0x5582fbdecfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdeabe0 0x5582fbdecfd0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbde6770 msgr2=0x5582fbde8c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbde6770 0x5582fbde8c10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3760072060 msgr2=0x7f37600080c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3760072060 0x7f37600080c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdefc10 msgr2=0x5582fbdf2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdefc10 0x5582fbdf2000 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3630034650 msgr2=0x7f3630036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3630034650 0x7f3630036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ab2a0 tx=0x7f375c0a7000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 msgr2=0x5582fbddb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376834b640 1 -- 172.21.15.169:0/2171101547 reap_dead start 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbddb770 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3760001800 tx=0x7f3760047440 comp rx=0 tx=0).stop 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 shutdown_connections 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2171101547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdd4590 0x5582fbddb770 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 >> 172.21.15.169:0/2171101547 conn(0x5582fbdd0970 msgr2=0x5582fbdcea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 shutdown_connections 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2171101547 wait complete. 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3640034650 msgr2=0x7f3640036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3640034650 0x7f3640036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f375c000c10 tx=0x7f375c005a10 comp rx=0 tx=0).stop 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 msgr2=0x5582fbdc7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 0x5582fbdc7eb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3760047a80 tx=0x7f3760047f30 comp rx=0 tx=0).stop 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 shutdown_connections 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3640034650 0x7f3640036b10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/2014768587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbdc7a90 0x5582fbdc7eb0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 >> 172.21.15.169:0/2014768587 conn(0x5582fbdbcbe0 msgr2=0x5582fbdbf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 shutdown_connections 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/2014768587 wait complete. 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdb2020 msgr2=0x5582fbdb4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5582fbdb2020 0x5582fbdb4410 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbcbba90 msgr2=0x5582fbdb0bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5582fbcbba90 0x5582fbdb0bc0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdb76d0 msgr2=0x5582fbdb9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5582fbdb76d0 0x5582fbdb9ac0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 msgr2=0x7f3650036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3650034650 0x7f3650036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ac000 tx=0x7f375c0a5000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 msgr2=0x5582fbda9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376a03a980 1 --2- 172.21.15.169:0/973900171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582fbc2c2e0 0x5582fbda9c10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3760000f90 tx=0x7f3760001260 comp rx=0 tx=0).stop 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.617+0000 7f376834b640 1 -- 172.21.15.169:0/973900171 reap_dead start 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.621+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 shutdown_connections 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.621+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 >> 172.21.15.169:0/973900171 conn(0x5582fbcb20a0 msgr2=0x5582fbd9d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.621+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 shutdown_connections 2024-09-13T06:31:11.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.621+0000 7f376a03a980 1 -- 172.21.15.169:0/973900171 wait complete. 2024-09-13T06:31:11.632 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.632 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.632 ERROR:root:0 2024-09-13T06:31:11.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:11.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:31:11.633 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T06:31:11.704 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:31:11.705 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:31:11.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f220429d980 1 Processor -- start 2024-09-13T06:31:11.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f220429d980 1 -- start start 2024-09-13T06:31:11.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f220429d980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5586d9076c70 0x5586d9079060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f220429d980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586d8ef8ae0 con 0x5586d90728f0 2024-09-13T06:31:11.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f220429d980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5586d8f1ce30 con 0x5586d9076c70 2024-09-13T06:31:11.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f22015ac640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5586d9076c70 0x5586d9079060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f2201dad640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x5586d90728f0 0x5586d9072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.169:48192/0 (socket says 172.21.15.169:48192) 2024-09-13T06:31:11.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f2201dad640 1 -- 172.21.15.169:0/1165709306 learned_addr learned my addr 172.21.15.169:0/1165709306 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-13T06:31:11.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f22015ac640 1 -- 172.21.15.169:0/1165709306 >> v1:172.21.15.112:6789/0 conn(0x5586d90728f0 legacy=0x5586d9072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.701+0000 7f22015ac640 1 -- 172.21.15.169:0/1165709306 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d907a5b0 con 0x5586d9076c70 2024-09-13T06:31:11.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f22015ac640 1 --2- 172.21.15.169:0/1165709306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9076c70 0x5586d9079060 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00a420 tx=0x7f21ec01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5839a563031643 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f2200dab640 1 -- 172.21.15.169:0/1165709306 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec0af070 con 0x5586d9076c70 2024-09-13T06:31:11.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f2200dab640 1 -- 172.21.15.169:0/1165709306 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec0aa530 con 0x5586d9076c70 2024-09-13T06:31:11.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f2200dab640 1 -- 172.21.15.169:0/1165709306 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec0aa850 con 0x5586d9076c70 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 -- 172.21.15.169:0/1165709306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9076c70 msgr2=0x5586d9079060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 --2- 172.21.15.169:0/1165709306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9076c70 0x5586d9079060 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00a420 tx=0x7f21ec01afd0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 -- 172.21.15.169:0/1165709306 shutdown_connections 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 --2- 172.21.15.169:0/1165709306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9076c70 0x5586d9079060 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 -- 172.21.15.169:0/1165709306 >> 172.21.15.169:0/1165709306 conn(0x5586d8fe6240 msgr2=0x5586d8fe6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 -- 172.21.15.169:0/1165709306 shutdown_connections 2024-09-13T06:31:11.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.705+0000 7f220429d980 1 -- 172.21.15.169:0/1165709306 wait complete. 2024-09-13T06:31:11.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 Processor -- start 2024-09-13T06:31:11.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- start start 2024-09-13T06:31:11.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d915dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5586d8f1e200 con 0x5586d90728f0 2024-09-13T06:31:11.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d915dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d915dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46606/0 (socket says 172.21.15.169:46606) 2024-09-13T06:31:11.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 -- 172.21.15.169:0/2977858877 learned_addr learned my addr 172.21.15.169:0/2977858877 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 -- 172.21.15.169:0/2977858877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d915e280 con 0x5586d90728f0 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 --2- 172.21.15.169:0/2977858877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d915dcb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f21f4001e20 tx=0x7f21f400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f783950be51788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f20efe07640 1 -- 172.21.15.169:0/2977858877 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f4012020 con 0x5586d90728f0 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f20efe07640 1 -- 172.21.15.169:0/2977858877 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f400e7c0 con 0x5586d90728f0 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f20efe07640 1 -- 172.21.15.169:0/2977858877 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f400eb00 con 0x5586d90728f0 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- 172.21.15.169:0/2977858877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 msgr2=0x5586d915dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 --2- 172.21.15.169:0/2977858877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d915dcb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f21f4001e20 tx=0x7f21f400b790 comp rx=0 tx=0).stop 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- 172.21.15.169:0/2977858877 shutdown_connections 2024-09-13T06:31:11.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 --2- 172.21.15.169:0/2977858877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d915dcb0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- 172.21.15.169:0/2977858877 >> 172.21.15.169:0/2977858877 conn(0x5586d8fe6240 msgr2=0x5586d91598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- 172.21.15.169:0/2977858877 shutdown_connections 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- 172.21.15.169:0/2977858877 wait complete. 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 Processor -- start 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- start start 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d9165060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f220429d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5586d907a0b0 con 0x5586d90728f0 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d9165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d9165060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46612/0 (socket says 172.21.15.169:46612) 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.721+0000 7f2201dad640 1 -- 172.21.15.169:0/4070053340 learned_addr learned my addr 172.21.15.169:0/4070053340 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f2201dad640 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d91655a0 con 0x5586d90728f0 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f2201dad640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d9165060 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f21f4001e20 tx=0x7f21f4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f20ee604640 1 -- 172.21.15.169:0/4070053340 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f4012030 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586d9165830 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f20ee604640 1 -- 172.21.15.169:0/4070053340 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f4001480 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f20ee604640 1 -- 172.21.15.169:0/4070053340 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f401a940 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d9168510 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f20ee604640 1 -- 172.21.15.169:0/4070053340 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21f4015020 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f20ee604640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20e8034650 0x7f20e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f20ee604640 1 -- 172.21.15.169:0/4070053340 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f21f4020030 con 0x5586d90728f0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f22015ac640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20e8034650 0x7f20e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d9076c70 0x5586d916c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d916c680 con 0x5586d9076c70 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f22025ae640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d9076c70 0x5586d916c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f22015ac640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20e8034650 0x7f20e8036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0ac000 tx=0x7f21ec0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f22025ae640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d9076c70 0x5586d916c030 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f22025ae640 1 -- 172.21.15.169:0/4070053340 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d9076c70 2024-09-13T06:31:11.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d916d470 0x5586d916f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d916fea0 con 0x5586d916d470 2024-09-13T06:31:11.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.725+0000 7f2201dad640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d916d470 0x5586d916f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f2201dad640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d916d470 0x5586d916f860 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f2201dad640 1 -- 172.21.15.169:0/4070053340 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21f4008030 con 0x5586d916d470 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d9171750 con 0x5586d916d470 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f2201dad640 1 -- 172.21.15.169:0/4070053340 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21f4008030 con 0x5586d916d470 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d9170980 con 0x5586d916d470 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f2201dad640 1 -- 172.21.15.169:0/4070053340 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21f4008030 con 0x5586d916d470 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d9172b00 0x5586d9174ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d9175430 con 0x5586d9172b00 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f22015ac640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d9172b00 0x5586d9174ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f22015ac640 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d9172b00 0x5586d9174ef0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f22015ac640 1 -- 172.21.15.169:0/4070053340 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21ec0b2070 con 0x5586d9172b00 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 Processor -- start 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 -- start start 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 0x5586d9183230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.729+0000 7f220429d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5586d8f77800 con 0x5586d9182e10 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 0x5586d9183230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 0x5586d9183230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46620/0 (socket says 172.21.15.169:46620) 2024-09-13T06:31:11.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 -- 172.21.15.169:0/642634124 learned_addr learned my addr 172.21.15.169:0/642634124 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 -- 172.21.15.169:0/642634124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d9183770 con 0x5586d9182e10 2024-09-13T06:31:11.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 0x5586d9183230 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f21f404a280 tx=0x7f21f4016680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f20e77fe640 1 -- 172.21.15.169:0/642634124 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f4042130 con 0x5586d9182e10 2024-09-13T06:31:11.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f20e77fe640 1 -- 172.21.15.169:0/642634124 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f400c580 con 0x5586d9182e10 2024-09-13T06:31:11.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f20e77fe640 1 -- 172.21.15.169:0/642634124 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f400c860 con 0x5586d9182e10 2024-09-13T06:31:11.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586d9183a00 con 0x5586d9182e10 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d9186680 con 0x5586d9182e10 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f20e77fe640 1 -- 172.21.15.169:0/642634124 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21f4009070 con 0x5586d9182e10 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f20e77fe640 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20dc0346a0 0x7f20dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f20e77fe640 1 -- 172.21.15.169:0/642634124 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f21f4005050 con 0x5586d9182e10 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f22015ac640 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20dc0346a0 0x7f20dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f220429d980 1 Processor -- start 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f220429d980 1 -- start start 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f22015ac640 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20dc0346a0 0x7f20dc036b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f21ec017be0 tx=0x7f21ec005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f220429d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d918fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f220429d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5586d915e600 con 0x5586d918f790 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d918fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d918fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46632/0 (socket says 172.21.15.169:46632) 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.733+0000 7f2201dad640 1 -- 172.21.15.169:0/1637434199 learned_addr learned my addr 172.21.15.169:0/1637434199 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 -- 172.21.15.169:0/1637434199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d9190160 con 0x5586d918f790 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 --2- 172.21.15.169:0/1637434199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d918fb90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f21f4008fd0 tx=0x7f21f404db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57243c55bb5ad2d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f20e57fa640 1 -- 172.21.15.169:0/1637434199 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f405f070 con 0x5586d918f790 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f20e57fa640 1 -- 172.21.15.169:0/1637434199 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f404d570 con 0x5586d918f790 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f20e57fa640 1 -- 172.21.15.169:0/1637434199 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f400cb30 con 0x5586d918f790 2024-09-13T06:31:11.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1637434199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 msgr2=0x5586d918fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 --2- 172.21.15.169:0/1637434199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d918fb90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f21f4008fd0 tx=0x7f21f404db90 comp rx=0 tx=0).stop 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1637434199 shutdown_connections 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 --2- 172.21.15.169:0/1637434199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d918fb90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1637434199 >> 172.21.15.169:0/1637434199 conn(0x5586d918bac0 msgr2=0x5586d9189bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1637434199 shutdown_connections 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1637434199 wait complete. 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 Processor -- start 2024-09-13T06:31:11.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- start start 2024-09-13T06:31:11.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d9196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5586d9190650 con 0x5586d918f790 2024-09-13T06:31:11.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d9196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d9196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:46640/0 (socket says 172.21.15.169:46640) 2024-09-13T06:31:11.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 learned_addr learned my addr 172.21.15.169:0/1520661647 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d9196e50 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f2201dad640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d9196910 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f21f40245c0 tx=0x7f21f4041b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f20d37fe640 1 -- 172.21.15.169:0/1520661647 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f400f280 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586d9196e50 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f20d37fe640 1 -- 172.21.15.169:0/1520661647 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f400f420 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d91972c0 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.737+0000 7f20d37fe640 1 -- 172.21.15.169:0/1520661647 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21f4032950 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f20d37fe640 1 -- 172.21.15.169:0/1520661647 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21f4075030 con 0x5586d918f790 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f20d37fe640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20cc034650 0x7f20cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f20d37fe640 1 -- 172.21.15.169:0/1520661647 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f21f4073070 con 0x5586d918f790 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22015ac640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20cc034650 0x7f20cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d91a1a50 0x5586d91a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a4640 con 0x5586d91a1a50 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22025ae640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d91a1a50 0x5586d91a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22025ae640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d91a1a50 0x5586d91a3ef0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22015ac640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20cc034650 0x7f20cc036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5586d91716e0 tx=0x7f21ec0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 realm 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a0f40 con 0x5586d91a1a50 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a5110 con 0x5586d91a1a50 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d91a5ec0 0x5586d91a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f2201dad640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d91a5ec0 0x5586d91a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f2201dad640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d91a5ec0 0x5586d91a82b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.741+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a9180 con 0x5586d91a5ec0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f220429d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:31:11.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f220429d980 20 searching for the correct realm 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d91aaa10 0x5586d91aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91ad5a0 con 0x5586d91aaa10 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22015ac640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d91aaa10 0x5586d91aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22015ac640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d91aaa10 0x5586d91aced0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91ad5a0 con 0x5586d91a5ec0 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f2201dad640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f21f4064070 0x7f21f40086e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x7f21f4064070 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f21f4064070 0x7f21f40086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f21f4064070 0x7f21f40086e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91aaa10 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.745+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x7f21f4064070 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x7f21f4064070 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91aaa10 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.749+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91aaa10 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91aaa10 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x7f21f4064070 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x7f21f4064070 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91aaa10 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x7f21f4064070 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91aaa10 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.753+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8930 con 0x5586d91a5ec0 2024-09-13T06:31:11.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a8e20 con 0x5586d91a1a50 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a9210 con 0x5586d91a5ec0 2024-09-13T06:31:11.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91a9210 con 0x5586d91aaa10 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 zone default found 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 4 Realm: () 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 zonegroup default 2024-09-13T06:31:11.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91ada20 con 0x7f21f4064070 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91afc50 con 0x5586d91aaa10 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91afff0 con 0x5586d91aaa10 2024-09-13T06:31:11.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 started sync module instance, tier type = 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.757+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91af090 con 0x5586d91a5ec0 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94037656401024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91af090 con 0x5586d91a5ec0 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b0840 con 0x5586d91a1a50 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94037656404880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b1090 con 0x5586d91a1a50 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b1ab0 con 0x5586d91a5ec0 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94037656401024] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.761+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94037656404880] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94037656409504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b0be0 con 0x5586d91a5ec0 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b2350 con 0x7f21f4064070 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94037656411808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b0be0 con 0x7f21f4064070 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b2dd0 con 0x5586d91a5ec0 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94037656409504] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.765+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94037656411808] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94037656412864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b28e0 con 0x5586d91a5ec0 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b3670 con 0x5586d91aaa10 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94037656416704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b28e0 con 0x5586d91aaa10 2024-09-13T06:31:11.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b44e0 con 0x5586d91aaa10 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94037656412864] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94037656416704] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94037656420400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b4880 con 0x5586d91aaa10 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b50d0 con 0x7f21f4064070 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94037656420400] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94037656422528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b5150 con 0x7f21f4064070 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=0 2024-09-13T06:31:11.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=1 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=2 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=3 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=4 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=5 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.769+0000 7f220429d980 20 add_watcher() i=6 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94037656422528] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 20 add_watcher() i=7 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b8490 con 0x5586d91a1a50 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94037656423952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b56e0 con 0x5586d91a1a50 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94037656423952] v35'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f20b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 5 note: GC not initialized 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f20b27fc640 20 reqs_thread_entry: start 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 20 init_complete bucket index max shards: 11 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 20 Filter name: none 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f2023fff640 20 reqs_thread_entry: start 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:31:11.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 20 rados->read ofs=0 len=0 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.773+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91dbbc0 con 0x5586d91a1a50 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91e24e0 con 0x5586d91a1a50 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94037656608592 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5586d91ddbd0 con 0x5586d91a5ec0 2024-09-13T06:31:11.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== watch-notify(notify (1) cookie 94037656412864 notify 150323855418 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5586d9183a00 con 0x5586d91a5ec0 2024-09-13T06:31:11.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(64 notify.4 [notify cookie 94037656608592 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f20e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855418 cookie 94037656412864 notifier 4918 bl.length()=649 2024-09-13T06:31:11.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f20e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:31:11.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f20e57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:31:11.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f20e57fa640 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f20c4003eb0 con 0x5586d91a5ec0 2024-09-13T06:31:11.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.777+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== watch-notify(notify_complete (2) cookie 94037656608592 notify 150323855418 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586d9183770 con 0x5586d91a5ec0 2024-09-13T06:31:11.785 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:31:09.002501Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:31:09.002488Z","tags":[],"group_ids":[]} 2024-09-13T06:31:11.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.781+0000 7f20b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:31:11.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.781+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94037656423952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91e17f0 con 0x5586d91a1a50 2024-09-13T06:31:11.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.781+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94037656423952] v35'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.781+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94037656401024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91e17f0 con 0x5586d91a5ec0 2024-09-13T06:31:11.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94037656401024] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 20 remove_watcher() i=0 2024-09-13T06:31:11.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 2 removed watcher, disabling cache 2024-09-13T06:31:11.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94037656404880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91e17f0 con 0x5586d91a1a50 2024-09-13T06:31:11.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94037656404880] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x5586d91a1a50 2024-09-13T06:31:11.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 20 remove_watcher() i=1 2024-09-13T06:31:11.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94037656409504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91e17f0 con 0x5586d91a5ec0 2024-09-13T06:31:11.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94037656409504] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 20 remove_watcher() i=2 2024-09-13T06:31:11.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.785+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94037656411808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91e17f0 con 0x7f21f4064070 2024-09-13T06:31:11.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94037656411808] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f220429d980 20 remove_watcher() i=3 2024-09-13T06:31:11.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94037656412864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b4e10 con 0x5586d91a5ec0 2024-09-13T06:31:11.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f2201dad640 1 -- 172.21.15.169:0/1520661647 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94037656412864] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4061030 con 0x5586d91a5ec0 2024-09-13T06:31:11.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f220429d980 20 remove_watcher() i=4 2024-09-13T06:31:11.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94037656416704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91af480 con 0x5586d91aaa10 2024-09-13T06:31:11.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94037656416704] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f220429d980 20 remove_watcher() i=5 2024-09-13T06:31:11.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.789+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94037656420400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b15a0 con 0x5586d91aaa10 2024-09-13T06:31:11.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f22015ac640 1 -- 172.21.15.169:0/1520661647 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94037656420400] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0c9070 con 0x5586d91aaa10 2024-09-13T06:31:11.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 20 remove_watcher() i=6 2024-09-13T06:31:11.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94037656422528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5586d91b4e10 con 0x7f21f4064070 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94037656422528] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21fc0083f0 con 0x7f21f4064070 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 20 remove_watcher() i=7 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d91a5ec0 msgr2=0x5586d91a82b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d91a5ec0 0x5586d91a82b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d91a1a50 msgr2=0x5586d91a3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d91a1a50 0x5586d91a3ef0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f21f4064070 msgr2=0x7f21f40086e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f21f4064070 0x7f21f40086e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d91aaa10 msgr2=0x5586d91aced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d91aaa10 0x5586d91aced0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20cc034650 msgr2=0x7f20cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20cc034650 0x7f20cc036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5586d91716e0 tx=0x7f21ec0a7000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 msgr2=0x5586d9196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/1520661647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d918f790 0x5586d9196910 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f21f40245c0 tx=0x7f21f4041b00 comp rx=0 tx=0).stop 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 reap_dead start 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f22025ae640 1 -- 172.21.15.169:0/1520661647 reap_dead start 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 shutdown_connections 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 >> 172.21.15.169:0/1520661647 conn(0x5586d918bac0 msgr2=0x5586d9189b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 shutdown_connections 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/1520661647 wait complete. 2024-09-13T06:31:11.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20dc0346a0 msgr2=0x7f20dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20dc0346a0 0x7f20dc036b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f21ec017be0 tx=0x7f21ec005d90 comp rx=0 tx=0).stop 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 msgr2=0x5586d9183230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 0x5586d9183230 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f21f404a280 tx=0x7f21f4016680 comp rx=0 tx=0).stop 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 shutdown_connections 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20dc0346a0 0x7f20dc036b60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/642634124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d9182e10 0x5586d9183230 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 >> 172.21.15.169:0/642634124 conn(0x5586d9177f60 msgr2=0x5586d917a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 shutdown_connections 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/642634124 wait complete. 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d916d470 msgr2=0x5586d916f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5586d916d470 0x5586d916f860 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d9076c70 msgr2=0x5586d916c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5586d9076c70 0x5586d916c030 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d9172b00 msgr2=0x5586d9174ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5586d9172b00 0x5586d9174ef0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20e8034650 msgr2=0x7f20e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f20e8034650 0x7f20e8036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0ac000 tx=0x7f21ec0a5000 comp rx=0 tx=0).stop 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 msgr2=0x5586d9165060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 --2- 172.21.15.169:0/4070053340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5586d90728f0 0x5586d9165060 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f21f4001e20 tx=0x7f21f4000ee0 comp rx=0 tx=0).stop 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f22025ae640 1 -- 172.21.15.169:0/4070053340 reap_dead start 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 shutdown_connections 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 >> 172.21.15.169:0/4070053340 conn(0x5586d8fe6240 msgr2=0x5586d9158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 shutdown_connections 2024-09-13T06:31:11.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:31:11.793+0000 7f220429d980 1 -- 172.21.15.169:0/4070053340 wait complete. 2024-09-13T06:31:11.807 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.808 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:31:09.002501Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:31:09.002488Z', 'tags': [], 'group_ids': []} 2024-09-13T06:31:11.808 ERROR:root:0 2024-09-13T06:31:11.808 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T06:31:11.825 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.825 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:11.837 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.838 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T06:31:11.854 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.855 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:11.868 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.869 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T06:31:11.892 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T06:31:11.893 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:11.907 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.908 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T06:31:11.931 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:11.931 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:11.945 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.946 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T06:31:11.969 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T06:31:11.969 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:11.982 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:11.982 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T06:31:12.008 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T06:31:12.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:12.021 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:12.022 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T06:31:12.044 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.044 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:12.057 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:12.058 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T06:31:12.077 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.078 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:12.091 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:12.092 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T06:31:12.115 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.116 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:31:12.130 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:12.130 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T06:31:12.143 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T06:31:12.145 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T06:31:12.161 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T06:31:12.195 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T06:31:12.210 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T06:31:12.210 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T06:31:12.225 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:31:12.184378Z', 'creation_time': '2024-09-13T06:31:12.177055Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:31:12.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T06:31:12.243 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:31:12.184378Z', 'creation_time': '2024-09-13T06:31:12.177055Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T06:31:12.253 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T06:31:12.271 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:31:12.184378Z', 'creation_time': '2024-09-13T06:31:12.177055Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:31:12.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T06:31:12.285 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000820a12623e53c741-0066e3dc30-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:31:12.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T06:31:12.316 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.317 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T06:31:12.343 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:31:12.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11'} 2024-09-13T06:31:12.392 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.438 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11'} 2024-09-13T06:31:12.467 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.468 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T06:31:12.495 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.517 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T06:31:12.538 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:31:12.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T06:31:12.554 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7fd9ecda-6337-4ce7-ac46-f04193654c7b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'marker': '8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:31:12.455778Z', 'creation_time': '2024-09-13T06:31:12.177055Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:32:12.671 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T06:32:12.717 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T06:32:12.718 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T06:32:12.756 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T06:32:12.757 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T06:32:12.771 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T06:32:12.771 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T06:32:12.784 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T06:32:12.784 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T06:32:12.798 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T06:32:12.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T06:32:12.812 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T06:32:12.812 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T06:32:12.825 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T06:32:12.826 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T06:32:12.844 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:32:12.844 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T06:32:12.857 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T06:32:12.858 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T06:32:12.883 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:32:12.897 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T06:32:12.922 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:32:13.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T06:32:13.340 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000ce1d49a7912b64d3-0066e3dc6d-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:13.523 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T06:32:13.536 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T06:32:13.546 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T06:32:13.560 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T06:32:13.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T06:32:13.803 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:32:13.803 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T06:32:13.822 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T06:32:13.823 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T06:32:13.840 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T06:32:13.865 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T06:32:13.879 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000000a7b9af4c8063493-0066e3dc6d-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:13.925 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T06:32:14.009 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:32:14.010 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:32:14.023 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000742105fd779e3323-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.023 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T06:32:14.036 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '80dec8ae-a3b9-43d1-a264-f2d38c8a985d'}]}} 2024-09-13T06:32:14.036 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T06:32:14.066 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:32:14.067 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T06:32:14.079 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T06:32:14.079 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T06:32:14.092 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000249a4207046153dd-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.092 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T06:32:14.105 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000094ab364e164a0095-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.133 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T06:32:14.145 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T06:32:14.146 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T06:32:14.160 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b6e46ea5c2a9b6c6-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.160 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T06:32:14.173 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f3f9a1b9c3eeba28-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.173 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T06:32:14.187 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T06:32:14.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T06:32:14.200 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000deb635449df129e1-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.200 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T06:32:14.213 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000eeef094fe2e06858-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T06:32:14.226 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b7302b5f9a213132-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T06:32:14.239 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000ed21e8ad65e1d006-0066e3dc6e-4225-default', 'HostId': '4225-default-default'} 2024-09-13T06:32:14.239 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T06:32:14.266 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:32:14.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T06:32:14.279 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T06:32:14.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T06:32:14.298 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:32:14.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T06:32:14.314 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T06:32:14.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T06:32:14.331 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:32:14.336 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T06:32:14.350 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T06:32:14.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:32:14.351 INFO:tasks.rgw.client.0.smithi169.stdout:2024-09-13T06:32:14.352+0000 7f3c766ab640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29442) UID: 0 2024-09-13T06:32:14.352 INFO:tasks.rgw.client.0.smithi169.stdout:2024-09-13T06:32:14.352+0000 7f3c79ef3a40 -1 shutting down 2024-09-13T06:32:44.860 INFO:tasks.rgw.client.0:Stopped 2024-09-13T06:32:44.860 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T06:32:44.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T06:32:44.924 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T06:32:44.979 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T06:32:44.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T06:32:44.979 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T06:32:45.059 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:32:45.059 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:32:45.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce38bd5980 1 Processor -- start 2024-09-13T06:32:45.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce38bd5980 1 -- start start 2024-09-13T06:32:45.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce38bd5980 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5603b8d58540 0x5603b8d58920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce38bd5980 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603b8be1ae0 con 0x5603b8d58e90 2024-09-13T06:32:45.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce38bd5980 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x5603b8c05e30 con 0x5603b8d58540 2024-09-13T06:32:45.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce366e5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5603b8d58540 0x5603b8d58920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce366e5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x5603b8d58540 0x5603b8d58920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:41282/0 (socket says 172.21.15.169:41282) 2024-09-13T06:32:45.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce366e5640 1 -- 172.21.15.169:0/3106236724 learned_addr learned my addr 172.21.15.169:0/3106236724 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:32:45.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce366e5640 1 -- 172.21.15.169:0/3106236724 >> v1:172.21.15.112:6789/0 conn(0x5603b8d58e90 legacy=0x5603b8d5d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.060+0000 7fce366e5640 1 -- 172.21.15.169:0/3106236724 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b8d60160 con 0x5603b8d58540 2024-09-13T06:32:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce366e5640 1 --2- 172.21.15.169:0/3106236724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8d58920 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fce2800a4e0 tx=0x7fce2801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4bac367b000bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce356e3640 1 -- 172.21.15.169:0/3106236724 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280aa540 con 0x5603b8d58540 2024-09-13T06:32:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce356e3640 1 -- 172.21.15.169:0/3106236724 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280aa6e0 con 0x5603b8d58540 2024-09-13T06:32:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce356e3640 1 -- 172.21.15.169:0/3106236724 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280aaa40 con 0x5603b8d58540 2024-09-13T06:32:45.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 -- 172.21.15.169:0/3106236724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 msgr2=0x5603b8d58920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3106236724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8d58920 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fce2800a4e0 tx=0x7fce2801b090 comp rx=0 tx=0).stop 2024-09-13T06:32:45.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 -- 172.21.15.169:0/3106236724 shutdown_connections 2024-09-13T06:32:45.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3106236724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8d58920 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 -- 172.21.15.169:0/3106236724 >> 172.21.15.169:0/3106236724 conn(0x5603b8d54060 msgr2=0x5603b8d56480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 -- 172.21.15.169:0/3106236724 shutdown_connections 2024-09-13T06:32:45.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.064+0000 7fce38bd5980 1 -- 172.21.15.169:0/3106236724 wait complete. 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce38bd5980 1 Processor -- start 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce38bd5980 1 -- start start 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce38bd5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8ccd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce38bd5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5603b8c07200 con 0x5603b8d58540 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8ccd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8ccd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:41298/0 (socket says 172.21.15.169:41298) 2024-09-13T06:32:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce366e5640 1 -- 172.21.15.169:0/731016235 learned_addr learned my addr 172.21.15.169:0/731016235 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:32:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.080+0000 7fce366e5640 1 -- 172.21.15.169:0/731016235 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b8ccd9b0 con 0x5603b8d58540 2024-09-13T06:32:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce366e5640 1 --2- 172.21.15.169:0/731016235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8ccd3e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce28017ca0 tx=0x7fce280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb18df324f922a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fcd24608640 1 -- 172.21.15.169:0/731016235 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280b9030 con 0x5603b8d58540 2024-09-13T06:32:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fcd24608640 1 -- 172.21.15.169:0/731016235 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280aaac0 con 0x5603b8d58540 2024-09-13T06:32:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fcd24608640 1 -- 172.21.15.169:0/731016235 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280aada0 con 0x5603b8d58540 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/731016235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 msgr2=0x5603b8ccd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 --2- 172.21.15.169:0/731016235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8ccd3e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce28017ca0 tx=0x7fce280033b0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/731016235 shutdown_connections 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 --2- 172.21.15.169:0/731016235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8ccd3e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/731016235 >> 172.21.15.169:0/731016235 conn(0x5603b8d54060 msgr2=0x5603b8e3f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/731016235 shutdown_connections 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/731016235 wait complete. 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 Processor -- start 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- start start 2024-09-13T06:32:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8e45110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5603b8d5fba0 con 0x5603b8d58540 2024-09-13T06:32:45.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8e45110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8e45110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:41314/0 (socket says 172.21.15.169:41314) 2024-09-13T06:32:45.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce366e5640 1 -- 172.21.15.169:0/3643684294 learned_addr learned my addr 172.21.15.169:0/3643684294 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce366e5640 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b8e43830 con 0x5603b8d58540 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce366e5640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8e45110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce28005cc0 tx=0x7fce28017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fcd22e05640 1 -- 172.21.15.169:0/3643684294 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280b9030 con 0x5603b8d58540 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fcd22e05640 1 -- 172.21.15.169:0/3643684294 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280c3070 con 0x5603b8d58540 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603b8e43ac0 con 0x5603b8d58540 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fcd22e05640 1 -- 172.21.15.169:0/3643684294 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280bf750 con 0x5603b8d58540 2024-09-13T06:32:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.084+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b8e43fb0 con 0x5603b8d58540 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fcd22e05640 1 -- 172.21.15.169:0/3643684294 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce280c5030 con 0x5603b8d58540 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fcd22e05640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd1c034650 0x7fcd1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fcd22e05640 1 -- 172.21.15.169:0/3643684294 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fce280ba070 con 0x5603b8d58540 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd1c034650 0x7fcd1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8d58e90 0x5603b8e55080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e555c0 con 0x5603b8d58e90 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce36ee6640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8d58e90 0x5603b8e55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd1c034650 0x7fcd1c036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fce20000f70 tx=0x7fce20001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce36ee6640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8d58e90 0x5603b8e55080 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce36ee6640 1 -- 172.21.15.169:0/3643684294 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8d58e90 2024-09-13T06:32:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e56030 0x5603b8e584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e58c60 con 0x5603b8e56030 2024-09-13T06:32:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce366e5640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e56030 0x5603b8e584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.088+0000 7fce366e5640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e56030 0x5603b8e584f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 -- 172.21.15.169:0/3643684294 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e56030 2024-09-13T06:32:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:3 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e5a510 con 0x5603b8e56030 2024-09-13T06:32:45.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 -- 172.21.15.169:0/3643684294 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(3 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e56030 2024-09-13T06:32:45.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e59740 con 0x5603b8e56030 2024-09-13T06:32:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 -- 172.21.15.169:0/3643684294 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e56030 2024-09-13T06:32:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e5b8c0 0x5603b8e5dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:5 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e5e1f0 con 0x5603b8e5b8c0 2024-09-13T06:32:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e5b8c0 0x5603b8e5dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e5b8c0 0x5603b8e5dcb0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce35ee4640 1 -- 172.21.15.169:0/3643684294 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(5 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce2000d040 con 0x5603b8e5b8c0 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 Processor -- start 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 -- start start 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 0x5603b8e6bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce38bd5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5603b8c60800 con 0x5603b8e6bbb0 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 0x5603b8e6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 0x5603b8e6bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:41324/0 (socket says 172.21.15.169:41324) 2024-09-13T06:32:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 -- 172.21.15.169:0/1311623626 learned_addr learned my addr 172.21.15.169:0/1311623626 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:32:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.092+0000 7fce366e5640 1 -- 172.21.15.169:0/1311623626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b8e6c510 con 0x5603b8e6bbb0 2024-09-13T06:32:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce366e5640 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 0x5603b8e6bfd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce280e51d0 tx=0x7fce280a9950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fcd1bfff640 1 -- 172.21.15.169:0/1311623626 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280c65d0 con 0x5603b8e6bbb0 2024-09-13T06:32:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fcd1bfff640 1 -- 172.21.15.169:0/1311623626 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280c6770 con 0x5603b8e6bbb0 2024-09-13T06:32:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fcd1bfff640 1 -- 172.21.15.169:0/1311623626 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280b4b90 con 0x5603b8e6bbb0 2024-09-13T06:32:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603b8e6c7a0 con 0x5603b8e6bbb0 2024-09-13T06:32:45.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b8e6c7a0 con 0x5603b8e6bbb0 2024-09-13T06:32:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fcd1bfff640 1 -- 172.21.15.169:0/1311623626 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce280df040 con 0x5603b8e6bbb0 2024-09-13T06:32:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fcd1bfff640 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd10034650 0x7fcd10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fcd1bfff640 1 -- 172.21.15.169:0/1311623626 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fce280eac20 con 0x5603b8e6bbb0 2024-09-13T06:32:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce35ee4640 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd10034650 0x7fcd10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce38bd5980 1 Processor -- start 2024-09-13T06:32:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce38bd5980 1 -- start start 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce38bd5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e78740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce38bd5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5603b8ccdc70 con 0x5603b8e78360 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce35ee4640 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd10034650 0x7fcd10036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5603b8e447b0 tx=0x7fce20006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e78740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e78740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:41338/0 (socket says 172.21.15.169:41338) 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce366e5640 1 -- 172.21.15.169:0/4222585383 learned_addr learned my addr 172.21.15.169:0/4222585383 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:32:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce366e5640 1 -- 172.21.15.169:0/4222585383 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b8e78d10 con 0x5603b8e78360 2024-09-13T06:32:45.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.096+0000 7fce366e5640 1 --2- 172.21.15.169:0/4222585383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e78740 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce280affd0 tx=0x7fce28002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09a0f07a23c9521 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fcd19ffb640 1 -- 172.21.15.169:0/4222585383 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280b4d30 con 0x5603b8e78360 2024-09-13T06:32:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fcd19ffb640 1 -- 172.21.15.169:0/4222585383 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280dc3f0 con 0x5603b8e78360 2024-09-13T06:32:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fcd19ffb640 1 -- 172.21.15.169:0/4222585383 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280f23a0 con 0x5603b8e78360 2024-09-13T06:32:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/4222585383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 msgr2=0x5603b8e78740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 --2- 172.21.15.169:0/4222585383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e78740 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce280affd0 tx=0x7fce28002fc0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/4222585383 shutdown_connections 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 --2- 172.21.15.169:0/4222585383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e78740 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/4222585383 >> 172.21.15.169:0/4222585383 conn(0x5603b8e74740 msgr2=0x5603b8e72840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/4222585383 shutdown_connections 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/4222585383 wait complete. 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 Processor -- start 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- start start 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e7f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5603b8e791b0 con 0x5603b8e78360 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e7f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce366e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e7f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.169:41340/0 (socket says 172.21.15.169:41340) 2024-09-13T06:32:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 learned_addr learned my addr 172.21.15.169:0/3710996977 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b8e7faa0 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce366e5640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e7f560 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce280f2fd0 tx=0x7fce280bff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fcd07fff640 1 -- 172.21.15.169:0/3710996977 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce2810c020 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603b8e7faa0 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fcd07fff640 1 -- 172.21.15.169:0/3710996977 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280d3c90 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fcd07fff640 1 -- 172.21.15.169:0/3710996977 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce280e3600 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.100+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b8e7faa0 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fcd07fff640 1 -- 172.21.15.169:0/3710996977 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce2810f020 con 0x5603b8e78360 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fcd07fff640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd00034650 0x7fcd00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fcd07fff640 1 -- 172.21.15.169:0/3710996977 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fce28102050 con 0x5603b8e78360 2024-09-13T06:32:45.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd00034650 0x7fcd00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8e8a5e0 0x5603b8e8caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e8d1f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce36ee6640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8e8a5e0 0x5603b8e8caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd00034650 0x7fcd00036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce20010fd0 tx=0x7fce20011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce36ee6640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8e8a5e0 0x5603b8e8caa0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 realm 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e89a10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e8dcc0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:32:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e8eaa0 0x5603b8e90e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91510 con 0x5603b8e8eaa0 2024-09-13T06:32:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce366e5640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e8eaa0 0x5603b8e90e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.104+0000 7fce366e5640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e8eaa0 0x5603b8e90e90 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:5 5.10 5:0f90187c:::zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== osd_op_reply(5 zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 20 searching for the correct realm 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e93ad0 0x5603b8e95ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e96540 con 0x5603b8e93ad0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e93ad0 0x5603b8e95ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce35ee4640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e93ad0 0x5603b8e95ec0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e96540 con 0x5603b8e8eaa0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 3 ==== osd_op_reply(7 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce366e5640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fce28111020 0x7fce280f9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x7fce28111020 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce36ee6640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fce28111020 0x7fce280f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce36ee6640 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fce28111020 0x7fce280f9270 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 4 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.108+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 5 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e93ad0 2024-09-13T06:32:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 6 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 4 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 5 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x7fce28111020 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x7fce28111020 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 6 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.112+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e93ad0 2024-09-13T06:32:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 3 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 9 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e93ad0 2024-09-13T06:32:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 4 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 10 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 11 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 12 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e93ad0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x7fce28111020 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8a5e0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 13 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x7fce28111020 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 5 ==== osd_op_reply(30 [pgnls start_epoch 35 out=82b] v35'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e93ad0 2024-09-13T06:32:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.116+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x7fce28111020 2024-09-13T06:32:45.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 8 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e93ad0 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 10 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e91d60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 11 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got zone_info.8744f35f-8918-4410-a77e-3a3ac7b40446 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e925b0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:32:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.120+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e929a0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:40 5.14 5:2dde072a:::zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e929a0 con 0x5603b8e93ad0 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 8 ==== osd_op_reply(40 zonegroup_info.7fd9ecda-6337-4ce7-ac46-f04193654c7b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 zone default found 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 4 Realm: () 2024-09-13T06:32:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 4 ZoneGroup: default (7fd9ecda-6337-4ce7-ac46-f04193654c7b) 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 4 Zone: default (8744f35f-8918-4410-a77e-3a3ac7b40446) 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 zonegroup default 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e969c0 con 0x7fce28111020 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 7 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98bf0 con 0x5603b8e93ad0 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados->read ofs=0 len=0 2024-09-13T06:32:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98f90 con 0x5603b8e93ad0 2024-09-13T06:32:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:32:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 started sync module instance, tier type = 2024-09-13T06:32:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 20 started zone id=8744f35f-8918-4410-a77e-3a3ac7b40446 (name=default) with tier type = 2024-09-13T06:32:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.124+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98030 con 0x5603b8e8eaa0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 13 ==== osd_op_reply(44 notify.0 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94573987202384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98030 con 0x5603b8e8eaa0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e99950 con 0x5603b8e8a5e0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 15 ==== osd_op_reply(46 notify.1 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94573987206304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9a1a0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9ab60 con 0x5603b8e8eaa0 2024-09-13T06:32:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94573987202384] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.128+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94573987206304] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 15 ==== osd_op_reply(48 notify.2 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94573987210928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9a1a0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9aad0 con 0x7fce28111020 2024-09-13T06:32:45.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 8 ==== osd_op_reply(50 notify.3 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94573987213136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9aad0 con 0x7fce28111020 2024-09-13T06:32:45.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9bef0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94573987210928] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94573987213136] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 17 ==== osd_op_reply(52 notify.4 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94573987214192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9beb0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.132+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9c2e0 con 0x5603b8e93ad0 2024-09-13T06:32:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 11 ==== osd_op_reply(54 notify.5 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94573987208432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9cb80 con 0x5603b8e93ad0 2024-09-13T06:32:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9d540 con 0x5603b8e93ad0 2024-09-13T06:32:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94573987214192] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94573987208432] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 13 ==== osd_op_reply(56 notify.6 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94573987219152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9d540 con 0x5603b8e93ad0 2024-09-13T06:32:45.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.136+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9caf0 con 0x7fce28111020 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94573987219152] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 10 ==== osd_op_reply(58 notify.7 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94573987221648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9d4b0 con 0x7fce28111020 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=0 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=1 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=2 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=3 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=4 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=5 2024-09-13T06:32:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=6 2024-09-13T06:32:45.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94573987221648] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 20 add_watcher() i=7 2024-09-13T06:32:45.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 2 all 8 watchers are set, enabling cache 2024-09-13T06:32:45.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea0e40 con 0x5603b8e8a5e0 2024-09-13T06:32:45.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.140+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94573987223904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9e380 con 0x5603b8e8a5e0 2024-09-13T06:32:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94573987223904] v35'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fccecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:32:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce38bd5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:32:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce38bd5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:32:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea96a0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea97b0 con 0x7fce28111020 2024-09-13T06:32:45.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.144+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea9ec0 con 0x5603b8e93ad0 2024-09-13T06:32:45.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.148+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.148+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eaa370 con 0x5603b8e8a5e0 2024-09-13T06:32:45.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.148+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.148+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea7500 con 0x5603b8e8eaa0 2024-09-13T06:32:45.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.152+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'84 uv83 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.152+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea7500 con 0x5603b8e93ad0 2024-09-13T06:32:45.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.152+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.152+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea7500 con 0x5603b8e8eaa0 2024-09-13T06:32:45.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.156+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.156+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eaaed0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.156+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.156+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab380 con 0x5603b8e8eaa0 2024-09-13T06:32:45.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.160+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.160+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab380 con 0x5603b8e8eaa0 2024-09-13T06:32:45.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.160+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'39 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.160+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab380 con 0x5603b8e8eaa0 2024-09-13T06:32:45.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.164+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.164+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab380 con 0x5603b8e93ad0 2024-09-13T06:32:45.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.164+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.164+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab550 con 0x5603b8e8eaa0 2024-09-13T06:32:45.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.168+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.168+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab550 con 0x5603b8e8a5e0 2024-09-13T06:32:45.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.168+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.168+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab7b0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.172+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.172+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab840 con 0x5603b8e8eaa0 2024-09-13T06:32:45.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.172+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.172+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab840 con 0x5603b8e8eaa0 2024-09-13T06:32:45.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.176+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.176+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab840 con 0x5603b8e93ad0 2024-09-13T06:32:45.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.180+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.180+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab8d0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.180+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.180+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab8d0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.184+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.184+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab8d0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.184+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.184+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eab8d0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.188+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.188+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabaa0 con 0x5603b8e93ad0 2024-09-13T06:32:45.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.188+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.188+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabaa0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.192+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.192+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabaa0 con 0x5603b8e93ad0 2024-09-13T06:32:45.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.192+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 20 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.192+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x5603b8e93ad0 2024-09-13T06:32:45.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.196+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 21 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'57 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.196+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x5603b8e93ad0 2024-09-13T06:32:45.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.196+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'35 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.196+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.200+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.200+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.200+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'57 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.200+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.204+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.204+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.204+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.204+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8eabea0 con 0x7fce28111020 2024-09-13T06:32:45.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.204+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.204+0000 7fcc677fe640 20 reqs_thread_entry: start 2024-09-13T06:32:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 20 init_complete bucket index max shards: 11 2024-09-13T06:32:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 20 Filter name: none 2024-09-13T06:32:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fcc657fa640 20 reqs_thread_entry: start 2024-09-13T06:32:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T06:32:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:94 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 34 ==== osd_op_reply(94 gc.18 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:95 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 35 ==== osd_op_reply(95 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.208+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:96 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 36 ==== osd_op_reply(96 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:97 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 37 ==== osd_op_reply(97 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:98 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 38 ==== osd_op_reply(98 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:99 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 39 ==== osd_op_reply(99 gc.18 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T06:32:45.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.212+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:100 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 26 ==== osd_op_reply(100 gc.19 [call] v35'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:101 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 27 ==== osd_op_reply(101 gc.19 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:102 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 28 ==== osd_op_reply(102 gc.19 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:103 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 29 ==== osd_op_reply(103 gc.19 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:104 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 30 ==== osd_op_reply(104 gc.19 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.216+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:105 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 31 ==== osd_op_reply(105 gc.19 [call] v35'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T06:32:45.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:106 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 40 ==== osd_op_reply(106 gc.20 [call] v35'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:107 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 41 ==== osd_op_reply(107 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.220+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:108 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 42 ==== osd_op_reply(108 gc.20 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:109 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 43 ==== osd_op_reply(109 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:110 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 44 ==== osd_op_reply(110 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.224+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:111 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 45 ==== osd_op_reply(111 gc.20 [call] v35'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T06:32:45.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:112 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 46 ==== osd_op_reply(112 gc.21 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:113 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 47 ==== osd_op_reply(113 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.228+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:114 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 48 ==== osd_op_reply(114 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:115 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 49 ==== osd_op_reply(115 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:116 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 50 ==== osd_op_reply(116 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.232+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:117 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 51 ==== osd_op_reply(117 gc.21 [call] v35'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T06:32:45.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:118 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 23 ==== osd_op_reply(118 gc.22 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:119 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 24 ==== osd_op_reply(119 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:120 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e93ad0 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 25 ==== osd_op_reply(120 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:121 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 26 ==== osd_op_reply(121 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:122 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 27 ==== osd_op_reply(122 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.236+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:123 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 28 ==== osd_op_reply(123 gc.22 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T06:32:45.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:124 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 52 ==== osd_op_reply(124 gc.23 [call] v35'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:125 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 53 ==== osd_op_reply(125 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:126 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 54 ==== osd_op_reply(126 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.240+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:127 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 55 ==== osd_op_reply(127 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:128 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 56 ==== osd_op_reply(128 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:129 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 57 ==== osd_op_reply(129 gc.23 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T06:32:45.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.244+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:130 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 29 ==== osd_op_reply(130 gc.24 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:131 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 30 ==== osd_op_reply(131 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:132 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e93ad0 2024-09-13T06:32:45.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 31 ==== osd_op_reply(132 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:133 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 32 ==== osd_op_reply(133 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:134 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 33 ==== osd_op_reply(134 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.248+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:135 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 34 ==== osd_op_reply(135 gc.24 [call] v35'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T06:32:45.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:136 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 35 ==== osd_op_reply(136 gc.25 [call] v35'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:137 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 36 ==== osd_op_reply(137 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:138 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 37 ==== osd_op_reply(138 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:139 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 38 ==== osd_op_reply(139 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:140 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 39 ==== osd_op_reply(140 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.252+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:141 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 40 ==== osd_op_reply(141 gc.25 [call] v35'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T06:32:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:142 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 41 ==== osd_op_reply(142 gc.26 [call] v35'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:143 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 42 ==== osd_op_reply(143 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.256+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:144 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e93ad0 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 43 ==== osd_op_reply(144 gc.26 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:145 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 44 ==== osd_op_reply(145 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:146 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 45 ==== osd_op_reply(146 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:147 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 46 ==== osd_op_reply(147 gc.26 [call] v35'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T06:32:45.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.260+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:148 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 58 ==== osd_op_reply(148 gc.27 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:149 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 59 ==== osd_op_reply(149 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:150 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 60 ==== osd_op_reply(150 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:151 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 61 ==== osd_op_reply(151 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:152 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 62 ==== osd_op_reply(152 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.264+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:153 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 63 ==== osd_op_reply(153 gc.27 [call] v35'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T06:32:45.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:154 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 32 ==== osd_op_reply(154 gc.28 [call] v35'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:155 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 33 ==== osd_op_reply(155 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:156 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 34 ==== osd_op_reply(156 gc.28 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.268+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:157 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 35 ==== osd_op_reply(157 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:158 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 36 ==== osd_op_reply(158 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:159 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 37 ==== osd_op_reply(159 gc.28 [call] v35'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T06:32:45.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.272+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:160 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 64 ==== osd_op_reply(160 gc.29 [call] v35'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:161 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 65 ==== osd_op_reply(161 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:162 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 66 ==== osd_op_reply(162 gc.29 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:163 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 67 ==== osd_op_reply(163 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:164 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 68 ==== osd_op_reply(164 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.276+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:165 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 69 ==== osd_op_reply(165 gc.29 [call] v35'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T06:32:45.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:166 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 38 ==== osd_op_reply(166 gc.30 [call] v35'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:167 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 39 ==== osd_op_reply(167 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:168 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 40 ==== osd_op_reply(168 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:169 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 41 ==== osd_op_reply(169 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:170 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 42 ==== osd_op_reply(170 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.280+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:171 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 43 ==== osd_op_reply(171 gc.30 [call] v35'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:172 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 14 ==== osd_op_reply(172 gc.31 [call] v35'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:173 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 15 ==== osd_op_reply(173 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:174 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x7fce28111020 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 16 ==== osd_op_reply(174 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:175 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 17 ==== osd_op_reply(175 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.284+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:176 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.288+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 18 ==== osd_op_reply(176 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.288+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.288+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:177 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.288+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 19 ==== osd_op_reply(177 gc.31 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.288+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T06:32:45.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.288+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:178 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 70 ==== osd_op_reply(178 gc.0 [call] v35'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:179 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 71 ==== osd_op_reply(179 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:180 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 72 ==== osd_op_reply(180 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:181 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 73 ==== osd_op_reply(181 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:182 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 74 ==== osd_op_reply(182 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.292+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:183 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.296+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 75 ==== osd_op_reply(183 gc.0 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.296+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T06:32:45.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.296+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:184 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.296+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 20 ==== osd_op_reply(184 gc.1 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.296+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:185 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 21 ==== osd_op_reply(185 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:186 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x7fce28111020 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 22 ==== osd_op_reply(186 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:187 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 23 ==== osd_op_reply(187 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:188 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 24 ==== osd_op_reply(188 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:189 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x7fce28111020 2024-09-13T06:32:45.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 25 ==== osd_op_reply(189 gc.1 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T06:32:45.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.300+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:190 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 47 ==== osd_op_reply(190 gc.2 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:191 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 48 ==== osd_op_reply(191 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:192 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e93ad0 2024-09-13T06:32:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 49 ==== osd_op_reply(192 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:193 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 50 ==== osd_op_reply(193 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:194 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 51 ==== osd_op_reply(194 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.304+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:195 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e93ad0 2024-09-13T06:32:45.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 52 ==== osd_op_reply(195 gc.2 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T06:32:45.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:196 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 44 ==== osd_op_reply(196 gc.3 [call] v35'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:197 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 45 ==== osd_op_reply(197 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:198 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 46 ==== osd_op_reply(198 gc.3 [call out=24b] v0'0 uv280 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:199 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 47 ==== osd_op_reply(199 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.308+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:200 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 48 ==== osd_op_reply(200 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:201 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 49 ==== osd_op_reply(201 gc.3 [call] v35'281 uv281 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T06:32:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.312+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:202 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 76 ==== osd_op_reply(202 gc.4 [call] v35'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:203 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 77 ==== osd_op_reply(203 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:204 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec6ed0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 78 ==== osd_op_reply(204 gc.4 [call out=24b] v0'0 uv87 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:205 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 79 ==== osd_op_reply(205 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:206 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ec7ee0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 80 ==== osd_op_reply(206 gc.4 [call out=1716b] v0'0 uv87 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T06:32:45.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 20 garbage collection: RGWGC::process iterating over entry tag='8744f35f-8918-4410-a77e-3a3ac7b40446.4225.15358582307919832091', time=2024-09-13T06:32:28.323054+0000, chain.objs.size()=7 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_1 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:207 3.8 3:12a5db33:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea60a0 con 0x5603b8e93ad0 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_2 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:208 3.8 3:11442bb7:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecb3c0 con 0x5603b8e93ad0 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_3 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:209 3.f 3:f3091002:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_4 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:210 3.e 3:71234cae:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ed0770 con 0x5603b8e8eaa0 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_5 2024-09-13T06:32:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:211 3.3d 3:be27edd8:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e93ad0 2024-09-13T06:32:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.316+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_6 2024-09-13T06:32:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.320+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:212 3.1b 3:da5ed320:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ed54b0 con 0x5603b8e93ad0 2024-09-13T06:32:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.320+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_7 2024-09-13T06:32:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.320+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:213 3.c 3:33b3afcb:::8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ed7d80 con 0x5603b8e8eaa0 2024-09-13T06:32:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.320+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 81 ==== osd_op_reply(213 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_7 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 53 ==== osd_op_reply(211 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_5 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 54 ==== osd_op_reply(207 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_1 [call] v35'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 82 ==== osd_op_reply(210 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_4 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 55 ==== osd_op_reply(208 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_2 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 83 ==== osd_op_reply(209 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_3 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 56 ==== osd_op_reply(212 8744f35f-8918-4410-a77e-3a3ac7b40446.4225.11__shadow_.MjkTHGW2d-ii6A10Pa4UdCcy5EjPXyV_6 [call] v35'8 uv8 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce38bd5980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T06:32:45.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.324+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:214 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ed02c0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.328+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 84 ==== osd_op_reply(214 gc.4 [call] v35'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.328+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:215 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ed02c0 con 0x5603b8e8eaa0 2024-09-13T06:32:45.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 85 ==== osd_op_reply(215 gc.4 [call] v35'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T06:32:45.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:216 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 57 ==== osd_op_reply(216 gc.5 [call] v35'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:217 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 58 ==== osd_op_reply(217 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:218 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 59 ==== osd_op_reply(218 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:219 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.332+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 60 ==== osd_op_reply(219 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:220 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 61 ==== osd_op_reply(220 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:221 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 62 ==== osd_op_reply(221 gc.5 [call] v35'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T06:32:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.336+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:222 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.340+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 86 ==== osd_op_reply(222 gc.6 [call] v35'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.340+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:223 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.340+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 87 ==== osd_op_reply(223 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.340+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.340+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:224 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 88 ==== osd_op_reply(224 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:225 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 89 ==== osd_op_reply(225 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:226 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 90 ==== osd_op_reply(226 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.344+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:227 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.348+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 91 ==== osd_op_reply(227 gc.6 [call] v35'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.348+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T06:32:45.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.348+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:228 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.348+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 50 ==== osd_op_reply(228 gc.7 [call] v35'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.348+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:229 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 51 ==== osd_op_reply(229 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:230 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 52 ==== osd_op_reply(230 gc.7 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:231 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 53 ==== osd_op_reply(231 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:232 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 54 ==== osd_op_reply(232 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.352+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:233 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8a5e0 2024-09-13T06:32:45.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.356+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 55 ==== osd_op_reply(233 gc.7 [call] v35'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.356+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T06:32:45.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.356+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:234 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.356+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 92 ==== osd_op_reply(234 gc.8 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.356+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:235 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 93 ==== osd_op_reply(235 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:236 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecde10 con 0x5603b8e8eaa0 2024-09-13T06:32:45.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 94 ==== osd_op_reply(236 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:237 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 95 ==== osd_op_reply(237 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:238 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 96 ==== osd_op_reply(238 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.360+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:239 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.364+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 97 ==== osd_op_reply(239 gc.8 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.364+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T06:32:45.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.364+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:240 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 98 ==== osd_op_reply(240 gc.9 [call] v35'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:241 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 99 ==== osd_op_reply(241 gc.9 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:242 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8eaa0 2024-09-13T06:32:45.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 100 ==== osd_op_reply(242 gc.9 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:243 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 101 ==== osd_op_reply(243 gc.9 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.368+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:244 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.372+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 102 ==== osd_op_reply(244 gc.9 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.372+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.372+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:245 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.372+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 103 ==== osd_op_reply(245 gc.9 [call] v35'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.372+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T06:32:45.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.372+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:246 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.376+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 104 ==== osd_op_reply(246 gc.10 [call] v35'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.376+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:247 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.376+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 105 ==== osd_op_reply(247 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.376+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.376+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:248 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8eaa0 2024-09-13T06:32:45.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 106 ==== osd_op_reply(248 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:249 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 107 ==== osd_op_reply(249 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:250 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 108 ==== osd_op_reply(250 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.380+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:251 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.384+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 109 ==== osd_op_reply(251 gc.10 [call] v35'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.384+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T06:32:45.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.384+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:252 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 63 ==== osd_op_reply(252 gc.11 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:253 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 64 ==== osd_op_reply(253 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:254 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 65 ==== osd_op_reply(254 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:255 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 66 ==== osd_op_reply(255 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:256 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 67 ==== osd_op_reply(256 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.388+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.392+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 68 ==== osd_op_reply(257 gc.11 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.392+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T06:32:45.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.392+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:258 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 110 ==== osd_op_reply(258 gc.12 [call] v35'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:259 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 111 ==== osd_op_reply(259 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:260 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8eaa0 2024-09-13T06:32:45.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 112 ==== osd_op_reply(260 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:261 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 113 ==== osd_op_reply(261 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.396+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:262 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 114 ==== osd_op_reply(262 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:263 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 115 ==== osd_op_reply(263 gc.12 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T06:32:45.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.400+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:264 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 56 ==== osd_op_reply(264 gc.13 [call] v35'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:265 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 57 ==== osd_op_reply(265 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:266 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8a5e0 2024-09-13T06:32:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 58 ==== osd_op_reply(266 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.404+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:267 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 59 ==== osd_op_reply(267 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:268 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 60 ==== osd_op_reply(268 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:269 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 61 ==== osd_op_reply(269 gc.13 [call] v35'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T06:32:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.408+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:270 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.412+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 62 ==== osd_op_reply(270 gc.14 [call] v35'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.412+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:271 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.412+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 63 ==== osd_op_reply(271 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.412+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.412+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:272 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8a5e0 2024-09-13T06:32:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 64 ==== osd_op_reply(272 gc.14 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:273 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 65 ==== osd_op_reply(273 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:274 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 66 ==== osd_op_reply(274 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.416+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:275 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8a5e0 2024-09-13T06:32:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.420+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 67 ==== osd_op_reply(275 gc.14 [call] v35'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.420+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T06:32:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.420+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:276 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.420+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 116 ==== osd_op_reply(276 gc.15 [call] v35'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.420+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:277 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 117 ==== osd_op_reply(277 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:278 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8eaa0 2024-09-13T06:32:45.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 118 ==== osd_op_reply(278 gc.15 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:279 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 119 ==== osd_op_reply(279 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:280 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 120 ==== osd_op_reply(280 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.424+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:281 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.428+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 121 ==== osd_op_reply(281 gc.15 [call] v35'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.428+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T06:32:45.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.428+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:282 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 122 ==== osd_op_reply(282 gc.16 [call] v35'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:283 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 123 ==== osd_op_reply(283 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:284 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e8eaa0 2024-09-13T06:32:45.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 124 ==== osd_op_reply(284 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:285 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 125 ==== osd_op_reply(285 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.432+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:286 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.436+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 126 ==== osd_op_reply(286 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.436+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.436+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:287 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e8eaa0 2024-09-13T06:32:45.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.436+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 127 ==== osd_op_reply(287 gc.16 [call] v35'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.436+0000 7fce38bd5980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T06:32:45.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.436+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:288 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.440+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 69 ==== osd_op_reply(288 gc.17 [call] v35'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.440+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:289 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.440+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 70 ==== osd_op_reply(289 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.440+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.440+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:290 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 71 ==== osd_op_reply(290 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:291 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 72 ==== osd_op_reply(291 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:32:45.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:292 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecc700 con 0x5603b8e93ad0 2024-09-13T06:32:45.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 73 ==== osd_op_reply(292 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce38bd5980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:32:45.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.444+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:293 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ecd710 con 0x5603b8e93ad0 2024-09-13T06:32:45.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.448+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 74 ==== osd_op_reply(293 gc.17 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.448+0000 7fccecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:32:45.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.448+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94573987223904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8ea5af0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.452+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94573987223904] v35'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.452+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94573987202384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9d960 con 0x5603b8e8eaa0 2024-09-13T06:32:45.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 128 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94573987202384] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce38bd5980 20 remove_watcher() i=0 2024-09-13T06:32:45.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce38bd5980 2 removed watcher, disabling cache 2024-09-13T06:32:45.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94573987206304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98550 con 0x5603b8e8a5e0 2024-09-13T06:32:45.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.1 v2:172.21.15.169:6808/3492903297 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94573987206304] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x5603b8e8a5e0 2024-09-13T06:32:45.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce38bd5980 20 remove_watcher() i=1 2024-09-13T06:32:45.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.456+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94573987210928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98550 con 0x5603b8e8eaa0 2024-09-13T06:32:45.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.460+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 129 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94573987210928] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.460+0000 7fce38bd5980 20 remove_watcher() i=2 2024-09-13T06:32:45.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.460+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94573987213136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9a6b0 con 0x7fce28111020 2024-09-13T06:32:45.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.460+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 26 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94573987213136] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.460+0000 7fce38bd5980 20 remove_watcher() i=3 2024-09-13T06:32:45.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.460+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94573987214192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e98550 con 0x5603b8e8eaa0 2024-09-13T06:32:45.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.464+0000 7fce366e5640 1 -- 172.21.15.169:0/3710996977 <== osd.0 v2:172.21.15.112:6800/389376018 130 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94573987214192] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce280ce070 con 0x5603b8e8eaa0 2024-09-13T06:32:45.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.464+0000 7fce38bd5980 20 remove_watcher() i=4 2024-09-13T06:32:45.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.464+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94573987208432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9a6b0 con 0x5603b8e93ad0 2024-09-13T06:32:45.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.468+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 75 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94573987208432] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.468+0000 7fce38bd5980 20 remove_watcher() i=5 2024-09-13T06:32:45.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.468+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94573987219152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e99cf0 con 0x5603b8e93ad0 2024-09-13T06:32:45.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.468+0000 7fce35ee4640 1 -- 172.21.15.169:0/3710996977 <== osd.3 v2:172.21.15.169:6800/747740583 76 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94573987219152] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20036040 con 0x5603b8e93ad0 2024-09-13T06:32:45.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.468+0000 7fce38bd5980 20 remove_watcher() i=6 2024-09-13T06:32:45.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.468+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94573987221648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603b8e9a6b0 con 0x7fce28111020 2024-09-13T06:32:45.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 <== osd.2 v2:172.21.15.169:6816/1749135367 27 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94573987221648] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300083f0 con 0x7fce28111020 2024-09-13T06:32:45.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 20 remove_watcher() i=7 2024-09-13T06:32:45.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e8eaa0 msgr2=0x5603b8e90e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e8eaa0 0x5603b8e90e90 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8e8a5e0 msgr2=0x5603b8e8caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8e8a5e0 0x5603b8e8caa0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fce28111020 msgr2=0x7fce280f9270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7fce28111020 0x7fce280f9270 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e93ad0 msgr2=0x5603b8e95ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e93ad0 0x5603b8e95ec0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd00034650 msgr2=0x7fcd00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd00034650 0x7fcd00036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce20010fd0 tx=0x7fce20011000 comp rx=0 tx=0).stop 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 msgr2=0x5603b8e7f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce36ee6640 1 -- 172.21.15.169:0/3710996977 reap_dead start 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e7f560 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce280f2fd0 tx=0x7fce280bff60 comp rx=0 tx=0).stop 2024-09-13T06:32:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 shutdown_connections 2024-09-13T06:32:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3710996977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e78360 0x5603b8e7f560 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 >> 172.21.15.169:0/3710996977 conn(0x5603b8e74740 msgr2=0x5603b8e72810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 shutdown_connections 2024-09-13T06:32:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3710996977 wait complete. 2024-09-13T06:32:45.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd10034650 msgr2=0x7fcd10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd10034650 0x7fcd10036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5603b8e447b0 tx=0x7fce20006000 comp rx=0 tx=0).stop 2024-09-13T06:32:45.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 msgr2=0x5603b8e6bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 0x5603b8e6bfd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce280e51d0 tx=0x7fce280a9950 comp rx=0 tx=0).stop 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 shutdown_connections 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd10034650 0x7fcd10036b10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/1311623626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8e6bbb0 0x5603b8e6bfd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 >> 172.21.15.169:0/1311623626 conn(0x5603b8e60d00 msgr2=0x5603b8e63780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 shutdown_connections 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/1311623626 wait complete. 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e56030 msgr2=0x5603b8e584f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x5603b8e56030 0x5603b8e584f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8d58e90 msgr2=0x5603b8e55080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x5603b8d58e90 0x5603b8e55080 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e5b8c0 msgr2=0x5603b8e5dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x5603b8e5b8c0 0x5603b8e5dcb0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd1c034650 msgr2=0x7fcd1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fcd1c034650 0x7fcd1c036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fce20000f70 tx=0x7fce20001420 comp rx=0 tx=0).stop 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 msgr2=0x5603b8e45110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 --2- 172.21.15.169:0/3643684294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5603b8d58540 0x5603b8e45110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce28005cc0 tx=0x7fce28017e30 comp rx=0 tx=0).stop 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce36ee6640 1 -- 172.21.15.169:0/3643684294 reap_dead start 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 shutdown_connections 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 >> 172.21.15.169:0/3643684294 conn(0x5603b8d54060 msgr2=0x5603b8e3e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.472+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 shutdown_connections 2024-09-13T06:32:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-13T06:32:45.476+0000 7fce38bd5980 1 -- 172.21.15.169:0/3643684294 wait complete. 2024-09-13T06:32:45.491 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T06:32:45.501 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:32:45.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:32:45.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.626+0000 7f0497d66640 1 Processor -- start 2024-09-13T06:32:45.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.626+0000 7f0497d66640 1 -- start start 2024-09-13T06:32:45.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f049012f390 0x7f0490133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04900984f0 con 0x7f049012e760 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0490098dc0 con 0x7f049012f390 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0495b02640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f049012e760 0x7f049012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46432/0 (socket says 172.21.15.112:46432) 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0495b02640 1 -- 172.21.15.112:0/3347461682 learned_addr learned my addr 172.21.15.112:0/3347461682 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0495301640 1 --2- 172.21.15.112:0/3347461682 >> v2:172.21.15.112:3300/0 conn(0x7f049012f390 0x7f0490133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0495301640 1 -- 172.21.15.112:0/3347461682 >> v1:172.21.15.112:6789/0 conn(0x7f049012e760 legacy=0x7f049012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0495301640 1 -- 172.21.15.112:0/3347461682 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04900981a0 con 0x7f049012f390 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0495301640 1 --2- 172.21.15.112:0/3347461682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012f390 0x7f0490133a80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0480009740 tx=0x7f048001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d8f9c8f88ab939 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0494b00640 1 -- 172.21.15.112:0/3347461682 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04800b1070 con 0x7f049012f390 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0494b00640 1 -- 172.21.15.112:0/3347461682 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04800ac570 con 0x7f049012f390 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0494b00640 1 -- 172.21.15.112:0/3347461682 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04800ac870 con 0x7f049012f390 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- 172.21.15.112:0/3347461682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012f390 msgr2=0x7f0490133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 --2- 172.21.15.112:0/3347461682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012f390 0x7f0490133a80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0480009740 tx=0x7f048001c400 comp rx=0 tx=0).stop 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- 172.21.15.112:0/3347461682 shutdown_connections 2024-09-13T06:32:45.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 --2- 172.21.15.112:0/3347461682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012f390 0x7f0490133a80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- 172.21.15.112:0/3347461682 >> 172.21.15.112:0/3347461682 conn(0x7f04900a10a0 msgr2=0x7f04900a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- 172.21.15.112:0/3347461682 shutdown_connections 2024-09-13T06:32:45.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.630+0000 7f0497d66640 1 -- 172.21.15.112:0/3347461682 wait complete. 2024-09-13T06:32:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 Processor -- start 2024-09-13T06:32:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 -- start start 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 0x7f04900963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0490136b70 con 0x7f049012e760 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0495b02640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 0x7f04900963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0495b02640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 0x7f04900963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46162/0 (socket says 172.21.15.112:46162) 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0495b02640 1 -- 172.21.15.112:0/1590676735 learned_addr learned my addr 172.21.15.112:0/1590676735 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0495b02640 1 -- 172.21.15.112:0/1590676735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0490131730 con 0x7f049012e760 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0495b02640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 0x7f04900963d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c480 tx=0x7f048c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f048c017070 con 0x7f049012e760 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c005c20 con 0x7f049012e760 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0490128f50 con 0x7f049012e760 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f048c007070 con 0x7f049012e760 2024-09-13T06:32:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0490131da0 con 0x7f049012e760 2024-09-13T06:32:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049012de00 con 0x7f049012e760 2024-09-13T06:32:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f048c01a070 con 0x7f049012e760 2024-09-13T06:32:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f04867fc640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0474035db0 0x7f0474038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.634+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f048c0487c0 con 0x7f049012e760 2024-09-13T06:32:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.638+0000 7f0495301640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0474035db0 0x7f0474038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.638+0000 7f0495301640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0474035db0 0x7f0474038270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f04800ae000 tx=0x7f0480008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.642+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0490131730 con 0x7f049012e760 2024-09-13T06:32:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.798+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f049012ec80 con 0x7f0474035db0 2024-09-13T06:32:45.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.950+0000 7f04867fc640 1 -- 172.21.15.112:0/1590676735 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665570 (secure 0 0 0) 0x7f049012ec80 con 0x7f0474035db0 2024-09-13T06:32:45.961 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:32:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:32:45.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0474035db0 msgr2=0x7f0474038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0474035db0 0x7f0474038270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f04800ae000 tx=0x7f0480008040 comp rx=0 tx=0).stop 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 msgr2=0x7f04900963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 0x7f04900963d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c480 tx=0x7f048c00c940 comp rx=0 tx=0).stop 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 shutdown_connections 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0474035db0 0x7f0474038270 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 --2- 172.21.15.112:0/1590676735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049012e760 0x7f04900963d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 >> 172.21.15.112:0/1590676735 conn(0x7f04900a10a0 msgr2=0x7f04900972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 shutdown_connections 2024-09-13T06:32:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:45.962+0000 7f0497d66640 1 -- 172.21.15.112:0/1590676735 wait complete. 2024-09-13T06:32:45.985 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T06:32:44.504791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4884,"num_read_kb":4465,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198896,"kb_used_data":53360,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288464,"statfs":{"total":386547056640,"available":386343387136,"internally_reserved":0,"allocated":54640640,"data_stored":53402662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006429"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576389+0000","last_change":"2024-09-13T06:28:58.716560+0000","last_active":"2024-09-13T06:30:39.576389+0000","last_peered":"2024-09-13T06:30:39.576389+0000","last_clean":"2024-09-13T06:30:39.576389+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:30:39.576389+0000","last_undegraded":"2024-09-13T06:30:39.576389+0000","last_fullsized":"2024-09-13T06:30:39.576389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:38.476549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776956+0000","last_change":"2024-09-13T06:29:00.715147+0000","last_active":"2024-09-13T06:32:13.776956+0000","last_peered":"2024-09-13T06:32:13.776956+0000","last_clean":"2024-09-13T06:32:13.776956+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:32:13.776956+0000","last_undegraded":"2024-09-13T06:32:13.776956+0000","last_fullsized":"2024-09-13T06:32:13.776956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318678+0000","last_change":"2024-09-13T06:28:58.727026+0000","last_active":"2024-09-13T06:30:40.318678+0000","last_peered":"2024-09-13T06:30:40.318678+0000","last_clean":"2024-09-13T06:30:40.318678+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:30:40.318678+0000","last_undegraded":"2024-09-13T06:30:40.318678+0000","last_fullsized":"2024-09-13T06:30:40.318678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.916216+0000","last_change":"2024-09-13T06:29:00.709791+0000","last_active":"2024-09-13T06:31:07.916216+0000","last_peered":"2024-09-13T06:31:07.916216+0000","last_clean":"2024-09-13T06:31:07.916216+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:31:07.916216+0000","last_undegraded":"2024-09-13T06:31:07.916216+0000","last_fullsized":"2024-09-13T06:31:07.916216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'1","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.489059+0000","last_change":"2024-09-13T06:28:58.725541+0000","last_active":"2024-09-13T06:31:05.489059+0000","last_peered":"2024-09-13T06:31:05.489059+0000","last_clean":"2024-09-13T06:31:05.489059+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:31:05.489059+0000","last_undegraded":"2024-09-13T06:31:05.489059+0000","last_fullsized":"2024-09-13T06:31:05.489059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495245+0000","last_change":"2024-09-13T06:29:00.707081+0000","last_active":"2024-09-13T06:31:30.495245+0000","last_peered":"2024-09-13T06:31:30.495245+0000","last_clean":"2024-09-13T06:31:30.495245+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:31:30.495245+0000","last_undegraded":"2024-09-13T06:31:30.495245+0000","last_fullsized":"2024-09-13T06:31:30.495245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566859+0000","last_change":"2024-09-13T06:28:58.721790+0000","last_active":"2024-09-13T06:30:39.566859+0000","last_peered":"2024-09-13T06:30:39.566859+0000","last_clean":"2024-09-13T06:30:39.566859+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:30:39.566859+0000","last_undegraded":"2024-09-13T06:30:39.566859+0000","last_fullsized":"2024-09-13T06:30:39.566859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:58.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905522+0000","last_change":"2024-09-13T06:29:00.707794+0000","last_active":"2024-09-13T06:30:39.905522+0000","last_peered":"2024-09-13T06:30:39.905522+0000","last_clean":"2024-09-13T06:30:39.905522+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:30:39.905522+0000","last_undegraded":"2024-09-13T06:30:39.905522+0000","last_fullsized":"2024-09-13T06:30:39.905522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572406+0000","last_change":"2024-09-13T06:28:58.707336+0000","last_active":"2024-09-13T06:30:39.572406+0000","last_peered":"2024-09-13T06:30:39.572406+0000","last_clean":"2024-09-13T06:30:39.572406+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:30:39.572406+0000","last_undegraded":"2024-09-13T06:30:39.572406+0000","last_fullsized":"2024-09-13T06:30:39.572406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121211+0000","last_change":"2024-09-13T06:29:00.731442+0000","last_active":"2024-09-13T06:32:14.121211+0000","last_peered":"2024-09-13T06:32:14.121211+0000","last_clean":"2024-09-13T06:32:14.121211+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:32:14.121211+0000","last_undegraded":"2024-09-13T06:32:14.121211+0000","last_fullsized":"2024-09-13T06:32:14.121211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573099+0000","last_change":"2024-09-13T06:28:58.734653+0000","last_active":"2024-09-13T06:30:39.573099+0000","last_peered":"2024-09-13T06:30:39.573099+0000","last_clean":"2024-09-13T06:30:39.573099+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:30:39.573099+0000","last_undegraded":"2024-09-13T06:30:39.573099+0000","last_fullsized":"2024-09-13T06:30:39.573099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.648254+0000","last_change":"2024-09-13T06:29:00.726885+0000","last_active":"2024-09-13T06:31:12.648254+0000","last_peered":"2024-09-13T06:31:12.648254+0000","last_clean":"2024-09-13T06:31:12.648254+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:31:12.648254+0000","last_undegraded":"2024-09-13T06:31:12.648254+0000","last_fullsized":"2024-09-13T06:31:12.648254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904763+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:30:39.904763+0000","last_peered":"2024-09-13T06:30:39.904763+0000","last_clean":"2024-09-13T06:30:39.904763+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:30:39.904763+0000","last_undegraded":"2024-09-13T06:30:39.904763+0000","last_fullsized":"2024-09-13T06:30:39.904763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.650812+0000","last_change":"2024-09-13T06:29:00.727067+0000","last_active":"2024-09-13T06:31:12.650812+0000","last_peered":"2024-09-13T06:31:12.650812+0000","last_clean":"2024-09-13T06:31:12.650812+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:31:12.650812+0000","last_undegraded":"2024-09-13T06:31:12.650812+0000","last_fullsized":"2024-09-13T06:31:12.650812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903907+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:30:39.903907+0000","last_peered":"2024-09-13T06:30:39.903907+0000","last_clean":"2024-09-13T06:30:39.903907+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:30:39.903907+0000","last_undegraded":"2024-09-13T06:30:39.903907+0000","last_fullsized":"2024-09-13T06:30:39.903907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.409976+0000","last_change":"2024-09-13T06:29:00.709914+0000","last_active":"2024-09-13T06:32:13.409976+0000","last_peered":"2024-09-13T06:32:13.409976+0000","last_clean":"2024-09-13T06:32:13.409976+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:32:13.409976+0000","last_undegraded":"2024-09-13T06:32:13.409976+0000","last_fullsized":"2024-09-13T06:32:13.409976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:37.375577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570878+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:13.570878+0000","last_peered":"2024-09-13T06:32:13.570878+0000","last_clean":"2024-09-13T06:32:13.570878+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:13.570878+0000","last_undegraded":"2024-09-13T06:32:13.570878+0000","last_fullsized":"2024-09-13T06:32:13.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321617+0000","last_change":"2024-09-13T06:28:58.730725+0000","last_active":"2024-09-13T06:30:40.321617+0000","last_peered":"2024-09-13T06:30:40.321617+0000","last_clean":"2024-09-13T06:30:40.321617+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:30:40.321617+0000","last_undegraded":"2024-09-13T06:30:40.321617+0000","last_fullsized":"2024-09-13T06:30:40.321617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.569961+0000","last_change":"2024-09-13T06:29:00.723386+0000","last_active":"2024-09-13T06:32:13.569961+0000","last_peered":"2024-09-13T06:32:13.569961+0000","last_clean":"2024-09-13T06:32:13.569961+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:32:13.569961+0000","last_undegraded":"2024-09-13T06:32:13.569961+0000","last_fullsized":"2024-09-13T06:32:13.569961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570235+0000","last_change":"2024-09-13T06:28:58.722377+0000","last_active":"2024-09-13T06:30:39.570235+0000","last_peered":"2024-09-13T06:30:39.570235+0000","last_clean":"2024-09-13T06:30:39.570235+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:30:39.570235+0000","last_undegraded":"2024-09-13T06:30:39.570235+0000","last_fullsized":"2024-09-13T06:30:39.570235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:18.147418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776857+0000","last_change":"2024-09-13T06:29:00.714209+0000","last_active":"2024-09-13T06:32:13.776857+0000","last_peered":"2024-09-13T06:32:13.776857+0000","last_clean":"2024-09-13T06:32:13.776857+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:32:13.776857+0000","last_undegraded":"2024-09-13T06:32:13.776857+0000","last_fullsized":"2024-09-13T06:32:13.776857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:33.364861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578134+0000","last_change":"2024-09-13T06:28:58.735019+0000","last_active":"2024-09-13T06:30:39.578134+0000","last_peered":"2024-09-13T06:30:39.578134+0000","last_clean":"2024-09-13T06:30:39.578134+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:30:39.578134+0000","last_undegraded":"2024-09-13T06:30:39.578134+0000","last_fullsized":"2024-09-13T06:30:39.578134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:38.804190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496657+0000","last_change":"2024-09-13T06:29:00.707042+0000","last_active":"2024-09-13T06:31:25.496657+0000","last_peered":"2024-09-13T06:31:25.496657+0000","last_clean":"2024-09-13T06:31:25.496657+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:31:25.496657+0000","last_undegraded":"2024-09-13T06:31:25.496657+0000","last_fullsized":"2024-09-13T06:31:25.496657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:22.300308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574705+0000","last_change":"2024-09-13T06:28:58.714709+0000","last_active":"2024-09-13T06:30:39.574705+0000","last_peered":"2024-09-13T06:30:39.574705+0000","last_clean":"2024-09-13T06:30:39.574705+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:30:39.574705+0000","last_undegraded":"2024-09-13T06:30:39.574705+0000","last_fullsized":"2024-09-13T06:30:39.574705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.663641+0000","last_change":"2024-09-13T06:29:00.706074+0000","last_active":"2024-09-13T06:31:12.663641+0000","last_peered":"2024-09-13T06:31:12.663641+0000","last_clean":"2024-09-13T06:31:12.663641+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:31:12.663641+0000","last_undegraded":"2024-09-13T06:31:12.663641+0000","last_fullsized":"2024-09-13T06:31:12.663641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:11.542286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905694+0000","last_change":"2024-09-13T06:28:58.710981+0000","last_active":"2024-09-13T06:30:39.905694+0000","last_peered":"2024-09-13T06:30:39.905694+0000","last_clean":"2024-09-13T06:30:39.905694+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:30:39.905694+0000","last_undegraded":"2024-09-13T06:30:39.905694+0000","last_fullsized":"2024-09-13T06:30:39.905694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889912+0000","last_change":"2024-09-13T06:29:00.726304+0000","last_active":"2024-09-13T06:32:13.889912+0000","last_peered":"2024-09-13T06:32:13.889912+0000","last_clean":"2024-09-13T06:32:13.889912+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:32:13.889912+0000","last_undegraded":"2024-09-13T06:32:13.889912+0000","last_fullsized":"2024-09-13T06:32:13.889912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:43.482408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904541+0000","last_change":"2024-09-13T06:28:58.725296+0000","last_active":"2024-09-13T06:30:39.904541+0000","last_peered":"2024-09-13T06:30:39.904541+0000","last_clean":"2024-09-13T06:30:39.904541+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:30:39.904541+0000","last_undegraded":"2024-09-13T06:30:39.904541+0000","last_fullsized":"2024-09-13T06:30:39.904541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.840079+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:13.840079+0000","last_peered":"2024-09-13T06:32:13.840079+0000","last_clean":"2024-09-13T06:32:13.840079+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:13.840079+0000","last_undegraded":"2024-09-13T06:32:13.840079+0000","last_fullsized":"2024-09-13T06:32:13.840079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:03.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888319+0000","last_change":"2024-09-13T06:29:00.723084+0000","last_active":"2024-09-13T06:32:13.888319+0000","last_peered":"2024-09-13T06:32:13.888319+0000","last_clean":"2024-09-13T06:32:13.888319+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:32:13.888319+0000","last_undegraded":"2024-09-13T06:32:13.888319+0000","last_fullsized":"2024-09-13T06:32:13.888319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905169+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:30:39.905169+0000","last_peered":"2024-09-13T06:30:39.905169+0000","last_clean":"2024-09-13T06:30:39.905169+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:30:39.905169+0000","last_undegraded":"2024-09-13T06:30:39.905169+0000","last_fullsized":"2024-09-13T06:30:39.905169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910459+0000","last_change":"2024-09-13T06:29:02.740336+0000","last_active":"2024-09-13T06:30:39.910459+0000","last_peered":"2024-09-13T06:30:39.910459+0000","last_clean":"2024-09-13T06:30:39.910459+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:30:39.910459+0000","last_undegraded":"2024-09-13T06:30:39.910459+0000","last_fullsized":"2024-09-13T06:30:39.910459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.250010+0000","last_change":"2024-09-13T06:29:04.756002+0000","last_active":"2024-09-13T06:31:10.250010+0000","last_peered":"2024-09-13T06:31:10.250010+0000","last_clean":"2024-09-13T06:31:10.250010+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:31:10.250010+0000","last_undegraded":"2024-09-13T06:31:10.250010+0000","last_fullsized":"2024-09-13T06:31:10.250010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:14.061458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578407+0000","last_change":"2024-09-13T06:29:06.774781+0000","last_active":"2024-09-13T06:30:39.578407+0000","last_peered":"2024-09-13T06:30:39.578407+0000","last_clean":"2024-09-13T06:30:39.578407+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:30:39.578407+0000","last_undegraded":"2024-09-13T06:30:39.578407+0000","last_fullsized":"2024-09-13T06:30:39.578407+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:56.034092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570612+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:30:39.570612+0000","last_peered":"2024-09-13T06:30:39.570612+0000","last_clean":"2024-09-13T06:30:39.570612+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:30:39.570612+0000","last_undegraded":"2024-09-13T06:30:39.570612+0000","last_fullsized":"2024-09-13T06:30:39.570612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:17.606468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.412627+0000","last_change":"2024-09-13T06:29:00.707011+0000","last_active":"2024-09-13T06:32:13.412627+0000","last_peered":"2024-09-13T06:32:13.412627+0000","last_clean":"2024-09-13T06:32:13.412627+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:32:13.412627+0000","last_undegraded":"2024-09-13T06:32:13.412627+0000","last_fullsized":"2024-09-13T06:32:13.412627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567903+0000","last_change":"2024-09-13T06:28:58.722224+0000","last_active":"2024-09-13T06:30:39.567903+0000","last_peered":"2024-09-13T06:30:39.567903+0000","last_clean":"2024-09-13T06:30:39.567903+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:30:39.567903+0000","last_undegraded":"2024-09-13T06:30:39.567903+0000","last_fullsized":"2024-09-13T06:30:39.567903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:01.378918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"24'1","reported_seq":222,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.763161+0000","last_change":"2024-09-13T06:29:02.717632+0000","last_active":"2024-09-13T06:31:11.763161+0000","last_peered":"2024-09-13T06:31:11.763161+0000","last_clean":"2024-09-13T06:31:11.763161+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:31:11.763161+0000","last_undegraded":"2024-09-13T06:31:11.763161+0000","last_fullsized":"2024-09-13T06:31:11.763161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319748+0000","last_change":"2024-09-13T06:29:04.739615+0000","last_active":"2024-09-13T06:30:40.319748+0000","last_peered":"2024-09-13T06:30:40.319748+0000","last_clean":"2024-09-13T06:30:40.319748+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:30:40.319748+0000","last_undegraded":"2024-09-13T06:30:40.319748+0000","last_fullsized":"2024-09-13T06:30:40.319748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:15.527728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573848+0000","last_change":"2024-09-13T06:29:06.774338+0000","last_active":"2024-09-13T06:30:39.573848+0000","last_peered":"2024-09-13T06:30:39.573848+0000","last_clean":"2024-09-13T06:30:39.573848+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:30:39.573848+0000","last_undegraded":"2024-09-13T06:30:39.573848+0000","last_fullsized":"2024-09-13T06:30:39.573848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:37.772201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903912+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:30:39.903912+0000","last_peered":"2024-09-13T06:30:39.903912+0000","last_clean":"2024-09-13T06:30:39.903912+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:30:39.903912+0000","last_undegraded":"2024-09-13T06:30:39.903912+0000","last_fullsized":"2024-09-13T06:30:39.903912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:11.691804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908288+0000","last_change":"2024-09-13T06:29:00.718205+0000","last_active":"2024-09-13T06:30:39.908288+0000","last_peered":"2024-09-13T06:30:39.908288+0000","last_clean":"2024-09-13T06:30:39.908288+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:30:39.908288+0000","last_undegraded":"2024-09-13T06:30:39.908288+0000","last_fullsized":"2024-09-13T06:30:39.908288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570600+0000","last_change":"2024-09-13T06:28:58.716607+0000","last_active":"2024-09-13T06:30:39.570600+0000","last_peered":"2024-09-13T06:30:39.570600+0000","last_clean":"2024-09-13T06:30:39.570600+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:30:39.570600+0000","last_undegraded":"2024-09-13T06:30:39.570600+0000","last_fullsized":"2024-09-13T06:30:39.570600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908756+0000","last_change":"2024-09-13T06:29:02.744274+0000","last_active":"2024-09-13T06:30:39.908756+0000","last_peered":"2024-09-13T06:30:39.908756+0000","last_clean":"2024-09-13T06:30:39.908756+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:30:39.908756+0000","last_undegraded":"2024-09-13T06:30:39.908756+0000","last_fullsized":"2024-09-13T06:30:39.908756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:14.111953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.918645+0000","last_change":"2024-09-13T06:29:04.723996+0000","last_active":"2024-09-13T06:31:07.918645+0000","last_peered":"2024-09-13T06:31:07.918645+0000","last_clean":"2024-09-13T06:31:07.918645+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:31:07.918645+0000","last_undegraded":"2024-09-13T06:31:07.918645+0000","last_fullsized":"2024-09-13T06:31:07.918645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:51.065801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.299299+0000","last_change":"2024-09-13T06:29:06.751269+0000","last_active":"2024-09-13T06:32:14.299299+0000","last_peered":"2024-09-13T06:32:14.299299+0000","last_clean":"2024-09-13T06:32:14.299299+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:32:14.299299+0000","last_undegraded":"2024-09-13T06:32:14.299299+0000","last_fullsized":"2024-09-13T06:32:14.299299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:53.815753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.125083+0000","last_change":"2024-09-13T06:29:08.762118+0000","last_active":"2024-09-13T06:32:14.125083+0000","last_peered":"2024-09-13T06:32:14.125083+0000","last_clean":"2024-09-13T06:32:14.125083+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:14.125083+0000","last_undegraded":"2024-09-13T06:32:14.125083+0000","last_fullsized":"2024-09-13T06:32:14.125083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.846533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910532+0000","last_change":"2024-09-13T06:29:00.733199+0000","last_active":"2024-09-13T06:30:39.910532+0000","last_peered":"2024-09-13T06:30:39.910532+0000","last_clean":"2024-09-13T06:30:39.910532+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:30:39.910532+0000","last_undegraded":"2024-09-13T06:30:39.910532+0000","last_fullsized":"2024-09-13T06:30:39.910532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570421+0000","last_change":"2024-09-13T06:28:58.715013+0000","last_active":"2024-09-13T06:30:39.570421+0000","last_peered":"2024-09-13T06:30:39.570421+0000","last_clean":"2024-09-13T06:30:39.570421+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:30:39.570421+0000","last_undegraded":"2024-09-13T06:30:39.570421+0000","last_fullsized":"2024-09-13T06:30:39.570421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:30.316190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575935+0000","last_change":"2024-09-13T06:29:02.715794+0000","last_active":"2024-09-13T06:30:39.575935+0000","last_peered":"2024-09-13T06:30:39.575935+0000","last_clean":"2024-09-13T06:30:39.575935+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:30:39.575935+0000","last_undegraded":"2024-09-13T06:30:39.575935+0000","last_fullsized":"2024-09-13T06:30:39.575935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:41.286736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.240501+0000","last_change":"2024-09-13T06:29:04.733210+0000","last_active":"2024-09-13T06:31:10.240501+0000","last_peered":"2024-09-13T06:31:10.240501+0000","last_clean":"2024-09-13T06:31:10.240501+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:31:10.240501+0000","last_undegraded":"2024-09-13T06:31:10.240501+0000","last_fullsized":"2024-09-13T06:31:10.240501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:44.479614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":406,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.973423+0000","last_change":"2024-09-13T06:29:06.768162+0000","last_active":"2024-09-13T06:32:13.973423+0000","last_peered":"2024-09-13T06:32:13.973423+0000","last_clean":"2024-09-13T06:32:13.973423+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:32:13.973423+0000","last_undegraded":"2024-09-13T06:32:13.973423+0000","last_fullsized":"2024-09-13T06:32:13.973423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:18.825186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965940+0000","last_change":"2024-09-13T06:29:39.532873+0000","last_active":"2024-09-13T06:32:13.965940+0000","last_peered":"2024-09-13T06:32:13.965940+0000","last_clean":"2024-09-13T06:32:13.965940+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:32:13.965940+0000","last_undegraded":"2024-09-13T06:32:13.965940+0000","last_fullsized":"2024-09-13T06:32:13.965940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:04.879833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'1","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493366+0000","last_change":"2024-09-13T06:28:58.715791+0000","last_active":"2024-09-13T06:31:14.493366+0000","last_peered":"2024-09-13T06:31:14.493366+0000","last_clean":"2024-09-13T06:31:14.493366+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:31:14.493366+0000","last_undegraded":"2024-09-13T06:31:14.493366+0000","last_fullsized":"2024-09-13T06:31:14.493366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:36.060034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318177+0000","last_change":"2024-09-13T06:29:02.732052+0000","last_active":"2024-09-13T06:30:40.318177+0000","last_peered":"2024-09-13T06:30:40.318177+0000","last_clean":"2024-09-13T06:30:40.318177+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:30:40.318177+0000","last_undegraded":"2024-09-13T06:30:40.318177+0000","last_fullsized":"2024-09-13T06:30:40.318177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'41","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493106+0000","last_change":"2024-09-13T06:29:04.731973+0000","last_active":"2024-09-13T06:31:14.493106+0000","last_peered":"2024-09-13T06:31:14.493106+0000","last_clean":"2024-09-13T06:31:14.493106+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:31:14.493106+0000","last_undegraded":"2024-09-13T06:31:14.493106+0000","last_fullsized":"2024-09-13T06:31:14.493106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:07.767226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316676+0000","last_change":"2024-09-13T06:29:06.747941+0000","last_active":"2024-09-13T06:30:40.316676+0000","last_peered":"2024-09-13T06:30:40.316676+0000","last_clean":"2024-09-13T06:30:40.316676+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:30:40.316676+0000","last_undegraded":"2024-09-13T06:30:40.316676+0000","last_fullsized":"2024-09-13T06:30:40.316676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:08.367030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568553+0000","last_change":"2024-09-13T06:29:08.791498+0000","last_active":"2024-09-13T06:30:39.568553+0000","last_peered":"2024-09-13T06:30:39.568553+0000","last_clean":"2024-09-13T06:30:39.568553+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:30:39.568553+0000","last_undegraded":"2024-09-13T06:30:39.568553+0000","last_fullsized":"2024-09-13T06:30:39.568553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:55.628851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'25","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908109+0000","last_change":"2024-09-13T06:29:00.726697+0000","last_active":"2024-09-13T06:32:13.908109+0000","last_peered":"2024-09-13T06:32:13.908109+0000","last_clean":"2024-09-13T06:32:13.908109+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:32:13.908109+0000","last_undegraded":"2024-09-13T06:32:13.908109+0000","last_fullsized":"2024-09-13T06:32:13.908109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.526443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493313+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:31:14.493313+0000","last_peered":"2024-09-13T06:31:14.493313+0000","last_clean":"2024-09-13T06:31:14.493313+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:31:14.493313+0000","last_undegraded":"2024-09-13T06:31:14.493313+0000","last_fullsized":"2024-09-13T06:31:14.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:12.552536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567535+0000","last_change":"2024-09-13T06:29:02.724597+0000","last_active":"2024-09-13T06:30:39.567535+0000","last_peered":"2024-09-13T06:30:39.567535+0000","last_clean":"2024-09-13T06:30:39.567535+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:30:39.567535+0000","last_undegraded":"2024-09-13T06:30:39.567535+0000","last_fullsized":"2024-09-13T06:30:39.567535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:30.887850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.219780+0000","last_change":"2024-09-13T06:29:04.754051+0000","last_active":"2024-09-13T06:31:10.219780+0000","last_peered":"2024-09-13T06:31:10.219780+0000","last_clean":"2024-09-13T06:31:10.219780+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:31:10.219780+0000","last_undegraded":"2024-09-13T06:31:10.219780+0000","last_fullsized":"2024-09-13T06:31:10.219780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:21.961022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907432+0000","last_change":"2024-09-13T06:29:06.762829+0000","last_active":"2024-09-13T06:30:39.907432+0000","last_peered":"2024-09-13T06:30:39.907432+0000","last_clean":"2024-09-13T06:30:39.907432+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:30:39.907432+0000","last_undegraded":"2024-09-13T06:30:39.907432+0000","last_fullsized":"2024-09-13T06:30:39.907432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:01.035464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317329+0000","last_change":"2024-09-13T06:29:08.766459+0000","last_active":"2024-09-13T06:30:40.317329+0000","last_peered":"2024-09-13T06:30:40.317329+0000","last_clean":"2024-09-13T06:30:40.317329+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:30:40.317329+0000","last_undegraded":"2024-09-13T06:30:40.317329+0000","last_fullsized":"2024-09-13T06:30:40.317329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:15.266692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.913863+0000","last_change":"2024-09-13T06:29:00.717664+0000","last_active":"2024-09-13T06:31:07.913863+0000","last_peered":"2024-09-13T06:31:07.913863+0000","last_clean":"2024-09-13T06:31:07.913863+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:31:07.913863+0000","last_undegraded":"2024-09-13T06:31:07.913863+0000","last_fullsized":"2024-09-13T06:31:07.913863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:51.974933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576427+0000","last_change":"2024-09-13T06:28:58.734667+0000","last_active":"2024-09-13T06:30:39.576427+0000","last_peered":"2024-09-13T06:30:39.576427+0000","last_clean":"2024-09-13T06:30:39.576427+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:30:39.576427+0000","last_undegraded":"2024-09-13T06:30:39.576427+0000","last_fullsized":"2024-09-13T06:30:39.576427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:44.299300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567032+0000","last_change":"2024-09-13T06:29:02.722214+0000","last_active":"2024-09-13T06:30:39.567032+0000","last_peered":"2024-09-13T06:30:39.567032+0000","last_clean":"2024-09-13T06:30:39.567032+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:30:39.567032+0000","last_undegraded":"2024-09-13T06:30:39.567032+0000","last_fullsized":"2024-09-13T06:30:39.567032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:53.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.263596+0000","last_change":"2024-09-13T06:29:04.732118+0000","last_active":"2024-09-13T06:31:10.263596+0000","last_peered":"2024-09-13T06:31:10.263596+0000","last_clean":"2024-09-13T06:31:10.263596+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:31:10.263596+0000","last_undegraded":"2024-09-13T06:31:10.263596+0000","last_fullsized":"2024-09-13T06:31:10.263596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:17.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":353,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.332565+0000","last_change":"2024-09-13T06:29:06.772585+0000","last_active":"2024-09-13T06:32:14.332565+0000","last_peered":"2024-09-13T06:32:14.332565+0000","last_clean":"2024-09-13T06:32:14.332565+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:14.332565+0000","last_undegraded":"2024-09-13T06:32:14.332565+0000","last_fullsized":"2024-09-13T06:32:14.332565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:31.824682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319032+0000","last_change":"2024-09-13T06:29:08.777939+0000","last_active":"2024-09-13T06:30:40.319032+0000","last_peered":"2024-09-13T06:30:40.319032+0000","last_clean":"2024-09-13T06:30:40.319032+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:30:40.319032+0000","last_undegraded":"2024-09-13T06:30:40.319032+0000","last_fullsized":"2024-09-13T06:30:40.319032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:59.485064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965033+0000","last_change":"2024-09-13T06:29:00.718738+0000","last_active":"2024-09-13T06:32:13.965033+0000","last_peered":"2024-09-13T06:32:13.965033+0000","last_clean":"2024-09-13T06:32:13.965033+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:32:13.965033+0000","last_undegraded":"2024-09-13T06:32:13.965033+0000","last_fullsized":"2024-09-13T06:32:13.965033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:39:59.890086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'3","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493208+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:31:14.493208+0000","last_peered":"2024-09-13T06:31:14.493208+0000","last_clean":"2024-09-13T06:31:14.493208+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:31:14.493208+0000","last_undegraded":"2024-09-13T06:31:14.493208+0000","last_fullsized":"2024-09-13T06:31:14.493208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.897247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567233+0000","last_change":"2024-09-13T06:29:02.741159+0000","last_active":"2024-09-13T06:30:39.567233+0000","last_peered":"2024-09-13T06:30:39.567233+0000","last_clean":"2024-09-13T06:30:39.567233+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:30:39.567233+0000","last_undegraded":"2024-09-13T06:30:39.567233+0000","last_fullsized":"2024-09-13T06:30:39.567233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:49.008324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'55","reported_seq":115,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.490705+0000","last_change":"2024-09-13T06:29:04.748682+0000","last_active":"2024-09-13T06:31:15.490705+0000","last_peered":"2024-09-13T06:31:15.490705+0000","last_clean":"2024-09-13T06:31:15.490705+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:31:15.490705+0000","last_undegraded":"2024-09-13T06:31:15.490705+0000","last_fullsized":"2024-09-13T06:31:15.490705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:57:59.868813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567773+0000","last_change":"2024-09-13T06:29:06.761508+0000","last_active":"2024-09-13T06:30:39.567773+0000","last_peered":"2024-09-13T06:30:39.567773+0000","last_clean":"2024-09-13T06:30:39.567773+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:30:39.567773+0000","last_undegraded":"2024-09-13T06:30:39.567773+0000","last_fullsized":"2024-09-13T06:30:39.567773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:26.451521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.257072+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:14.257072+0000","last_peered":"2024-09-13T06:32:14.257072+0000","last_clean":"2024-09-13T06:32:14.257072+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:14.257072+0000","last_undegraded":"2024-09-13T06:32:14.257072+0000","last_fullsized":"2024-09-13T06:32:14.257072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:13.465995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.915876+0000","last_change":"2024-09-13T06:29:00.728932+0000","last_active":"2024-09-13T06:31:07.915876+0000","last_peered":"2024-09-13T06:31:07.915876+0000","last_clean":"2024-09-13T06:31:07.915876+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:31:07.915876+0000","last_undegraded":"2024-09-13T06:31:07.915876+0000","last_fullsized":"2024-09-13T06:31:07.915876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:17.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904865+0000","last_change":"2024-09-13T06:28:58.719722+0000","last_active":"2024-09-13T06:30:39.904865+0000","last_peered":"2024-09-13T06:30:39.904865+0000","last_clean":"2024-09-13T06:30:39.904865+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:30:39.904865+0000","last_undegraded":"2024-09-13T06:30:39.904865+0000","last_fullsized":"2024-09-13T06:30:39.904865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569358+0000","last_change":"2024-09-13T06:29:02.713294+0000","last_active":"2024-09-13T06:30:39.569358+0000","last_peered":"2024-09-13T06:30:39.569358+0000","last_clean":"2024-09-13T06:30:39.569358+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:30:39.569358+0000","last_undegraded":"2024-09-13T06:30:39.569358+0000","last_fullsized":"2024-09-13T06:30:39.569358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:48.621894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.228501+0000","last_change":"2024-09-13T06:29:04.731052+0000","last_active":"2024-09-13T06:31:10.228501+0000","last_peered":"2024-09-13T06:31:10.228501+0000","last_clean":"2024-09-13T06:31:10.228501+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:31:10.228501+0000","last_undegraded":"2024-09-13T06:31:10.228501+0000","last_fullsized":"2024-09-13T06:31:10.228501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:15.859442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907352+0000","last_change":"2024-09-13T06:29:06.772900+0000","last_active":"2024-09-13T06:30:39.907352+0000","last_peered":"2024-09-13T06:30:39.907352+0000","last_clean":"2024-09-13T06:30:39.907352+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:30:39.907352+0000","last_undegraded":"2024-09-13T06:30:39.907352+0000","last_fullsized":"2024-09-13T06:30:39.907352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:13.253864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489704+0000","last_change":"2024-09-13T06:29:08.785484+0000","last_active":"2024-09-13T06:31:10.489704+0000","last_peered":"2024-09-13T06:31:10.489704+0000","last_clean":"2024-09-13T06:31:10.489704+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:31:10.489704+0000","last_undegraded":"2024-09-13T06:31:10.489704+0000","last_fullsized":"2024-09-13T06:31:10.489704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.070123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.665886+0000","last_change":"2024-09-13T06:29:00.714668+0000","last_active":"2024-09-13T06:31:12.665886+0000","last_peered":"2024-09-13T06:31:12.665886+0000","last_clean":"2024-09-13T06:31:12.665886+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:31:12.665886+0000","last_undegraded":"2024-09-13T06:31:12.665886+0000","last_fullsized":"2024-09-13T06:31:12.665886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572293+0000","last_change":"2024-09-13T06:28:58.716633+0000","last_active":"2024-09-13T06:30:39.572293+0000","last_peered":"2024-09-13T06:30:39.572293+0000","last_clean":"2024-09-13T06:30:39.572293+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:30:39.572293+0000","last_undegraded":"2024-09-13T06:30:39.572293+0000","last_fullsized":"2024-09-13T06:30:39.572293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316839+0000","last_change":"2024-09-13T06:29:02.730107+0000","last_active":"2024-09-13T06:30:40.316839+0000","last_peered":"2024-09-13T06:30:40.316839+0000","last_clean":"2024-09-13T06:30:40.316839+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:30:40.316839+0000","last_undegraded":"2024-09-13T06:30:40.316839+0000","last_fullsized":"2024-09-13T06:30:40.316839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:11.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.277436+0000","last_change":"2024-09-13T06:29:04.746327+0000","last_active":"2024-09-13T06:31:10.277436+0000","last_peered":"2024-09-13T06:31:10.277436+0000","last_clean":"2024-09-13T06:31:10.277436+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:31:10.277436+0000","last_undegraded":"2024-09-13T06:31:10.277436+0000","last_fullsized":"2024-09-13T06:31:10.277436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:05.773239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":408,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.267708+0000","last_change":"2024-09-13T06:29:06.761923+0000","last_active":"2024-09-13T06:32:14.267708+0000","last_peered":"2024-09-13T06:32:14.267708+0000","last_clean":"2024-09-13T06:32:14.267708+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:14.267708+0000","last_undegraded":"2024-09-13T06:32:14.267708+0000","last_fullsized":"2024-09-13T06:32:14.267708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:01.791112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.911859+0000","last_change":"2024-09-13T06:29:08.773016+0000","last_active":"2024-09-13T06:32:13.911859+0000","last_peered":"2024-09-13T06:32:13.911859+0000","last_clean":"2024-09-13T06:32:13.911859+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:32:13.911859+0000","last_undegraded":"2024-09-13T06:32:13.911859+0000","last_fullsized":"2024-09-13T06:32:13.911859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:10.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984706+0000","last_change":"2024-09-13T06:29:00.705902+0000","last_active":"2024-09-13T06:32:13.984706+0000","last_peered":"2024-09-13T06:32:13.984706+0000","last_clean":"2024-09-13T06:32:13.984706+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:32:13.984706+0000","last_undegraded":"2024-09-13T06:32:13.984706+0000","last_fullsized":"2024-09-13T06:32:13.984706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:13.530929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.744249+0000","last_change":"2024-09-13T06:28:58.720215+0000","last_active":"2024-09-13T06:32:13.744249+0000","last_peered":"2024-09-13T06:32:13.744249+0000","last_clean":"2024-09-13T06:32:13.744249+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:32:13.744249+0000","last_undegraded":"2024-09-13T06:32:13.744249+0000","last_fullsized":"2024-09-13T06:32:13.744249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.763219+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:31:11.763219+0000","last_peered":"2024-09-13T06:31:11.763219+0000","last_clean":"2024-09-13T06:31:11.763219+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:31:11.763219+0000","last_undegraded":"2024-09-13T06:31:11.763219+0000","last_fullsized":"2024-09-13T06:31:11.763219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:18.248897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910468+0000","last_change":"2024-09-13T06:29:04.749190+0000","last_active":"2024-09-13T06:30:39.910468+0000","last_peered":"2024-09-13T06:30:39.910468+0000","last_clean":"2024-09-13T06:30:39.910468+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:30:39.910468+0000","last_undegraded":"2024-09-13T06:30:39.910468+0000","last_fullsized":"2024-09-13T06:30:39.910468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:38.367590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":470,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.131279+0000","last_change":"2024-09-13T06:29:06.751363+0000","last_active":"2024-09-13T06:32:14.131279+0000","last_peered":"2024-09-13T06:32:14.131279+0000","last_clean":"2024-09-13T06:32:14.131279+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:32:14.131279+0000","last_undegraded":"2024-09-13T06:32:14.131279+0000","last_fullsized":"2024-09-13T06:32:14.131279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:20.636655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.114868+0000","last_change":"2024-09-13T06:29:08.792692+0000","last_active":"2024-09-13T06:31:12.114868+0000","last_peered":"2024-09-13T06:31:12.114868+0000","last_clean":"2024-09-13T06:31:12.114868+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:31:12.114868+0000","last_undegraded":"2024-09-13T06:31:12.114868+0000","last_fullsized":"2024-09-13T06:31:12.114868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:44.557550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494543+0000","last_change":"2024-09-13T06:29:00.731625+0000","last_active":"2024-09-13T06:31:15.494543+0000","last_peered":"2024-09-13T06:31:15.494543+0000","last_clean":"2024-09-13T06:31:15.494543+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:31:15.494543+0000","last_undegraded":"2024-09-13T06:31:15.494543+0000","last_fullsized":"2024-09-13T06:31:15.494543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.152230+0000","last_change":"2024-09-13T06:28:58.719501+0000","last_active":"2024-09-13T06:32:13.152230+0000","last_peered":"2024-09-13T06:32:13.152230+0000","last_clean":"2024-09-13T06:32:13.152230+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:32:13.152230+0000","last_undegraded":"2024-09-13T06:32:13.152230+0000","last_fullsized":"2024-09-13T06:32:13.152230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:07:21.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908571+0000","last_change":"2024-09-13T06:29:02.721649+0000","last_active":"2024-09-13T06:30:39.908571+0000","last_peered":"2024-09-13T06:30:39.908571+0000","last_clean":"2024-09-13T06:30:39.908571+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:30:39.908571+0000","last_undegraded":"2024-09-13T06:30:39.908571+0000","last_fullsized":"2024-09-13T06:30:39.908571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:42.633548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.252844+0000","last_change":"2024-09-13T06:29:04.736682+0000","last_active":"2024-09-13T06:31:10.252844+0000","last_peered":"2024-09-13T06:31:10.252844+0000","last_clean":"2024-09-13T06:31:10.252844+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:31:10.252844+0000","last_undegraded":"2024-09-13T06:31:10.252844+0000","last_fullsized":"2024-09-13T06:31:10.252844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:59.443857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575252+0000","last_change":"2024-09-13T06:29:06.765942+0000","last_active":"2024-09-13T06:30:39.575252+0000","last_peered":"2024-09-13T06:30:39.575252+0000","last_clean":"2024-09-13T06:30:39.575252+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:30:39.575252+0000","last_undegraded":"2024-09-13T06:30:39.575252+0000","last_fullsized":"2024-09-13T06:30:39.575252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:40.247898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.062083+0000","last_change":"2024-09-13T06:29:08.765210+0000","last_active":"2024-09-13T06:32:14.062083+0000","last_peered":"2024-09-13T06:32:14.062083+0000","last_clean":"2024-09-13T06:32:14.062083+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:32:14.062083+0000","last_undegraded":"2024-09-13T06:32:14.062083+0000","last_fullsized":"2024-09-13T06:32:14.062083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:19.888668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889442+0000","last_change":"2024-09-13T06:29:00.723363+0000","last_active":"2024-09-13T06:32:13.889442+0000","last_peered":"2024-09-13T06:32:13.889442+0000","last_clean":"2024-09-13T06:32:13.889442+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:32:13.889442+0000","last_undegraded":"2024-09-13T06:32:13.889442+0000","last_fullsized":"2024-09-13T06:32:13.889442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:19:56.144098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.314554+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:30:40.314554+0000","last_peered":"2024-09-13T06:30:40.314554+0000","last_clean":"2024-09-13T06:30:40.314554+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:30:40.314554+0000","last_undegraded":"2024-09-13T06:30:40.314554+0000","last_fullsized":"2024-09-13T06:30:40.314554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:19.132984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572517+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:30:39.572517+0000","last_peered":"2024-09-13T06:30:39.572517+0000","last_clean":"2024-09-13T06:30:39.572517+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:30:39.572517+0000","last_undegraded":"2024-09-13T06:30:39.572517+0000","last_fullsized":"2024-09-13T06:30:39.572517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.927955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.893869+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:31:07.893869+0000","last_peered":"2024-09-13T06:31:07.893869+0000","last_clean":"2024-09-13T06:31:07.893869+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:31:07.893869+0000","last_undegraded":"2024-09-13T06:31:07.893869+0000","last_fullsized":"2024-09-13T06:31:07.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317017+0000","last_change":"2024-09-13T06:29:02.723791+0000","last_active":"2024-09-13T06:30:40.317017+0000","last_peered":"2024-09-13T06:30:40.317017+0000","last_clean":"2024-09-13T06:30:40.317017+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:30:40.317017+0000","last_undegraded":"2024-09-13T06:30:40.317017+0000","last_fullsized":"2024-09-13T06:30:40.317017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":149,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.275042+0000","last_change":"2024-09-13T06:29:04.750793+0000","last_active":"2024-09-13T06:31:10.275042+0000","last_peered":"2024-09-13T06:31:10.275042+0000","last_clean":"2024-09-13T06:31:10.275042+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:31:10.275042+0000","last_undegraded":"2024-09-13T06:31:10.275042+0000","last_fullsized":"2024-09-13T06:31:10.275042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:10:59.019066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.906152+0000","last_change":"2024-09-13T06:29:06.774102+0000","last_active":"2024-09-13T06:30:39.906152+0000","last_peered":"2024-09-13T06:30:39.906152+0000","last_clean":"2024-09-13T06:30:39.906152+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:30:39.906152+0000","last_undegraded":"2024-09-13T06:30:39.906152+0000","last_fullsized":"2024-09-13T06:30:39.906152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:32.602209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.993878+0000","last_change":"2024-09-13T06:29:08.791090+0000","last_active":"2024-09-13T06:32:13.993878+0000","last_peered":"2024-09-13T06:32:13.993878+0000","last_clean":"2024-09-13T06:32:13.993878+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:32:13.993878+0000","last_undegraded":"2024-09-13T06:32:13.993878+0000","last_fullsized":"2024-09-13T06:32:13.993878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:33.250567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908198+0000","last_change":"2024-09-13T06:29:00.724256+0000","last_active":"2024-09-13T06:30:39.908198+0000","last_peered":"2024-09-13T06:30:39.908198+0000","last_clean":"2024-09-13T06:30:39.908198+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:30:39.908198+0000","last_undegraded":"2024-09-13T06:30:39.908198+0000","last_fullsized":"2024-09-13T06:30:39.908198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571368+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:30:39.571368+0000","last_peered":"2024-09-13T06:30:39.571368+0000","last_clean":"2024-09-13T06:30:39.571368+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:30:39.571368+0000","last_undegraded":"2024-09-13T06:30:39.571368+0000","last_fullsized":"2024-09-13T06:30:39.571368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:55.462615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318457+0000","last_change":"2024-09-13T06:28:58.711388+0000","last_active":"2024-09-13T06:30:40.318457+0000","last_peered":"2024-09-13T06:30:40.318457+0000","last_clean":"2024-09-13T06:30:40.318457+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:30:40.318457+0000","last_undegraded":"2024-09-13T06:30:40.318457+0000","last_fullsized":"2024-09-13T06:30:40.318457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576408+0000","last_change":"2024-09-13T06:29:02.739238+0000","last_active":"2024-09-13T06:30:39.576408+0000","last_peered":"2024-09-13T06:30:39.576408+0000","last_clean":"2024-09-13T06:30:39.576408+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:30:39.576408+0000","last_undegraded":"2024-09-13T06:30:39.576408+0000","last_fullsized":"2024-09-13T06:30:39.576408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:36.820291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'273","reported_seq":481,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977862+0000","last_change":"2024-09-13T06:29:04.740633+0000","last_active":"2024-09-13T06:32:12.977862+0000","last_peered":"2024-09-13T06:32:12.977862+0000","last_clean":"2024-09-13T06:32:12.977862+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:32:12.977862+0000","last_undegraded":"2024-09-13T06:32:12.977862+0000","last_fullsized":"2024-09-13T06:32:12.977862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:21.488854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905987+0000","last_change":"2024-09-13T06:29:06.768289+0000","last_active":"2024-09-13T06:30:39.905987+0000","last_peered":"2024-09-13T06:30:39.905987+0000","last_clean":"2024-09-13T06:30:39.905987+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:30:39.905987+0000","last_undegraded":"2024-09-13T06:30:39.905987+0000","last_fullsized":"2024-09-13T06:30:39.905987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.453168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.657752+0000","last_change":"2024-09-13T06:29:08.785933+0000","last_active":"2024-09-13T06:31:12.657752+0000","last_peered":"2024-09-13T06:31:12.657752+0000","last_clean":"2024-09-13T06:31:12.657752+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:31:12.657752+0000","last_undegraded":"2024-09-13T06:31:12.657752+0000","last_fullsized":"2024-09-13T06:31:12.657752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:34.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965135+0000","last_change":"2024-09-13T06:29:00.726943+0000","last_active":"2024-09-13T06:32:13.965135+0000","last_peered":"2024-09-13T06:32:13.965135+0000","last_clean":"2024-09-13T06:32:13.965135+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:32:13.965135+0000","last_undegraded":"2024-09-13T06:32:13.965135+0000","last_fullsized":"2024-09-13T06:32:13.965135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567910+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:30:39.567910+0000","last_peered":"2024-09-13T06:30:39.567910+0000","last_clean":"2024-09-13T06:30:39.567910+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:30:39.567910+0000","last_undegraded":"2024-09-13T06:30:39.567910+0000","last_fullsized":"2024-09-13T06:30:39.567910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:05.399184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315650+0000","last_change":"2024-09-13T06:28:58.710601+0000","last_active":"2024-09-13T06:30:40.315650+0000","last_peered":"2024-09-13T06:30:40.315650+0000","last_clean":"2024-09-13T06:30:40.315650+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:30:40.315650+0000","last_undegraded":"2024-09-13T06:30:40.315650+0000","last_fullsized":"2024-09-13T06:30:40.315650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:06.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570571+0000","last_change":"2024-09-13T06:29:02.715757+0000","last_active":"2024-09-13T06:30:39.570571+0000","last_peered":"2024-09-13T06:30:39.570571+0000","last_clean":"2024-09-13T06:30:39.570571+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:30:39.570571+0000","last_undegraded":"2024-09-13T06:30:39.570571+0000","last_fullsized":"2024-09-13T06:30:39.570571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:41.827034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977483+0000","last_change":"2024-09-13T06:29:04.730506+0000","last_active":"2024-09-13T06:32:12.977483+0000","last_peered":"2024-09-13T06:32:12.977483+0000","last_clean":"2024-09-13T06:32:12.977483+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:12.977483+0000","last_undegraded":"2024-09-13T06:32:12.977483+0000","last_fullsized":"2024-09-13T06:32:12.977483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:06.934896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317336+0000","last_change":"2024-09-13T06:29:06.766201+0000","last_active":"2024-09-13T06:30:40.317336+0000","last_peered":"2024-09-13T06:30:40.317336+0000","last_clean":"2024-09-13T06:30:40.317336+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:30:40.317336+0000","last_undegraded":"2024-09-13T06:30:40.317336+0000","last_fullsized":"2024-09-13T06:30:40.317336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:14.063090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907100+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:30:39.907100+0000","last_peered":"2024-09-13T06:30:39.907100+0000","last_clean":"2024-09-13T06:30:39.907100+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:30:39.907100+0000","last_undegraded":"2024-09-13T06:30:39.907100+0000","last_fullsized":"2024-09-13T06:30:39.907100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:16.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.414514+0000","last_change":"2024-09-13T06:29:00.721955+0000","last_active":"2024-09-13T06:32:13.414514+0000","last_peered":"2024-09-13T06:32:13.414514+0000","last_clean":"2024-09-13T06:32:13.414514+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:32:13.414514+0000","last_undegraded":"2024-09-13T06:32:13.414514+0000","last_fullsized":"2024-09-13T06:32:13.414514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572122+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:30:39.572122+0000","last_peered":"2024-09-13T06:30:39.572122+0000","last_clean":"2024-09-13T06:30:39.572122+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:30:39.572122+0000","last_undegraded":"2024-09-13T06:30:39.572122+0000","last_fullsized":"2024-09-13T06:30:39.572122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:57.119174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572256+0000","last_change":"2024-09-13T06:28:58.714825+0000","last_active":"2024-09-13T06:30:39.572256+0000","last_peered":"2024-09-13T06:30:39.572256+0000","last_clean":"2024-09-13T06:30:39.572256+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:30:39.572256+0000","last_undegraded":"2024-09-13T06:30:39.572256+0000","last_fullsized":"2024-09-13T06:30:39.572256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319184+0000","last_change":"2024-09-13T06:29:02.726548+0000","last_active":"2024-09-13T06:30:40.319184+0000","last_peered":"2024-09-13T06:30:40.319184+0000","last_clean":"2024-09-13T06:30:40.319184+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:30:40.319184+0000","last_undegraded":"2024-09-13T06:30:40.319184+0000","last_fullsized":"2024-09-13T06:30:40.319184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.698111+0000","last_change":"2024-09-13T06:29:04.753220+0000","last_active":"2024-09-13T06:32:12.698111+0000","last_peered":"2024-09-13T06:32:12.698111+0000","last_clean":"2024-09-13T06:32:12.698111+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:32:12.698111+0000","last_undegraded":"2024-09-13T06:32:12.698111+0000","last_fullsized":"2024-09-13T06:32:12.698111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:23.310355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907445+0000","last_change":"2024-09-13T06:29:06.776644+0000","last_active":"2024-09-13T06:30:39.907445+0000","last_peered":"2024-09-13T06:30:39.907445+0000","last_clean":"2024-09-13T06:30:39.907445+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:30:39.907445+0000","last_undegraded":"2024-09-13T06:30:39.907445+0000","last_fullsized":"2024-09-13T06:30:39.907445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:07.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.916234+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:12.916234+0000","last_peered":"2024-09-13T06:32:12.916234+0000","last_clean":"2024-09-13T06:32:12.916234+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:12.916234+0000","last_undegraded":"2024-09-13T06:32:12.916234+0000","last_fullsized":"2024-09-13T06:32:12.916234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:03.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965048+0000","last_change":"2024-09-13T06:29:00.729564+0000","last_active":"2024-09-13T06:32:13.965048+0000","last_peered":"2024-09-13T06:32:13.965048+0000","last_clean":"2024-09-13T06:32:13.965048+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:32:13.965048+0000","last_undegraded":"2024-09-13T06:32:13.965048+0000","last_fullsized":"2024-09-13T06:32:13.965048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:03.871675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576292+0000","last_change":"2024-09-13T06:28:58.734084+0000","last_active":"2024-09-13T06:30:39.576292+0000","last_peered":"2024-09-13T06:30:39.576292+0000","last_clean":"2024-09-13T06:30:39.576292+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:30:39.576292+0000","last_undegraded":"2024-09-13T06:30:39.576292+0000","last_fullsized":"2024-09-13T06:30:39.576292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:04.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317623+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:30:40.317623+0000","last_peered":"2024-09-13T06:30:40.317623+0000","last_clean":"2024-09-13T06:30:40.317623+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:30:40.317623+0000","last_undegraded":"2024-09-13T06:30:40.317623+0000","last_fullsized":"2024-09-13T06:30:40.317623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:03.965231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492649+0000","last_change":"2024-09-13T06:29:02.741057+0000","last_active":"2024-09-13T06:31:10.492649+0000","last_peered":"2024-09-13T06:31:10.492649+0000","last_clean":"2024-09-13T06:31:10.492649+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:31:10.492649+0000","last_undegraded":"2024-09-13T06:31:10.492649+0000","last_fullsized":"2024-09-13T06:31:10.492649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:19.872981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.275964+0000","last_change":"2024-09-13T06:29:04.747105+0000","last_active":"2024-09-13T06:31:10.275964+0000","last_peered":"2024-09-13T06:31:10.275964+0000","last_clean":"2024-09-13T06:31:10.275964+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:31:10.275964+0000","last_undegraded":"2024-09-13T06:31:10.275964+0000","last_fullsized":"2024-09-13T06:31:10.275964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:20.114697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571995+0000","last_change":"2024-09-13T06:29:06.756361+0000","last_active":"2024-09-13T06:30:39.571995+0000","last_peered":"2024-09-13T06:30:39.571995+0000","last_clean":"2024-09-13T06:30:39.571995+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:30:39.571995+0000","last_undegraded":"2024-09-13T06:30:39.571995+0000","last_fullsized":"2024-09-13T06:30:39.571995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:29.424661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.495367+0000","last_change":"2024-09-13T06:29:08.775523+0000","last_active":"2024-09-13T06:31:12.495367+0000","last_peered":"2024-09-13T06:31:12.495367+0000","last_clean":"2024-09-13T06:31:12.495367+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:31:12.495367+0000","last_undegraded":"2024-09-13T06:31:12.495367+0000","last_fullsized":"2024-09-13T06:31:12.495367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:26.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317034+0000","last_change":"2024-09-13T06:29:00.726613+0000","last_active":"2024-09-13T06:30:40.317034+0000","last_peered":"2024-09-13T06:30:40.317034+0000","last_clean":"2024-09-13T06:30:40.317034+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:30:40.317034+0000","last_undegraded":"2024-09-13T06:30:40.317034+0000","last_fullsized":"2024-09-13T06:30:40.317034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:24.356329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318422+0000","last_change":"2024-09-13T06:28:58.709334+0000","last_active":"2024-09-13T06:30:40.318422+0000","last_peered":"2024-09-13T06:30:40.318422+0000","last_clean":"2024-09-13T06:30:40.318422+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:30:40.318422+0000","last_undegraded":"2024-09-13T06:30:40.318422+0000","last_fullsized":"2024-09-13T06:30:40.318422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576205+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:30:39.576205+0000","last_peered":"2024-09-13T06:30:39.576205+0000","last_clean":"2024-09-13T06:30:39.576205+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:30:39.576205+0000","last_undegraded":"2024-09-13T06:30:39.576205+0000","last_fullsized":"2024-09-13T06:30:39.576205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:39:32.946230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571971+0000","last_change":"2024-09-13T06:29:02.747586+0000","last_active":"2024-09-13T06:30:39.571971+0000","last_peered":"2024-09-13T06:30:39.571971+0000","last_clean":"2024-09-13T06:30:39.571971+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:30:39.571971+0000","last_undegraded":"2024-09-13T06:30:39.571971+0000","last_fullsized":"2024-09-13T06:30:39.571971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:52.363598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318311+0000","last_change":"2024-09-13T06:29:04.747057+0000","last_active":"2024-09-13T06:30:40.318311+0000","last_peered":"2024-09-13T06:30:40.318311+0000","last_clean":"2024-09-13T06:30:40.318311+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:30:40.318311+0000","last_undegraded":"2024-09-13T06:30:40.318311+0000","last_fullsized":"2024-09-13T06:30:40.318311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:43.295549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977817+0000","last_change":"2024-09-13T06:29:06.772300+0000","last_active":"2024-09-13T06:32:12.977817+0000","last_peered":"2024-09-13T06:32:12.977817+0000","last_clean":"2024-09-13T06:32:12.977817+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:12.977817+0000","last_undegraded":"2024-09-13T06:32:12.977817+0000","last_fullsized":"2024-09-13T06:32:12.977817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:40.383988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907997+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:30:39.907997+0000","last_peered":"2024-09-13T06:30:39.907997+0000","last_clean":"2024-09-13T06:30:39.907997+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:30:39.907997+0000","last_undegraded":"2024-09-13T06:30:39.907997+0000","last_fullsized":"2024-09-13T06:30:39.907997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964847+0000","last_change":"2024-09-13T06:29:00.723308+0000","last_active":"2024-09-13T06:32:13.964847+0000","last_peered":"2024-09-13T06:32:13.964847+0000","last_clean":"2024-09-13T06:32:13.964847+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:32:13.964847+0000","last_undegraded":"2024-09-13T06:32:13.964847+0000","last_fullsized":"2024-09-13T06:32:13.964847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.313741+0000","last_change":"2024-09-13T06:28:58.724803+0000","last_active":"2024-09-13T06:32:13.313741+0000","last_peered":"2024-09-13T06:32:13.313741+0000","last_clean":"2024-09-13T06:32:13.313741+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:32:13.313741+0000","last_undegraded":"2024-09-13T06:32:13.313741+0000","last_fullsized":"2024-09-13T06:32:13.313741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318345+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:30:40.318345+0000","last_peered":"2024-09-13T06:30:40.318345+0000","last_clean":"2024-09-13T06:30:40.318345+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:30:40.318345+0000","last_undegraded":"2024-09-13T06:30:40.318345+0000","last_fullsized":"2024-09-13T06:30:40.318345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:58.129743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571648+0000","last_change":"2024-09-13T06:29:02.716108+0000","last_active":"2024-09-13T06:30:39.571648+0000","last_peered":"2024-09-13T06:30:39.571648+0000","last_clean":"2024-09-13T06:30:39.571648+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:30:39.571648+0000","last_undegraded":"2024-09-13T06:30:39.571648+0000","last_fullsized":"2024-09-13T06:30:39.571648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:34.365503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'12","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489787+0000","last_change":"2024-09-13T06:29:04.749361+0000","last_active":"2024-09-13T06:31:10.489787+0000","last_peered":"2024-09-13T06:31:10.489787+0000","last_clean":"2024-09-13T06:31:10.489787+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:31:10.489787+0000","last_undegraded":"2024-09-13T06:31:10.489787+0000","last_fullsized":"2024-09-13T06:31:10.489787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:35:45.201511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":434,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.258705+0000","last_change":"2024-09-13T06:29:06.773446+0000","last_active":"2024-09-13T06:32:14.258705+0000","last_peered":"2024-09-13T06:32:14.258705+0000","last_clean":"2024-09-13T06:32:14.258705+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:32:14.258705+0000","last_undegraded":"2024-09-13T06:32:14.258705+0000","last_fullsized":"2024-09-13T06:32:14.258705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:17.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316421+0000","last_change":"2024-09-13T06:29:08.789911+0000","last_active":"2024-09-13T06:30:40.316421+0000","last_peered":"2024-09-13T06:30:40.316421+0000","last_clean":"2024-09-13T06:30:40.316421+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:30:40.316421+0000","last_undegraded":"2024-09-13T06:30:40.316421+0000","last_fullsized":"2024-09-13T06:30:40.316421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:20.838014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566835+0000","last_change":"2024-09-13T06:29:00.703730+0000","last_active":"2024-09-13T06:30:39.566835+0000","last_peered":"2024-09-13T06:30:39.566835+0000","last_clean":"2024-09-13T06:30:39.566835+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:30:39.566835+0000","last_undegraded":"2024-09-13T06:30:39.566835+0000","last_fullsized":"2024-09-13T06:30:39.566835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:12.971383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318815+0000","last_change":"2024-09-13T06:28:58.716525+0000","last_active":"2024-09-13T06:30:40.318815+0000","last_peered":"2024-09-13T06:30:40.318815+0000","last_clean":"2024-09-13T06:30:40.318815+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:30:40.318815+0000","last_undegraded":"2024-09-13T06:30:40.318815+0000","last_fullsized":"2024-09-13T06:30:40.318815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575105+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:30:39.575105+0000","last_peered":"2024-09-13T06:30:39.575105+0000","last_clean":"2024-09-13T06:30:39.575105+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:30:39.575105+0000","last_undegraded":"2024-09-13T06:30:39.575105+0000","last_fullsized":"2024-09-13T06:30:39.575105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:00.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903968+0000","last_change":"2024-09-13T06:29:02.744270+0000","last_active":"2024-09-13T06:30:39.903968+0000","last_peered":"2024-09-13T06:30:39.903968+0000","last_clean":"2024-09-13T06:30:39.903968+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:30:39.903968+0000","last_undegraded":"2024-09-13T06:30:39.903968+0000","last_fullsized":"2024-09-13T06:30:39.903968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'83","reported_seq":159,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.248360+0000","last_change":"2024-09-13T06:29:04.732298+0000","last_active":"2024-09-13T06:31:10.248360+0000","last_peered":"2024-09-13T06:31:10.248360+0000","last_clean":"2024-09-13T06:31:10.248360+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:31:10.248360+0000","last_undegraded":"2024-09-13T06:31:10.248360+0000","last_fullsized":"2024-09-13T06:31:10.248360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:26.343883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905084+0000","last_change":"2024-09-13T06:29:06.767247+0000","last_active":"2024-09-13T06:30:39.905084+0000","last_peered":"2024-09-13T06:30:39.905084+0000","last_clean":"2024-09-13T06:30:39.905084+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:30:39.905084+0000","last_undegraded":"2024-09-13T06:30:39.905084+0000","last_fullsized":"2024-09-13T06:30:39.905084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:57.472237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570309+0000","last_change":"2024-09-13T06:29:08.778016+0000","last_active":"2024-09-13T06:30:39.570309+0000","last_peered":"2024-09-13T06:30:39.570309+0000","last_clean":"2024-09-13T06:30:39.570309+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:30:39.570309+0000","last_undegraded":"2024-09-13T06:30:39.570309+0000","last_fullsized":"2024-09-13T06:30:39.570309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.627161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569024+0000","last_change":"2024-09-13T06:29:08.775423+0000","last_active":"2024-09-13T06:30:39.569024+0000","last_peered":"2024-09-13T06:30:39.569024+0000","last_clean":"2024-09-13T06:30:39.569024+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:30:39.569024+0000","last_undegraded":"2024-09-13T06:30:39.569024+0000","last_fullsized":"2024-09-13T06:30:39.569024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:37.906807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777693+0000","last_change":"2024-09-13T06:29:00.706756+0000","last_active":"2024-09-13T06:32:13.777693+0000","last_peered":"2024-09-13T06:32:13.777693+0000","last_clean":"2024-09-13T06:32:13.777693+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:32:13.777693+0000","last_undegraded":"2024-09-13T06:32:13.777693+0000","last_fullsized":"2024-09-13T06:32:13.777693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:51.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.952185+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:13.952185+0000","last_peered":"2024-09-13T06:32:13.952185+0000","last_clean":"2024-09-13T06:32:13.952185+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:13.952185+0000","last_undegraded":"2024-09-13T06:32:13.952185+0000","last_fullsized":"2024-09-13T06:32:13.952185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316032+0000","last_change":"2024-09-13T06:29:02.737913+0000","last_active":"2024-09-13T06:30:40.316032+0000","last_peered":"2024-09-13T06:30:40.316032+0000","last_clean":"2024-09-13T06:30:40.316032+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:30:40.316032+0000","last_undegraded":"2024-09-13T06:30:40.316032+0000","last_fullsized":"2024-09-13T06:30:40.316032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.260616+0000","last_change":"2024-09-13T06:29:04.751781+0000","last_active":"2024-09-13T06:31:10.260616+0000","last_peered":"2024-09-13T06:31:10.260616+0000","last_clean":"2024-09-13T06:31:10.260616+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:31:10.260616+0000","last_undegraded":"2024-09-13T06:31:10.260616+0000","last_fullsized":"2024-09-13T06:31:10.260616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:17.156772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904554+0000","last_change":"2024-09-13T06:29:06.768895+0000","last_active":"2024-09-13T06:30:39.904554+0000","last_peered":"2024-09-13T06:30:39.904554+0000","last_clean":"2024-09-13T06:30:39.904554+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:30:39.904554+0000","last_undegraded":"2024-09-13T06:30:39.904554+0000","last_fullsized":"2024-09-13T06:30:39.904554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:59.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:09.813655+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:31:09.813655+0000","last_peered":"2024-09-13T06:31:09.813655+0000","last_clean":"2024-09-13T06:31:09.813655+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:31:09.813655+0000","last_undegraded":"2024-09-13T06:31:09.813655+0000","last_fullsized":"2024-09-13T06:31:09.813655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:50.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495777+0000","last_change":"2024-09-13T06:29:00.724056+0000","last_active":"2024-09-13T06:31:20.495777+0000","last_peered":"2024-09-13T06:31:20.495777+0000","last_clean":"2024-09-13T06:31:20.495777+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:31:20.495777+0000","last_undegraded":"2024-09-13T06:31:20.495777+0000","last_fullsized":"2024-09-13T06:31:20.495777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:17.805986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568468+0000","last_change":"2024-09-13T06:28:58.722577+0000","last_active":"2024-09-13T06:30:39.568468+0000","last_peered":"2024-09-13T06:30:39.568468+0000","last_clean":"2024-09-13T06:30:39.568468+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:30:39.568468+0000","last_undegraded":"2024-09-13T06:30:39.568468+0000","last_fullsized":"2024-09-13T06:30:39.568468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:49.189520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905810+0000","last_change":"2024-09-13T06:29:02.740396+0000","last_active":"2024-09-13T06:30:39.905810+0000","last_peered":"2024-09-13T06:30:39.905810+0000","last_clean":"2024-09-13T06:30:39.905810+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:30:39.905810+0000","last_undegraded":"2024-09-13T06:30:39.905810+0000","last_fullsized":"2024-09-13T06:30:39.905810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.707084+0000","last_change":"2024-09-13T06:29:04.741028+0000","last_active":"2024-09-13T06:32:12.707084+0000","last_peered":"2024-09-13T06:32:12.707084+0000","last_clean":"2024-09-13T06:32:12.707084+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:32:12.707084+0000","last_undegraded":"2024-09-13T06:32:12.707084+0000","last_fullsized":"2024-09-13T06:32:12.707084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:36.374316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566162+0000","last_change":"2024-09-13T06:29:06.765377+0000","last_active":"2024-09-13T06:30:39.566162+0000","last_peered":"2024-09-13T06:30:39.566162+0000","last_clean":"2024-09-13T06:30:39.566162+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:30:39.566162+0000","last_undegraded":"2024-09-13T06:30:39.566162+0000","last_fullsized":"2024-09-13T06:30:39.566162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:44.482785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317385+0000","last_change":"2024-09-13T06:29:08.787430+0000","last_active":"2024-09-13T06:30:40.317385+0000","last_peered":"2024-09-13T06:30:40.317385+0000","last_clean":"2024-09-13T06:30:40.317385+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:30:40.317385+0000","last_undegraded":"2024-09-13T06:30:40.317385+0000","last_fullsized":"2024-09-13T06:30:40.317385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:01.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'7","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492082+0000","last_change":"2024-09-13T06:29:00.709739+0000","last_active":"2024-09-13T06:31:20.492082+0000","last_peered":"2024-09-13T06:31:20.492082+0000","last_clean":"2024-09-13T06:31:20.492082+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:31:20.492082+0000","last_undegraded":"2024-09-13T06:31:20.492082+0000","last_fullsized":"2024-09-13T06:31:20.492082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575239+0000","last_change":"2024-09-13T06:28:58.717681+0000","last_active":"2024-09-13T06:30:39.575239+0000","last_peered":"2024-09-13T06:30:39.575239+0000","last_clean":"2024-09-13T06:30:39.575239+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:30:39.575239+0000","last_undegraded":"2024-09-13T06:30:39.575239+0000","last_fullsized":"2024-09-13T06:30:39.575239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:27.815067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.749307+0000","last_change":"2024-09-13T06:29:02.727813+0000","last_active":"2024-09-13T06:31:11.749307+0000","last_peered":"2024-09-13T06:31:11.749307+0000","last_clean":"2024-09-13T06:31:11.749307+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:31:11.749307+0000","last_undegraded":"2024-09-13T06:31:11.749307+0000","last_fullsized":"2024-09-13T06:31:11.749307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:24.145601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.858516+0000","last_change":"2024-09-13T06:29:04.750547+0000","last_active":"2024-09-13T06:32:12.858516+0000","last_peered":"2024-09-13T06:32:12.858516+0000","last_clean":"2024-09-13T06:32:12.858516+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:12.858516+0000","last_undegraded":"2024-09-13T06:32:12.858516+0000","last_fullsized":"2024-09-13T06:32:12.858516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:12.046692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315686+0000","last_change":"2024-09-13T06:29:06.765688+0000","last_active":"2024-09-13T06:30:40.315686+0000","last_peered":"2024-09-13T06:30:40.315686+0000","last_clean":"2024-09-13T06:30:40.315686+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:30:40.315686+0000","last_undegraded":"2024-09-13T06:30:40.315686+0000","last_fullsized":"2024-09-13T06:30:40.315686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:19.173170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905501+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:30:39.905501+0000","last_peered":"2024-09-13T06:30:39.905501+0000","last_clean":"2024-09-13T06:30:39.905501+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:30:39.905501+0000","last_undegraded":"2024-09-13T06:30:39.905501+0000","last_fullsized":"2024-09-13T06:30:39.905501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:15.759918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565768+0000","last_change":"2024-09-13T06:29:39.508832+0000","last_active":"2024-09-13T06:30:39.565768+0000","last_peered":"2024-09-13T06:30:39.565768+0000","last_clean":"2024-09-13T06:30:39.565768+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:30:39.565768+0000","last_undegraded":"2024-09-13T06:30:39.565768+0000","last_fullsized":"2024-09-13T06:30:39.565768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:22:26.112599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321498+0000","last_change":"2024-09-13T06:28:58.716514+0000","last_active":"2024-09-13T06:30:40.321498+0000","last_peered":"2024-09-13T06:30:40.321498+0000","last_clean":"2024-09-13T06:30:40.321498+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:30:40.321498+0000","last_undegraded":"2024-09-13T06:30:40.321498+0000","last_fullsized":"2024-09-13T06:30:40.321498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907794+0000","last_change":"2024-09-13T06:29:02.718645+0000","last_active":"2024-09-13T06:30:39.907794+0000","last_peered":"2024-09-13T06:30:39.907794+0000","last_clean":"2024-09-13T06:30:39.907794+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:30:39.907794+0000","last_undegraded":"2024-09-13T06:30:39.907794+0000","last_fullsized":"2024-09-13T06:30:39.907794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.231976+0000","last_change":"2024-09-13T06:29:04.733778+0000","last_active":"2024-09-13T06:31:10.231976+0000","last_peered":"2024-09-13T06:31:10.231976+0000","last_clean":"2024-09-13T06:31:10.231976+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:31:10.231976+0000","last_undegraded":"2024-09-13T06:31:10.231976+0000","last_fullsized":"2024-09-13T06:31:10.231976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:56.673325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568833+0000","last_change":"2024-09-13T06:29:06.762809+0000","last_active":"2024-09-13T06:30:39.568833+0000","last_peered":"2024-09-13T06:30:39.568833+0000","last_clean":"2024-09-13T06:30:39.568833+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:30:39.568833+0000","last_undegraded":"2024-09-13T06:30:39.568833+0000","last_fullsized":"2024-09-13T06:30:39.568833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:34.809800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571091+0000","last_change":"2024-09-13T06:29:00.717648+0000","last_active":"2024-09-13T06:32:13.571091+0000","last_peered":"2024-09-13T06:32:13.571091+0000","last_clean":"2024-09-13T06:32:13.571091+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:32:13.571091+0000","last_undegraded":"2024-09-13T06:32:13.571091+0000","last_fullsized":"2024-09-13T06:32:13.571091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903356+0000","last_change":"2024-09-13T06:28:58.719660+0000","last_active":"2024-09-13T06:30:39.903356+0000","last_peered":"2024-09-13T06:30:39.903356+0000","last_clean":"2024-09-13T06:30:39.903356+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:30:39.903356+0000","last_undegraded":"2024-09-13T06:30:39.903356+0000","last_fullsized":"2024-09-13T06:30:39.903356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319720+0000","last_change":"2024-09-13T06:29:02.737808+0000","last_active":"2024-09-13T06:30:40.319720+0000","last_peered":"2024-09-13T06:30:40.319720+0000","last_clean":"2024-09-13T06:30:40.319720+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:30:40.319720+0000","last_undegraded":"2024-09-13T06:30:40.319720+0000","last_fullsized":"2024-09-13T06:30:40.319720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'55","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.272428+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:31:10.272428+0000","last_peered":"2024-09-13T06:31:10.272428+0000","last_clean":"2024-09-13T06:31:10.272428+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:31:10.272428+0000","last_undegraded":"2024-09-13T06:31:10.272428+0000","last_fullsized":"2024-09-13T06:31:10.272428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568263+0000","last_change":"2024-09-13T06:29:06.770864+0000","last_active":"2024-09-13T06:30:39.568263+0000","last_peered":"2024-09-13T06:30:39.568263+0000","last_clean":"2024-09-13T06:30:39.568263+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:30:39.568263+0000","last_undegraded":"2024-09-13T06:30:39.568263+0000","last_fullsized":"2024-09-13T06:30:39.568263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:21.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.485917+0000","last_change":"2024-09-13T06:29:08.784874+0000","last_active":"2024-09-13T06:31:12.485917+0000","last_peered":"2024-09-13T06:31:12.485917+0000","last_clean":"2024-09-13T06:31:12.485917+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:31:12.485917+0000","last_undegraded":"2024-09-13T06:31:12.485917+0000","last_fullsized":"2024-09-13T06:31:12.485917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:36.951899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319331+0000","last_change":"2024-09-13T06:29:00.731362+0000","last_active":"2024-09-13T06:30:40.319331+0000","last_peered":"2024-09-13T06:30:40.319331+0000","last_clean":"2024-09-13T06:30:40.319331+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:30:40.319331+0000","last_undegraded":"2024-09-13T06:30:40.319331+0000","last_fullsized":"2024-09-13T06:30:40.319331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:19.896337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315793+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:30:40.315793+0000","last_peered":"2024-09-13T06:30:40.315793+0000","last_clean":"2024-09-13T06:30:40.315793+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:30:40.315793+0000","last_undegraded":"2024-09-13T06:30:40.315793+0000","last_fullsized":"2024-09-13T06:30:40.315793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.495874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578114+0000","last_change":"2024-09-13T06:29:02.720915+0000","last_active":"2024-09-13T06:30:39.578114+0000","last_peered":"2024-09-13T06:30:39.578114+0000","last_clean":"2024-09-13T06:30:39.578114+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:30:39.578114+0000","last_undegraded":"2024-09-13T06:30:39.578114+0000","last_fullsized":"2024-09-13T06:30:39.578114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:13.518915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.233950+0000","last_change":"2024-09-13T06:29:04.732931+0000","last_active":"2024-09-13T06:31:10.233950+0000","last_peered":"2024-09-13T06:31:10.233950+0000","last_clean":"2024-09-13T06:31:10.233950+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:31:10.233950+0000","last_undegraded":"2024-09-13T06:31:10.233950+0000","last_fullsized":"2024-09-13T06:31:10.233950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:37.616554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319314+0000","last_change":"2024-09-13T06:29:06.762859+0000","last_active":"2024-09-13T06:30:40.319314+0000","last_peered":"2024-09-13T06:30:40.319314+0000","last_clean":"2024-09-13T06:30:40.319314+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:30:40.319314+0000","last_undegraded":"2024-09-13T06:30:40.319314+0000","last_fullsized":"2024-09-13T06:30:40.319314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:56.472153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570852+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:30:39.570852+0000","last_peered":"2024-09-13T06:30:39.570852+0000","last_clean":"2024-09-13T06:30:39.570852+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:30:39.570852+0000","last_undegraded":"2024-09-13T06:30:39.570852+0000","last_fullsized":"2024-09-13T06:30:39.570852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965070+0000","last_change":"2024-09-13T06:29:00.732260+0000","last_active":"2024-09-13T06:32:13.965070+0000","last_peered":"2024-09-13T06:32:13.965070+0000","last_clean":"2024-09-13T06:32:13.965070+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:32:13.965070+0000","last_undegraded":"2024-09-13T06:32:13.965070+0000","last_fullsized":"2024-09-13T06:32:13.965070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572703+0000","last_change":"2024-09-13T06:28:58.716000+0000","last_active":"2024-09-13T06:30:39.572703+0000","last_peered":"2024-09-13T06:30:39.572703+0000","last_clean":"2024-09-13T06:30:39.572703+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:30:39.572703+0000","last_undegraded":"2024-09-13T06:30:39.572703+0000","last_fullsized":"2024-09-13T06:30:39.572703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574668+0000","last_change":"2024-09-13T06:29:02.718646+0000","last_active":"2024-09-13T06:30:39.574668+0000","last_peered":"2024-09-13T06:30:39.574668+0000","last_clean":"2024-09-13T06:30:39.574668+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:30:39.574668+0000","last_undegraded":"2024-09-13T06:30:39.574668+0000","last_fullsized":"2024-09-13T06:30:39.574668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'34","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.268754+0000","last_change":"2024-09-13T06:29:04.752663+0000","last_active":"2024-09-13T06:31:10.268754+0000","last_peered":"2024-09-13T06:31:10.268754+0000","last_clean":"2024-09-13T06:31:10.268754+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:31:10.268754+0000","last_undegraded":"2024-09-13T06:31:10.268754+0000","last_fullsized":"2024-09-13T06:31:10.268754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:06.350632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321281+0000","last_change":"2024-09-13T06:29:06.766875+0000","last_active":"2024-09-13T06:30:40.321281+0000","last_peered":"2024-09-13T06:30:40.321281+0000","last_clean":"2024-09-13T06:30:40.321281+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:30:40.321281+0000","last_undegraded":"2024-09-13T06:30:40.321281+0000","last_fullsized":"2024-09-13T06:30:40.321281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:25.326753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.653823+0000","last_change":"2024-09-13T06:29:08.769294+0000","last_active":"2024-09-13T06:31:12.653823+0000","last_peered":"2024-09-13T06:31:12.653823+0000","last_clean":"2024-09-13T06:31:12.653823+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:31:12.653823+0000","last_undegraded":"2024-09-13T06:31:12.653823+0000","last_fullsized":"2024-09-13T06:31:12.653823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:00:59.776143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.410858+0000","last_change":"2024-09-13T06:29:00.722796+0000","last_active":"2024-09-13T06:32:13.410858+0000","last_peered":"2024-09-13T06:32:13.410858+0000","last_clean":"2024-09-13T06:32:13.410858+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:32:13.410858+0000","last_undegraded":"2024-09-13T06:32:13.410858+0000","last_fullsized":"2024-09-13T06:32:13.410858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:28.267490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'7","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.750950+0000","last_change":"2024-09-13T06:28:58.705967+0000","last_active":"2024-09-13T06:32:13.750950+0000","last_peered":"2024-09-13T06:32:13.750950+0000","last_clean":"2024-09-13T06:32:13.750950+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:32:13.750950+0000","last_undegraded":"2024-09-13T06:32:13.750950+0000","last_fullsized":"2024-09-13T06:32:13.750950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:49.212428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":31,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319567+0000","last_change":"2024-09-13T06:29:02.727947+0000","last_active":"2024-09-13T06:30:40.319567+0000","last_peered":"2024-09-13T06:30:40.319567+0000","last_clean":"2024-09-13T06:30:40.319567+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:30:40.319567+0000","last_undegraded":"2024-09-13T06:30:40.319567+0000","last_fullsized":"2024-09-13T06:30:40.319567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:43.175259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910215+0000","last_change":"2024-09-13T06:29:04.754166+0000","last_active":"2024-09-13T06:30:39.910215+0000","last_peered":"2024-09-13T06:30:39.910215+0000","last_clean":"2024-09-13T06:30:39.910215+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:30:39.910215+0000","last_undegraded":"2024-09-13T06:30:39.910215+0000","last_fullsized":"2024-09-13T06:30:39.910215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:54.455755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.977868+0000","last_change":"2024-09-13T06:29:06.774577+0000","last_active":"2024-09-13T06:32:13.977868+0000","last_peered":"2024-09-13T06:32:13.977868+0000","last_clean":"2024-09-13T06:32:13.977868+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:32:13.977868+0000","last_undegraded":"2024-09-13T06:32:13.977868+0000","last_fullsized":"2024-09-13T06:32:13.977868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:26.057296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570192+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:30:39.570192+0000","last_peered":"2024-09-13T06:30:39.570192+0000","last_clean":"2024-09-13T06:30:39.570192+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:30:39.570192+0000","last_undegraded":"2024-09-13T06:30:39.570192+0000","last_fullsized":"2024-09-13T06:30:39.570192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.891076+0000","last_change":"2024-09-13T06:29:00.703118+0000","last_active":"2024-09-13T06:32:13.891076+0000","last_peered":"2024-09-13T06:32:13.891076+0000","last_clean":"2024-09-13T06:32:13.891076+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:32:13.891076+0000","last_undegraded":"2024-09-13T06:32:13.891076+0000","last_fullsized":"2024-09-13T06:32:13.891076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318695+0000","last_change":"2024-09-13T06:28:58.727668+0000","last_active":"2024-09-13T06:30:40.318695+0000","last_peered":"2024-09-13T06:30:40.318695+0000","last_clean":"2024-09-13T06:30:40.318695+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:30:40.318695+0000","last_undegraded":"2024-09-13T06:30:40.318695+0000","last_fullsized":"2024-09-13T06:30:40.318695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:44.537548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317498+0000","last_change":"2024-09-13T06:29:02.737035+0000","last_active":"2024-09-13T06:30:40.317498+0000","last_peered":"2024-09-13T06:30:40.317498+0000","last_clean":"2024-09-13T06:30:40.317498+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:30:40.317498+0000","last_undegraded":"2024-09-13T06:30:40.317498+0000","last_fullsized":"2024-09-13T06:30:40.317498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.989322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.216689+0000","last_change":"2024-09-13T06:29:04.736867+0000","last_active":"2024-09-13T06:31:10.216689+0000","last_peered":"2024-09-13T06:31:10.216689+0000","last_clean":"2024-09-13T06:31:10.216689+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:31:10.216689+0000","last_undegraded":"2024-09-13T06:31:10.216689+0000","last_fullsized":"2024-09-13T06:31:10.216689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.266864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903117+0000","last_change":"2024-09-13T06:29:06.755656+0000","last_active":"2024-09-13T06:30:39.903117+0000","last_peered":"2024-09-13T06:30:39.903117+0000","last_clean":"2024-09-13T06:30:39.903117+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:30:39.903117+0000","last_undegraded":"2024-09-13T06:30:39.903117+0000","last_fullsized":"2024-09-13T06:30:39.903117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:08.951294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576139+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:30:39.576139+0000","last_peered":"2024-09-13T06:30:39.576139+0000","last_clean":"2024-09-13T06:30:39.576139+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:30:39.576139+0000","last_undegraded":"2024-09-13T06:30:39.576139+0000","last_fullsized":"2024-09-13T06:30:39.576139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:24.414010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570406+0000","last_change":"2024-09-13T06:29:00.715931+0000","last_active":"2024-09-13T06:32:13.570406+0000","last_peered":"2024-09-13T06:32:13.570406+0000","last_clean":"2024-09-13T06:32:13.570406+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:32:13.570406+0000","last_undegraded":"2024-09-13T06:32:13.570406+0000","last_fullsized":"2024-09-13T06:32:13.570406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:16.645482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.577929+0000","last_change":"2024-09-13T06:28:58.706848+0000","last_active":"2024-09-13T06:30:39.577929+0000","last_peered":"2024-09-13T06:30:39.577929+0000","last_clean":"2024-09-13T06:30:39.577929+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:30:39.577929+0000","last_undegraded":"2024-09-13T06:30:39.577929+0000","last_fullsized":"2024-09-13T06:30:39.577929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:08.398250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572664+0000","last_change":"2024-09-13T06:29:02.715301+0000","last_active":"2024-09-13T06:30:39.572664+0000","last_peered":"2024-09-13T06:30:39.572664+0000","last_clean":"2024-09-13T06:30:39.572664+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:30:39.572664+0000","last_undegraded":"2024-09-13T06:30:39.572664+0000","last_fullsized":"2024-09-13T06:30:39.572664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:19.480041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.217481+0000","last_change":"2024-09-13T06:29:04.728823+0000","last_active":"2024-09-13T06:31:10.217481+0000","last_peered":"2024-09-13T06:31:10.217481+0000","last_clean":"2024-09-13T06:31:10.217481+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:31:10.217481+0000","last_undegraded":"2024-09-13T06:31:10.217481+0000","last_fullsized":"2024-09-13T06:31:10.217481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:22.717282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571575+0000","last_change":"2024-09-13T06:29:06.774527+0000","last_active":"2024-09-13T06:30:39.571575+0000","last_peered":"2024-09-13T06:30:39.571575+0000","last_clean":"2024-09-13T06:30:39.571575+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:30:39.571575+0000","last_undegraded":"2024-09-13T06:30:39.571575+0000","last_fullsized":"2024-09-13T06:30:39.571575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:17.985155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.457421+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.457421+0000","last_peered":"2024-09-13T06:32:13.457421+0000","last_clean":"2024-09-13T06:32:13.457421+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.457421+0000","last_undegraded":"2024-09-13T06:32:13.457421+0000","last_fullsized":"2024-09-13T06:32:13.457421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:54.961718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777639+0000","last_change":"2024-09-13T06:29:00.710678+0000","last_active":"2024-09-13T06:32:13.777639+0000","last_peered":"2024-09-13T06:32:13.777639+0000","last_clean":"2024-09-13T06:32:13.777639+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:32:13.777639+0000","last_undegraded":"2024-09-13T06:32:13.777639+0000","last_fullsized":"2024-09-13T06:32:13.777639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910338+0000","last_change":"2024-09-13T06:28:58.728835+0000","last_active":"2024-09-13T06:30:39.910338+0000","last_peered":"2024-09-13T06:30:39.910338+0000","last_clean":"2024-09-13T06:30:39.910338+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:30:39.910338+0000","last_undegraded":"2024-09-13T06:30:39.910338+0000","last_fullsized":"2024-09-13T06:30:39.910338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315953+0000","last_change":"2024-09-13T06:29:02.731541+0000","last_active":"2024-09-13T06:30:40.315953+0000","last_peered":"2024-09-13T06:30:40.315953+0000","last_clean":"2024-09-13T06:30:40.315953+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:30:40.315953+0000","last_undegraded":"2024-09-13T06:30:40.315953+0000","last_fullsized":"2024-09-13T06:30:40.315953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:35.369421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'27","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.265189+0000","last_change":"2024-09-13T06:29:04.750320+0000","last_active":"2024-09-13T06:31:10.265189+0000","last_peered":"2024-09-13T06:31:10.265189+0000","last_clean":"2024-09-13T06:31:10.265189+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:31:10.265189+0000","last_undegraded":"2024-09-13T06:31:10.265189+0000","last_fullsized":"2024-09-13T06:31:10.265189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:20.698413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571889+0000","last_change":"2024-09-13T06:29:06.744904+0000","last_active":"2024-09-13T06:30:39.571889+0000","last_peered":"2024-09-13T06:30:39.571889+0000","last_clean":"2024-09-13T06:30:39.571889+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:30:39.571889+0000","last_undegraded":"2024-09-13T06:30:39.571889+0000","last_fullsized":"2024-09-13T06:30:39.571889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:03.059130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.857298+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.857298+0000","last_peered":"2024-09-13T06:32:13.857298+0000","last_clean":"2024-09-13T06:32:13.857298+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.857298+0000","last_undegraded":"2024-09-13T06:32:13.857298+0000","last_fullsized":"2024-09-13T06:32:13.857298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:21.044316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888955+0000","last_change":"2024-09-13T06:29:00.723086+0000","last_active":"2024-09-13T06:32:13.888955+0000","last_peered":"2024-09-13T06:32:13.888955+0000","last_clean":"2024-09-13T06:32:13.888955+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:32:13.888955+0000","last_undegraded":"2024-09-13T06:32:13.888955+0000","last_fullsized":"2024-09-13T06:32:13.888955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321598+0000","last_change":"2024-09-13T06:28:58.709396+0000","last_active":"2024-09-13T06:30:40.321598+0000","last_peered":"2024-09-13T06:30:40.321598+0000","last_clean":"2024-09-13T06:30:40.321598+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:30:40.321598+0000","last_undegraded":"2024-09-13T06:30:40.321598+0000","last_fullsized":"2024-09-13T06:30:40.321598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:08.425859+0000","last_change":"2024-09-13T06:29:02.732125+0000","last_active":"2024-09-13T06:31:08.425859+0000","last_peered":"2024-09-13T06:31:08.425859+0000","last_clean":"2024-09-13T06:31:08.425859+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:31:08.425859+0000","last_undegraded":"2024-09-13T06:31:08.425859+0000","last_fullsized":"2024-09-13T06:31:08.425859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:18.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'33","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.708447+0000","last_change":"2024-09-13T06:29:04.732737+0000","last_active":"2024-09-13T06:32:12.708447+0000","last_peered":"2024-09-13T06:32:12.708447+0000","last_clean":"2024-09-13T06:32:12.708447+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:12.708447+0000","last_undegraded":"2024-09-13T06:32:12.708447+0000","last_fullsized":"2024-09-13T06:32:12.708447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:10:29.688497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568199+0000","last_change":"2024-09-13T06:29:06.776200+0000","last_active":"2024-09-13T06:30:39.568199+0000","last_peered":"2024-09-13T06:30:39.568199+0000","last_clean":"2024-09-13T06:30:39.568199+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:30:39.568199+0000","last_undegraded":"2024-09-13T06:30:39.568199+0000","last_fullsized":"2024-09-13T06:30:39.568199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:14.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.287953+0000","last_change":"2024-09-13T06:29:08.770047+0000","last_active":"2024-09-13T06:31:10.287953+0000","last_peered":"2024-09-13T06:31:10.287953+0000","last_clean":"2024-09-13T06:31:10.287953+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:31:10.287953+0000","last_undegraded":"2024-09-13T06:31:10.287953+0000","last_fullsized":"2024-09-13T06:31:10.287953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:12.926423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.322106+0000","last_change":"2024-09-13T06:29:00.723899+0000","last_active":"2024-09-13T06:30:40.322106+0000","last_peered":"2024-09-13T06:30:40.322106+0000","last_clean":"2024-09-13T06:30:40.322106+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:30:40.322106+0000","last_undegraded":"2024-09-13T06:30:40.322106+0000","last_fullsized":"2024-09-13T06:30:40.322106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565933+0000","last_change":"2024-09-13T06:28:58.721562+0000","last_active":"2024-09-13T06:30:39.565933+0000","last_peered":"2024-09-13T06:30:39.565933+0000","last_clean":"2024-09-13T06:30:39.565933+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:30:39.565933+0000","last_undegraded":"2024-09-13T06:30:39.565933+0000","last_fullsized":"2024-09-13T06:30:39.565933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:26.902921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571617+0000","last_change":"2024-09-13T06:29:00.721713+0000","last_active":"2024-09-13T06:32:13.571617+0000","last_peered":"2024-09-13T06:32:13.571617+0000","last_clean":"2024-09-13T06:32:13.571617+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:32:13.571617+0000","last_undegraded":"2024-09-13T06:32:13.571617+0000","last_fullsized":"2024-09-13T06:32:13.571617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:53.230794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.357941+0000","last_change":"2024-09-13T06:28:58.708285+0000","last_active":"2024-09-13T06:31:12.357941+0000","last_peered":"2024-09-13T06:31:12.357941+0000","last_clean":"2024-09-13T06:31:12.357941+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:31:12.357941+0000","last_undegraded":"2024-09-13T06:31:12.357941+0000","last_fullsized":"2024-09-13T06:31:12.357941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:29:28.632008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'5","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:50.502622+0000","last_change":"2024-09-13T06:29:39.540853+0000","last_active":"2024-09-13T06:31:50.502622+0000","last_peered":"2024-09-13T06:31:50.502622+0000","last_clean":"2024-09-13T06:31:50.502622+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:31:50.502622+0000","last_undegraded":"2024-09-13T06:31:50.502622+0000","last_fullsized":"2024-09-13T06:31:50.502622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:10.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905352+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:30:39.905352+0000","last_peered":"2024-09-13T06:30:39.905352+0000","last_clean":"2024-09-13T06:30:39.905352+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:30:39.905352+0000","last_undegraded":"2024-09-13T06:30:39.905352+0000","last_fullsized":"2024-09-13T06:30:39.905352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777960+0000","last_change":"2024-09-13T06:29:00.721804+0000","last_active":"2024-09-13T06:32:13.777960+0000","last_peered":"2024-09-13T06:32:13.777960+0000","last_clean":"2024-09-13T06:32:13.777960+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:32:13.777960+0000","last_undegraded":"2024-09-13T06:32:13.777960+0000","last_fullsized":"2024-09-13T06:32:13.777960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:38.933470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567585+0000","last_change":"2024-09-13T06:28:58.722511+0000","last_active":"2024-09-13T06:30:39.567585+0000","last_peered":"2024-09-13T06:30:39.567585+0000","last_clean":"2024-09-13T06:30:39.567585+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:30:39.567585+0000","last_undegraded":"2024-09-13T06:30:39.567585+0000","last_fullsized":"2024-09-13T06:30:39.567585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:59.470833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.413604+0000","last_change":"2024-09-13T06:29:39.527461+0000","last_active":"2024-09-13T06:32:13.413604+0000","last_peered":"2024-09-13T06:32:13.413604+0000","last_clean":"2024-09-13T06:32:13.413604+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:32:13.413604+0000","last_undegraded":"2024-09-13T06:32:13.413604+0000","last_fullsized":"2024-09-13T06:32:13.413604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:35.974634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910363+0000","last_change":"2024-09-13T06:28:58.724998+0000","last_active":"2024-09-13T06:30:39.910363+0000","last_peered":"2024-09-13T06:30:39.910363+0000","last_clean":"2024-09-13T06:30:39.910363+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:30:39.910363+0000","last_undegraded":"2024-09-13T06:30:39.910363+0000","last_fullsized":"2024-09-13T06:30:39.910363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889884+0000","last_change":"2024-09-13T06:29:00.723960+0000","last_active":"2024-09-13T06:32:13.889884+0000","last_peered":"2024-09-13T06:32:13.889884+0000","last_clean":"2024-09-13T06:32:13.889884+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:32:13.889884+0000","last_undegraded":"2024-09-13T06:32:13.889884+0000","last_fullsized":"2024-09-13T06:32:13.889884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:45.154423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317979+0000","last_change":"2024-09-13T06:28:58.730726+0000","last_active":"2024-09-13T06:30:40.317979+0000","last_peered":"2024-09-13T06:30:40.317979+0000","last_clean":"2024-09-13T06:30:40.317979+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:30:40.317979+0000","last_undegraded":"2024-09-13T06:30:40.317979+0000","last_fullsized":"2024-09-13T06:30:40.317979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905756+0000","last_change":"2024-09-13T06:29:00.718381+0000","last_active":"2024-09-13T06:30:39.905756+0000","last_peered":"2024-09-13T06:30:39.905756+0000","last_clean":"2024-09-13T06:30:39.905756+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:30:39.905756+0000","last_undegraded":"2024-09-13T06:30:39.905756+0000","last_fullsized":"2024-09-13T06:30:39.905756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569016+0000","last_change":"2024-09-13T06:28:58.707516+0000","last_active":"2024-09-13T06:30:39.569016+0000","last_peered":"2024-09-13T06:30:39.569016+0000","last_clean":"2024-09-13T06:30:39.569016+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:30:39.569016+0000","last_undegraded":"2024-09-13T06:30:39.569016+0000","last_fullsized":"2024-09-13T06:30:39.569016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:50:18.113331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570745+0000","last_change":"2024-09-13T06:29:00.715113+0000","last_active":"2024-09-13T06:30:39.570745+0000","last_peered":"2024-09-13T06:30:39.570745+0000","last_clean":"2024-09-13T06:30:39.570745+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:30:39.570745+0000","last_undegraded":"2024-09-13T06:30:39.570745+0000","last_fullsized":"2024-09-13T06:30:39.570745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908260+0000","last_change":"2024-09-13T06:28:58.725590+0000","last_active":"2024-09-13T06:30:39.908260+0000","last_peered":"2024-09-13T06:30:39.908260+0000","last_clean":"2024-09-13T06:30:39.908260+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:30:39.908260+0000","last_undegraded":"2024-09-13T06:30:39.908260+0000","last_fullsized":"2024-09-13T06:30:39.908260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:50.900848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964923+0000","last_change":"2024-09-13T06:29:00.713384+0000","last_active":"2024-09-13T06:32:13.964923+0000","last_peered":"2024-09-13T06:32:13.964923+0000","last_clean":"2024-09-13T06:32:13.964923+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:32:13.964923+0000","last_undegraded":"2024-09-13T06:32:13.964923+0000","last_fullsized":"2024-09-13T06:32:13.964923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.737385+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.737385+0000","last_peered":"2024-09-13T06:32:13.737385+0000","last_clean":"2024-09-13T06:32:13.737385+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.737385+0000","last_undegraded":"2024-09-13T06:32:13.737385+0000","last_fullsized":"2024-09-13T06:32:13.737385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:48.282068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.890443+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:13.890443+0000","last_peered":"2024-09-13T06:32:13.890443+0000","last_clean":"2024-09-13T06:32:13.890443+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:13.890443+0000","last_undegraded":"2024-09-13T06:32:13.890443+0000","last_fullsized":"2024-09-13T06:32:13.890443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905294+0000","last_change":"2024-09-13T06:28:58.705020+0000","last_active":"2024-09-13T06:30:39.905294+0000","last_peered":"2024-09-13T06:30:39.905294+0000","last_clean":"2024-09-13T06:30:39.905294+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:30:39.905294+0000","last_undegraded":"2024-09-13T06:30:39.905294+0000","last_fullsized":"2024-09-13T06:30:39.905294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493929+0000","last_change":"2024-09-13T06:29:00.702900+0000","last_active":"2024-09-13T06:31:15.493929+0000","last_peered":"2024-09-13T06:31:15.493929+0000","last_clean":"2024-09-13T06:31:15.493929+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:31:15.493929+0000","last_undegraded":"2024-09-13T06:31:15.493929+0000","last_fullsized":"2024-09-13T06:31:15.493929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:18.709977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572544+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:30:39.572544+0000","last_peered":"2024-09-13T06:30:39.572544+0000","last_clean":"2024-09-13T06:30:39.572544+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:30:39.572544+0000","last_undegraded":"2024-09-13T06:30:39.572544+0000","last_fullsized":"2024-09-13T06:30:39.572544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:31:36.559365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777954+0000","last_change":"2024-09-13T06:29:00.732329+0000","last_active":"2024-09-13T06:32:13.777954+0000","last_peered":"2024-09-13T06:32:13.777954+0000","last_clean":"2024-09-13T06:32:13.777954+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:32:13.777954+0000","last_undegraded":"2024-09-13T06:32:13.777954+0000","last_fullsized":"2024-09-13T06:32:13.777954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318194+0000","last_change":"2024-09-13T06:28:58.716875+0000","last_active":"2024-09-13T06:30:40.318194+0000","last_peered":"2024-09-13T06:30:40.318194+0000","last_clean":"2024-09-13T06:30:40.318194+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:30:40.318194+0000","last_undegraded":"2024-09-13T06:30:40.318194+0000","last_fullsized":"2024-09-13T06:30:40.318194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:32.384190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888966+0000","last_change":"2024-09-13T06:29:00.716069+0000","last_active":"2024-09-13T06:32:13.888966+0000","last_peered":"2024-09-13T06:32:13.888966+0000","last_clean":"2024-09-13T06:32:13.888966+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:32:13.888966+0000","last_undegraded":"2024-09-13T06:32:13.888966+0000","last_fullsized":"2024-09-13T06:32:13.888966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.758463+0000","last_change":"2024-09-13T06:28:58.725136+0000","last_active":"2024-09-13T06:32:13.758463+0000","last_peered":"2024-09-13T06:32:13.758463+0000","last_clean":"2024-09-13T06:32:13.758463+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:32:13.758463+0000","last_undegraded":"2024-09-13T06:32:13.758463+0000","last_fullsized":"2024-09-13T06:32:13.758463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984562+0000","last_change":"2024-09-13T06:29:00.729388+0000","last_active":"2024-09-13T06:32:13.984562+0000","last_peered":"2024-09-13T06:32:13.984562+0000","last_clean":"2024-09-13T06:32:13.984562+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:32:13.984562+0000","last_undegraded":"2024-09-13T06:32:13.984562+0000","last_fullsized":"2024-09-13T06:32:13.984562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:35.921007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908553+0000","last_change":"2024-09-13T06:28:58.720437+0000","last_active":"2024-09-13T06:30:39.908553+0000","last_peered":"2024-09-13T06:30:39.908553+0000","last_clean":"2024-09-13T06:30:39.908553+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:30:39.908553+0000","last_undegraded":"2024-09-13T06:30:39.908553+0000","last_fullsized":"2024-09-13T06:30:39.908553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904803+0000","last_change":"2024-09-13T06:29:00.722844+0000","last_active":"2024-09-13T06:30:39.904803+0000","last_peered":"2024-09-13T06:30:39.904803+0000","last_clean":"2024-09-13T06:30:39.904803+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:30:39.904803+0000","last_undegraded":"2024-09-13T06:30:39.904803+0000","last_fullsized":"2024-09-13T06:30:39.904803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.765398+0000","last_change":"2024-09-13T06:28:58.707588+0000","last_active":"2024-09-13T06:32:13.765398+0000","last_peered":"2024-09-13T06:32:13.765398+0000","last_clean":"2024-09-13T06:32:13.765398+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:32:13.765398+0000","last_undegraded":"2024-09-13T06:32:13.765398+0000","last_fullsized":"2024-09-13T06:32:13.765398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:13.693638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776869+0000","last_change":"2024-09-13T06:29:00.717476+0000","last_active":"2024-09-13T06:32:13.776869+0000","last_peered":"2024-09-13T06:32:13.776869+0000","last_clean":"2024-09-13T06:32:13.776869+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:32:13.776869+0000","last_undegraded":"2024-09-13T06:32:13.776869+0000","last_fullsized":"2024-09-13T06:32:13.776869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:25:20.841077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908636+0000","last_change":"2024-09-13T06:28:58.720596+0000","last_active":"2024-09-13T06:30:39.908636+0000","last_peered":"2024-09-13T06:30:39.908636+0000","last_clean":"2024-09-13T06:30:39.908636+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:30:39.908636+0000","last_undegraded":"2024-09-13T06:30:39.908636+0000","last_fullsized":"2024-09-13T06:30:39.908636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.599725+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:31:12.599725+0000","last_peered":"2024-09-13T06:31:12.599725+0000","last_clean":"2024-09-13T06:31:12.599725+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:31:12.599725+0000","last_undegraded":"2024-09-13T06:31:12.599725+0000","last_fullsized":"2024-09-13T06:31:12.599725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570695+0000","last_change":"2024-09-13T06:29:00.709102+0000","last_active":"2024-09-13T06:30:39.570695+0000","last_peered":"2024-09-13T06:30:39.570695+0000","last_clean":"2024-09-13T06:30:39.570695+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:30:39.570695+0000","last_undegraded":"2024-09-13T06:30:39.570695+0000","last_fullsized":"2024-09-13T06:30:39.570695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:36.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316128+0000","last_change":"2024-09-13T06:28:58.716677+0000","last_active":"2024-09-13T06:30:40.316128+0000","last_peered":"2024-09-13T06:30:40.316128+0000","last_clean":"2024-09-13T06:30:40.316128+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:30:40.316128+0000","last_undegraded":"2024-09-13T06:30:40.316128+0000","last_fullsized":"2024-09-13T06:30:40.316128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965751+0000","last_change":"2024-09-13T06:29:39.515090+0000","last_active":"2024-09-13T06:32:13.965751+0000","last_peered":"2024-09-13T06:32:13.965751+0000","last_clean":"2024-09-13T06:32:13.965751+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:32:13.965751+0000","last_undegraded":"2024-09-13T06:32:13.965751+0000","last_fullsized":"2024-09-13T06:32:13.965751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:44.609771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52164,"kb_used_data":16820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319676,"statfs":{"total":96636764160,"available":96583348224,"internally_reserved":0,"allocated":17223680,"data_stored":16928749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49324,"kb_used_data":9820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322516,"statfs":{"total":96636764160,"available":96586256384,"internally_reserved":0,"allocated":10055680,"data_stored":9770864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48664,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323176,"statfs":{"total":96636764160,"available":96586932224,"internally_reserved":0,"allocated":13639680,"data_stored":13325489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":13400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":13721600,"data_stored":13377560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:32:45.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:32:46.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0e01336640 1 Processor -- start 2024-09-13T06:32:46.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0e01336640 1 -- start start 2024-09-13T06:32:46.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0e01336640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0dfc06ece0 0x7f0dfc130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0e01336640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dfc06f750 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0e01336640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0dfc070c10 con 0x7f0dfc06ece0 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0dfaffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0dfc06e1f0 0x7f0dfc06e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46442/0 (socket says 172.21.15.112:46442) 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0dfaffd640 1 -- 172.21.15.112:0/2826052540 learned_addr learned my addr 172.21.15.112:0/2826052540 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.146+0000 7f0dfa7fc640 1 --2- 172.21.15.112:0/2826052540 >> v2:172.21.15.112:3300/0 conn(0x7f0dfc06ece0 0x7f0dfc130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0df9ffb640 1 -- 172.21.15.112:0/2826052540 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514636468 0 0) 0x7f0dfc06f750 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0df9ffb640 1 -- 172.21.15.112:0/2826052540 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de4003530 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0dfa7fc640 1 -- 172.21.15.112:0/2826052540 >> v1:172.21.15.112:6789/0 conn(0x7f0dfc06e1f0 legacy=0x7f0dfc06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0dfa7fc640 1 -- 172.21.15.112:0/2826052540 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc0703f0 con 0x7f0dfc06ece0 2024-09-13T06:32:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0dfa7fc640 1 --2- 172.21.15.112:0/2826052540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06ece0 0x7f0dfc130e50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009740 tx=0x7f0dec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cfc83ca188359b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0df9ffb640 1 -- 172.21.15.112:0/2826052540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec0b0070 con 0x7f0dfc06ece0 2024-09-13T06:32:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0df9ffb640 1 -- 172.21.15.112:0/2826052540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec0ab530 con 0x7f0dfc06ece0 2024-09-13T06:32:46.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0df9ffb640 1 -- 172.21.15.112:0/2826052540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec0ab830 con 0x7f0dfc06ece0 2024-09-13T06:32:46.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 -- 172.21.15.112:0/2826052540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06ece0 msgr2=0x7f0dfc130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 --2- 172.21.15.112:0/2826052540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06ece0 0x7f0dfc130e50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009740 tx=0x7f0dec01c370 comp rx=0 tx=0).stop 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 -- 172.21.15.112:0/2826052540 shutdown_connections 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 --2- 172.21.15.112:0/2826052540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06ece0 0x7f0dfc130e50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 -- 172.21.15.112:0/2826052540 >> 172.21.15.112:0/2826052540 conn(0x7f0dfc099a50 msgr2=0x7f0dfc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 -- 172.21.15.112:0/2826052540 shutdown_connections 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.150+0000 7f0e01336640 1 -- 172.21.15.112:0/2826052540 wait complete. 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 Processor -- start 2024-09-13T06:32:46.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 -- start start 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 0x7f0dfc096890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc133d30 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 0x7f0dfc096890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 0x7f0dfc096890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46180/0 (socket says 172.21.15.112:46180) 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfaffd640 1 -- 172.21.15.112:0/4208054684 learned_addr learned my addr 172.21.15.112:0/4208054684 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfaffd640 1 -- 172.21.15.112:0/4208054684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc06db60 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfaffd640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 0x7f0dfc096890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c450 tx=0x7f0df000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df0017070 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df0005c20 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc129540 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df0007070 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc129fa0 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dfc129710 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0df001a070 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0de37fe640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0de8035db0 0x7f0de8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f0df00482e0 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfa7fc640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0de8035db0 0x7f0de8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.154+0000 7f0dfa7fc640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0de8035db0 0x7f0de8038270 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0ad000 tx=0x7f0dec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.158+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0df0007210 con 0x7f0dfc06e1f0 2024-09-13T06:32:46.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.318+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0dfc06e5d0 con 0x7f0de8035db0 2024-09-13T06:32:46.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.362+0000 7f0de37fe640 1 -- 172.21.15.112:0/4208054684 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665570 (secure 0 0 0) 0x7f0dfc06e5d0 con 0x7f0de8035db0 2024-09-13T06:32:46.373 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:32:46.379 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:32:46.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0de8035db0 msgr2=0x7f0de8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0de8035db0 0x7f0de8038270 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0ad000 tx=0x7f0dec0a6000 comp rx=0 tx=0).stop 2024-09-13T06:32:46.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 msgr2=0x7f0dfc096890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 0x7f0dfc096890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c450 tx=0x7f0df000c910 comp rx=0 tx=0).stop 2024-09-13T06:32:46.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 shutdown_connections 2024-09-13T06:32:46.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0de8035db0 0x7f0de8038270 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 --2- 172.21.15.112:0/4208054684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dfc06e1f0 0x7f0dfc096890 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 >> 172.21.15.112:0/4208054684 conn(0x7f0dfc099a50 msgr2=0x7f0dfc09a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:46.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 shutdown_connections 2024-09-13T06:32:46.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.370+0000 7f0e01336640 1 -- 172.21.15.112:0/4208054684 wait complete. 2024-09-13T06:32:46.393 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T06:32:44.504791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4884,"num_read_kb":4465,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198896,"kb_used_data":53360,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288464,"statfs":{"total":386547056640,"available":386343387136,"internally_reserved":0,"allocated":54640640,"data_stored":53402662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006429"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576389+0000","last_change":"2024-09-13T06:28:58.716560+0000","last_active":"2024-09-13T06:30:39.576389+0000","last_peered":"2024-09-13T06:30:39.576389+0000","last_clean":"2024-09-13T06:30:39.576389+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:30:39.576389+0000","last_undegraded":"2024-09-13T06:30:39.576389+0000","last_fullsized":"2024-09-13T06:30:39.576389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:38.476549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776956+0000","last_change":"2024-09-13T06:29:00.715147+0000","last_active":"2024-09-13T06:32:13.776956+0000","last_peered":"2024-09-13T06:32:13.776956+0000","last_clean":"2024-09-13T06:32:13.776956+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:32:13.776956+0000","last_undegraded":"2024-09-13T06:32:13.776956+0000","last_fullsized":"2024-09-13T06:32:13.776956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318678+0000","last_change":"2024-09-13T06:28:58.727026+0000","last_active":"2024-09-13T06:30:40.318678+0000","last_peered":"2024-09-13T06:30:40.318678+0000","last_clean":"2024-09-13T06:30:40.318678+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:30:40.318678+0000","last_undegraded":"2024-09-13T06:30:40.318678+0000","last_fullsized":"2024-09-13T06:30:40.318678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.916216+0000","last_change":"2024-09-13T06:29:00.709791+0000","last_active":"2024-09-13T06:31:07.916216+0000","last_peered":"2024-09-13T06:31:07.916216+0000","last_clean":"2024-09-13T06:31:07.916216+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:31:07.916216+0000","last_undegraded":"2024-09-13T06:31:07.916216+0000","last_fullsized":"2024-09-13T06:31:07.916216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'1","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.489059+0000","last_change":"2024-09-13T06:28:58.725541+0000","last_active":"2024-09-13T06:31:05.489059+0000","last_peered":"2024-09-13T06:31:05.489059+0000","last_clean":"2024-09-13T06:31:05.489059+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:31:05.489059+0000","last_undegraded":"2024-09-13T06:31:05.489059+0000","last_fullsized":"2024-09-13T06:31:05.489059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495245+0000","last_change":"2024-09-13T06:29:00.707081+0000","last_active":"2024-09-13T06:31:30.495245+0000","last_peered":"2024-09-13T06:31:30.495245+0000","last_clean":"2024-09-13T06:31:30.495245+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:31:30.495245+0000","last_undegraded":"2024-09-13T06:31:30.495245+0000","last_fullsized":"2024-09-13T06:31:30.495245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566859+0000","last_change":"2024-09-13T06:28:58.721790+0000","last_active":"2024-09-13T06:30:39.566859+0000","last_peered":"2024-09-13T06:30:39.566859+0000","last_clean":"2024-09-13T06:30:39.566859+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:30:39.566859+0000","last_undegraded":"2024-09-13T06:30:39.566859+0000","last_fullsized":"2024-09-13T06:30:39.566859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:58.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905522+0000","last_change":"2024-09-13T06:29:00.707794+0000","last_active":"2024-09-13T06:30:39.905522+0000","last_peered":"2024-09-13T06:30:39.905522+0000","last_clean":"2024-09-13T06:30:39.905522+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:30:39.905522+0000","last_undegraded":"2024-09-13T06:30:39.905522+0000","last_fullsized":"2024-09-13T06:30:39.905522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572406+0000","last_change":"2024-09-13T06:28:58.707336+0000","last_active":"2024-09-13T06:30:39.572406+0000","last_peered":"2024-09-13T06:30:39.572406+0000","last_clean":"2024-09-13T06:30:39.572406+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:30:39.572406+0000","last_undegraded":"2024-09-13T06:30:39.572406+0000","last_fullsized":"2024-09-13T06:30:39.572406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121211+0000","last_change":"2024-09-13T06:29:00.731442+0000","last_active":"2024-09-13T06:32:14.121211+0000","last_peered":"2024-09-13T06:32:14.121211+0000","last_clean":"2024-09-13T06:32:14.121211+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:32:14.121211+0000","last_undegraded":"2024-09-13T06:32:14.121211+0000","last_fullsized":"2024-09-13T06:32:14.121211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573099+0000","last_change":"2024-09-13T06:28:58.734653+0000","last_active":"2024-09-13T06:30:39.573099+0000","last_peered":"2024-09-13T06:30:39.573099+0000","last_clean":"2024-09-13T06:30:39.573099+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:30:39.573099+0000","last_undegraded":"2024-09-13T06:30:39.573099+0000","last_fullsized":"2024-09-13T06:30:39.573099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.648254+0000","last_change":"2024-09-13T06:29:00.726885+0000","last_active":"2024-09-13T06:31:12.648254+0000","last_peered":"2024-09-13T06:31:12.648254+0000","last_clean":"2024-09-13T06:31:12.648254+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:31:12.648254+0000","last_undegraded":"2024-09-13T06:31:12.648254+0000","last_fullsized":"2024-09-13T06:31:12.648254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904763+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:30:39.904763+0000","last_peered":"2024-09-13T06:30:39.904763+0000","last_clean":"2024-09-13T06:30:39.904763+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:30:39.904763+0000","last_undegraded":"2024-09-13T06:30:39.904763+0000","last_fullsized":"2024-09-13T06:30:39.904763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.650812+0000","last_change":"2024-09-13T06:29:00.727067+0000","last_active":"2024-09-13T06:31:12.650812+0000","last_peered":"2024-09-13T06:31:12.650812+0000","last_clean":"2024-09-13T06:31:12.650812+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:31:12.650812+0000","last_undegraded":"2024-09-13T06:31:12.650812+0000","last_fullsized":"2024-09-13T06:31:12.650812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903907+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:30:39.903907+0000","last_peered":"2024-09-13T06:30:39.903907+0000","last_clean":"2024-09-13T06:30:39.903907+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:30:39.903907+0000","last_undegraded":"2024-09-13T06:30:39.903907+0000","last_fullsized":"2024-09-13T06:30:39.903907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.409976+0000","last_change":"2024-09-13T06:29:00.709914+0000","last_active":"2024-09-13T06:32:13.409976+0000","last_peered":"2024-09-13T06:32:13.409976+0000","last_clean":"2024-09-13T06:32:13.409976+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:32:13.409976+0000","last_undegraded":"2024-09-13T06:32:13.409976+0000","last_fullsized":"2024-09-13T06:32:13.409976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:37.375577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570878+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:13.570878+0000","last_peered":"2024-09-13T06:32:13.570878+0000","last_clean":"2024-09-13T06:32:13.570878+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:13.570878+0000","last_undegraded":"2024-09-13T06:32:13.570878+0000","last_fullsized":"2024-09-13T06:32:13.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321617+0000","last_change":"2024-09-13T06:28:58.730725+0000","last_active":"2024-09-13T06:30:40.321617+0000","last_peered":"2024-09-13T06:30:40.321617+0000","last_clean":"2024-09-13T06:30:40.321617+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:30:40.321617+0000","last_undegraded":"2024-09-13T06:30:40.321617+0000","last_fullsized":"2024-09-13T06:30:40.321617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.569961+0000","last_change":"2024-09-13T06:29:00.723386+0000","last_active":"2024-09-13T06:32:13.569961+0000","last_peered":"2024-09-13T06:32:13.569961+0000","last_clean":"2024-09-13T06:32:13.569961+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:32:13.569961+0000","last_undegraded":"2024-09-13T06:32:13.569961+0000","last_fullsized":"2024-09-13T06:32:13.569961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570235+0000","last_change":"2024-09-13T06:28:58.722377+0000","last_active":"2024-09-13T06:30:39.570235+0000","last_peered":"2024-09-13T06:30:39.570235+0000","last_clean":"2024-09-13T06:30:39.570235+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:30:39.570235+0000","last_undegraded":"2024-09-13T06:30:39.570235+0000","last_fullsized":"2024-09-13T06:30:39.570235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:18.147418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776857+0000","last_change":"2024-09-13T06:29:00.714209+0000","last_active":"2024-09-13T06:32:13.776857+0000","last_peered":"2024-09-13T06:32:13.776857+0000","last_clean":"2024-09-13T06:32:13.776857+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:32:13.776857+0000","last_undegraded":"2024-09-13T06:32:13.776857+0000","last_fullsized":"2024-09-13T06:32:13.776857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:33.364861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578134+0000","last_change":"2024-09-13T06:28:58.735019+0000","last_active":"2024-09-13T06:30:39.578134+0000","last_peered":"2024-09-13T06:30:39.578134+0000","last_clean":"2024-09-13T06:30:39.578134+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:30:39.578134+0000","last_undegraded":"2024-09-13T06:30:39.578134+0000","last_fullsized":"2024-09-13T06:30:39.578134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:38.804190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496657+0000","last_change":"2024-09-13T06:29:00.707042+0000","last_active":"2024-09-13T06:31:25.496657+0000","last_peered":"2024-09-13T06:31:25.496657+0000","last_clean":"2024-09-13T06:31:25.496657+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:31:25.496657+0000","last_undegraded":"2024-09-13T06:31:25.496657+0000","last_fullsized":"2024-09-13T06:31:25.496657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:22.300308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574705+0000","last_change":"2024-09-13T06:28:58.714709+0000","last_active":"2024-09-13T06:30:39.574705+0000","last_peered":"2024-09-13T06:30:39.574705+0000","last_clean":"2024-09-13T06:30:39.574705+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:30:39.574705+0000","last_undegraded":"2024-09-13T06:30:39.574705+0000","last_fullsized":"2024-09-13T06:30:39.574705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.663641+0000","last_change":"2024-09-13T06:29:00.706074+0000","last_active":"2024-09-13T06:31:12.663641+0000","last_peered":"2024-09-13T06:31:12.663641+0000","last_clean":"2024-09-13T06:31:12.663641+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:31:12.663641+0000","last_undegraded":"2024-09-13T06:31:12.663641+0000","last_fullsized":"2024-09-13T06:31:12.663641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:11.542286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905694+0000","last_change":"2024-09-13T06:28:58.710981+0000","last_active":"2024-09-13T06:30:39.905694+0000","last_peered":"2024-09-13T06:30:39.905694+0000","last_clean":"2024-09-13T06:30:39.905694+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:30:39.905694+0000","last_undegraded":"2024-09-13T06:30:39.905694+0000","last_fullsized":"2024-09-13T06:30:39.905694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889912+0000","last_change":"2024-09-13T06:29:00.726304+0000","last_active":"2024-09-13T06:32:13.889912+0000","last_peered":"2024-09-13T06:32:13.889912+0000","last_clean":"2024-09-13T06:32:13.889912+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:32:13.889912+0000","last_undegraded":"2024-09-13T06:32:13.889912+0000","last_fullsized":"2024-09-13T06:32:13.889912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:43.482408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904541+0000","last_change":"2024-09-13T06:28:58.725296+0000","last_active":"2024-09-13T06:30:39.904541+0000","last_peered":"2024-09-13T06:30:39.904541+0000","last_clean":"2024-09-13T06:30:39.904541+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:30:39.904541+0000","last_undegraded":"2024-09-13T06:30:39.904541+0000","last_fullsized":"2024-09-13T06:30:39.904541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.840079+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:13.840079+0000","last_peered":"2024-09-13T06:32:13.840079+0000","last_clean":"2024-09-13T06:32:13.840079+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:13.840079+0000","last_undegraded":"2024-09-13T06:32:13.840079+0000","last_fullsized":"2024-09-13T06:32:13.840079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:03.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888319+0000","last_change":"2024-09-13T06:29:00.723084+0000","last_active":"2024-09-13T06:32:13.888319+0000","last_peered":"2024-09-13T06:32:13.888319+0000","last_clean":"2024-09-13T06:32:13.888319+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:32:13.888319+0000","last_undegraded":"2024-09-13T06:32:13.888319+0000","last_fullsized":"2024-09-13T06:32:13.888319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905169+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:30:39.905169+0000","last_peered":"2024-09-13T06:30:39.905169+0000","last_clean":"2024-09-13T06:30:39.905169+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:30:39.905169+0000","last_undegraded":"2024-09-13T06:30:39.905169+0000","last_fullsized":"2024-09-13T06:30:39.905169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910459+0000","last_change":"2024-09-13T06:29:02.740336+0000","last_active":"2024-09-13T06:30:39.910459+0000","last_peered":"2024-09-13T06:30:39.910459+0000","last_clean":"2024-09-13T06:30:39.910459+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:30:39.910459+0000","last_undegraded":"2024-09-13T06:30:39.910459+0000","last_fullsized":"2024-09-13T06:30:39.910459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.250010+0000","last_change":"2024-09-13T06:29:04.756002+0000","last_active":"2024-09-13T06:31:10.250010+0000","last_peered":"2024-09-13T06:31:10.250010+0000","last_clean":"2024-09-13T06:31:10.250010+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:31:10.250010+0000","last_undegraded":"2024-09-13T06:31:10.250010+0000","last_fullsized":"2024-09-13T06:31:10.250010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:14.061458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578407+0000","last_change":"2024-09-13T06:29:06.774781+0000","last_active":"2024-09-13T06:30:39.578407+0000","last_peered":"2024-09-13T06:30:39.578407+0000","last_clean":"2024-09-13T06:30:39.578407+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:30:39.578407+0000","last_undegraded":"2024-09-13T06:30:39.578407+0000","last_fullsized":"2024-09-13T06:30:39.578407+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:56.034092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570612+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:30:39.570612+0000","last_peered":"2024-09-13T06:30:39.570612+0000","last_clean":"2024-09-13T06:30:39.570612+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:30:39.570612+0000","last_undegraded":"2024-09-13T06:30:39.570612+0000","last_fullsized":"2024-09-13T06:30:39.570612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:17.606468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.412627+0000","last_change":"2024-09-13T06:29:00.707011+0000","last_active":"2024-09-13T06:32:13.412627+0000","last_peered":"2024-09-13T06:32:13.412627+0000","last_clean":"2024-09-13T06:32:13.412627+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:32:13.412627+0000","last_undegraded":"2024-09-13T06:32:13.412627+0000","last_fullsized":"2024-09-13T06:32:13.412627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567903+0000","last_change":"2024-09-13T06:28:58.722224+0000","last_active":"2024-09-13T06:30:39.567903+0000","last_peered":"2024-09-13T06:30:39.567903+0000","last_clean":"2024-09-13T06:30:39.567903+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:30:39.567903+0000","last_undegraded":"2024-09-13T06:30:39.567903+0000","last_fullsized":"2024-09-13T06:30:39.567903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:01.378918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"24'1","reported_seq":222,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.763161+0000","last_change":"2024-09-13T06:29:02.717632+0000","last_active":"2024-09-13T06:31:11.763161+0000","last_peered":"2024-09-13T06:31:11.763161+0000","last_clean":"2024-09-13T06:31:11.763161+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:31:11.763161+0000","last_undegraded":"2024-09-13T06:31:11.763161+0000","last_fullsized":"2024-09-13T06:31:11.763161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319748+0000","last_change":"2024-09-13T06:29:04.739615+0000","last_active":"2024-09-13T06:30:40.319748+0000","last_peered":"2024-09-13T06:30:40.319748+0000","last_clean":"2024-09-13T06:30:40.319748+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:30:40.319748+0000","last_undegraded":"2024-09-13T06:30:40.319748+0000","last_fullsized":"2024-09-13T06:30:40.319748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:15.527728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573848+0000","last_change":"2024-09-13T06:29:06.774338+0000","last_active":"2024-09-13T06:30:39.573848+0000","last_peered":"2024-09-13T06:30:39.573848+0000","last_clean":"2024-09-13T06:30:39.573848+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:30:39.573848+0000","last_undegraded":"2024-09-13T06:30:39.573848+0000","last_fullsized":"2024-09-13T06:30:39.573848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:37.772201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903912+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:30:39.903912+0000","last_peered":"2024-09-13T06:30:39.903912+0000","last_clean":"2024-09-13T06:30:39.903912+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:30:39.903912+0000","last_undegraded":"2024-09-13T06:30:39.903912+0000","last_fullsized":"2024-09-13T06:30:39.903912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:11.691804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908288+0000","last_change":"2024-09-13T06:29:00.718205+0000","last_active":"2024-09-13T06:30:39.908288+0000","last_peered":"2024-09-13T06:30:39.908288+0000","last_clean":"2024-09-13T06:30:39.908288+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:30:39.908288+0000","last_undegraded":"2024-09-13T06:30:39.908288+0000","last_fullsized":"2024-09-13T06:30:39.908288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570600+0000","last_change":"2024-09-13T06:28:58.716607+0000","last_active":"2024-09-13T06:30:39.570600+0000","last_peered":"2024-09-13T06:30:39.570600+0000","last_clean":"2024-09-13T06:30:39.570600+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:30:39.570600+0000","last_undegraded":"2024-09-13T06:30:39.570600+0000","last_fullsized":"2024-09-13T06:30:39.570600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908756+0000","last_change":"2024-09-13T06:29:02.744274+0000","last_active":"2024-09-13T06:30:39.908756+0000","last_peered":"2024-09-13T06:30:39.908756+0000","last_clean":"2024-09-13T06:30:39.908756+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:30:39.908756+0000","last_undegraded":"2024-09-13T06:30:39.908756+0000","last_fullsized":"2024-09-13T06:30:39.908756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:14.111953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.918645+0000","last_change":"2024-09-13T06:29:04.723996+0000","last_active":"2024-09-13T06:31:07.918645+0000","last_peered":"2024-09-13T06:31:07.918645+0000","last_clean":"2024-09-13T06:31:07.918645+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:31:07.918645+0000","last_undegraded":"2024-09-13T06:31:07.918645+0000","last_fullsized":"2024-09-13T06:31:07.918645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:51.065801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.299299+0000","last_change":"2024-09-13T06:29:06.751269+0000","last_active":"2024-09-13T06:32:14.299299+0000","last_peered":"2024-09-13T06:32:14.299299+0000","last_clean":"2024-09-13T06:32:14.299299+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:32:14.299299+0000","last_undegraded":"2024-09-13T06:32:14.299299+0000","last_fullsized":"2024-09-13T06:32:14.299299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:53.815753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.125083+0000","last_change":"2024-09-13T06:29:08.762118+0000","last_active":"2024-09-13T06:32:14.125083+0000","last_peered":"2024-09-13T06:32:14.125083+0000","last_clean":"2024-09-13T06:32:14.125083+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:14.125083+0000","last_undegraded":"2024-09-13T06:32:14.125083+0000","last_fullsized":"2024-09-13T06:32:14.125083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.846533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910532+0000","last_change":"2024-09-13T06:29:00.733199+0000","last_active":"2024-09-13T06:30:39.910532+0000","last_peered":"2024-09-13T06:30:39.910532+0000","last_clean":"2024-09-13T06:30:39.910532+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:30:39.910532+0000","last_undegraded":"2024-09-13T06:30:39.910532+0000","last_fullsized":"2024-09-13T06:30:39.910532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570421+0000","last_change":"2024-09-13T06:28:58.715013+0000","last_active":"2024-09-13T06:30:39.570421+0000","last_peered":"2024-09-13T06:30:39.570421+0000","last_clean":"2024-09-13T06:30:39.570421+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:30:39.570421+0000","last_undegraded":"2024-09-13T06:30:39.570421+0000","last_fullsized":"2024-09-13T06:30:39.570421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:30.316190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575935+0000","last_change":"2024-09-13T06:29:02.715794+0000","last_active":"2024-09-13T06:30:39.575935+0000","last_peered":"2024-09-13T06:30:39.575935+0000","last_clean":"2024-09-13T06:30:39.575935+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:30:39.575935+0000","last_undegraded":"2024-09-13T06:30:39.575935+0000","last_fullsized":"2024-09-13T06:30:39.575935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:41.286736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.240501+0000","last_change":"2024-09-13T06:29:04.733210+0000","last_active":"2024-09-13T06:31:10.240501+0000","last_peered":"2024-09-13T06:31:10.240501+0000","last_clean":"2024-09-13T06:31:10.240501+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:31:10.240501+0000","last_undegraded":"2024-09-13T06:31:10.240501+0000","last_fullsized":"2024-09-13T06:31:10.240501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:44.479614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":406,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.973423+0000","last_change":"2024-09-13T06:29:06.768162+0000","last_active":"2024-09-13T06:32:13.973423+0000","last_peered":"2024-09-13T06:32:13.973423+0000","last_clean":"2024-09-13T06:32:13.973423+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:32:13.973423+0000","last_undegraded":"2024-09-13T06:32:13.973423+0000","last_fullsized":"2024-09-13T06:32:13.973423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:18.825186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965940+0000","last_change":"2024-09-13T06:29:39.532873+0000","last_active":"2024-09-13T06:32:13.965940+0000","last_peered":"2024-09-13T06:32:13.965940+0000","last_clean":"2024-09-13T06:32:13.965940+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:32:13.965940+0000","last_undegraded":"2024-09-13T06:32:13.965940+0000","last_fullsized":"2024-09-13T06:32:13.965940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:04.879833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'1","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493366+0000","last_change":"2024-09-13T06:28:58.715791+0000","last_active":"2024-09-13T06:31:14.493366+0000","last_peered":"2024-09-13T06:31:14.493366+0000","last_clean":"2024-09-13T06:31:14.493366+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:31:14.493366+0000","last_undegraded":"2024-09-13T06:31:14.493366+0000","last_fullsized":"2024-09-13T06:31:14.493366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:36.060034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318177+0000","last_change":"2024-09-13T06:29:02.732052+0000","last_active":"2024-09-13T06:30:40.318177+0000","last_peered":"2024-09-13T06:30:40.318177+0000","last_clean":"2024-09-13T06:30:40.318177+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:30:40.318177+0000","last_undegraded":"2024-09-13T06:30:40.318177+0000","last_fullsized":"2024-09-13T06:30:40.318177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'41","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493106+0000","last_change":"2024-09-13T06:29:04.731973+0000","last_active":"2024-09-13T06:31:14.493106+0000","last_peered":"2024-09-13T06:31:14.493106+0000","last_clean":"2024-09-13T06:31:14.493106+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:31:14.493106+0000","last_undegraded":"2024-09-13T06:31:14.493106+0000","last_fullsized":"2024-09-13T06:31:14.493106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:07.767226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316676+0000","last_change":"2024-09-13T06:29:06.747941+0000","last_active":"2024-09-13T06:30:40.316676+0000","last_peered":"2024-09-13T06:30:40.316676+0000","last_clean":"2024-09-13T06:30:40.316676+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:30:40.316676+0000","last_undegraded":"2024-09-13T06:30:40.316676+0000","last_fullsized":"2024-09-13T06:30:40.316676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:08.367030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568553+0000","last_change":"2024-09-13T06:29:08.791498+0000","last_active":"2024-09-13T06:30:39.568553+0000","last_peered":"2024-09-13T06:30:39.568553+0000","last_clean":"2024-09-13T06:30:39.568553+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:30:39.568553+0000","last_undegraded":"2024-09-13T06:30:39.568553+0000","last_fullsized":"2024-09-13T06:30:39.568553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:55.628851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'25","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908109+0000","last_change":"2024-09-13T06:29:00.726697+0000","last_active":"2024-09-13T06:32:13.908109+0000","last_peered":"2024-09-13T06:32:13.908109+0000","last_clean":"2024-09-13T06:32:13.908109+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:32:13.908109+0000","last_undegraded":"2024-09-13T06:32:13.908109+0000","last_fullsized":"2024-09-13T06:32:13.908109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.526443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493313+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:31:14.493313+0000","last_peered":"2024-09-13T06:31:14.493313+0000","last_clean":"2024-09-13T06:31:14.493313+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:31:14.493313+0000","last_undegraded":"2024-09-13T06:31:14.493313+0000","last_fullsized":"2024-09-13T06:31:14.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:12.552536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567535+0000","last_change":"2024-09-13T06:29:02.724597+0000","last_active":"2024-09-13T06:30:39.567535+0000","last_peered":"2024-09-13T06:30:39.567535+0000","last_clean":"2024-09-13T06:30:39.567535+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:30:39.567535+0000","last_undegraded":"2024-09-13T06:30:39.567535+0000","last_fullsized":"2024-09-13T06:30:39.567535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:30.887850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.219780+0000","last_change":"2024-09-13T06:29:04.754051+0000","last_active":"2024-09-13T06:31:10.219780+0000","last_peered":"2024-09-13T06:31:10.219780+0000","last_clean":"2024-09-13T06:31:10.219780+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:31:10.219780+0000","last_undegraded":"2024-09-13T06:31:10.219780+0000","last_fullsized":"2024-09-13T06:31:10.219780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:21.961022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907432+0000","last_change":"2024-09-13T06:29:06.762829+0000","last_active":"2024-09-13T06:30:39.907432+0000","last_peered":"2024-09-13T06:30:39.907432+0000","last_clean":"2024-09-13T06:30:39.907432+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:30:39.907432+0000","last_undegraded":"2024-09-13T06:30:39.907432+0000","last_fullsized":"2024-09-13T06:30:39.907432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:01.035464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317329+0000","last_change":"2024-09-13T06:29:08.766459+0000","last_active":"2024-09-13T06:30:40.317329+0000","last_peered":"2024-09-13T06:30:40.317329+0000","last_clean":"2024-09-13T06:30:40.317329+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:30:40.317329+0000","last_undegraded":"2024-09-13T06:30:40.317329+0000","last_fullsized":"2024-09-13T06:30:40.317329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:15.266692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.913863+0000","last_change":"2024-09-13T06:29:00.717664+0000","last_active":"2024-09-13T06:31:07.913863+0000","last_peered":"2024-09-13T06:31:07.913863+0000","last_clean":"2024-09-13T06:31:07.913863+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:31:07.913863+0000","last_undegraded":"2024-09-13T06:31:07.913863+0000","last_fullsized":"2024-09-13T06:31:07.913863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:51.974933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576427+0000","last_change":"2024-09-13T06:28:58.734667+0000","last_active":"2024-09-13T06:30:39.576427+0000","last_peered":"2024-09-13T06:30:39.576427+0000","last_clean":"2024-09-13T06:30:39.576427+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:30:39.576427+0000","last_undegraded":"2024-09-13T06:30:39.576427+0000","last_fullsized":"2024-09-13T06:30:39.576427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:44.299300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567032+0000","last_change":"2024-09-13T06:29:02.722214+0000","last_active":"2024-09-13T06:30:39.567032+0000","last_peered":"2024-09-13T06:30:39.567032+0000","last_clean":"2024-09-13T06:30:39.567032+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:30:39.567032+0000","last_undegraded":"2024-09-13T06:30:39.567032+0000","last_fullsized":"2024-09-13T06:30:39.567032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:53.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.263596+0000","last_change":"2024-09-13T06:29:04.732118+0000","last_active":"2024-09-13T06:31:10.263596+0000","last_peered":"2024-09-13T06:31:10.263596+0000","last_clean":"2024-09-13T06:31:10.263596+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:31:10.263596+0000","last_undegraded":"2024-09-13T06:31:10.263596+0000","last_fullsized":"2024-09-13T06:31:10.263596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:17.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":353,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.332565+0000","last_change":"2024-09-13T06:29:06.772585+0000","last_active":"2024-09-13T06:32:14.332565+0000","last_peered":"2024-09-13T06:32:14.332565+0000","last_clean":"2024-09-13T06:32:14.332565+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:14.332565+0000","last_undegraded":"2024-09-13T06:32:14.332565+0000","last_fullsized":"2024-09-13T06:32:14.332565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:31.824682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319032+0000","last_change":"2024-09-13T06:29:08.777939+0000","last_active":"2024-09-13T06:30:40.319032+0000","last_peered":"2024-09-13T06:30:40.319032+0000","last_clean":"2024-09-13T06:30:40.319032+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:30:40.319032+0000","last_undegraded":"2024-09-13T06:30:40.319032+0000","last_fullsized":"2024-09-13T06:30:40.319032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:59.485064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965033+0000","last_change":"2024-09-13T06:29:00.718738+0000","last_active":"2024-09-13T06:32:13.965033+0000","last_peered":"2024-09-13T06:32:13.965033+0000","last_clean":"2024-09-13T06:32:13.965033+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:32:13.965033+0000","last_undegraded":"2024-09-13T06:32:13.965033+0000","last_fullsized":"2024-09-13T06:32:13.965033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:39:59.890086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'3","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493208+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:31:14.493208+0000","last_peered":"2024-09-13T06:31:14.493208+0000","last_clean":"2024-09-13T06:31:14.493208+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:31:14.493208+0000","last_undegraded":"2024-09-13T06:31:14.493208+0000","last_fullsized":"2024-09-13T06:31:14.493208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.897247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567233+0000","last_change":"2024-09-13T06:29:02.741159+0000","last_active":"2024-09-13T06:30:39.567233+0000","last_peered":"2024-09-13T06:30:39.567233+0000","last_clean":"2024-09-13T06:30:39.567233+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:30:39.567233+0000","last_undegraded":"2024-09-13T06:30:39.567233+0000","last_fullsized":"2024-09-13T06:30:39.567233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:49.008324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'55","reported_seq":115,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.490705+0000","last_change":"2024-09-13T06:29:04.748682+0000","last_active":"2024-09-13T06:31:15.490705+0000","last_peered":"2024-09-13T06:31:15.490705+0000","last_clean":"2024-09-13T06:31:15.490705+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:31:15.490705+0000","last_undegraded":"2024-09-13T06:31:15.490705+0000","last_fullsized":"2024-09-13T06:31:15.490705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:57:59.868813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567773+0000","last_change":"2024-09-13T06:29:06.761508+0000","last_active":"2024-09-13T06:30:39.567773+0000","last_peered":"2024-09-13T06:30:39.567773+0000","last_clean":"2024-09-13T06:30:39.567773+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:30:39.567773+0000","last_undegraded":"2024-09-13T06:30:39.567773+0000","last_fullsized":"2024-09-13T06:30:39.567773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:26.451521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.257072+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:14.257072+0000","last_peered":"2024-09-13T06:32:14.257072+0000","last_clean":"2024-09-13T06:32:14.257072+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:14.257072+0000","last_undegraded":"2024-09-13T06:32:14.257072+0000","last_fullsized":"2024-09-13T06:32:14.257072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:13.465995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.915876+0000","last_change":"2024-09-13T06:29:00.728932+0000","last_active":"2024-09-13T06:31:07.915876+0000","last_peered":"2024-09-13T06:31:07.915876+0000","last_clean":"2024-09-13T06:31:07.915876+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:31:07.915876+0000","last_undegraded":"2024-09-13T06:31:07.915876+0000","last_fullsized":"2024-09-13T06:31:07.915876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:17.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904865+0000","last_change":"2024-09-13T06:28:58.719722+0000","last_active":"2024-09-13T06:30:39.904865+0000","last_peered":"2024-09-13T06:30:39.904865+0000","last_clean":"2024-09-13T06:30:39.904865+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:30:39.904865+0000","last_undegraded":"2024-09-13T06:30:39.904865+0000","last_fullsized":"2024-09-13T06:30:39.904865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569358+0000","last_change":"2024-09-13T06:29:02.713294+0000","last_active":"2024-09-13T06:30:39.569358+0000","last_peered":"2024-09-13T06:30:39.569358+0000","last_clean":"2024-09-13T06:30:39.569358+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:30:39.569358+0000","last_undegraded":"2024-09-13T06:30:39.569358+0000","last_fullsized":"2024-09-13T06:30:39.569358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:48.621894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.228501+0000","last_change":"2024-09-13T06:29:04.731052+0000","last_active":"2024-09-13T06:31:10.228501+0000","last_peered":"2024-09-13T06:31:10.228501+0000","last_clean":"2024-09-13T06:31:10.228501+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:31:10.228501+0000","last_undegraded":"2024-09-13T06:31:10.228501+0000","last_fullsized":"2024-09-13T06:31:10.228501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:15.859442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907352+0000","last_change":"2024-09-13T06:29:06.772900+0000","last_active":"2024-09-13T06:30:39.907352+0000","last_peered":"2024-09-13T06:30:39.907352+0000","last_clean":"2024-09-13T06:30:39.907352+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:30:39.907352+0000","last_undegraded":"2024-09-13T06:30:39.907352+0000","last_fullsized":"2024-09-13T06:30:39.907352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:13.253864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489704+0000","last_change":"2024-09-13T06:29:08.785484+0000","last_active":"2024-09-13T06:31:10.489704+0000","last_peered":"2024-09-13T06:31:10.489704+0000","last_clean":"2024-09-13T06:31:10.489704+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:31:10.489704+0000","last_undegraded":"2024-09-13T06:31:10.489704+0000","last_fullsized":"2024-09-13T06:31:10.489704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.070123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.665886+0000","last_change":"2024-09-13T06:29:00.714668+0000","last_active":"2024-09-13T06:31:12.665886+0000","last_peered":"2024-09-13T06:31:12.665886+0000","last_clean":"2024-09-13T06:31:12.665886+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:31:12.665886+0000","last_undegraded":"2024-09-13T06:31:12.665886+0000","last_fullsized":"2024-09-13T06:31:12.665886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572293+0000","last_change":"2024-09-13T06:28:58.716633+0000","last_active":"2024-09-13T06:30:39.572293+0000","last_peered":"2024-09-13T06:30:39.572293+0000","last_clean":"2024-09-13T06:30:39.572293+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:30:39.572293+0000","last_undegraded":"2024-09-13T06:30:39.572293+0000","last_fullsized":"2024-09-13T06:30:39.572293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316839+0000","last_change":"2024-09-13T06:29:02.730107+0000","last_active":"2024-09-13T06:30:40.316839+0000","last_peered":"2024-09-13T06:30:40.316839+0000","last_clean":"2024-09-13T06:30:40.316839+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:30:40.316839+0000","last_undegraded":"2024-09-13T06:30:40.316839+0000","last_fullsized":"2024-09-13T06:30:40.316839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:11.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.277436+0000","last_change":"2024-09-13T06:29:04.746327+0000","last_active":"2024-09-13T06:31:10.277436+0000","last_peered":"2024-09-13T06:31:10.277436+0000","last_clean":"2024-09-13T06:31:10.277436+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:31:10.277436+0000","last_undegraded":"2024-09-13T06:31:10.277436+0000","last_fullsized":"2024-09-13T06:31:10.277436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:05.773239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":408,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.267708+0000","last_change":"2024-09-13T06:29:06.761923+0000","last_active":"2024-09-13T06:32:14.267708+0000","last_peered":"2024-09-13T06:32:14.267708+0000","last_clean":"2024-09-13T06:32:14.267708+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:14.267708+0000","last_undegraded":"2024-09-13T06:32:14.267708+0000","last_fullsized":"2024-09-13T06:32:14.267708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:01.791112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.911859+0000","last_change":"2024-09-13T06:29:08.773016+0000","last_active":"2024-09-13T06:32:13.911859+0000","last_peered":"2024-09-13T06:32:13.911859+0000","last_clean":"2024-09-13T06:32:13.911859+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:32:13.911859+0000","last_undegraded":"2024-09-13T06:32:13.911859+0000","last_fullsized":"2024-09-13T06:32:13.911859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:10.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984706+0000","last_change":"2024-09-13T06:29:00.705902+0000","last_active":"2024-09-13T06:32:13.984706+0000","last_peered":"2024-09-13T06:32:13.984706+0000","last_clean":"2024-09-13T06:32:13.984706+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:32:13.984706+0000","last_undegraded":"2024-09-13T06:32:13.984706+0000","last_fullsized":"2024-09-13T06:32:13.984706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:13.530929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.744249+0000","last_change":"2024-09-13T06:28:58.720215+0000","last_active":"2024-09-13T06:32:13.744249+0000","last_peered":"2024-09-13T06:32:13.744249+0000","last_clean":"2024-09-13T06:32:13.744249+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:32:13.744249+0000","last_undegraded":"2024-09-13T06:32:13.744249+0000","last_fullsized":"2024-09-13T06:32:13.744249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.763219+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:31:11.763219+0000","last_peered":"2024-09-13T06:31:11.763219+0000","last_clean":"2024-09-13T06:31:11.763219+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:31:11.763219+0000","last_undegraded":"2024-09-13T06:31:11.763219+0000","last_fullsized":"2024-09-13T06:31:11.763219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:18.248897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910468+0000","last_change":"2024-09-13T06:29:04.749190+0000","last_active":"2024-09-13T06:30:39.910468+0000","last_peered":"2024-09-13T06:30:39.910468+0000","last_clean":"2024-09-13T06:30:39.910468+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:30:39.910468+0000","last_undegraded":"2024-09-13T06:30:39.910468+0000","last_fullsized":"2024-09-13T06:30:39.910468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:38.367590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":470,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.131279+0000","last_change":"2024-09-13T06:29:06.751363+0000","last_active":"2024-09-13T06:32:14.131279+0000","last_peered":"2024-09-13T06:32:14.131279+0000","last_clean":"2024-09-13T06:32:14.131279+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:32:14.131279+0000","last_undegraded":"2024-09-13T06:32:14.131279+0000","last_fullsized":"2024-09-13T06:32:14.131279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:20.636655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.114868+0000","last_change":"2024-09-13T06:29:08.792692+0000","last_active":"2024-09-13T06:31:12.114868+0000","last_peered":"2024-09-13T06:31:12.114868+0000","last_clean":"2024-09-13T06:31:12.114868+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:31:12.114868+0000","last_undegraded":"2024-09-13T06:31:12.114868+0000","last_fullsized":"2024-09-13T06:31:12.114868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:44.557550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494543+0000","last_change":"2024-09-13T06:29:00.731625+0000","last_active":"2024-09-13T06:31:15.494543+0000","last_peered":"2024-09-13T06:31:15.494543+0000","last_clean":"2024-09-13T06:31:15.494543+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:31:15.494543+0000","last_undegraded":"2024-09-13T06:31:15.494543+0000","last_fullsized":"2024-09-13T06:31:15.494543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.152230+0000","last_change":"2024-09-13T06:28:58.719501+0000","last_active":"2024-09-13T06:32:13.152230+0000","last_peered":"2024-09-13T06:32:13.152230+0000","last_clean":"2024-09-13T06:32:13.152230+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:32:13.152230+0000","last_undegraded":"2024-09-13T06:32:13.152230+0000","last_fullsized":"2024-09-13T06:32:13.152230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:07:21.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908571+0000","last_change":"2024-09-13T06:29:02.721649+0000","last_active":"2024-09-13T06:30:39.908571+0000","last_peered":"2024-09-13T06:30:39.908571+0000","last_clean":"2024-09-13T06:30:39.908571+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:30:39.908571+0000","last_undegraded":"2024-09-13T06:30:39.908571+0000","last_fullsized":"2024-09-13T06:30:39.908571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:42.633548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.252844+0000","last_change":"2024-09-13T06:29:04.736682+0000","last_active":"2024-09-13T06:31:10.252844+0000","last_peered":"2024-09-13T06:31:10.252844+0000","last_clean":"2024-09-13T06:31:10.252844+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:31:10.252844+0000","last_undegraded":"2024-09-13T06:31:10.252844+0000","last_fullsized":"2024-09-13T06:31:10.252844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:59.443857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575252+0000","last_change":"2024-09-13T06:29:06.765942+0000","last_active":"2024-09-13T06:30:39.575252+0000","last_peered":"2024-09-13T06:30:39.575252+0000","last_clean":"2024-09-13T06:30:39.575252+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:30:39.575252+0000","last_undegraded":"2024-09-13T06:30:39.575252+0000","last_fullsized":"2024-09-13T06:30:39.575252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:40.247898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.062083+0000","last_change":"2024-09-13T06:29:08.765210+0000","last_active":"2024-09-13T06:32:14.062083+0000","last_peered":"2024-09-13T06:32:14.062083+0000","last_clean":"2024-09-13T06:32:14.062083+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:32:14.062083+0000","last_undegraded":"2024-09-13T06:32:14.062083+0000","last_fullsized":"2024-09-13T06:32:14.062083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:19.888668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889442+0000","last_change":"2024-09-13T06:29:00.723363+0000","last_active":"2024-09-13T06:32:13.889442+0000","last_peered":"2024-09-13T06:32:13.889442+0000","last_clean":"2024-09-13T06:32:13.889442+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:32:13.889442+0000","last_undegraded":"2024-09-13T06:32:13.889442+0000","last_fullsized":"2024-09-13T06:32:13.889442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:19:56.144098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.314554+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:30:40.314554+0000","last_peered":"2024-09-13T06:30:40.314554+0000","last_clean":"2024-09-13T06:30:40.314554+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:30:40.314554+0000","last_undegraded":"2024-09-13T06:30:40.314554+0000","last_fullsized":"2024-09-13T06:30:40.314554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:19.132984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572517+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:30:39.572517+0000","last_peered":"2024-09-13T06:30:39.572517+0000","last_clean":"2024-09-13T06:30:39.572517+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:30:39.572517+0000","last_undegraded":"2024-09-13T06:30:39.572517+0000","last_fullsized":"2024-09-13T06:30:39.572517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.927955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.893869+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:31:07.893869+0000","last_peered":"2024-09-13T06:31:07.893869+0000","last_clean":"2024-09-13T06:31:07.893869+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:31:07.893869+0000","last_undegraded":"2024-09-13T06:31:07.893869+0000","last_fullsized":"2024-09-13T06:31:07.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317017+0000","last_change":"2024-09-13T06:29:02.723791+0000","last_active":"2024-09-13T06:30:40.317017+0000","last_peered":"2024-09-13T06:30:40.317017+0000","last_clean":"2024-09-13T06:30:40.317017+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:30:40.317017+0000","last_undegraded":"2024-09-13T06:30:40.317017+0000","last_fullsized":"2024-09-13T06:30:40.317017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":149,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.275042+0000","last_change":"2024-09-13T06:29:04.750793+0000","last_active":"2024-09-13T06:31:10.275042+0000","last_peered":"2024-09-13T06:31:10.275042+0000","last_clean":"2024-09-13T06:31:10.275042+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:31:10.275042+0000","last_undegraded":"2024-09-13T06:31:10.275042+0000","last_fullsized":"2024-09-13T06:31:10.275042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:10:59.019066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.906152+0000","last_change":"2024-09-13T06:29:06.774102+0000","last_active":"2024-09-13T06:30:39.906152+0000","last_peered":"2024-09-13T06:30:39.906152+0000","last_clean":"2024-09-13T06:30:39.906152+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:30:39.906152+0000","last_undegraded":"2024-09-13T06:30:39.906152+0000","last_fullsized":"2024-09-13T06:30:39.906152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:32.602209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.993878+0000","last_change":"2024-09-13T06:29:08.791090+0000","last_active":"2024-09-13T06:32:13.993878+0000","last_peered":"2024-09-13T06:32:13.993878+0000","last_clean":"2024-09-13T06:32:13.993878+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:32:13.993878+0000","last_undegraded":"2024-09-13T06:32:13.993878+0000","last_fullsized":"2024-09-13T06:32:13.993878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:33.250567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908198+0000","last_change":"2024-09-13T06:29:00.724256+0000","last_active":"2024-09-13T06:30:39.908198+0000","last_peered":"2024-09-13T06:30:39.908198+0000","last_clean":"2024-09-13T06:30:39.908198+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:30:39.908198+0000","last_undegraded":"2024-09-13T06:30:39.908198+0000","last_fullsized":"2024-09-13T06:30:39.908198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571368+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:30:39.571368+0000","last_peered":"2024-09-13T06:30:39.571368+0000","last_clean":"2024-09-13T06:30:39.571368+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:30:39.571368+0000","last_undegraded":"2024-09-13T06:30:39.571368+0000","last_fullsized":"2024-09-13T06:30:39.571368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:55.462615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318457+0000","last_change":"2024-09-13T06:28:58.711388+0000","last_active":"2024-09-13T06:30:40.318457+0000","last_peered":"2024-09-13T06:30:40.318457+0000","last_clean":"2024-09-13T06:30:40.318457+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:30:40.318457+0000","last_undegraded":"2024-09-13T06:30:40.318457+0000","last_fullsized":"2024-09-13T06:30:40.318457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576408+0000","last_change":"2024-09-13T06:29:02.739238+0000","last_active":"2024-09-13T06:30:39.576408+0000","last_peered":"2024-09-13T06:30:39.576408+0000","last_clean":"2024-09-13T06:30:39.576408+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:30:39.576408+0000","last_undegraded":"2024-09-13T06:30:39.576408+0000","last_fullsized":"2024-09-13T06:30:39.576408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:36.820291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'273","reported_seq":481,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977862+0000","last_change":"2024-09-13T06:29:04.740633+0000","last_active":"2024-09-13T06:32:12.977862+0000","last_peered":"2024-09-13T06:32:12.977862+0000","last_clean":"2024-09-13T06:32:12.977862+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:32:12.977862+0000","last_undegraded":"2024-09-13T06:32:12.977862+0000","last_fullsized":"2024-09-13T06:32:12.977862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:21.488854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905987+0000","last_change":"2024-09-13T06:29:06.768289+0000","last_active":"2024-09-13T06:30:39.905987+0000","last_peered":"2024-09-13T06:30:39.905987+0000","last_clean":"2024-09-13T06:30:39.905987+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:30:39.905987+0000","last_undegraded":"2024-09-13T06:30:39.905987+0000","last_fullsized":"2024-09-13T06:30:39.905987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.453168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.657752+0000","last_change":"2024-09-13T06:29:08.785933+0000","last_active":"2024-09-13T06:31:12.657752+0000","last_peered":"2024-09-13T06:31:12.657752+0000","last_clean":"2024-09-13T06:31:12.657752+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:31:12.657752+0000","last_undegraded":"2024-09-13T06:31:12.657752+0000","last_fullsized":"2024-09-13T06:31:12.657752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:34.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965135+0000","last_change":"2024-09-13T06:29:00.726943+0000","last_active":"2024-09-13T06:32:13.965135+0000","last_peered":"2024-09-13T06:32:13.965135+0000","last_clean":"2024-09-13T06:32:13.965135+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:32:13.965135+0000","last_undegraded":"2024-09-13T06:32:13.965135+0000","last_fullsized":"2024-09-13T06:32:13.965135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567910+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:30:39.567910+0000","last_peered":"2024-09-13T06:30:39.567910+0000","last_clean":"2024-09-13T06:30:39.567910+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:30:39.567910+0000","last_undegraded":"2024-09-13T06:30:39.567910+0000","last_fullsized":"2024-09-13T06:30:39.567910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:05.399184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315650+0000","last_change":"2024-09-13T06:28:58.710601+0000","last_active":"2024-09-13T06:30:40.315650+0000","last_peered":"2024-09-13T06:30:40.315650+0000","last_clean":"2024-09-13T06:30:40.315650+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:30:40.315650+0000","last_undegraded":"2024-09-13T06:30:40.315650+0000","last_fullsized":"2024-09-13T06:30:40.315650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:06.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570571+0000","last_change":"2024-09-13T06:29:02.715757+0000","last_active":"2024-09-13T06:30:39.570571+0000","last_peered":"2024-09-13T06:30:39.570571+0000","last_clean":"2024-09-13T06:30:39.570571+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:30:39.570571+0000","last_undegraded":"2024-09-13T06:30:39.570571+0000","last_fullsized":"2024-09-13T06:30:39.570571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:41.827034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977483+0000","last_change":"2024-09-13T06:29:04.730506+0000","last_active":"2024-09-13T06:32:12.977483+0000","last_peered":"2024-09-13T06:32:12.977483+0000","last_clean":"2024-09-13T06:32:12.977483+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:12.977483+0000","last_undegraded":"2024-09-13T06:32:12.977483+0000","last_fullsized":"2024-09-13T06:32:12.977483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:06.934896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317336+0000","last_change":"2024-09-13T06:29:06.766201+0000","last_active":"2024-09-13T06:30:40.317336+0000","last_peered":"2024-09-13T06:30:40.317336+0000","last_clean":"2024-09-13T06:30:40.317336+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:30:40.317336+0000","last_undegraded":"2024-09-13T06:30:40.317336+0000","last_fullsized":"2024-09-13T06:30:40.317336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:14.063090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907100+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:30:39.907100+0000","last_peered":"2024-09-13T06:30:39.907100+0000","last_clean":"2024-09-13T06:30:39.907100+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:30:39.907100+0000","last_undegraded":"2024-09-13T06:30:39.907100+0000","last_fullsized":"2024-09-13T06:30:39.907100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:16.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.414514+0000","last_change":"2024-09-13T06:29:00.721955+0000","last_active":"2024-09-13T06:32:13.414514+0000","last_peered":"2024-09-13T06:32:13.414514+0000","last_clean":"2024-09-13T06:32:13.414514+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:32:13.414514+0000","last_undegraded":"2024-09-13T06:32:13.414514+0000","last_fullsized":"2024-09-13T06:32:13.414514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572122+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:30:39.572122+0000","last_peered":"2024-09-13T06:30:39.572122+0000","last_clean":"2024-09-13T06:30:39.572122+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:30:39.572122+0000","last_undegraded":"2024-09-13T06:30:39.572122+0000","last_fullsized":"2024-09-13T06:30:39.572122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:57.119174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572256+0000","last_change":"2024-09-13T06:28:58.714825+0000","last_active":"2024-09-13T06:30:39.572256+0000","last_peered":"2024-09-13T06:30:39.572256+0000","last_clean":"2024-09-13T06:30:39.572256+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:30:39.572256+0000","last_undegraded":"2024-09-13T06:30:39.572256+0000","last_fullsized":"2024-09-13T06:30:39.572256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319184+0000","last_change":"2024-09-13T06:29:02.726548+0000","last_active":"2024-09-13T06:30:40.319184+0000","last_peered":"2024-09-13T06:30:40.319184+0000","last_clean":"2024-09-13T06:30:40.319184+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:30:40.319184+0000","last_undegraded":"2024-09-13T06:30:40.319184+0000","last_fullsized":"2024-09-13T06:30:40.319184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.698111+0000","last_change":"2024-09-13T06:29:04.753220+0000","last_active":"2024-09-13T06:32:12.698111+0000","last_peered":"2024-09-13T06:32:12.698111+0000","last_clean":"2024-09-13T06:32:12.698111+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:32:12.698111+0000","last_undegraded":"2024-09-13T06:32:12.698111+0000","last_fullsized":"2024-09-13T06:32:12.698111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:23.310355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907445+0000","last_change":"2024-09-13T06:29:06.776644+0000","last_active":"2024-09-13T06:30:39.907445+0000","last_peered":"2024-09-13T06:30:39.907445+0000","last_clean":"2024-09-13T06:30:39.907445+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:30:39.907445+0000","last_undegraded":"2024-09-13T06:30:39.907445+0000","last_fullsized":"2024-09-13T06:30:39.907445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:07.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.916234+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:12.916234+0000","last_peered":"2024-09-13T06:32:12.916234+0000","last_clean":"2024-09-13T06:32:12.916234+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:12.916234+0000","last_undegraded":"2024-09-13T06:32:12.916234+0000","last_fullsized":"2024-09-13T06:32:12.916234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:03.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965048+0000","last_change":"2024-09-13T06:29:00.729564+0000","last_active":"2024-09-13T06:32:13.965048+0000","last_peered":"2024-09-13T06:32:13.965048+0000","last_clean":"2024-09-13T06:32:13.965048+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:32:13.965048+0000","last_undegraded":"2024-09-13T06:32:13.965048+0000","last_fullsized":"2024-09-13T06:32:13.965048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:03.871675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576292+0000","last_change":"2024-09-13T06:28:58.734084+0000","last_active":"2024-09-13T06:30:39.576292+0000","last_peered":"2024-09-13T06:30:39.576292+0000","last_clean":"2024-09-13T06:30:39.576292+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:30:39.576292+0000","last_undegraded":"2024-09-13T06:30:39.576292+0000","last_fullsized":"2024-09-13T06:30:39.576292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:04.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317623+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:30:40.317623+0000","last_peered":"2024-09-13T06:30:40.317623+0000","last_clean":"2024-09-13T06:30:40.317623+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:30:40.317623+0000","last_undegraded":"2024-09-13T06:30:40.317623+0000","last_fullsized":"2024-09-13T06:30:40.317623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:03.965231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492649+0000","last_change":"2024-09-13T06:29:02.741057+0000","last_active":"2024-09-13T06:31:10.492649+0000","last_peered":"2024-09-13T06:31:10.492649+0000","last_clean":"2024-09-13T06:31:10.492649+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:31:10.492649+0000","last_undegraded":"2024-09-13T06:31:10.492649+0000","last_fullsized":"2024-09-13T06:31:10.492649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:19.872981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.275964+0000","last_change":"2024-09-13T06:29:04.747105+0000","last_active":"2024-09-13T06:31:10.275964+0000","last_peered":"2024-09-13T06:31:10.275964+0000","last_clean":"2024-09-13T06:31:10.275964+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:31:10.275964+0000","last_undegraded":"2024-09-13T06:31:10.275964+0000","last_fullsized":"2024-09-13T06:31:10.275964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:20.114697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571995+0000","last_change":"2024-09-13T06:29:06.756361+0000","last_active":"2024-09-13T06:30:39.571995+0000","last_peered":"2024-09-13T06:30:39.571995+0000","last_clean":"2024-09-13T06:30:39.571995+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:30:39.571995+0000","last_undegraded":"2024-09-13T06:30:39.571995+0000","last_fullsized":"2024-09-13T06:30:39.571995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:29.424661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.495367+0000","last_change":"2024-09-13T06:29:08.775523+0000","last_active":"2024-09-13T06:31:12.495367+0000","last_peered":"2024-09-13T06:31:12.495367+0000","last_clean":"2024-09-13T06:31:12.495367+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:31:12.495367+0000","last_undegraded":"2024-09-13T06:31:12.495367+0000","last_fullsized":"2024-09-13T06:31:12.495367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:26.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317034+0000","last_change":"2024-09-13T06:29:00.726613+0000","last_active":"2024-09-13T06:30:40.317034+0000","last_peered":"2024-09-13T06:30:40.317034+0000","last_clean":"2024-09-13T06:30:40.317034+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:30:40.317034+0000","last_undegraded":"2024-09-13T06:30:40.317034+0000","last_fullsized":"2024-09-13T06:30:40.317034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:24.356329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318422+0000","last_change":"2024-09-13T06:28:58.709334+0000","last_active":"2024-09-13T06:30:40.318422+0000","last_peered":"2024-09-13T06:30:40.318422+0000","last_clean":"2024-09-13T06:30:40.318422+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:30:40.318422+0000","last_undegraded":"2024-09-13T06:30:40.318422+0000","last_fullsized":"2024-09-13T06:30:40.318422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576205+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:30:39.576205+0000","last_peered":"2024-09-13T06:30:39.576205+0000","last_clean":"2024-09-13T06:30:39.576205+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:30:39.576205+0000","last_undegraded":"2024-09-13T06:30:39.576205+0000","last_fullsized":"2024-09-13T06:30:39.576205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:39:32.946230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571971+0000","last_change":"2024-09-13T06:29:02.747586+0000","last_active":"2024-09-13T06:30:39.571971+0000","last_peered":"2024-09-13T06:30:39.571971+0000","last_clean":"2024-09-13T06:30:39.571971+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:30:39.571971+0000","last_undegraded":"2024-09-13T06:30:39.571971+0000","last_fullsized":"2024-09-13T06:30:39.571971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:52.363598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318311+0000","last_change":"2024-09-13T06:29:04.747057+0000","last_active":"2024-09-13T06:30:40.318311+0000","last_peered":"2024-09-13T06:30:40.318311+0000","last_clean":"2024-09-13T06:30:40.318311+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:30:40.318311+0000","last_undegraded":"2024-09-13T06:30:40.318311+0000","last_fullsized":"2024-09-13T06:30:40.318311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:43.295549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977817+0000","last_change":"2024-09-13T06:29:06.772300+0000","last_active":"2024-09-13T06:32:12.977817+0000","last_peered":"2024-09-13T06:32:12.977817+0000","last_clean":"2024-09-13T06:32:12.977817+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:12.977817+0000","last_undegraded":"2024-09-13T06:32:12.977817+0000","last_fullsized":"2024-09-13T06:32:12.977817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:40.383988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907997+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:30:39.907997+0000","last_peered":"2024-09-13T06:30:39.907997+0000","last_clean":"2024-09-13T06:30:39.907997+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:30:39.907997+0000","last_undegraded":"2024-09-13T06:30:39.907997+0000","last_fullsized":"2024-09-13T06:30:39.907997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964847+0000","last_change":"2024-09-13T06:29:00.723308+0000","last_active":"2024-09-13T06:32:13.964847+0000","last_peered":"2024-09-13T06:32:13.964847+0000","last_clean":"2024-09-13T06:32:13.964847+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:32:13.964847+0000","last_undegraded":"2024-09-13T06:32:13.964847+0000","last_fullsized":"2024-09-13T06:32:13.964847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.313741+0000","last_change":"2024-09-13T06:28:58.724803+0000","last_active":"2024-09-13T06:32:13.313741+0000","last_peered":"2024-09-13T06:32:13.313741+0000","last_clean":"2024-09-13T06:32:13.313741+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:32:13.313741+0000","last_undegraded":"2024-09-13T06:32:13.313741+0000","last_fullsized":"2024-09-13T06:32:13.313741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318345+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:30:40.318345+0000","last_peered":"2024-09-13T06:30:40.318345+0000","last_clean":"2024-09-13T06:30:40.318345+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:30:40.318345+0000","last_undegraded":"2024-09-13T06:30:40.318345+0000","last_fullsized":"2024-09-13T06:30:40.318345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:58.129743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571648+0000","last_change":"2024-09-13T06:29:02.716108+0000","last_active":"2024-09-13T06:30:39.571648+0000","last_peered":"2024-09-13T06:30:39.571648+0000","last_clean":"2024-09-13T06:30:39.571648+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:30:39.571648+0000","last_undegraded":"2024-09-13T06:30:39.571648+0000","last_fullsized":"2024-09-13T06:30:39.571648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:34.365503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'12","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489787+0000","last_change":"2024-09-13T06:29:04.749361+0000","last_active":"2024-09-13T06:31:10.489787+0000","last_peered":"2024-09-13T06:31:10.489787+0000","last_clean":"2024-09-13T06:31:10.489787+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:31:10.489787+0000","last_undegraded":"2024-09-13T06:31:10.489787+0000","last_fullsized":"2024-09-13T06:31:10.489787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:35:45.201511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":434,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.258705+0000","last_change":"2024-09-13T06:29:06.773446+0000","last_active":"2024-09-13T06:32:14.258705+0000","last_peered":"2024-09-13T06:32:14.258705+0000","last_clean":"2024-09-13T06:32:14.258705+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:32:14.258705+0000","last_undegraded":"2024-09-13T06:32:14.258705+0000","last_fullsized":"2024-09-13T06:32:14.258705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:17.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316421+0000","last_change":"2024-09-13T06:29:08.789911+0000","last_active":"2024-09-13T06:30:40.316421+0000","last_peered":"2024-09-13T06:30:40.316421+0000","last_clean":"2024-09-13T06:30:40.316421+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:30:40.316421+0000","last_undegraded":"2024-09-13T06:30:40.316421+0000","last_fullsized":"2024-09-13T06:30:40.316421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:20.838014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566835+0000","last_change":"2024-09-13T06:29:00.703730+0000","last_active":"2024-09-13T06:30:39.566835+0000","last_peered":"2024-09-13T06:30:39.566835+0000","last_clean":"2024-09-13T06:30:39.566835+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:30:39.566835+0000","last_undegraded":"2024-09-13T06:30:39.566835+0000","last_fullsized":"2024-09-13T06:30:39.566835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:12.971383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318815+0000","last_change":"2024-09-13T06:28:58.716525+0000","last_active":"2024-09-13T06:30:40.318815+0000","last_peered":"2024-09-13T06:30:40.318815+0000","last_clean":"2024-09-13T06:30:40.318815+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:30:40.318815+0000","last_undegraded":"2024-09-13T06:30:40.318815+0000","last_fullsized":"2024-09-13T06:30:40.318815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575105+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:30:39.575105+0000","last_peered":"2024-09-13T06:30:39.575105+0000","last_clean":"2024-09-13T06:30:39.575105+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:30:39.575105+0000","last_undegraded":"2024-09-13T06:30:39.575105+0000","last_fullsized":"2024-09-13T06:30:39.575105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:00.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903968+0000","last_change":"2024-09-13T06:29:02.744270+0000","last_active":"2024-09-13T06:30:39.903968+0000","last_peered":"2024-09-13T06:30:39.903968+0000","last_clean":"2024-09-13T06:30:39.903968+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:30:39.903968+0000","last_undegraded":"2024-09-13T06:30:39.903968+0000","last_fullsized":"2024-09-13T06:30:39.903968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'83","reported_seq":159,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.248360+0000","last_change":"2024-09-13T06:29:04.732298+0000","last_active":"2024-09-13T06:31:10.248360+0000","last_peered":"2024-09-13T06:31:10.248360+0000","last_clean":"2024-09-13T06:31:10.248360+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:31:10.248360+0000","last_undegraded":"2024-09-13T06:31:10.248360+0000","last_fullsized":"2024-09-13T06:31:10.248360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:26.343883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905084+0000","last_change":"2024-09-13T06:29:06.767247+0000","last_active":"2024-09-13T06:30:39.905084+0000","last_peered":"2024-09-13T06:30:39.905084+0000","last_clean":"2024-09-13T06:30:39.905084+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:30:39.905084+0000","last_undegraded":"2024-09-13T06:30:39.905084+0000","last_fullsized":"2024-09-13T06:30:39.905084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:57.472237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570309+0000","last_change":"2024-09-13T06:29:08.778016+0000","last_active":"2024-09-13T06:30:39.570309+0000","last_peered":"2024-09-13T06:30:39.570309+0000","last_clean":"2024-09-13T06:30:39.570309+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:30:39.570309+0000","last_undegraded":"2024-09-13T06:30:39.570309+0000","last_fullsized":"2024-09-13T06:30:39.570309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.627161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569024+0000","last_change":"2024-09-13T06:29:08.775423+0000","last_active":"2024-09-13T06:30:39.569024+0000","last_peered":"2024-09-13T06:30:39.569024+0000","last_clean":"2024-09-13T06:30:39.569024+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:30:39.569024+0000","last_undegraded":"2024-09-13T06:30:39.569024+0000","last_fullsized":"2024-09-13T06:30:39.569024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:37.906807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777693+0000","last_change":"2024-09-13T06:29:00.706756+0000","last_active":"2024-09-13T06:32:13.777693+0000","last_peered":"2024-09-13T06:32:13.777693+0000","last_clean":"2024-09-13T06:32:13.777693+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:32:13.777693+0000","last_undegraded":"2024-09-13T06:32:13.777693+0000","last_fullsized":"2024-09-13T06:32:13.777693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:51.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.952185+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:13.952185+0000","last_peered":"2024-09-13T06:32:13.952185+0000","last_clean":"2024-09-13T06:32:13.952185+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:13.952185+0000","last_undegraded":"2024-09-13T06:32:13.952185+0000","last_fullsized":"2024-09-13T06:32:13.952185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316032+0000","last_change":"2024-09-13T06:29:02.737913+0000","last_active":"2024-09-13T06:30:40.316032+0000","last_peered":"2024-09-13T06:30:40.316032+0000","last_clean":"2024-09-13T06:30:40.316032+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:30:40.316032+0000","last_undegraded":"2024-09-13T06:30:40.316032+0000","last_fullsized":"2024-09-13T06:30:40.316032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.260616+0000","last_change":"2024-09-13T06:29:04.751781+0000","last_active":"2024-09-13T06:31:10.260616+0000","last_peered":"2024-09-13T06:31:10.260616+0000","last_clean":"2024-09-13T06:31:10.260616+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:31:10.260616+0000","last_undegraded":"2024-09-13T06:31:10.260616+0000","last_fullsized":"2024-09-13T06:31:10.260616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:17.156772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904554+0000","last_change":"2024-09-13T06:29:06.768895+0000","last_active":"2024-09-13T06:30:39.904554+0000","last_peered":"2024-09-13T06:30:39.904554+0000","last_clean":"2024-09-13T06:30:39.904554+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:30:39.904554+0000","last_undegraded":"2024-09-13T06:30:39.904554+0000","last_fullsized":"2024-09-13T06:30:39.904554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:59.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:09.813655+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:31:09.813655+0000","last_peered":"2024-09-13T06:31:09.813655+0000","last_clean":"2024-09-13T06:31:09.813655+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:31:09.813655+0000","last_undegraded":"2024-09-13T06:31:09.813655+0000","last_fullsized":"2024-09-13T06:31:09.813655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:50.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495777+0000","last_change":"2024-09-13T06:29:00.724056+0000","last_active":"2024-09-13T06:31:20.495777+0000","last_peered":"2024-09-13T06:31:20.495777+0000","last_clean":"2024-09-13T06:31:20.495777+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:31:20.495777+0000","last_undegraded":"2024-09-13T06:31:20.495777+0000","last_fullsized":"2024-09-13T06:31:20.495777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:17.805986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568468+0000","last_change":"2024-09-13T06:28:58.722577+0000","last_active":"2024-09-13T06:30:39.568468+0000","last_peered":"2024-09-13T06:30:39.568468+0000","last_clean":"2024-09-13T06:30:39.568468+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:30:39.568468+0000","last_undegraded":"2024-09-13T06:30:39.568468+0000","last_fullsized":"2024-09-13T06:30:39.568468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:49.189520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905810+0000","last_change":"2024-09-13T06:29:02.740396+0000","last_active":"2024-09-13T06:30:39.905810+0000","last_peered":"2024-09-13T06:30:39.905810+0000","last_clean":"2024-09-13T06:30:39.905810+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:30:39.905810+0000","last_undegraded":"2024-09-13T06:30:39.905810+0000","last_fullsized":"2024-09-13T06:30:39.905810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.707084+0000","last_change":"2024-09-13T06:29:04.741028+0000","last_active":"2024-09-13T06:32:12.707084+0000","last_peered":"2024-09-13T06:32:12.707084+0000","last_clean":"2024-09-13T06:32:12.707084+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:32:12.707084+0000","last_undegraded":"2024-09-13T06:32:12.707084+0000","last_fullsized":"2024-09-13T06:32:12.707084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:36.374316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566162+0000","last_change":"2024-09-13T06:29:06.765377+0000","last_active":"2024-09-13T06:30:39.566162+0000","last_peered":"2024-09-13T06:30:39.566162+0000","last_clean":"2024-09-13T06:30:39.566162+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:30:39.566162+0000","last_undegraded":"2024-09-13T06:30:39.566162+0000","last_fullsized":"2024-09-13T06:30:39.566162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:44.482785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317385+0000","last_change":"2024-09-13T06:29:08.787430+0000","last_active":"2024-09-13T06:30:40.317385+0000","last_peered":"2024-09-13T06:30:40.317385+0000","last_clean":"2024-09-13T06:30:40.317385+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:30:40.317385+0000","last_undegraded":"2024-09-13T06:30:40.317385+0000","last_fullsized":"2024-09-13T06:30:40.317385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:01.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'7","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492082+0000","last_change":"2024-09-13T06:29:00.709739+0000","last_active":"2024-09-13T06:31:20.492082+0000","last_peered":"2024-09-13T06:31:20.492082+0000","last_clean":"2024-09-13T06:31:20.492082+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:31:20.492082+0000","last_undegraded":"2024-09-13T06:31:20.492082+0000","last_fullsized":"2024-09-13T06:31:20.492082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575239+0000","last_change":"2024-09-13T06:28:58.717681+0000","last_active":"2024-09-13T06:30:39.575239+0000","last_peered":"2024-09-13T06:30:39.575239+0000","last_clean":"2024-09-13T06:30:39.575239+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:30:39.575239+0000","last_undegraded":"2024-09-13T06:30:39.575239+0000","last_fullsized":"2024-09-13T06:30:39.575239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:27.815067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.749307+0000","last_change":"2024-09-13T06:29:02.727813+0000","last_active":"2024-09-13T06:31:11.749307+0000","last_peered":"2024-09-13T06:31:11.749307+0000","last_clean":"2024-09-13T06:31:11.749307+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:31:11.749307+0000","last_undegraded":"2024-09-13T06:31:11.749307+0000","last_fullsized":"2024-09-13T06:31:11.749307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:24.145601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.858516+0000","last_change":"2024-09-13T06:29:04.750547+0000","last_active":"2024-09-13T06:32:12.858516+0000","last_peered":"2024-09-13T06:32:12.858516+0000","last_clean":"2024-09-13T06:32:12.858516+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:12.858516+0000","last_undegraded":"2024-09-13T06:32:12.858516+0000","last_fullsized":"2024-09-13T06:32:12.858516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:12.046692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315686+0000","last_change":"2024-09-13T06:29:06.765688+0000","last_active":"2024-09-13T06:30:40.315686+0000","last_peered":"2024-09-13T06:30:40.315686+0000","last_clean":"2024-09-13T06:30:40.315686+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:30:40.315686+0000","last_undegraded":"2024-09-13T06:30:40.315686+0000","last_fullsized":"2024-09-13T06:30:40.315686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:19.173170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905501+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:30:39.905501+0000","last_peered":"2024-09-13T06:30:39.905501+0000","last_clean":"2024-09-13T06:30:39.905501+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:30:39.905501+0000","last_undegraded":"2024-09-13T06:30:39.905501+0000","last_fullsized":"2024-09-13T06:30:39.905501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:15.759918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565768+0000","last_change":"2024-09-13T06:29:39.508832+0000","last_active":"2024-09-13T06:30:39.565768+0000","last_peered":"2024-09-13T06:30:39.565768+0000","last_clean":"2024-09-13T06:30:39.565768+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:30:39.565768+0000","last_undegraded":"2024-09-13T06:30:39.565768+0000","last_fullsized":"2024-09-13T06:30:39.565768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:22:26.112599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321498+0000","last_change":"2024-09-13T06:28:58.716514+0000","last_active":"2024-09-13T06:30:40.321498+0000","last_peered":"2024-09-13T06:30:40.321498+0000","last_clean":"2024-09-13T06:30:40.321498+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:30:40.321498+0000","last_undegraded":"2024-09-13T06:30:40.321498+0000","last_fullsized":"2024-09-13T06:30:40.321498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907794+0000","last_change":"2024-09-13T06:29:02.718645+0000","last_active":"2024-09-13T06:30:39.907794+0000","last_peered":"2024-09-13T06:30:39.907794+0000","last_clean":"2024-09-13T06:30:39.907794+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:30:39.907794+0000","last_undegraded":"2024-09-13T06:30:39.907794+0000","last_fullsized":"2024-09-13T06:30:39.907794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.231976+0000","last_change":"2024-09-13T06:29:04.733778+0000","last_active":"2024-09-13T06:31:10.231976+0000","last_peered":"2024-09-13T06:31:10.231976+0000","last_clean":"2024-09-13T06:31:10.231976+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:31:10.231976+0000","last_undegraded":"2024-09-13T06:31:10.231976+0000","last_fullsized":"2024-09-13T06:31:10.231976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:56.673325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568833+0000","last_change":"2024-09-13T06:29:06.762809+0000","last_active":"2024-09-13T06:30:39.568833+0000","last_peered":"2024-09-13T06:30:39.568833+0000","last_clean":"2024-09-13T06:30:39.568833+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:30:39.568833+0000","last_undegraded":"2024-09-13T06:30:39.568833+0000","last_fullsized":"2024-09-13T06:30:39.568833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:34.809800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571091+0000","last_change":"2024-09-13T06:29:00.717648+0000","last_active":"2024-09-13T06:32:13.571091+0000","last_peered":"2024-09-13T06:32:13.571091+0000","last_clean":"2024-09-13T06:32:13.571091+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:32:13.571091+0000","last_undegraded":"2024-09-13T06:32:13.571091+0000","last_fullsized":"2024-09-13T06:32:13.571091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903356+0000","last_change":"2024-09-13T06:28:58.719660+0000","last_active":"2024-09-13T06:30:39.903356+0000","last_peered":"2024-09-13T06:30:39.903356+0000","last_clean":"2024-09-13T06:30:39.903356+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:30:39.903356+0000","last_undegraded":"2024-09-13T06:30:39.903356+0000","last_fullsized":"2024-09-13T06:30:39.903356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319720+0000","last_change":"2024-09-13T06:29:02.737808+0000","last_active":"2024-09-13T06:30:40.319720+0000","last_peered":"2024-09-13T06:30:40.319720+0000","last_clean":"2024-09-13T06:30:40.319720+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:30:40.319720+0000","last_undegraded":"2024-09-13T06:30:40.319720+0000","last_fullsized":"2024-09-13T06:30:40.319720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'55","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.272428+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:31:10.272428+0000","last_peered":"2024-09-13T06:31:10.272428+0000","last_clean":"2024-09-13T06:31:10.272428+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:31:10.272428+0000","last_undegraded":"2024-09-13T06:31:10.272428+0000","last_fullsized":"2024-09-13T06:31:10.272428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568263+0000","last_change":"2024-09-13T06:29:06.770864+0000","last_active":"2024-09-13T06:30:39.568263+0000","last_peered":"2024-09-13T06:30:39.568263+0000","last_clean":"2024-09-13T06:30:39.568263+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:30:39.568263+0000","last_undegraded":"2024-09-13T06:30:39.568263+0000","last_fullsized":"2024-09-13T06:30:39.568263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:21.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.485917+0000","last_change":"2024-09-13T06:29:08.784874+0000","last_active":"2024-09-13T06:31:12.485917+0000","last_peered":"2024-09-13T06:31:12.485917+0000","last_clean":"2024-09-13T06:31:12.485917+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:31:12.485917+0000","last_undegraded":"2024-09-13T06:31:12.485917+0000","last_fullsized":"2024-09-13T06:31:12.485917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:36.951899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319331+0000","last_change":"2024-09-13T06:29:00.731362+0000","last_active":"2024-09-13T06:30:40.319331+0000","last_peered":"2024-09-13T06:30:40.319331+0000","last_clean":"2024-09-13T06:30:40.319331+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:30:40.319331+0000","last_undegraded":"2024-09-13T06:30:40.319331+0000","last_fullsized":"2024-09-13T06:30:40.319331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:19.896337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315793+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:30:40.315793+0000","last_peered":"2024-09-13T06:30:40.315793+0000","last_clean":"2024-09-13T06:30:40.315793+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:30:40.315793+0000","last_undegraded":"2024-09-13T06:30:40.315793+0000","last_fullsized":"2024-09-13T06:30:40.315793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.495874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578114+0000","last_change":"2024-09-13T06:29:02.720915+0000","last_active":"2024-09-13T06:30:39.578114+0000","last_peered":"2024-09-13T06:30:39.578114+0000","last_clean":"2024-09-13T06:30:39.578114+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:30:39.578114+0000","last_undegraded":"2024-09-13T06:30:39.578114+0000","last_fullsized":"2024-09-13T06:30:39.578114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:13.518915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.233950+0000","last_change":"2024-09-13T06:29:04.732931+0000","last_active":"2024-09-13T06:31:10.233950+0000","last_peered":"2024-09-13T06:31:10.233950+0000","last_clean":"2024-09-13T06:31:10.233950+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:31:10.233950+0000","last_undegraded":"2024-09-13T06:31:10.233950+0000","last_fullsized":"2024-09-13T06:31:10.233950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:37.616554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319314+0000","last_change":"2024-09-13T06:29:06.762859+0000","last_active":"2024-09-13T06:30:40.319314+0000","last_peered":"2024-09-13T06:30:40.319314+0000","last_clean":"2024-09-13T06:30:40.319314+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:30:40.319314+0000","last_undegraded":"2024-09-13T06:30:40.319314+0000","last_fullsized":"2024-09-13T06:30:40.319314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:56.472153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570852+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:30:39.570852+0000","last_peered":"2024-09-13T06:30:39.570852+0000","last_clean":"2024-09-13T06:30:39.570852+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:30:39.570852+0000","last_undegraded":"2024-09-13T06:30:39.570852+0000","last_fullsized":"2024-09-13T06:30:39.570852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965070+0000","last_change":"2024-09-13T06:29:00.732260+0000","last_active":"2024-09-13T06:32:13.965070+0000","last_peered":"2024-09-13T06:32:13.965070+0000","last_clean":"2024-09-13T06:32:13.965070+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:32:13.965070+0000","last_undegraded":"2024-09-13T06:32:13.965070+0000","last_fullsized":"2024-09-13T06:32:13.965070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572703+0000","last_change":"2024-09-13T06:28:58.716000+0000","last_active":"2024-09-13T06:30:39.572703+0000","last_peered":"2024-09-13T06:30:39.572703+0000","last_clean":"2024-09-13T06:30:39.572703+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:30:39.572703+0000","last_undegraded":"2024-09-13T06:30:39.572703+0000","last_fullsized":"2024-09-13T06:30:39.572703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574668+0000","last_change":"2024-09-13T06:29:02.718646+0000","last_active":"2024-09-13T06:30:39.574668+0000","last_peered":"2024-09-13T06:30:39.574668+0000","last_clean":"2024-09-13T06:30:39.574668+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:30:39.574668+0000","last_undegraded":"2024-09-13T06:30:39.574668+0000","last_fullsized":"2024-09-13T06:30:39.574668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'34","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.268754+0000","last_change":"2024-09-13T06:29:04.752663+0000","last_active":"2024-09-13T06:31:10.268754+0000","last_peered":"2024-09-13T06:31:10.268754+0000","last_clean":"2024-09-13T06:31:10.268754+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:31:10.268754+0000","last_undegraded":"2024-09-13T06:31:10.268754+0000","last_fullsized":"2024-09-13T06:31:10.268754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:06.350632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321281+0000","last_change":"2024-09-13T06:29:06.766875+0000","last_active":"2024-09-13T06:30:40.321281+0000","last_peered":"2024-09-13T06:30:40.321281+0000","last_clean":"2024-09-13T06:30:40.321281+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:30:40.321281+0000","last_undegraded":"2024-09-13T06:30:40.321281+0000","last_fullsized":"2024-09-13T06:30:40.321281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:25.326753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.653823+0000","last_change":"2024-09-13T06:29:08.769294+0000","last_active":"2024-09-13T06:31:12.653823+0000","last_peered":"2024-09-13T06:31:12.653823+0000","last_clean":"2024-09-13T06:31:12.653823+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:31:12.653823+0000","last_undegraded":"2024-09-13T06:31:12.653823+0000","last_fullsized":"2024-09-13T06:31:12.653823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:00:59.776143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.410858+0000","last_change":"2024-09-13T06:29:00.722796+0000","last_active":"2024-09-13T06:32:13.410858+0000","last_peered":"2024-09-13T06:32:13.410858+0000","last_clean":"2024-09-13T06:32:13.410858+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:32:13.410858+0000","last_undegraded":"2024-09-13T06:32:13.410858+0000","last_fullsized":"2024-09-13T06:32:13.410858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:28.267490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'7","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.750950+0000","last_change":"2024-09-13T06:28:58.705967+0000","last_active":"2024-09-13T06:32:13.750950+0000","last_peered":"2024-09-13T06:32:13.750950+0000","last_clean":"2024-09-13T06:32:13.750950+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:32:13.750950+0000","last_undegraded":"2024-09-13T06:32:13.750950+0000","last_fullsized":"2024-09-13T06:32:13.750950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:49.212428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":31,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319567+0000","last_change":"2024-09-13T06:29:02.727947+0000","last_active":"2024-09-13T06:30:40.319567+0000","last_peered":"2024-09-13T06:30:40.319567+0000","last_clean":"2024-09-13T06:30:40.319567+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:30:40.319567+0000","last_undegraded":"2024-09-13T06:30:40.319567+0000","last_fullsized":"2024-09-13T06:30:40.319567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:43.175259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910215+0000","last_change":"2024-09-13T06:29:04.754166+0000","last_active":"2024-09-13T06:30:39.910215+0000","last_peered":"2024-09-13T06:30:39.910215+0000","last_clean":"2024-09-13T06:30:39.910215+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:30:39.910215+0000","last_undegraded":"2024-09-13T06:30:39.910215+0000","last_fullsized":"2024-09-13T06:30:39.910215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:54.455755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.977868+0000","last_change":"2024-09-13T06:29:06.774577+0000","last_active":"2024-09-13T06:32:13.977868+0000","last_peered":"2024-09-13T06:32:13.977868+0000","last_clean":"2024-09-13T06:32:13.977868+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:32:13.977868+0000","last_undegraded":"2024-09-13T06:32:13.977868+0000","last_fullsized":"2024-09-13T06:32:13.977868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:26.057296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570192+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:30:39.570192+0000","last_peered":"2024-09-13T06:30:39.570192+0000","last_clean":"2024-09-13T06:30:39.570192+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:30:39.570192+0000","last_undegraded":"2024-09-13T06:30:39.570192+0000","last_fullsized":"2024-09-13T06:30:39.570192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.891076+0000","last_change":"2024-09-13T06:29:00.703118+0000","last_active":"2024-09-13T06:32:13.891076+0000","last_peered":"2024-09-13T06:32:13.891076+0000","last_clean":"2024-09-13T06:32:13.891076+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:32:13.891076+0000","last_undegraded":"2024-09-13T06:32:13.891076+0000","last_fullsized":"2024-09-13T06:32:13.891076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318695+0000","last_change":"2024-09-13T06:28:58.727668+0000","last_active":"2024-09-13T06:30:40.318695+0000","last_peered":"2024-09-13T06:30:40.318695+0000","last_clean":"2024-09-13T06:30:40.318695+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:30:40.318695+0000","last_undegraded":"2024-09-13T06:30:40.318695+0000","last_fullsized":"2024-09-13T06:30:40.318695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:44.537548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317498+0000","last_change":"2024-09-13T06:29:02.737035+0000","last_active":"2024-09-13T06:30:40.317498+0000","last_peered":"2024-09-13T06:30:40.317498+0000","last_clean":"2024-09-13T06:30:40.317498+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:30:40.317498+0000","last_undegraded":"2024-09-13T06:30:40.317498+0000","last_fullsized":"2024-09-13T06:30:40.317498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.989322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.216689+0000","last_change":"2024-09-13T06:29:04.736867+0000","last_active":"2024-09-13T06:31:10.216689+0000","last_peered":"2024-09-13T06:31:10.216689+0000","last_clean":"2024-09-13T06:31:10.216689+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:31:10.216689+0000","last_undegraded":"2024-09-13T06:31:10.216689+0000","last_fullsized":"2024-09-13T06:31:10.216689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.266864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903117+0000","last_change":"2024-09-13T06:29:06.755656+0000","last_active":"2024-09-13T06:30:39.903117+0000","last_peered":"2024-09-13T06:30:39.903117+0000","last_clean":"2024-09-13T06:30:39.903117+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:30:39.903117+0000","last_undegraded":"2024-09-13T06:30:39.903117+0000","last_fullsized":"2024-09-13T06:30:39.903117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:08.951294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576139+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:30:39.576139+0000","last_peered":"2024-09-13T06:30:39.576139+0000","last_clean":"2024-09-13T06:30:39.576139+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:30:39.576139+0000","last_undegraded":"2024-09-13T06:30:39.576139+0000","last_fullsized":"2024-09-13T06:30:39.576139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:24.414010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570406+0000","last_change":"2024-09-13T06:29:00.715931+0000","last_active":"2024-09-13T06:32:13.570406+0000","last_peered":"2024-09-13T06:32:13.570406+0000","last_clean":"2024-09-13T06:32:13.570406+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:32:13.570406+0000","last_undegraded":"2024-09-13T06:32:13.570406+0000","last_fullsized":"2024-09-13T06:32:13.570406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:16.645482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.577929+0000","last_change":"2024-09-13T06:28:58.706848+0000","last_active":"2024-09-13T06:30:39.577929+0000","last_peered":"2024-09-13T06:30:39.577929+0000","last_clean":"2024-09-13T06:30:39.577929+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:30:39.577929+0000","last_undegraded":"2024-09-13T06:30:39.577929+0000","last_fullsized":"2024-09-13T06:30:39.577929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:08.398250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572664+0000","last_change":"2024-09-13T06:29:02.715301+0000","last_active":"2024-09-13T06:30:39.572664+0000","last_peered":"2024-09-13T06:30:39.572664+0000","last_clean":"2024-09-13T06:30:39.572664+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:30:39.572664+0000","last_undegraded":"2024-09-13T06:30:39.572664+0000","last_fullsized":"2024-09-13T06:30:39.572664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:19.480041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.217481+0000","last_change":"2024-09-13T06:29:04.728823+0000","last_active":"2024-09-13T06:31:10.217481+0000","last_peered":"2024-09-13T06:31:10.217481+0000","last_clean":"2024-09-13T06:31:10.217481+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:31:10.217481+0000","last_undegraded":"2024-09-13T06:31:10.217481+0000","last_fullsized":"2024-09-13T06:31:10.217481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:22.717282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571575+0000","last_change":"2024-09-13T06:29:06.774527+0000","last_active":"2024-09-13T06:30:39.571575+0000","last_peered":"2024-09-13T06:30:39.571575+0000","last_clean":"2024-09-13T06:30:39.571575+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:30:39.571575+0000","last_undegraded":"2024-09-13T06:30:39.571575+0000","last_fullsized":"2024-09-13T06:30:39.571575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:17.985155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.457421+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.457421+0000","last_peered":"2024-09-13T06:32:13.457421+0000","last_clean":"2024-09-13T06:32:13.457421+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.457421+0000","last_undegraded":"2024-09-13T06:32:13.457421+0000","last_fullsized":"2024-09-13T06:32:13.457421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:54.961718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777639+0000","last_change":"2024-09-13T06:29:00.710678+0000","last_active":"2024-09-13T06:32:13.777639+0000","last_peered":"2024-09-13T06:32:13.777639+0000","last_clean":"2024-09-13T06:32:13.777639+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:32:13.777639+0000","last_undegraded":"2024-09-13T06:32:13.777639+0000","last_fullsized":"2024-09-13T06:32:13.777639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910338+0000","last_change":"2024-09-13T06:28:58.728835+0000","last_active":"2024-09-13T06:30:39.910338+0000","last_peered":"2024-09-13T06:30:39.910338+0000","last_clean":"2024-09-13T06:30:39.910338+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:30:39.910338+0000","last_undegraded":"2024-09-13T06:30:39.910338+0000","last_fullsized":"2024-09-13T06:30:39.910338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315953+0000","last_change":"2024-09-13T06:29:02.731541+0000","last_active":"2024-09-13T06:30:40.315953+0000","last_peered":"2024-09-13T06:30:40.315953+0000","last_clean":"2024-09-13T06:30:40.315953+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:30:40.315953+0000","last_undegraded":"2024-09-13T06:30:40.315953+0000","last_fullsized":"2024-09-13T06:30:40.315953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:35.369421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'27","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.265189+0000","last_change":"2024-09-13T06:29:04.750320+0000","last_active":"2024-09-13T06:31:10.265189+0000","last_peered":"2024-09-13T06:31:10.265189+0000","last_clean":"2024-09-13T06:31:10.265189+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:31:10.265189+0000","last_undegraded":"2024-09-13T06:31:10.265189+0000","last_fullsized":"2024-09-13T06:31:10.265189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:20.698413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571889+0000","last_change":"2024-09-13T06:29:06.744904+0000","last_active":"2024-09-13T06:30:39.571889+0000","last_peered":"2024-09-13T06:30:39.571889+0000","last_clean":"2024-09-13T06:30:39.571889+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:30:39.571889+0000","last_undegraded":"2024-09-13T06:30:39.571889+0000","last_fullsized":"2024-09-13T06:30:39.571889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:03.059130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.857298+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.857298+0000","last_peered":"2024-09-13T06:32:13.857298+0000","last_clean":"2024-09-13T06:32:13.857298+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.857298+0000","last_undegraded":"2024-09-13T06:32:13.857298+0000","last_fullsized":"2024-09-13T06:32:13.857298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:21.044316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888955+0000","last_change":"2024-09-13T06:29:00.723086+0000","last_active":"2024-09-13T06:32:13.888955+0000","last_peered":"2024-09-13T06:32:13.888955+0000","last_clean":"2024-09-13T06:32:13.888955+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:32:13.888955+0000","last_undegraded":"2024-09-13T06:32:13.888955+0000","last_fullsized":"2024-09-13T06:32:13.888955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321598+0000","last_change":"2024-09-13T06:28:58.709396+0000","last_active":"2024-09-13T06:30:40.321598+0000","last_peered":"2024-09-13T06:30:40.321598+0000","last_clean":"2024-09-13T06:30:40.321598+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:30:40.321598+0000","last_undegraded":"2024-09-13T06:30:40.321598+0000","last_fullsized":"2024-09-13T06:30:40.321598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:08.425859+0000","last_change":"2024-09-13T06:29:02.732125+0000","last_active":"2024-09-13T06:31:08.425859+0000","last_peered":"2024-09-13T06:31:08.425859+0000","last_clean":"2024-09-13T06:31:08.425859+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:31:08.425859+0000","last_undegraded":"2024-09-13T06:31:08.425859+0000","last_fullsized":"2024-09-13T06:31:08.425859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:18.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'33","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.708447+0000","last_change":"2024-09-13T06:29:04.732737+0000","last_active":"2024-09-13T06:32:12.708447+0000","last_peered":"2024-09-13T06:32:12.708447+0000","last_clean":"2024-09-13T06:32:12.708447+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:12.708447+0000","last_undegraded":"2024-09-13T06:32:12.708447+0000","last_fullsized":"2024-09-13T06:32:12.708447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:10:29.688497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568199+0000","last_change":"2024-09-13T06:29:06.776200+0000","last_active":"2024-09-13T06:30:39.568199+0000","last_peered":"2024-09-13T06:30:39.568199+0000","last_clean":"2024-09-13T06:30:39.568199+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:30:39.568199+0000","last_undegraded":"2024-09-13T06:30:39.568199+0000","last_fullsized":"2024-09-13T06:30:39.568199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:14.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.287953+0000","last_change":"2024-09-13T06:29:08.770047+0000","last_active":"2024-09-13T06:31:10.287953+0000","last_peered":"2024-09-13T06:31:10.287953+0000","last_clean":"2024-09-13T06:31:10.287953+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:31:10.287953+0000","last_undegraded":"2024-09-13T06:31:10.287953+0000","last_fullsized":"2024-09-13T06:31:10.287953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:12.926423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.322106+0000","last_change":"2024-09-13T06:29:00.723899+0000","last_active":"2024-09-13T06:30:40.322106+0000","last_peered":"2024-09-13T06:30:40.322106+0000","last_clean":"2024-09-13T06:30:40.322106+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:30:40.322106+0000","last_undegraded":"2024-09-13T06:30:40.322106+0000","last_fullsized":"2024-09-13T06:30:40.322106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565933+0000","last_change":"2024-09-13T06:28:58.721562+0000","last_active":"2024-09-13T06:30:39.565933+0000","last_peered":"2024-09-13T06:30:39.565933+0000","last_clean":"2024-09-13T06:30:39.565933+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:30:39.565933+0000","last_undegraded":"2024-09-13T06:30:39.565933+0000","last_fullsized":"2024-09-13T06:30:39.565933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:26.902921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571617+0000","last_change":"2024-09-13T06:29:00.721713+0000","last_active":"2024-09-13T06:32:13.571617+0000","last_peered":"2024-09-13T06:32:13.571617+0000","last_clean":"2024-09-13T06:32:13.571617+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:32:13.571617+0000","last_undegraded":"2024-09-13T06:32:13.571617+0000","last_fullsized":"2024-09-13T06:32:13.571617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:53.230794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.357941+0000","last_change":"2024-09-13T06:28:58.708285+0000","last_active":"2024-09-13T06:31:12.357941+0000","last_peered":"2024-09-13T06:31:12.357941+0000","last_clean":"2024-09-13T06:31:12.357941+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:31:12.357941+0000","last_undegraded":"2024-09-13T06:31:12.357941+0000","last_fullsized":"2024-09-13T06:31:12.357941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:29:28.632008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'5","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:50.502622+0000","last_change":"2024-09-13T06:29:39.540853+0000","last_active":"2024-09-13T06:31:50.502622+0000","last_peered":"2024-09-13T06:31:50.502622+0000","last_clean":"2024-09-13T06:31:50.502622+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:31:50.502622+0000","last_undegraded":"2024-09-13T06:31:50.502622+0000","last_fullsized":"2024-09-13T06:31:50.502622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:10.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905352+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:30:39.905352+0000","last_peered":"2024-09-13T06:30:39.905352+0000","last_clean":"2024-09-13T06:30:39.905352+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:30:39.905352+0000","last_undegraded":"2024-09-13T06:30:39.905352+0000","last_fullsized":"2024-09-13T06:30:39.905352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777960+0000","last_change":"2024-09-13T06:29:00.721804+0000","last_active":"2024-09-13T06:32:13.777960+0000","last_peered":"2024-09-13T06:32:13.777960+0000","last_clean":"2024-09-13T06:32:13.777960+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:32:13.777960+0000","last_undegraded":"2024-09-13T06:32:13.777960+0000","last_fullsized":"2024-09-13T06:32:13.777960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:38.933470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567585+0000","last_change":"2024-09-13T06:28:58.722511+0000","last_active":"2024-09-13T06:30:39.567585+0000","last_peered":"2024-09-13T06:30:39.567585+0000","last_clean":"2024-09-13T06:30:39.567585+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:30:39.567585+0000","last_undegraded":"2024-09-13T06:30:39.567585+0000","last_fullsized":"2024-09-13T06:30:39.567585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:59.470833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.413604+0000","last_change":"2024-09-13T06:29:39.527461+0000","last_active":"2024-09-13T06:32:13.413604+0000","last_peered":"2024-09-13T06:32:13.413604+0000","last_clean":"2024-09-13T06:32:13.413604+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:32:13.413604+0000","last_undegraded":"2024-09-13T06:32:13.413604+0000","last_fullsized":"2024-09-13T06:32:13.413604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:35.974634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910363+0000","last_change":"2024-09-13T06:28:58.724998+0000","last_active":"2024-09-13T06:30:39.910363+0000","last_peered":"2024-09-13T06:30:39.910363+0000","last_clean":"2024-09-13T06:30:39.910363+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:30:39.910363+0000","last_undegraded":"2024-09-13T06:30:39.910363+0000","last_fullsized":"2024-09-13T06:30:39.910363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889884+0000","last_change":"2024-09-13T06:29:00.723960+0000","last_active":"2024-09-13T06:32:13.889884+0000","last_peered":"2024-09-13T06:32:13.889884+0000","last_clean":"2024-09-13T06:32:13.889884+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:32:13.889884+0000","last_undegraded":"2024-09-13T06:32:13.889884+0000","last_fullsized":"2024-09-13T06:32:13.889884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:45.154423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317979+0000","last_change":"2024-09-13T06:28:58.730726+0000","last_active":"2024-09-13T06:30:40.317979+0000","last_peered":"2024-09-13T06:30:40.317979+0000","last_clean":"2024-09-13T06:30:40.317979+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:30:40.317979+0000","last_undegraded":"2024-09-13T06:30:40.317979+0000","last_fullsized":"2024-09-13T06:30:40.317979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905756+0000","last_change":"2024-09-13T06:29:00.718381+0000","last_active":"2024-09-13T06:30:39.905756+0000","last_peered":"2024-09-13T06:30:39.905756+0000","last_clean":"2024-09-13T06:30:39.905756+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:30:39.905756+0000","last_undegraded":"2024-09-13T06:30:39.905756+0000","last_fullsized":"2024-09-13T06:30:39.905756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569016+0000","last_change":"2024-09-13T06:28:58.707516+0000","last_active":"2024-09-13T06:30:39.569016+0000","last_peered":"2024-09-13T06:30:39.569016+0000","last_clean":"2024-09-13T06:30:39.569016+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:30:39.569016+0000","last_undegraded":"2024-09-13T06:30:39.569016+0000","last_fullsized":"2024-09-13T06:30:39.569016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:50:18.113331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570745+0000","last_change":"2024-09-13T06:29:00.715113+0000","last_active":"2024-09-13T06:30:39.570745+0000","last_peered":"2024-09-13T06:30:39.570745+0000","last_clean":"2024-09-13T06:30:39.570745+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:30:39.570745+0000","last_undegraded":"2024-09-13T06:30:39.570745+0000","last_fullsized":"2024-09-13T06:30:39.570745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908260+0000","last_change":"2024-09-13T06:28:58.725590+0000","last_active":"2024-09-13T06:30:39.908260+0000","last_peered":"2024-09-13T06:30:39.908260+0000","last_clean":"2024-09-13T06:30:39.908260+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:30:39.908260+0000","last_undegraded":"2024-09-13T06:30:39.908260+0000","last_fullsized":"2024-09-13T06:30:39.908260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:50.900848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964923+0000","last_change":"2024-09-13T06:29:00.713384+0000","last_active":"2024-09-13T06:32:13.964923+0000","last_peered":"2024-09-13T06:32:13.964923+0000","last_clean":"2024-09-13T06:32:13.964923+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:32:13.964923+0000","last_undegraded":"2024-09-13T06:32:13.964923+0000","last_fullsized":"2024-09-13T06:32:13.964923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.737385+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.737385+0000","last_peered":"2024-09-13T06:32:13.737385+0000","last_clean":"2024-09-13T06:32:13.737385+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.737385+0000","last_undegraded":"2024-09-13T06:32:13.737385+0000","last_fullsized":"2024-09-13T06:32:13.737385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:48.282068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.890443+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:13.890443+0000","last_peered":"2024-09-13T06:32:13.890443+0000","last_clean":"2024-09-13T06:32:13.890443+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:13.890443+0000","last_undegraded":"2024-09-13T06:32:13.890443+0000","last_fullsized":"2024-09-13T06:32:13.890443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905294+0000","last_change":"2024-09-13T06:28:58.705020+0000","last_active":"2024-09-13T06:30:39.905294+0000","last_peered":"2024-09-13T06:30:39.905294+0000","last_clean":"2024-09-13T06:30:39.905294+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:30:39.905294+0000","last_undegraded":"2024-09-13T06:30:39.905294+0000","last_fullsized":"2024-09-13T06:30:39.905294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493929+0000","last_change":"2024-09-13T06:29:00.702900+0000","last_active":"2024-09-13T06:31:15.493929+0000","last_peered":"2024-09-13T06:31:15.493929+0000","last_clean":"2024-09-13T06:31:15.493929+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:31:15.493929+0000","last_undegraded":"2024-09-13T06:31:15.493929+0000","last_fullsized":"2024-09-13T06:31:15.493929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:18.709977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572544+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:30:39.572544+0000","last_peered":"2024-09-13T06:30:39.572544+0000","last_clean":"2024-09-13T06:30:39.572544+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:30:39.572544+0000","last_undegraded":"2024-09-13T06:30:39.572544+0000","last_fullsized":"2024-09-13T06:30:39.572544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:31:36.559365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777954+0000","last_change":"2024-09-13T06:29:00.732329+0000","last_active":"2024-09-13T06:32:13.777954+0000","last_peered":"2024-09-13T06:32:13.777954+0000","last_clean":"2024-09-13T06:32:13.777954+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:32:13.777954+0000","last_undegraded":"2024-09-13T06:32:13.777954+0000","last_fullsized":"2024-09-13T06:32:13.777954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318194+0000","last_change":"2024-09-13T06:28:58.716875+0000","last_active":"2024-09-13T06:30:40.318194+0000","last_peered":"2024-09-13T06:30:40.318194+0000","last_clean":"2024-09-13T06:30:40.318194+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:30:40.318194+0000","last_undegraded":"2024-09-13T06:30:40.318194+0000","last_fullsized":"2024-09-13T06:30:40.318194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:32.384190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888966+0000","last_change":"2024-09-13T06:29:00.716069+0000","last_active":"2024-09-13T06:32:13.888966+0000","last_peered":"2024-09-13T06:32:13.888966+0000","last_clean":"2024-09-13T06:32:13.888966+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:32:13.888966+0000","last_undegraded":"2024-09-13T06:32:13.888966+0000","last_fullsized":"2024-09-13T06:32:13.888966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.758463+0000","last_change":"2024-09-13T06:28:58.725136+0000","last_active":"2024-09-13T06:32:13.758463+0000","last_peered":"2024-09-13T06:32:13.758463+0000","last_clean":"2024-09-13T06:32:13.758463+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:32:13.758463+0000","last_undegraded":"2024-09-13T06:32:13.758463+0000","last_fullsized":"2024-09-13T06:32:13.758463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984562+0000","last_change":"2024-09-13T06:29:00.729388+0000","last_active":"2024-09-13T06:32:13.984562+0000","last_peered":"2024-09-13T06:32:13.984562+0000","last_clean":"2024-09-13T06:32:13.984562+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:32:13.984562+0000","last_undegraded":"2024-09-13T06:32:13.984562+0000","last_fullsized":"2024-09-13T06:32:13.984562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:35.921007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908553+0000","last_change":"2024-09-13T06:28:58.720437+0000","last_active":"2024-09-13T06:30:39.908553+0000","last_peered":"2024-09-13T06:30:39.908553+0000","last_clean":"2024-09-13T06:30:39.908553+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:30:39.908553+0000","last_undegraded":"2024-09-13T06:30:39.908553+0000","last_fullsized":"2024-09-13T06:30:39.908553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904803+0000","last_change":"2024-09-13T06:29:00.722844+0000","last_active":"2024-09-13T06:30:39.904803+0000","last_peered":"2024-09-13T06:30:39.904803+0000","last_clean":"2024-09-13T06:30:39.904803+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:30:39.904803+0000","last_undegraded":"2024-09-13T06:30:39.904803+0000","last_fullsized":"2024-09-13T06:30:39.904803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.765398+0000","last_change":"2024-09-13T06:28:58.707588+0000","last_active":"2024-09-13T06:32:13.765398+0000","last_peered":"2024-09-13T06:32:13.765398+0000","last_clean":"2024-09-13T06:32:13.765398+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:32:13.765398+0000","last_undegraded":"2024-09-13T06:32:13.765398+0000","last_fullsized":"2024-09-13T06:32:13.765398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:13.693638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776869+0000","last_change":"2024-09-13T06:29:00.717476+0000","last_active":"2024-09-13T06:32:13.776869+0000","last_peered":"2024-09-13T06:32:13.776869+0000","last_clean":"2024-09-13T06:32:13.776869+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:32:13.776869+0000","last_undegraded":"2024-09-13T06:32:13.776869+0000","last_fullsized":"2024-09-13T06:32:13.776869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:25:20.841077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908636+0000","last_change":"2024-09-13T06:28:58.720596+0000","last_active":"2024-09-13T06:30:39.908636+0000","last_peered":"2024-09-13T06:30:39.908636+0000","last_clean":"2024-09-13T06:30:39.908636+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:30:39.908636+0000","last_undegraded":"2024-09-13T06:30:39.908636+0000","last_fullsized":"2024-09-13T06:30:39.908636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.599725+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:31:12.599725+0000","last_peered":"2024-09-13T06:31:12.599725+0000","last_clean":"2024-09-13T06:31:12.599725+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:31:12.599725+0000","last_undegraded":"2024-09-13T06:31:12.599725+0000","last_fullsized":"2024-09-13T06:31:12.599725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570695+0000","last_change":"2024-09-13T06:29:00.709102+0000","last_active":"2024-09-13T06:30:39.570695+0000","last_peered":"2024-09-13T06:30:39.570695+0000","last_clean":"2024-09-13T06:30:39.570695+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:30:39.570695+0000","last_undegraded":"2024-09-13T06:30:39.570695+0000","last_fullsized":"2024-09-13T06:30:39.570695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:36.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316128+0000","last_change":"2024-09-13T06:28:58.716677+0000","last_active":"2024-09-13T06:30:40.316128+0000","last_peered":"2024-09-13T06:30:40.316128+0000","last_clean":"2024-09-13T06:30:40.316128+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:30:40.316128+0000","last_undegraded":"2024-09-13T06:30:40.316128+0000","last_fullsized":"2024-09-13T06:30:40.316128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965751+0000","last_change":"2024-09-13T06:29:39.515090+0000","last_active":"2024-09-13T06:32:13.965751+0000","last_peered":"2024-09-13T06:32:13.965751+0000","last_clean":"2024-09-13T06:32:13.965751+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:32:13.965751+0000","last_undegraded":"2024-09-13T06:32:13.965751+0000","last_fullsized":"2024-09-13T06:32:13.965751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:44.609771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52164,"kb_used_data":16820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319676,"statfs":{"total":96636764160,"available":96583348224,"internally_reserved":0,"allocated":17223680,"data_stored":16928749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49324,"kb_used_data":9820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322516,"statfs":{"total":96636764160,"available":96586256384,"internally_reserved":0,"allocated":10055680,"data_stored":9770864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48664,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323176,"statfs":{"total":96636764160,"available":96586932224,"internally_reserved":0,"allocated":13639680,"data_stored":13325489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":13400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":13721600,"data_stored":13377560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:32:46.403 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:32:46.404 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:32:46.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.554+0000 7f6cbebb8640 1 Processor -- start 2024-09-13T06:32:46.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.554+0000 7f6cbebb8640 1 -- start start 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.554+0000 7f6cbebb8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cb812e260 0x7f6cb8130650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.554+0000 7f6cbebb8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb806e970 con 0x7f6cb8127c00 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.554+0000 7f6cbebb8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6cb8070270 con 0x7f6cb812e260 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbc954640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6cb8127c00 0x7f6cb8127fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46446/0 (socket says 172.21.15.112:46446) 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbc954640 1 -- 172.21.15.112:0/4236367736 learned_addr learned my addr 172.21.15.112:0/4236367736 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb7fff640 1 --2- 172.21.15.112:0/4236367736 >> v2:172.21.15.112:3300/0 conn(0x7f6cb812e260 0x7f6cb8130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb77fe640 1 -- 172.21.15.112:0/4236367736 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183450171 0 0) 0x7f6cb806e970 con 0x7f6cb8127c00 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb77fe640 1 -- 172.21.15.112:0/4236367736 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca4003530 con 0x7f6cb8127c00 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb7fff640 1 -- 172.21.15.112:0/4236367736 >> v1:172.21.15.112:6789/0 conn(0x7f6cb8127c00 legacy=0x7f6cb8127fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb7fff640 1 -- 172.21.15.112:0/4236367736 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb8070580 con 0x7f6cb812e260 2024-09-13T06:32:46.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb7fff640 1 --2- 172.21.15.112:0/4236367736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb812e260 0x7f6cb8130650 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009740 tx=0x7f6ca001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a9b36051d943b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb77fe640 1 -- 172.21.15.112:0/4236367736 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca00b0070 con 0x7f6cb812e260 2024-09-13T06:32:46.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb77fe640 1 -- 172.21.15.112:0/4236367736 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca00ab530 con 0x7f6cb812e260 2024-09-13T06:32:46.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cb77fe640 1 -- 172.21.15.112:0/4236367736 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca00ab830 con 0x7f6cb812e260 2024-09-13T06:32:46.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 -- 172.21.15.112:0/4236367736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb812e260 msgr2=0x7f6cb8130650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 --2- 172.21.15.112:0/4236367736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb812e260 0x7f6cb8130650 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009740 tx=0x7f6ca001c310 comp rx=0 tx=0).stop 2024-09-13T06:32:46.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 -- 172.21.15.112:0/4236367736 shutdown_connections 2024-09-13T06:32:46.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 --2- 172.21.15.112:0/4236367736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb812e260 0x7f6cb8130650 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 -- 172.21.15.112:0/4236367736 >> 172.21.15.112:0/4236367736 conn(0x7f6cb8099a50 msgr2=0x7f6cb80972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:46.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 -- 172.21.15.112:0/4236367736 shutdown_connections 2024-09-13T06:32:46.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.558+0000 7f6cbebb8640 1 -- 172.21.15.112:0/4236367736 wait complete. 2024-09-13T06:32:46.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 Processor -- start 2024-09-13T06:32:46.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 -- start start 2024-09-13T06:32:46.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 0x7f6cb8122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8135040 con 0x7f6cb8127c00 2024-09-13T06:32:46.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbc954640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 0x7f6cb8122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbc954640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 0x7f6cb8122ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46202/0 (socket says 172.21.15.112:46202) 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbc954640 1 -- 172.21.15.112:0/3287448766 learned_addr learned my addr 172.21.15.112:0/3287448766 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbc954640 1 -- 172.21.15.112:0/3287448766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb8125a60 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbc954640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 0x7f6cb8122ac0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000cb40 tx=0x7f6cb000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0017070 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb000abf0 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0012400 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb8124e30 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb8123000 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb8127fe0 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6cb001a070 con 0x7f6cb8127c00 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb57fa640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6c98035de0 0x7f6c980382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f6cb0048e10 con 0x7f6cb8127c00 2024-09-13T06:32:46.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.562+0000 7f6cb7fff640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6c98035de0 0x7f6c980382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.566+0000 7f6cb7fff640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6c98035de0 0x7f6c980382a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00ad000 tx=0x7f6ca00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.566+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cb00078c0 con 0x7f6cb8127c00 2024-09-13T06:32:46.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.726+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cb8123bc0 con 0x7f6c98035de0 2024-09-13T06:32:46.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.774+0000 7f6cb57fa640 1 -- 172.21.15.112:0/3287448766 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665525 (secure 0 0 0) 0x7f6cb8123bc0 con 0x7f6c98035de0 2024-09-13T06:32:46.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:32:46.788 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:32:46.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6c98035de0 msgr2=0x7f6c980382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6c98035de0 0x7f6c980382a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00ad000 tx=0x7f6ca00a6000 comp rx=0 tx=0).stop 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 msgr2=0x7f6cb8122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 0x7f6cb8122ac0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000cb40 tx=0x7f6cb000a060 comp rx=0 tx=0).stop 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 shutdown_connections 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6c98035de0 0x7f6c980382a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 --2- 172.21.15.112:0/3287448766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cb8127c00 0x7f6cb8122ac0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 >> 172.21.15.112:0/3287448766 conn(0x7f6cb8099a50 msgr2=0x7f6cb8071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 shutdown_connections 2024-09-13T06:32:46.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.778+0000 7f6cbebb8640 1 -- 172.21.15.112:0/3287448766 wait complete. 2024-09-13T06:32:46.800 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T06:32:46.505389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9635593,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":4997,"num_read_kb":4577,"num_write":2146,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4552,"ondisk_log_size":4552,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198896,"kb_used_data":53360,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288464,"statfs":{"total":386547056640,"available":386343387136,"internally_reserved":0,"allocated":54640640,"data_stored":53402662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16777216,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005684"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576389+0000","last_change":"2024-09-13T06:28:58.716560+0000","last_active":"2024-09-13T06:30:39.576389+0000","last_peered":"2024-09-13T06:30:39.576389+0000","last_clean":"2024-09-13T06:30:39.576389+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:30:39.576389+0000","last_undegraded":"2024-09-13T06:30:39.576389+0000","last_fullsized":"2024-09-13T06:30:39.576389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:38.476549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776956+0000","last_change":"2024-09-13T06:29:00.715147+0000","last_active":"2024-09-13T06:32:13.776956+0000","last_peered":"2024-09-13T06:32:13.776956+0000","last_clean":"2024-09-13T06:32:13.776956+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:32:13.776956+0000","last_undegraded":"2024-09-13T06:32:13.776956+0000","last_fullsized":"2024-09-13T06:32:13.776956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318678+0000","last_change":"2024-09-13T06:28:58.727026+0000","last_active":"2024-09-13T06:30:40.318678+0000","last_peered":"2024-09-13T06:30:40.318678+0000","last_clean":"2024-09-13T06:30:40.318678+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:30:40.318678+0000","last_undegraded":"2024-09-13T06:30:40.318678+0000","last_fullsized":"2024-09-13T06:30:40.318678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.916216+0000","last_change":"2024-09-13T06:29:00.709791+0000","last_active":"2024-09-13T06:31:07.916216+0000","last_peered":"2024-09-13T06:31:07.916216+0000","last_clean":"2024-09-13T06:31:07.916216+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:31:07.916216+0000","last_undegraded":"2024-09-13T06:31:07.916216+0000","last_fullsized":"2024-09-13T06:31:07.916216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.258504+0000","last_change":"2024-09-13T06:28:58.725541+0000","last_active":"2024-09-13T06:32:13.258504+0000","last_peered":"2024-09-13T06:32:13.258504+0000","last_clean":"2024-09-13T06:32:13.258504+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:32:13.258504+0000","last_undegraded":"2024-09-13T06:32:13.258504+0000","last_fullsized":"2024-09-13T06:32:13.258504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495245+0000","last_change":"2024-09-13T06:29:00.707081+0000","last_active":"2024-09-13T06:31:30.495245+0000","last_peered":"2024-09-13T06:31:30.495245+0000","last_clean":"2024-09-13T06:31:30.495245+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:31:30.495245+0000","last_undegraded":"2024-09-13T06:31:30.495245+0000","last_fullsized":"2024-09-13T06:31:30.495245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566859+0000","last_change":"2024-09-13T06:28:58.721790+0000","last_active":"2024-09-13T06:30:39.566859+0000","last_peered":"2024-09-13T06:30:39.566859+0000","last_clean":"2024-09-13T06:30:39.566859+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:30:39.566859+0000","last_undegraded":"2024-09-13T06:30:39.566859+0000","last_fullsized":"2024-09-13T06:30:39.566859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:58.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905522+0000","last_change":"2024-09-13T06:29:00.707794+0000","last_active":"2024-09-13T06:30:39.905522+0000","last_peered":"2024-09-13T06:30:39.905522+0000","last_clean":"2024-09-13T06:30:39.905522+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:30:39.905522+0000","last_undegraded":"2024-09-13T06:30:39.905522+0000","last_fullsized":"2024-09-13T06:30:39.905522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572406+0000","last_change":"2024-09-13T06:28:58.707336+0000","last_active":"2024-09-13T06:30:39.572406+0000","last_peered":"2024-09-13T06:30:39.572406+0000","last_clean":"2024-09-13T06:30:39.572406+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:30:39.572406+0000","last_undegraded":"2024-09-13T06:30:39.572406+0000","last_fullsized":"2024-09-13T06:30:39.572406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121211+0000","last_change":"2024-09-13T06:29:00.731442+0000","last_active":"2024-09-13T06:32:14.121211+0000","last_peered":"2024-09-13T06:32:14.121211+0000","last_clean":"2024-09-13T06:32:14.121211+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:32:14.121211+0000","last_undegraded":"2024-09-13T06:32:14.121211+0000","last_fullsized":"2024-09-13T06:32:14.121211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573099+0000","last_change":"2024-09-13T06:28:58.734653+0000","last_active":"2024-09-13T06:30:39.573099+0000","last_peered":"2024-09-13T06:30:39.573099+0000","last_clean":"2024-09-13T06:30:39.573099+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:30:39.573099+0000","last_undegraded":"2024-09-13T06:30:39.573099+0000","last_fullsized":"2024-09-13T06:30:39.573099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.648254+0000","last_change":"2024-09-13T06:29:00.726885+0000","last_active":"2024-09-13T06:31:12.648254+0000","last_peered":"2024-09-13T06:31:12.648254+0000","last_clean":"2024-09-13T06:31:12.648254+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:31:12.648254+0000","last_undegraded":"2024-09-13T06:31:12.648254+0000","last_fullsized":"2024-09-13T06:31:12.648254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904763+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:30:39.904763+0000","last_peered":"2024-09-13T06:30:39.904763+0000","last_clean":"2024-09-13T06:30:39.904763+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:30:39.904763+0000","last_undegraded":"2024-09-13T06:30:39.904763+0000","last_fullsized":"2024-09-13T06:30:39.904763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.650812+0000","last_change":"2024-09-13T06:29:00.727067+0000","last_active":"2024-09-13T06:31:12.650812+0000","last_peered":"2024-09-13T06:31:12.650812+0000","last_clean":"2024-09-13T06:31:12.650812+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:31:12.650812+0000","last_undegraded":"2024-09-13T06:31:12.650812+0000","last_fullsized":"2024-09-13T06:31:12.650812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903907+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:30:39.903907+0000","last_peered":"2024-09-13T06:30:39.903907+0000","last_clean":"2024-09-13T06:30:39.903907+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:30:39.903907+0000","last_undegraded":"2024-09-13T06:30:39.903907+0000","last_fullsized":"2024-09-13T06:30:39.903907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.409976+0000","last_change":"2024-09-13T06:29:00.709914+0000","last_active":"2024-09-13T06:32:13.409976+0000","last_peered":"2024-09-13T06:32:13.409976+0000","last_clean":"2024-09-13T06:32:13.409976+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:32:13.409976+0000","last_undegraded":"2024-09-13T06:32:13.409976+0000","last_fullsized":"2024-09-13T06:32:13.409976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:37.375577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570878+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:13.570878+0000","last_peered":"2024-09-13T06:32:13.570878+0000","last_clean":"2024-09-13T06:32:13.570878+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:13.570878+0000","last_undegraded":"2024-09-13T06:32:13.570878+0000","last_fullsized":"2024-09-13T06:32:13.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321617+0000","last_change":"2024-09-13T06:28:58.730725+0000","last_active":"2024-09-13T06:30:40.321617+0000","last_peered":"2024-09-13T06:30:40.321617+0000","last_clean":"2024-09-13T06:30:40.321617+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:30:40.321617+0000","last_undegraded":"2024-09-13T06:30:40.321617+0000","last_fullsized":"2024-09-13T06:30:40.321617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.569961+0000","last_change":"2024-09-13T06:29:00.723386+0000","last_active":"2024-09-13T06:32:13.569961+0000","last_peered":"2024-09-13T06:32:13.569961+0000","last_clean":"2024-09-13T06:32:13.569961+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:32:13.569961+0000","last_undegraded":"2024-09-13T06:32:13.569961+0000","last_fullsized":"2024-09-13T06:32:13.569961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570235+0000","last_change":"2024-09-13T06:28:58.722377+0000","last_active":"2024-09-13T06:30:39.570235+0000","last_peered":"2024-09-13T06:30:39.570235+0000","last_clean":"2024-09-13T06:30:39.570235+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:30:39.570235+0000","last_undegraded":"2024-09-13T06:30:39.570235+0000","last_fullsized":"2024-09-13T06:30:39.570235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:18.147418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776857+0000","last_change":"2024-09-13T06:29:00.714209+0000","last_active":"2024-09-13T06:32:13.776857+0000","last_peered":"2024-09-13T06:32:13.776857+0000","last_clean":"2024-09-13T06:32:13.776857+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:32:13.776857+0000","last_undegraded":"2024-09-13T06:32:13.776857+0000","last_fullsized":"2024-09-13T06:32:13.776857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:33.364861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578134+0000","last_change":"2024-09-13T06:28:58.735019+0000","last_active":"2024-09-13T06:30:39.578134+0000","last_peered":"2024-09-13T06:30:39.578134+0000","last_clean":"2024-09-13T06:30:39.578134+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:30:39.578134+0000","last_undegraded":"2024-09-13T06:30:39.578134+0000","last_fullsized":"2024-09-13T06:30:39.578134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:38.804190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496657+0000","last_change":"2024-09-13T06:29:00.707042+0000","last_active":"2024-09-13T06:31:25.496657+0000","last_peered":"2024-09-13T06:31:25.496657+0000","last_clean":"2024-09-13T06:31:25.496657+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:31:25.496657+0000","last_undegraded":"2024-09-13T06:31:25.496657+0000","last_fullsized":"2024-09-13T06:31:25.496657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:22.300308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574705+0000","last_change":"2024-09-13T06:28:58.714709+0000","last_active":"2024-09-13T06:30:39.574705+0000","last_peered":"2024-09-13T06:30:39.574705+0000","last_clean":"2024-09-13T06:30:39.574705+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:30:39.574705+0000","last_undegraded":"2024-09-13T06:30:39.574705+0000","last_fullsized":"2024-09-13T06:30:39.574705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.663641+0000","last_change":"2024-09-13T06:29:00.706074+0000","last_active":"2024-09-13T06:31:12.663641+0000","last_peered":"2024-09-13T06:31:12.663641+0000","last_clean":"2024-09-13T06:31:12.663641+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:31:12.663641+0000","last_undegraded":"2024-09-13T06:31:12.663641+0000","last_fullsized":"2024-09-13T06:31:12.663641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:11.542286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905694+0000","last_change":"2024-09-13T06:28:58.710981+0000","last_active":"2024-09-13T06:30:39.905694+0000","last_peered":"2024-09-13T06:30:39.905694+0000","last_clean":"2024-09-13T06:30:39.905694+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:30:39.905694+0000","last_undegraded":"2024-09-13T06:30:39.905694+0000","last_fullsized":"2024-09-13T06:30:39.905694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889912+0000","last_change":"2024-09-13T06:29:00.726304+0000","last_active":"2024-09-13T06:32:13.889912+0000","last_peered":"2024-09-13T06:32:13.889912+0000","last_clean":"2024-09-13T06:32:13.889912+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:32:13.889912+0000","last_undegraded":"2024-09-13T06:32:13.889912+0000","last_fullsized":"2024-09-13T06:32:13.889912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:43.482408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904541+0000","last_change":"2024-09-13T06:28:58.725296+0000","last_active":"2024-09-13T06:30:39.904541+0000","last_peered":"2024-09-13T06:30:39.904541+0000","last_clean":"2024-09-13T06:30:39.904541+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:30:39.904541+0000","last_undegraded":"2024-09-13T06:30:39.904541+0000","last_fullsized":"2024-09-13T06:30:39.904541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.840079+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:13.840079+0000","last_peered":"2024-09-13T06:32:13.840079+0000","last_clean":"2024-09-13T06:32:13.840079+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:13.840079+0000","last_undegraded":"2024-09-13T06:32:13.840079+0000","last_fullsized":"2024-09-13T06:32:13.840079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:03.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888319+0000","last_change":"2024-09-13T06:29:00.723084+0000","last_active":"2024-09-13T06:32:13.888319+0000","last_peered":"2024-09-13T06:32:13.888319+0000","last_clean":"2024-09-13T06:32:13.888319+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:32:13.888319+0000","last_undegraded":"2024-09-13T06:32:13.888319+0000","last_fullsized":"2024-09-13T06:32:13.888319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905169+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:30:39.905169+0000","last_peered":"2024-09-13T06:30:39.905169+0000","last_clean":"2024-09-13T06:30:39.905169+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:30:39.905169+0000","last_undegraded":"2024-09-13T06:30:39.905169+0000","last_fullsized":"2024-09-13T06:30:39.905169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910459+0000","last_change":"2024-09-13T06:29:02.740336+0000","last_active":"2024-09-13T06:30:39.910459+0000","last_peered":"2024-09-13T06:30:39.910459+0000","last_clean":"2024-09-13T06:30:39.910459+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:30:39.910459+0000","last_undegraded":"2024-09-13T06:30:39.910459+0000","last_fullsized":"2024-09-13T06:30:39.910459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'33","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.447012+0000","last_change":"2024-09-13T06:29:04.756002+0000","last_active":"2024-09-13T06:32:45.447012+0000","last_peered":"2024-09-13T06:32:45.447012+0000","last_clean":"2024-09-13T06:32:45.447012+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:32:45.447012+0000","last_undegraded":"2024-09-13T06:32:45.447012+0000","last_fullsized":"2024-09-13T06:32:45.447012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:14.061458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578407+0000","last_change":"2024-09-13T06:29:06.774781+0000","last_active":"2024-09-13T06:30:39.578407+0000","last_peered":"2024-09-13T06:30:39.578407+0000","last_clean":"2024-09-13T06:30:39.578407+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:30:39.578407+0000","last_undegraded":"2024-09-13T06:30:39.578407+0000","last_fullsized":"2024-09-13T06:30:39.578407+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:56.034092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570612+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:30:39.570612+0000","last_peered":"2024-09-13T06:30:39.570612+0000","last_clean":"2024-09-13T06:30:39.570612+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:30:39.570612+0000","last_undegraded":"2024-09-13T06:30:39.570612+0000","last_fullsized":"2024-09-13T06:30:39.570612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:17.606468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.412627+0000","last_change":"2024-09-13T06:29:00.707011+0000","last_active":"2024-09-13T06:32:13.412627+0000","last_peered":"2024-09-13T06:32:13.412627+0000","last_clean":"2024-09-13T06:32:13.412627+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:32:13.412627+0000","last_undegraded":"2024-09-13T06:32:13.412627+0000","last_fullsized":"2024-09-13T06:32:13.412627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567903+0000","last_change":"2024-09-13T06:28:58.722224+0000","last_active":"2024-09-13T06:30:39.567903+0000","last_peered":"2024-09-13T06:30:39.567903+0000","last_clean":"2024-09-13T06:30:39.567903+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:30:39.567903+0000","last_undegraded":"2024-09-13T06:30:39.567903+0000","last_fullsized":"2024-09-13T06:30:39.567903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:01.378918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"24'1","reported_seq":224,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.095087+0000","last_change":"2024-09-13T06:29:02.717632+0000","last_active":"2024-09-13T06:32:45.095087+0000","last_peered":"2024-09-13T06:32:45.095087+0000","last_clean":"2024-09-13T06:32:45.095087+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:32:45.095087+0000","last_undegraded":"2024-09-13T06:32:45.095087+0000","last_fullsized":"2024-09-13T06:32:45.095087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319748+0000","last_change":"2024-09-13T06:29:04.739615+0000","last_active":"2024-09-13T06:30:40.319748+0000","last_peered":"2024-09-13T06:30:40.319748+0000","last_clean":"2024-09-13T06:30:40.319748+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:30:40.319748+0000","last_undegraded":"2024-09-13T06:30:40.319748+0000","last_fullsized":"2024-09-13T06:30:40.319748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:15.527728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573848+0000","last_change":"2024-09-13T06:29:06.774338+0000","last_active":"2024-09-13T06:30:39.573848+0000","last_peered":"2024-09-13T06:30:39.573848+0000","last_clean":"2024-09-13T06:30:39.573848+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:30:39.573848+0000","last_undegraded":"2024-09-13T06:30:39.573848+0000","last_fullsized":"2024-09-13T06:30:39.573848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:37.772201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903912+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:30:39.903912+0000","last_peered":"2024-09-13T06:30:39.903912+0000","last_clean":"2024-09-13T06:30:39.903912+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:30:39.903912+0000","last_undegraded":"2024-09-13T06:30:39.903912+0000","last_fullsized":"2024-09-13T06:30:39.903912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:11.691804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908288+0000","last_change":"2024-09-13T06:29:00.718205+0000","last_active":"2024-09-13T06:30:39.908288+0000","last_peered":"2024-09-13T06:30:39.908288+0000","last_clean":"2024-09-13T06:30:39.908288+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:30:39.908288+0000","last_undegraded":"2024-09-13T06:30:39.908288+0000","last_fullsized":"2024-09-13T06:30:39.908288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570600+0000","last_change":"2024-09-13T06:28:58.716607+0000","last_active":"2024-09-13T06:30:39.570600+0000","last_peered":"2024-09-13T06:30:39.570600+0000","last_clean":"2024-09-13T06:30:39.570600+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:30:39.570600+0000","last_undegraded":"2024-09-13T06:30:39.570600+0000","last_fullsized":"2024-09-13T06:30:39.570600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908756+0000","last_change":"2024-09-13T06:29:02.744274+0000","last_active":"2024-09-13T06:30:39.908756+0000","last_peered":"2024-09-13T06:30:39.908756+0000","last_clean":"2024-09-13T06:30:39.908756+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:30:39.908756+0000","last_undegraded":"2024-09-13T06:30:39.908756+0000","last_fullsized":"2024-09-13T06:30:39.908756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:14.111953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.918645+0000","last_change":"2024-09-13T06:29:04.723996+0000","last_active":"2024-09-13T06:31:07.918645+0000","last_peered":"2024-09-13T06:31:07.918645+0000","last_clean":"2024-09-13T06:31:07.918645+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:31:07.918645+0000","last_undegraded":"2024-09-13T06:31:07.918645+0000","last_fullsized":"2024-09-13T06:31:07.918645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:51.065801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.299299+0000","last_change":"2024-09-13T06:29:06.751269+0000","last_active":"2024-09-13T06:32:14.299299+0000","last_peered":"2024-09-13T06:32:14.299299+0000","last_clean":"2024-09-13T06:32:14.299299+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:32:14.299299+0000","last_undegraded":"2024-09-13T06:32:14.299299+0000","last_fullsized":"2024-09-13T06:32:14.299299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:53.815753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.125083+0000","last_change":"2024-09-13T06:29:08.762118+0000","last_active":"2024-09-13T06:32:14.125083+0000","last_peered":"2024-09-13T06:32:14.125083+0000","last_clean":"2024-09-13T06:32:14.125083+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:14.125083+0000","last_undegraded":"2024-09-13T06:32:14.125083+0000","last_fullsized":"2024-09-13T06:32:14.125083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.846533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910532+0000","last_change":"2024-09-13T06:29:00.733199+0000","last_active":"2024-09-13T06:30:39.910532+0000","last_peered":"2024-09-13T06:30:39.910532+0000","last_clean":"2024-09-13T06:30:39.910532+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:30:39.910532+0000","last_undegraded":"2024-09-13T06:30:39.910532+0000","last_fullsized":"2024-09-13T06:30:39.910532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570421+0000","last_change":"2024-09-13T06:28:58.715013+0000","last_active":"2024-09-13T06:30:39.570421+0000","last_peered":"2024-09-13T06:30:39.570421+0000","last_clean":"2024-09-13T06:30:39.570421+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:30:39.570421+0000","last_undegraded":"2024-09-13T06:30:39.570421+0000","last_fullsized":"2024-09-13T06:30:39.570421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:30.316190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575935+0000","last_change":"2024-09-13T06:29:02.715794+0000","last_active":"2024-09-13T06:30:39.575935+0000","last_peered":"2024-09-13T06:30:39.575935+0000","last_clean":"2024-09-13T06:30:39.575935+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:30:39.575935+0000","last_undegraded":"2024-09-13T06:30:39.575935+0000","last_fullsized":"2024-09-13T06:30:39.575935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:41.286736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.240501+0000","last_change":"2024-09-13T06:29:04.733210+0000","last_active":"2024-09-13T06:31:10.240501+0000","last_peered":"2024-09-13T06:31:10.240501+0000","last_clean":"2024-09-13T06:31:10.240501+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:31:10.240501+0000","last_undegraded":"2024-09-13T06:31:10.240501+0000","last_fullsized":"2024-09-13T06:31:10.240501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:44.479614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":409,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.140888+0000","last_change":"2024-09-13T06:29:06.768162+0000","last_active":"2024-09-13T06:32:45.140888+0000","last_peered":"2024-09-13T06:32:45.140888+0000","last_clean":"2024-09-13T06:32:45.140888+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:32:45.140888+0000","last_undegraded":"2024-09-13T06:32:45.140888+0000","last_fullsized":"2024-09-13T06:32:45.140888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:18.825186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965940+0000","last_change":"2024-09-13T06:29:39.532873+0000","last_active":"2024-09-13T06:32:13.965940+0000","last_peered":"2024-09-13T06:32:13.965940+0000","last_clean":"2024-09-13T06:32:13.965940+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:32:13.965940+0000","last_undegraded":"2024-09-13T06:32:13.965940+0000","last_fullsized":"2024-09-13T06:32:13.965940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:04.879833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'1","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493366+0000","last_change":"2024-09-13T06:28:58.715791+0000","last_active":"2024-09-13T06:31:14.493366+0000","last_peered":"2024-09-13T06:31:14.493366+0000","last_clean":"2024-09-13T06:31:14.493366+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:31:14.493366+0000","last_undegraded":"2024-09-13T06:31:14.493366+0000","last_fullsized":"2024-09-13T06:31:14.493366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:36.060034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318177+0000","last_change":"2024-09-13T06:29:02.732052+0000","last_active":"2024-09-13T06:30:40.318177+0000","last_peered":"2024-09-13T06:30:40.318177+0000","last_clean":"2024-09-13T06:30:40.318177+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:30:40.318177+0000","last_undegraded":"2024-09-13T06:30:40.318177+0000","last_fullsized":"2024-09-13T06:30:40.318177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'41","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493106+0000","last_change":"2024-09-13T06:29:04.731973+0000","last_active":"2024-09-13T06:31:14.493106+0000","last_peered":"2024-09-13T06:31:14.493106+0000","last_clean":"2024-09-13T06:31:14.493106+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:31:14.493106+0000","last_undegraded":"2024-09-13T06:31:14.493106+0000","last_fullsized":"2024-09-13T06:31:14.493106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:07.767226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316676+0000","last_change":"2024-09-13T06:29:06.747941+0000","last_active":"2024-09-13T06:30:40.316676+0000","last_peered":"2024-09-13T06:30:40.316676+0000","last_clean":"2024-09-13T06:30:40.316676+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:30:40.316676+0000","last_undegraded":"2024-09-13T06:30:40.316676+0000","last_fullsized":"2024-09-13T06:30:40.316676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:08.367030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568553+0000","last_change":"2024-09-13T06:29:08.791498+0000","last_active":"2024-09-13T06:30:39.568553+0000","last_peered":"2024-09-13T06:30:39.568553+0000","last_clean":"2024-09-13T06:30:39.568553+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:30:39.568553+0000","last_undegraded":"2024-09-13T06:30:39.568553+0000","last_fullsized":"2024-09-13T06:30:39.568553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:55.628851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'25","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908109+0000","last_change":"2024-09-13T06:29:00.726697+0000","last_active":"2024-09-13T06:32:13.908109+0000","last_peered":"2024-09-13T06:32:13.908109+0000","last_clean":"2024-09-13T06:32:13.908109+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:32:13.908109+0000","last_undegraded":"2024-09-13T06:32:13.908109+0000","last_fullsized":"2024-09-13T06:32:13.908109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.526443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493313+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:31:14.493313+0000","last_peered":"2024-09-13T06:31:14.493313+0000","last_clean":"2024-09-13T06:31:14.493313+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:31:14.493313+0000","last_undegraded":"2024-09-13T06:31:14.493313+0000","last_fullsized":"2024-09-13T06:31:14.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:12.552536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567535+0000","last_change":"2024-09-13T06:29:02.724597+0000","last_active":"2024-09-13T06:30:39.567535+0000","last_peered":"2024-09-13T06:30:39.567535+0000","last_clean":"2024-09-13T06:30:39.567535+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:30:39.567535+0000","last_undegraded":"2024-09-13T06:30:39.567535+0000","last_fullsized":"2024-09-13T06:30:39.567535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:30.887850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'33","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.307152+0000","last_change":"2024-09-13T06:29:04.754051+0000","last_active":"2024-09-13T06:32:45.307152+0000","last_peered":"2024-09-13T06:32:45.307152+0000","last_clean":"2024-09-13T06:32:45.307152+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:32:45.307152+0000","last_undegraded":"2024-09-13T06:32:45.307152+0000","last_fullsized":"2024-09-13T06:32:45.307152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:21.961022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907432+0000","last_change":"2024-09-13T06:29:06.762829+0000","last_active":"2024-09-13T06:30:39.907432+0000","last_peered":"2024-09-13T06:30:39.907432+0000","last_clean":"2024-09-13T06:30:39.907432+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:30:39.907432+0000","last_undegraded":"2024-09-13T06:30:39.907432+0000","last_fullsized":"2024-09-13T06:30:39.907432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:01.035464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317329+0000","last_change":"2024-09-13T06:29:08.766459+0000","last_active":"2024-09-13T06:30:40.317329+0000","last_peered":"2024-09-13T06:30:40.317329+0000","last_clean":"2024-09-13T06:30:40.317329+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:30:40.317329+0000","last_undegraded":"2024-09-13T06:30:40.317329+0000","last_fullsized":"2024-09-13T06:30:40.317329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:15.266692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.913863+0000","last_change":"2024-09-13T06:29:00.717664+0000","last_active":"2024-09-13T06:31:07.913863+0000","last_peered":"2024-09-13T06:31:07.913863+0000","last_clean":"2024-09-13T06:31:07.913863+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:31:07.913863+0000","last_undegraded":"2024-09-13T06:31:07.913863+0000","last_fullsized":"2024-09-13T06:31:07.913863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:51.974933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576427+0000","last_change":"2024-09-13T06:28:58.734667+0000","last_active":"2024-09-13T06:30:39.576427+0000","last_peered":"2024-09-13T06:30:39.576427+0000","last_clean":"2024-09-13T06:30:39.576427+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:30:39.576427+0000","last_undegraded":"2024-09-13T06:30:39.576427+0000","last_fullsized":"2024-09-13T06:30:39.576427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:44.299300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567032+0000","last_change":"2024-09-13T06:29:02.722214+0000","last_active":"2024-09-13T06:30:39.567032+0000","last_peered":"2024-09-13T06:30:39.567032+0000","last_clean":"2024-09-13T06:30:39.567032+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:30:39.567032+0000","last_undegraded":"2024-09-13T06:30:39.567032+0000","last_fullsized":"2024-09-13T06:30:39.567032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:53.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.263596+0000","last_change":"2024-09-13T06:29:04.732118+0000","last_active":"2024-09-13T06:31:10.263596+0000","last_peered":"2024-09-13T06:31:10.263596+0000","last_clean":"2024-09-13T06:31:10.263596+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:31:10.263596+0000","last_undegraded":"2024-09-13T06:31:10.263596+0000","last_fullsized":"2024-09-13T06:31:10.263596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:17.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":356,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.142179+0000","last_change":"2024-09-13T06:29:06.772585+0000","last_active":"2024-09-13T06:32:45.142179+0000","last_peered":"2024-09-13T06:32:45.142179+0000","last_clean":"2024-09-13T06:32:45.142179+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:45.142179+0000","last_undegraded":"2024-09-13T06:32:45.142179+0000","last_fullsized":"2024-09-13T06:32:45.142179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:31.824682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319032+0000","last_change":"2024-09-13T06:29:08.777939+0000","last_active":"2024-09-13T06:30:40.319032+0000","last_peered":"2024-09-13T06:30:40.319032+0000","last_clean":"2024-09-13T06:30:40.319032+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:30:40.319032+0000","last_undegraded":"2024-09-13T06:30:40.319032+0000","last_fullsized":"2024-09-13T06:30:40.319032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:59.485064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965033+0000","last_change":"2024-09-13T06:29:00.718738+0000","last_active":"2024-09-13T06:32:13.965033+0000","last_peered":"2024-09-13T06:32:13.965033+0000","last_clean":"2024-09-13T06:32:13.965033+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:32:13.965033+0000","last_undegraded":"2024-09-13T06:32:13.965033+0000","last_fullsized":"2024-09-13T06:32:13.965033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:39:59.890086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'3","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493208+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:31:14.493208+0000","last_peered":"2024-09-13T06:31:14.493208+0000","last_clean":"2024-09-13T06:31:14.493208+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:31:14.493208+0000","last_undegraded":"2024-09-13T06:31:14.493208+0000","last_fullsized":"2024-09-13T06:31:14.493208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.897247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567233+0000","last_change":"2024-09-13T06:29:02.741159+0000","last_active":"2024-09-13T06:30:39.567233+0000","last_peered":"2024-09-13T06:30:39.567233+0000","last_clean":"2024-09-13T06:30:39.567233+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:30:39.567233+0000","last_undegraded":"2024-09-13T06:30:39.567233+0000","last_fullsized":"2024-09-13T06:30:39.567233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:49.008324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'61","reported_seq":129,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.337272+0000","last_change":"2024-09-13T06:29:04.748682+0000","last_active":"2024-09-13T06:32:45.337272+0000","last_peered":"2024-09-13T06:32:45.337272+0000","last_clean":"2024-09-13T06:32:45.337272+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:32:45.337272+0000","last_undegraded":"2024-09-13T06:32:45.337272+0000","last_fullsized":"2024-09-13T06:32:45.337272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:57:59.868813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567773+0000","last_change":"2024-09-13T06:29:06.761508+0000","last_active":"2024-09-13T06:30:39.567773+0000","last_peered":"2024-09-13T06:30:39.567773+0000","last_clean":"2024-09-13T06:30:39.567773+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:30:39.567773+0000","last_undegraded":"2024-09-13T06:30:39.567773+0000","last_fullsized":"2024-09-13T06:30:39.567773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:26.451521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.257072+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:14.257072+0000","last_peered":"2024-09-13T06:32:14.257072+0000","last_clean":"2024-09-13T06:32:14.257072+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:14.257072+0000","last_undegraded":"2024-09-13T06:32:14.257072+0000","last_fullsized":"2024-09-13T06:32:14.257072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:13.465995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.915876+0000","last_change":"2024-09-13T06:29:00.728932+0000","last_active":"2024-09-13T06:31:07.915876+0000","last_peered":"2024-09-13T06:31:07.915876+0000","last_clean":"2024-09-13T06:31:07.915876+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:31:07.915876+0000","last_undegraded":"2024-09-13T06:31:07.915876+0000","last_fullsized":"2024-09-13T06:31:07.915876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:17.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904865+0000","last_change":"2024-09-13T06:28:58.719722+0000","last_active":"2024-09-13T06:30:39.904865+0000","last_peered":"2024-09-13T06:30:39.904865+0000","last_clean":"2024-09-13T06:30:39.904865+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:30:39.904865+0000","last_undegraded":"2024-09-13T06:30:39.904865+0000","last_fullsized":"2024-09-13T06:30:39.904865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569358+0000","last_change":"2024-09-13T06:29:02.713294+0000","last_active":"2024-09-13T06:30:39.569358+0000","last_peered":"2024-09-13T06:30:39.569358+0000","last_clean":"2024-09-13T06:30:39.569358+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:30:39.569358+0000","last_undegraded":"2024-09-13T06:30:39.569358+0000","last_fullsized":"2024-09-13T06:30:39.569358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:48.621894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.228501+0000","last_change":"2024-09-13T06:29:04.731052+0000","last_active":"2024-09-13T06:31:10.228501+0000","last_peered":"2024-09-13T06:31:10.228501+0000","last_clean":"2024-09-13T06:31:10.228501+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:31:10.228501+0000","last_undegraded":"2024-09-13T06:31:10.228501+0000","last_fullsized":"2024-09-13T06:31:10.228501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:15.859442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907352+0000","last_change":"2024-09-13T06:29:06.772900+0000","last_active":"2024-09-13T06:30:39.907352+0000","last_peered":"2024-09-13T06:30:39.907352+0000","last_clean":"2024-09-13T06:30:39.907352+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:30:39.907352+0000","last_undegraded":"2024-09-13T06:30:39.907352+0000","last_fullsized":"2024-09-13T06:30:39.907352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:13.253864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489704+0000","last_change":"2024-09-13T06:29:08.785484+0000","last_active":"2024-09-13T06:31:10.489704+0000","last_peered":"2024-09-13T06:31:10.489704+0000","last_clean":"2024-09-13T06:31:10.489704+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:31:10.489704+0000","last_undegraded":"2024-09-13T06:31:10.489704+0000","last_fullsized":"2024-09-13T06:31:10.489704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.070123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.665886+0000","last_change":"2024-09-13T06:29:00.714668+0000","last_active":"2024-09-13T06:31:12.665886+0000","last_peered":"2024-09-13T06:31:12.665886+0000","last_clean":"2024-09-13T06:31:12.665886+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:31:12.665886+0000","last_undegraded":"2024-09-13T06:31:12.665886+0000","last_fullsized":"2024-09-13T06:31:12.665886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572293+0000","last_change":"2024-09-13T06:28:58.716633+0000","last_active":"2024-09-13T06:30:39.572293+0000","last_peered":"2024-09-13T06:30:39.572293+0000","last_clean":"2024-09-13T06:30:39.572293+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:30:39.572293+0000","last_undegraded":"2024-09-13T06:30:39.572293+0000","last_fullsized":"2024-09-13T06:30:39.572293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316839+0000","last_change":"2024-09-13T06:29:02.730107+0000","last_active":"2024-09-13T06:30:40.316839+0000","last_peered":"2024-09-13T06:30:40.316839+0000","last_clean":"2024-09-13T06:30:40.316839+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:30:40.316839+0000","last_undegraded":"2024-09-13T06:30:40.316839+0000","last_fullsized":"2024-09-13T06:30:40.316839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:11.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'39","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.288829+0000","last_change":"2024-09-13T06:29:04.746327+0000","last_active":"2024-09-13T06:32:45.288829+0000","last_peered":"2024-09-13T06:32:45.288829+0000","last_clean":"2024-09-13T06:32:45.288829+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:32:45.288829+0000","last_undegraded":"2024-09-13T06:32:45.288829+0000","last_fullsized":"2024-09-13T06:32:45.288829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:05.773239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.135851+0000","last_change":"2024-09-13T06:29:06.761923+0000","last_active":"2024-09-13T06:32:45.135851+0000","last_peered":"2024-09-13T06:32:45.135851+0000","last_clean":"2024-09-13T06:32:45.135851+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:45.135851+0000","last_undegraded":"2024-09-13T06:32:45.135851+0000","last_fullsized":"2024-09-13T06:32:45.135851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:01.791112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.911859+0000","last_change":"2024-09-13T06:29:08.773016+0000","last_active":"2024-09-13T06:32:13.911859+0000","last_peered":"2024-09-13T06:32:13.911859+0000","last_clean":"2024-09-13T06:32:13.911859+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:32:13.911859+0000","last_undegraded":"2024-09-13T06:32:13.911859+0000","last_fullsized":"2024-09-13T06:32:13.911859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:10.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984706+0000","last_change":"2024-09-13T06:29:00.705902+0000","last_active":"2024-09-13T06:32:13.984706+0000","last_peered":"2024-09-13T06:32:13.984706+0000","last_clean":"2024-09-13T06:32:13.984706+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:32:13.984706+0000","last_undegraded":"2024-09-13T06:32:13.984706+0000","last_fullsized":"2024-09-13T06:32:13.984706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:13.530929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.744249+0000","last_change":"2024-09-13T06:28:58.720215+0000","last_active":"2024-09-13T06:32:13.744249+0000","last_peered":"2024-09-13T06:32:13.744249+0000","last_clean":"2024-09-13T06:32:13.744249+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:32:13.744249+0000","last_undegraded":"2024-09-13T06:32:13.744249+0000","last_fullsized":"2024-09-13T06:32:13.744249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.763219+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:31:11.763219+0000","last_peered":"2024-09-13T06:31:11.763219+0000","last_clean":"2024-09-13T06:31:11.763219+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:31:11.763219+0000","last_undegraded":"2024-09-13T06:31:11.763219+0000","last_fullsized":"2024-09-13T06:31:11.763219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:18.248897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910468+0000","last_change":"2024-09-13T06:29:04.749190+0000","last_active":"2024-09-13T06:30:39.910468+0000","last_peered":"2024-09-13T06:30:39.910468+0000","last_clean":"2024-09-13T06:30:39.910468+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:30:39.910468+0000","last_undegraded":"2024-09-13T06:30:39.910468+0000","last_fullsized":"2024-09-13T06:30:39.910468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:38.367590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":470,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.131279+0000","last_change":"2024-09-13T06:29:06.751363+0000","last_active":"2024-09-13T06:32:14.131279+0000","last_peered":"2024-09-13T06:32:14.131279+0000","last_clean":"2024-09-13T06:32:14.131279+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:32:14.131279+0000","last_undegraded":"2024-09-13T06:32:14.131279+0000","last_fullsized":"2024-09-13T06:32:14.131279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:20.636655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.114868+0000","last_change":"2024-09-13T06:29:08.792692+0000","last_active":"2024-09-13T06:31:12.114868+0000","last_peered":"2024-09-13T06:31:12.114868+0000","last_clean":"2024-09-13T06:31:12.114868+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:31:12.114868+0000","last_undegraded":"2024-09-13T06:31:12.114868+0000","last_fullsized":"2024-09-13T06:31:12.114868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:44.557550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494543+0000","last_change":"2024-09-13T06:29:00.731625+0000","last_active":"2024-09-13T06:31:15.494543+0000","last_peered":"2024-09-13T06:31:15.494543+0000","last_clean":"2024-09-13T06:31:15.494543+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:31:15.494543+0000","last_undegraded":"2024-09-13T06:31:15.494543+0000","last_fullsized":"2024-09-13T06:31:15.494543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.326110+0000","last_change":"2024-09-13T06:28:58.719501+0000","last_active":"2024-09-13T06:32:45.326110+0000","last_peered":"2024-09-13T06:32:45.326110+0000","last_clean":"2024-09-13T06:32:45.326110+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:32:45.326110+0000","last_undegraded":"2024-09-13T06:32:45.326110+0000","last_fullsized":"2024-09-13T06:32:45.326110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:07:21.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908571+0000","last_change":"2024-09-13T06:29:02.721649+0000","last_active":"2024-09-13T06:30:39.908571+0000","last_peered":"2024-09-13T06:30:39.908571+0000","last_clean":"2024-09-13T06:30:39.908571+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:30:39.908571+0000","last_undegraded":"2024-09-13T06:30:39.908571+0000","last_fullsized":"2024-09-13T06:30:39.908571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:42.633548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.252844+0000","last_change":"2024-09-13T06:29:04.736682+0000","last_active":"2024-09-13T06:31:10.252844+0000","last_peered":"2024-09-13T06:31:10.252844+0000","last_clean":"2024-09-13T06:31:10.252844+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:31:10.252844+0000","last_undegraded":"2024-09-13T06:31:10.252844+0000","last_fullsized":"2024-09-13T06:31:10.252844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:59.443857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575252+0000","last_change":"2024-09-13T06:29:06.765942+0000","last_active":"2024-09-13T06:30:39.575252+0000","last_peered":"2024-09-13T06:30:39.575252+0000","last_clean":"2024-09-13T06:30:39.575252+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:30:39.575252+0000","last_undegraded":"2024-09-13T06:30:39.575252+0000","last_fullsized":"2024-09-13T06:30:39.575252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:40.247898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.062083+0000","last_change":"2024-09-13T06:29:08.765210+0000","last_active":"2024-09-13T06:32:14.062083+0000","last_peered":"2024-09-13T06:32:14.062083+0000","last_clean":"2024-09-13T06:32:14.062083+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:32:14.062083+0000","last_undegraded":"2024-09-13T06:32:14.062083+0000","last_fullsized":"2024-09-13T06:32:14.062083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:19.888668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889442+0000","last_change":"2024-09-13T06:29:00.723363+0000","last_active":"2024-09-13T06:32:13.889442+0000","last_peered":"2024-09-13T06:32:13.889442+0000","last_clean":"2024-09-13T06:32:13.889442+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:32:13.889442+0000","last_undegraded":"2024-09-13T06:32:13.889442+0000","last_fullsized":"2024-09-13T06:32:13.889442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:19:56.144098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.314554+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:30:40.314554+0000","last_peered":"2024-09-13T06:30:40.314554+0000","last_clean":"2024-09-13T06:30:40.314554+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:30:40.314554+0000","last_undegraded":"2024-09-13T06:30:40.314554+0000","last_fullsized":"2024-09-13T06:30:40.314554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:19.132984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572517+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:30:39.572517+0000","last_peered":"2024-09-13T06:30:39.572517+0000","last_clean":"2024-09-13T06:30:39.572517+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:30:39.572517+0000","last_undegraded":"2024-09-13T06:30:39.572517+0000","last_fullsized":"2024-09-13T06:30:39.572517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.927955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.893869+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:31:07.893869+0000","last_peered":"2024-09-13T06:31:07.893869+0000","last_clean":"2024-09-13T06:31:07.893869+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:31:07.893869+0000","last_undegraded":"2024-09-13T06:31:07.893869+0000","last_fullsized":"2024-09-13T06:31:07.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317017+0000","last_change":"2024-09-13T06:29:02.723791+0000","last_active":"2024-09-13T06:30:40.317017+0000","last_peered":"2024-09-13T06:30:40.317017+0000","last_clean":"2024-09-13T06:30:40.317017+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:30:40.317017+0000","last_undegraded":"2024-09-13T06:30:40.317017+0000","last_fullsized":"2024-09-13T06:30:40.317017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":149,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.275042+0000","last_change":"2024-09-13T06:29:04.750793+0000","last_active":"2024-09-13T06:31:10.275042+0000","last_peered":"2024-09-13T06:31:10.275042+0000","last_clean":"2024-09-13T06:31:10.275042+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:31:10.275042+0000","last_undegraded":"2024-09-13T06:31:10.275042+0000","last_fullsized":"2024-09-13T06:31:10.275042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:10:59.019066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.906152+0000","last_change":"2024-09-13T06:29:06.774102+0000","last_active":"2024-09-13T06:30:39.906152+0000","last_peered":"2024-09-13T06:30:39.906152+0000","last_clean":"2024-09-13T06:30:39.906152+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:30:39.906152+0000","last_undegraded":"2024-09-13T06:30:39.906152+0000","last_fullsized":"2024-09-13T06:30:39.906152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:32.602209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.993878+0000","last_change":"2024-09-13T06:29:08.791090+0000","last_active":"2024-09-13T06:32:13.993878+0000","last_peered":"2024-09-13T06:32:13.993878+0000","last_clean":"2024-09-13T06:32:13.993878+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:32:13.993878+0000","last_undegraded":"2024-09-13T06:32:13.993878+0000","last_fullsized":"2024-09-13T06:32:13.993878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:33.250567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908198+0000","last_change":"2024-09-13T06:29:00.724256+0000","last_active":"2024-09-13T06:30:39.908198+0000","last_peered":"2024-09-13T06:30:39.908198+0000","last_clean":"2024-09-13T06:30:39.908198+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:30:39.908198+0000","last_undegraded":"2024-09-13T06:30:39.908198+0000","last_fullsized":"2024-09-13T06:30:39.908198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571368+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:30:39.571368+0000","last_peered":"2024-09-13T06:30:39.571368+0000","last_clean":"2024-09-13T06:30:39.571368+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:30:39.571368+0000","last_undegraded":"2024-09-13T06:30:39.571368+0000","last_fullsized":"2024-09-13T06:30:39.571368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:55.462615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318457+0000","last_change":"2024-09-13T06:28:58.711388+0000","last_active":"2024-09-13T06:30:40.318457+0000","last_peered":"2024-09-13T06:30:40.318457+0000","last_clean":"2024-09-13T06:30:40.318457+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:30:40.318457+0000","last_undegraded":"2024-09-13T06:30:40.318457+0000","last_fullsized":"2024-09-13T06:30:40.318457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576408+0000","last_change":"2024-09-13T06:29:02.739238+0000","last_active":"2024-09-13T06:30:39.576408+0000","last_peered":"2024-09-13T06:30:39.576408+0000","last_clean":"2024-09-13T06:30:39.576408+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:30:39.576408+0000","last_undegraded":"2024-09-13T06:30:39.576408+0000","last_fullsized":"2024-09-13T06:30:39.576408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:36.820291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'284","reported_seq":505,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.421070+0000","last_change":"2024-09-13T06:29:04.740633+0000","last_active":"2024-09-13T06:32:45.421070+0000","last_peered":"2024-09-13T06:32:45.421070+0000","last_clean":"2024-09-13T06:32:45.421070+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:32:45.421070+0000","last_undegraded":"2024-09-13T06:32:45.421070+0000","last_fullsized":"2024-09-13T06:32:45.421070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:21.488854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905987+0000","last_change":"2024-09-13T06:29:06.768289+0000","last_active":"2024-09-13T06:30:39.905987+0000","last_peered":"2024-09-13T06:30:39.905987+0000","last_clean":"2024-09-13T06:30:39.905987+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:30:39.905987+0000","last_undegraded":"2024-09-13T06:30:39.905987+0000","last_fullsized":"2024-09-13T06:30:39.905987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.453168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.657752+0000","last_change":"2024-09-13T06:29:08.785933+0000","last_active":"2024-09-13T06:31:12.657752+0000","last_peered":"2024-09-13T06:31:12.657752+0000","last_clean":"2024-09-13T06:31:12.657752+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:31:12.657752+0000","last_undegraded":"2024-09-13T06:31:12.657752+0000","last_fullsized":"2024-09-13T06:31:12.657752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:34.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965135+0000","last_change":"2024-09-13T06:29:00.726943+0000","last_active":"2024-09-13T06:32:13.965135+0000","last_peered":"2024-09-13T06:32:13.965135+0000","last_clean":"2024-09-13T06:32:13.965135+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:32:13.965135+0000","last_undegraded":"2024-09-13T06:32:13.965135+0000","last_fullsized":"2024-09-13T06:32:13.965135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567910+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:30:39.567910+0000","last_peered":"2024-09-13T06:30:39.567910+0000","last_clean":"2024-09-13T06:30:39.567910+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:30:39.567910+0000","last_undegraded":"2024-09-13T06:30:39.567910+0000","last_fullsized":"2024-09-13T06:30:39.567910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:05.399184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315650+0000","last_change":"2024-09-13T06:28:58.710601+0000","last_active":"2024-09-13T06:30:40.315650+0000","last_peered":"2024-09-13T06:30:40.315650+0000","last_clean":"2024-09-13T06:30:40.315650+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:30:40.315650+0000","last_undegraded":"2024-09-13T06:30:40.315650+0000","last_fullsized":"2024-09-13T06:30:40.315650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:06.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570571+0000","last_change":"2024-09-13T06:29:02.715757+0000","last_active":"2024-09-13T06:30:39.570571+0000","last_peered":"2024-09-13T06:30:39.570571+0000","last_clean":"2024-09-13T06:30:39.570571+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:30:39.570571+0000","last_undegraded":"2024-09-13T06:30:39.570571+0000","last_fullsized":"2024-09-13T06:30:39.570571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:41.827034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977483+0000","last_change":"2024-09-13T06:29:04.730506+0000","last_active":"2024-09-13T06:32:12.977483+0000","last_peered":"2024-09-13T06:32:12.977483+0000","last_clean":"2024-09-13T06:32:12.977483+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:12.977483+0000","last_undegraded":"2024-09-13T06:32:12.977483+0000","last_fullsized":"2024-09-13T06:32:12.977483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:06.934896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317336+0000","last_change":"2024-09-13T06:29:06.766201+0000","last_active":"2024-09-13T06:30:40.317336+0000","last_peered":"2024-09-13T06:30:40.317336+0000","last_clean":"2024-09-13T06:30:40.317336+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:30:40.317336+0000","last_undegraded":"2024-09-13T06:30:40.317336+0000","last_fullsized":"2024-09-13T06:30:40.317336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:14.063090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907100+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:30:39.907100+0000","last_peered":"2024-09-13T06:30:39.907100+0000","last_clean":"2024-09-13T06:30:39.907100+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:30:39.907100+0000","last_undegraded":"2024-09-13T06:30:39.907100+0000","last_fullsized":"2024-09-13T06:30:39.907100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:16.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.414514+0000","last_change":"2024-09-13T06:29:00.721955+0000","last_active":"2024-09-13T06:32:13.414514+0000","last_peered":"2024-09-13T06:32:13.414514+0000","last_clean":"2024-09-13T06:32:13.414514+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:32:13.414514+0000","last_undegraded":"2024-09-13T06:32:13.414514+0000","last_fullsized":"2024-09-13T06:32:13.414514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572122+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:30:39.572122+0000","last_peered":"2024-09-13T06:30:39.572122+0000","last_clean":"2024-09-13T06:30:39.572122+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:30:39.572122+0000","last_undegraded":"2024-09-13T06:30:39.572122+0000","last_fullsized":"2024-09-13T06:30:39.572122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:57.119174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572256+0000","last_change":"2024-09-13T06:28:58.714825+0000","last_active":"2024-09-13T06:30:39.572256+0000","last_peered":"2024-09-13T06:30:39.572256+0000","last_clean":"2024-09-13T06:30:39.572256+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:30:39.572256+0000","last_undegraded":"2024-09-13T06:30:39.572256+0000","last_fullsized":"2024-09-13T06:30:39.572256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319184+0000","last_change":"2024-09-13T06:29:02.726548+0000","last_active":"2024-09-13T06:30:40.319184+0000","last_peered":"2024-09-13T06:30:40.319184+0000","last_clean":"2024-09-13T06:30:40.319184+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:30:40.319184+0000","last_undegraded":"2024-09-13T06:30:40.319184+0000","last_fullsized":"2024-09-13T06:30:40.319184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.698111+0000","last_change":"2024-09-13T06:29:04.753220+0000","last_active":"2024-09-13T06:32:12.698111+0000","last_peered":"2024-09-13T06:32:12.698111+0000","last_clean":"2024-09-13T06:32:12.698111+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:32:12.698111+0000","last_undegraded":"2024-09-13T06:32:12.698111+0000","last_fullsized":"2024-09-13T06:32:12.698111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:23.310355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907445+0000","last_change":"2024-09-13T06:29:06.776644+0000","last_active":"2024-09-13T06:30:39.907445+0000","last_peered":"2024-09-13T06:30:39.907445+0000","last_clean":"2024-09-13T06:30:39.907445+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:30:39.907445+0000","last_undegraded":"2024-09-13T06:30:39.907445+0000","last_fullsized":"2024-09-13T06:30:39.907445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:07.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.916234+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:12.916234+0000","last_peered":"2024-09-13T06:32:12.916234+0000","last_clean":"2024-09-13T06:32:12.916234+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:12.916234+0000","last_undegraded":"2024-09-13T06:32:12.916234+0000","last_fullsized":"2024-09-13T06:32:12.916234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:03.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965048+0000","last_change":"2024-09-13T06:29:00.729564+0000","last_active":"2024-09-13T06:32:13.965048+0000","last_peered":"2024-09-13T06:32:13.965048+0000","last_clean":"2024-09-13T06:32:13.965048+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:32:13.965048+0000","last_undegraded":"2024-09-13T06:32:13.965048+0000","last_fullsized":"2024-09-13T06:32:13.965048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:03.871675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576292+0000","last_change":"2024-09-13T06:28:58.734084+0000","last_active":"2024-09-13T06:30:39.576292+0000","last_peered":"2024-09-13T06:30:39.576292+0000","last_clean":"2024-09-13T06:30:39.576292+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:30:39.576292+0000","last_undegraded":"2024-09-13T06:30:39.576292+0000","last_fullsized":"2024-09-13T06:30:39.576292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:04.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317623+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:30:40.317623+0000","last_peered":"2024-09-13T06:30:40.317623+0000","last_clean":"2024-09-13T06:30:40.317623+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:30:40.317623+0000","last_undegraded":"2024-09-13T06:30:40.317623+0000","last_fullsized":"2024-09-13T06:30:40.317623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:03.965231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.331107+0000","last_change":"2024-09-13T06:29:02.741057+0000","last_active":"2024-09-13T06:32:14.331107+0000","last_peered":"2024-09-13T06:32:14.331107+0000","last_clean":"2024-09-13T06:32:14.331107+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:32:14.331107+0000","last_undegraded":"2024-09-13T06:32:14.331107+0000","last_fullsized":"2024-09-13T06:32:14.331107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:19.872981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'67","reported_seq":138,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.409477+0000","last_change":"2024-09-13T06:29:04.747105+0000","last_active":"2024-09-13T06:32:45.409477+0000","last_peered":"2024-09-13T06:32:45.409477+0000","last_clean":"2024-09-13T06:32:45.409477+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:32:45.409477+0000","last_undegraded":"2024-09-13T06:32:45.409477+0000","last_fullsized":"2024-09-13T06:32:45.409477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:20.114697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571995+0000","last_change":"2024-09-13T06:29:06.756361+0000","last_active":"2024-09-13T06:30:39.571995+0000","last_peered":"2024-09-13T06:30:39.571995+0000","last_clean":"2024-09-13T06:30:39.571995+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:30:39.571995+0000","last_undegraded":"2024-09-13T06:30:39.571995+0000","last_fullsized":"2024-09-13T06:30:39.571995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:29.424661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.495367+0000","last_change":"2024-09-13T06:29:08.775523+0000","last_active":"2024-09-13T06:31:12.495367+0000","last_peered":"2024-09-13T06:31:12.495367+0000","last_clean":"2024-09-13T06:31:12.495367+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:31:12.495367+0000","last_undegraded":"2024-09-13T06:31:12.495367+0000","last_fullsized":"2024-09-13T06:31:12.495367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:26.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317034+0000","last_change":"2024-09-13T06:29:00.726613+0000","last_active":"2024-09-13T06:30:40.317034+0000","last_peered":"2024-09-13T06:30:40.317034+0000","last_clean":"2024-09-13T06:30:40.317034+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:30:40.317034+0000","last_undegraded":"2024-09-13T06:30:40.317034+0000","last_fullsized":"2024-09-13T06:30:40.317034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:24.356329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318422+0000","last_change":"2024-09-13T06:28:58.709334+0000","last_active":"2024-09-13T06:30:40.318422+0000","last_peered":"2024-09-13T06:30:40.318422+0000","last_clean":"2024-09-13T06:30:40.318422+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:30:40.318422+0000","last_undegraded":"2024-09-13T06:30:40.318422+0000","last_fullsized":"2024-09-13T06:30:40.318422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576205+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:30:39.576205+0000","last_peered":"2024-09-13T06:30:39.576205+0000","last_clean":"2024-09-13T06:30:39.576205+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:30:39.576205+0000","last_undegraded":"2024-09-13T06:30:39.576205+0000","last_fullsized":"2024-09-13T06:30:39.576205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:39:32.946230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571971+0000","last_change":"2024-09-13T06:29:02.747586+0000","last_active":"2024-09-13T06:30:39.571971+0000","last_peered":"2024-09-13T06:30:39.571971+0000","last_clean":"2024-09-13T06:30:39.571971+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:30:39.571971+0000","last_undegraded":"2024-09-13T06:30:39.571971+0000","last_fullsized":"2024-09-13T06:30:39.571971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:52.363598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318311+0000","last_change":"2024-09-13T06:29:04.747057+0000","last_active":"2024-09-13T06:30:40.318311+0000","last_peered":"2024-09-13T06:30:40.318311+0000","last_clean":"2024-09-13T06:30:40.318311+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:30:40.318311+0000","last_undegraded":"2024-09-13T06:30:40.318311+0000","last_fullsized":"2024-09-13T06:30:40.318311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:43.295549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":363,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.132352+0000","last_change":"2024-09-13T06:29:06.772300+0000","last_active":"2024-09-13T06:32:45.132352+0000","last_peered":"2024-09-13T06:32:45.132352+0000","last_clean":"2024-09-13T06:32:45.132352+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:45.132352+0000","last_undegraded":"2024-09-13T06:32:45.132352+0000","last_fullsized":"2024-09-13T06:32:45.132352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:40.383988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907997+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:30:39.907997+0000","last_peered":"2024-09-13T06:30:39.907997+0000","last_clean":"2024-09-13T06:30:39.907997+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:30:39.907997+0000","last_undegraded":"2024-09-13T06:30:39.907997+0000","last_fullsized":"2024-09-13T06:30:39.907997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964847+0000","last_change":"2024-09-13T06:29:00.723308+0000","last_active":"2024-09-13T06:32:13.964847+0000","last_peered":"2024-09-13T06:32:13.964847+0000","last_clean":"2024-09-13T06:32:13.964847+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:32:13.964847+0000","last_undegraded":"2024-09-13T06:32:13.964847+0000","last_fullsized":"2024-09-13T06:32:13.964847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.313741+0000","last_change":"2024-09-13T06:28:58.724803+0000","last_active":"2024-09-13T06:32:13.313741+0000","last_peered":"2024-09-13T06:32:13.313741+0000","last_clean":"2024-09-13T06:32:13.313741+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:32:13.313741+0000","last_undegraded":"2024-09-13T06:32:13.313741+0000","last_fullsized":"2024-09-13T06:32:13.313741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318345+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:30:40.318345+0000","last_peered":"2024-09-13T06:30:40.318345+0000","last_clean":"2024-09-13T06:30:40.318345+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:30:40.318345+0000","last_undegraded":"2024-09-13T06:30:40.318345+0000","last_fullsized":"2024-09-13T06:30:40.318345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:58.129743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571648+0000","last_change":"2024-09-13T06:29:02.716108+0000","last_active":"2024-09-13T06:30:39.571648+0000","last_peered":"2024-09-13T06:30:39.571648+0000","last_clean":"2024-09-13T06:30:39.571648+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:30:39.571648+0000","last_undegraded":"2024-09-13T06:30:39.571648+0000","last_fullsized":"2024-09-13T06:30:39.571648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:34.365503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'12","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489787+0000","last_change":"2024-09-13T06:29:04.749361+0000","last_active":"2024-09-13T06:31:10.489787+0000","last_peered":"2024-09-13T06:31:10.489787+0000","last_clean":"2024-09-13T06:31:10.489787+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:31:10.489787+0000","last_undegraded":"2024-09-13T06:31:10.489787+0000","last_fullsized":"2024-09-13T06:31:10.489787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:35:45.201511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":437,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.139274+0000","last_change":"2024-09-13T06:29:06.773446+0000","last_active":"2024-09-13T06:32:45.139274+0000","last_peered":"2024-09-13T06:32:45.139274+0000","last_clean":"2024-09-13T06:32:45.139274+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:32:45.139274+0000","last_undegraded":"2024-09-13T06:32:45.139274+0000","last_fullsized":"2024-09-13T06:32:45.139274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:17.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316421+0000","last_change":"2024-09-13T06:29:08.789911+0000","last_active":"2024-09-13T06:30:40.316421+0000","last_peered":"2024-09-13T06:30:40.316421+0000","last_clean":"2024-09-13T06:30:40.316421+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:30:40.316421+0000","last_undegraded":"2024-09-13T06:30:40.316421+0000","last_fullsized":"2024-09-13T06:30:40.316421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:20.838014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566835+0000","last_change":"2024-09-13T06:29:00.703730+0000","last_active":"2024-09-13T06:30:39.566835+0000","last_peered":"2024-09-13T06:30:39.566835+0000","last_clean":"2024-09-13T06:30:39.566835+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:30:39.566835+0000","last_undegraded":"2024-09-13T06:30:39.566835+0000","last_fullsized":"2024-09-13T06:30:39.566835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:12.971383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318815+0000","last_change":"2024-09-13T06:28:58.716525+0000","last_active":"2024-09-13T06:30:40.318815+0000","last_peered":"2024-09-13T06:30:40.318815+0000","last_clean":"2024-09-13T06:30:40.318815+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:30:40.318815+0000","last_undegraded":"2024-09-13T06:30:40.318815+0000","last_fullsized":"2024-09-13T06:30:40.318815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575105+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:30:39.575105+0000","last_peered":"2024-09-13T06:30:39.575105+0000","last_clean":"2024-09-13T06:30:39.575105+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:30:39.575105+0000","last_undegraded":"2024-09-13T06:30:39.575105+0000","last_fullsized":"2024-09-13T06:30:39.575105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:00.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903968+0000","last_change":"2024-09-13T06:29:02.744270+0000","last_active":"2024-09-13T06:30:39.903968+0000","last_peered":"2024-09-13T06:30:39.903968+0000","last_clean":"2024-09-13T06:30:39.903968+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:30:39.903968+0000","last_undegraded":"2024-09-13T06:30:39.903968+0000","last_fullsized":"2024-09-13T06:30:39.903968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'83","reported_seq":159,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.248360+0000","last_change":"2024-09-13T06:29:04.732298+0000","last_active":"2024-09-13T06:31:10.248360+0000","last_peered":"2024-09-13T06:31:10.248360+0000","last_clean":"2024-09-13T06:31:10.248360+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:31:10.248360+0000","last_undegraded":"2024-09-13T06:31:10.248360+0000","last_fullsized":"2024-09-13T06:31:10.248360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:26.343883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905084+0000","last_change":"2024-09-13T06:29:06.767247+0000","last_active":"2024-09-13T06:30:39.905084+0000","last_peered":"2024-09-13T06:30:39.905084+0000","last_clean":"2024-09-13T06:30:39.905084+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:30:39.905084+0000","last_undegraded":"2024-09-13T06:30:39.905084+0000","last_fullsized":"2024-09-13T06:30:39.905084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:57.472237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570309+0000","last_change":"2024-09-13T06:29:08.778016+0000","last_active":"2024-09-13T06:30:39.570309+0000","last_peered":"2024-09-13T06:30:39.570309+0000","last_clean":"2024-09-13T06:30:39.570309+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:30:39.570309+0000","last_undegraded":"2024-09-13T06:30:39.570309+0000","last_fullsized":"2024-09-13T06:30:39.570309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.627161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569024+0000","last_change":"2024-09-13T06:29:08.775423+0000","last_active":"2024-09-13T06:30:39.569024+0000","last_peered":"2024-09-13T06:30:39.569024+0000","last_clean":"2024-09-13T06:30:39.569024+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:30:39.569024+0000","last_undegraded":"2024-09-13T06:30:39.569024+0000","last_fullsized":"2024-09-13T06:30:39.569024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:37.906807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777693+0000","last_change":"2024-09-13T06:29:00.706756+0000","last_active":"2024-09-13T06:32:13.777693+0000","last_peered":"2024-09-13T06:32:13.777693+0000","last_clean":"2024-09-13T06:32:13.777693+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:32:13.777693+0000","last_undegraded":"2024-09-13T06:32:13.777693+0000","last_fullsized":"2024-09-13T06:32:13.777693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:51.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.952185+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:13.952185+0000","last_peered":"2024-09-13T06:32:13.952185+0000","last_clean":"2024-09-13T06:32:13.952185+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:13.952185+0000","last_undegraded":"2024-09-13T06:32:13.952185+0000","last_fullsized":"2024-09-13T06:32:13.952185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316032+0000","last_change":"2024-09-13T06:29:02.737913+0000","last_active":"2024-09-13T06:30:40.316032+0000","last_peered":"2024-09-13T06:30:40.316032+0000","last_clean":"2024-09-13T06:30:40.316032+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:30:40.316032+0000","last_undegraded":"2024-09-13T06:30:40.316032+0000","last_fullsized":"2024-09-13T06:30:40.316032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'35","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.239635+0000","last_change":"2024-09-13T06:29:04.751781+0000","last_active":"2024-09-13T06:32:45.239635+0000","last_peered":"2024-09-13T06:32:45.239635+0000","last_clean":"2024-09-13T06:32:45.239635+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:32:45.239635+0000","last_undegraded":"2024-09-13T06:32:45.239635+0000","last_fullsized":"2024-09-13T06:32:45.239635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:17.156772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904554+0000","last_change":"2024-09-13T06:29:06.768895+0000","last_active":"2024-09-13T06:30:39.904554+0000","last_peered":"2024-09-13T06:30:39.904554+0000","last_clean":"2024-09-13T06:30:39.904554+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:30:39.904554+0000","last_undegraded":"2024-09-13T06:30:39.904554+0000","last_fullsized":"2024-09-13T06:30:39.904554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:59.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:09.813655+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:31:09.813655+0000","last_peered":"2024-09-13T06:31:09.813655+0000","last_clean":"2024-09-13T06:31:09.813655+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:31:09.813655+0000","last_undegraded":"2024-09-13T06:31:09.813655+0000","last_fullsized":"2024-09-13T06:31:09.813655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:50.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495777+0000","last_change":"2024-09-13T06:29:00.724056+0000","last_active":"2024-09-13T06:31:20.495777+0000","last_peered":"2024-09-13T06:31:20.495777+0000","last_clean":"2024-09-13T06:31:20.495777+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:31:20.495777+0000","last_undegraded":"2024-09-13T06:31:20.495777+0000","last_fullsized":"2024-09-13T06:31:20.495777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:17.805986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568468+0000","last_change":"2024-09-13T06:28:58.722577+0000","last_active":"2024-09-13T06:30:39.568468+0000","last_peered":"2024-09-13T06:30:39.568468+0000","last_clean":"2024-09-13T06:30:39.568468+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:30:39.568468+0000","last_undegraded":"2024-09-13T06:30:39.568468+0000","last_fullsized":"2024-09-13T06:30:39.568468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:49.189520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905810+0000","last_change":"2024-09-13T06:29:02.740396+0000","last_active":"2024-09-13T06:30:39.905810+0000","last_peered":"2024-09-13T06:30:39.905810+0000","last_clean":"2024-09-13T06:30:39.905810+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:30:39.905810+0000","last_undegraded":"2024-09-13T06:30:39.905810+0000","last_fullsized":"2024-09-13T06:30:39.905810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.707084+0000","last_change":"2024-09-13T06:29:04.741028+0000","last_active":"2024-09-13T06:32:12.707084+0000","last_peered":"2024-09-13T06:32:12.707084+0000","last_clean":"2024-09-13T06:32:12.707084+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:32:12.707084+0000","last_undegraded":"2024-09-13T06:32:12.707084+0000","last_fullsized":"2024-09-13T06:32:12.707084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:36.374316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566162+0000","last_change":"2024-09-13T06:29:06.765377+0000","last_active":"2024-09-13T06:30:39.566162+0000","last_peered":"2024-09-13T06:30:39.566162+0000","last_clean":"2024-09-13T06:30:39.566162+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:30:39.566162+0000","last_undegraded":"2024-09-13T06:30:39.566162+0000","last_fullsized":"2024-09-13T06:30:39.566162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:44.482785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317385+0000","last_change":"2024-09-13T06:29:08.787430+0000","last_active":"2024-09-13T06:30:40.317385+0000","last_peered":"2024-09-13T06:30:40.317385+0000","last_clean":"2024-09-13T06:30:40.317385+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:30:40.317385+0000","last_undegraded":"2024-09-13T06:30:40.317385+0000","last_fullsized":"2024-09-13T06:30:40.317385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:01.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'7","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492082+0000","last_change":"2024-09-13T06:29:00.709739+0000","last_active":"2024-09-13T06:31:20.492082+0000","last_peered":"2024-09-13T06:31:20.492082+0000","last_clean":"2024-09-13T06:31:20.492082+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:31:20.492082+0000","last_undegraded":"2024-09-13T06:31:20.492082+0000","last_fullsized":"2024-09-13T06:31:20.492082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575239+0000","last_change":"2024-09-13T06:28:58.717681+0000","last_active":"2024-09-13T06:30:39.575239+0000","last_peered":"2024-09-13T06:30:39.575239+0000","last_clean":"2024-09-13T06:30:39.575239+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:30:39.575239+0000","last_undegraded":"2024-09-13T06:30:39.575239+0000","last_fullsized":"2024-09-13T06:30:39.575239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:27.815067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.749307+0000","last_change":"2024-09-13T06:29:02.727813+0000","last_active":"2024-09-13T06:31:11.749307+0000","last_peered":"2024-09-13T06:31:11.749307+0000","last_clean":"2024-09-13T06:31:11.749307+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:31:11.749307+0000","last_undegraded":"2024-09-13T06:31:11.749307+0000","last_fullsized":"2024-09-13T06:31:11.749307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:24.145601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'43","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.391991+0000","last_change":"2024-09-13T06:29:04.750547+0000","last_active":"2024-09-13T06:32:45.391991+0000","last_peered":"2024-09-13T06:32:45.391991+0000","last_clean":"2024-09-13T06:32:45.391991+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:45.391991+0000","last_undegraded":"2024-09-13T06:32:45.391991+0000","last_fullsized":"2024-09-13T06:32:45.391991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:12.046692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315686+0000","last_change":"2024-09-13T06:29:06.765688+0000","last_active":"2024-09-13T06:30:40.315686+0000","last_peered":"2024-09-13T06:30:40.315686+0000","last_clean":"2024-09-13T06:30:40.315686+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:30:40.315686+0000","last_undegraded":"2024-09-13T06:30:40.315686+0000","last_fullsized":"2024-09-13T06:30:40.315686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:19.173170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905501+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:30:39.905501+0000","last_peered":"2024-09-13T06:30:39.905501+0000","last_clean":"2024-09-13T06:30:39.905501+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:30:39.905501+0000","last_undegraded":"2024-09-13T06:30:39.905501+0000","last_fullsized":"2024-09-13T06:30:39.905501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:15.759918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565768+0000","last_change":"2024-09-13T06:29:39.508832+0000","last_active":"2024-09-13T06:30:39.565768+0000","last_peered":"2024-09-13T06:30:39.565768+0000","last_clean":"2024-09-13T06:30:39.565768+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:30:39.565768+0000","last_undegraded":"2024-09-13T06:30:39.565768+0000","last_fullsized":"2024-09-13T06:30:39.565768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:22:26.112599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321498+0000","last_change":"2024-09-13T06:28:58.716514+0000","last_active":"2024-09-13T06:30:40.321498+0000","last_peered":"2024-09-13T06:30:40.321498+0000","last_clean":"2024-09-13T06:30:40.321498+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:30:40.321498+0000","last_undegraded":"2024-09-13T06:30:40.321498+0000","last_fullsized":"2024-09-13T06:30:40.321498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907794+0000","last_change":"2024-09-13T06:29:02.718645+0000","last_active":"2024-09-13T06:30:39.907794+0000","last_peered":"2024-09-13T06:30:39.907794+0000","last_clean":"2024-09-13T06:30:39.907794+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:30:39.907794+0000","last_undegraded":"2024-09-13T06:30:39.907794+0000","last_fullsized":"2024-09-13T06:30:39.907794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.231976+0000","last_change":"2024-09-13T06:29:04.733778+0000","last_active":"2024-09-13T06:31:10.231976+0000","last_peered":"2024-09-13T06:31:10.231976+0000","last_clean":"2024-09-13T06:31:10.231976+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:31:10.231976+0000","last_undegraded":"2024-09-13T06:31:10.231976+0000","last_fullsized":"2024-09-13T06:31:10.231976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:56.673325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568833+0000","last_change":"2024-09-13T06:29:06.762809+0000","last_active":"2024-09-13T06:30:39.568833+0000","last_peered":"2024-09-13T06:30:39.568833+0000","last_clean":"2024-09-13T06:30:39.568833+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:30:39.568833+0000","last_undegraded":"2024-09-13T06:30:39.568833+0000","last_fullsized":"2024-09-13T06:30:39.568833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:34.809800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571091+0000","last_change":"2024-09-13T06:29:00.717648+0000","last_active":"2024-09-13T06:32:13.571091+0000","last_peered":"2024-09-13T06:32:13.571091+0000","last_clean":"2024-09-13T06:32:13.571091+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:32:13.571091+0000","last_undegraded":"2024-09-13T06:32:13.571091+0000","last_fullsized":"2024-09-13T06:32:13.571091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903356+0000","last_change":"2024-09-13T06:28:58.719660+0000","last_active":"2024-09-13T06:30:39.903356+0000","last_peered":"2024-09-13T06:30:39.903356+0000","last_clean":"2024-09-13T06:30:39.903356+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:30:39.903356+0000","last_undegraded":"2024-09-13T06:30:39.903356+0000","last_fullsized":"2024-09-13T06:30:39.903356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319720+0000","last_change":"2024-09-13T06:29:02.737808+0000","last_active":"2024-09-13T06:30:40.319720+0000","last_peered":"2024-09-13T06:30:40.319720+0000","last_clean":"2024-09-13T06:30:40.319720+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:30:40.319720+0000","last_undegraded":"2024-09-13T06:30:40.319720+0000","last_fullsized":"2024-09-13T06:30:40.319720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":146,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.355177+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:32:45.355177+0000","last_peered":"2024-09-13T06:32:45.355177+0000","last_clean":"2024-09-13T06:32:45.355177+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:32:45.355177+0000","last_undegraded":"2024-09-13T06:32:45.355177+0000","last_fullsized":"2024-09-13T06:32:45.355177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568263+0000","last_change":"2024-09-13T06:29:06.770864+0000","last_active":"2024-09-13T06:30:39.568263+0000","last_peered":"2024-09-13T06:30:39.568263+0000","last_clean":"2024-09-13T06:30:39.568263+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:30:39.568263+0000","last_undegraded":"2024-09-13T06:30:39.568263+0000","last_fullsized":"2024-09-13T06:30:39.568263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:21.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.485917+0000","last_change":"2024-09-13T06:29:08.784874+0000","last_active":"2024-09-13T06:31:12.485917+0000","last_peered":"2024-09-13T06:31:12.485917+0000","last_clean":"2024-09-13T06:31:12.485917+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:31:12.485917+0000","last_undegraded":"2024-09-13T06:31:12.485917+0000","last_fullsized":"2024-09-13T06:31:12.485917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:36.951899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319331+0000","last_change":"2024-09-13T06:29:00.731362+0000","last_active":"2024-09-13T06:30:40.319331+0000","last_peered":"2024-09-13T06:30:40.319331+0000","last_clean":"2024-09-13T06:30:40.319331+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:30:40.319331+0000","last_undegraded":"2024-09-13T06:30:40.319331+0000","last_fullsized":"2024-09-13T06:30:40.319331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:19.896337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315793+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:30:40.315793+0000","last_peered":"2024-09-13T06:30:40.315793+0000","last_clean":"2024-09-13T06:30:40.315793+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:30:40.315793+0000","last_undegraded":"2024-09-13T06:30:40.315793+0000","last_fullsized":"2024-09-13T06:30:40.315793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.495874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578114+0000","last_change":"2024-09-13T06:29:02.720915+0000","last_active":"2024-09-13T06:30:39.578114+0000","last_peered":"2024-09-13T06:30:39.578114+0000","last_clean":"2024-09-13T06:30:39.578114+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:30:39.578114+0000","last_undegraded":"2024-09-13T06:30:39.578114+0000","last_fullsized":"2024-09-13T06:30:39.578114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:13.518915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.233950+0000","last_change":"2024-09-13T06:29:04.732931+0000","last_active":"2024-09-13T06:31:10.233950+0000","last_peered":"2024-09-13T06:31:10.233950+0000","last_clean":"2024-09-13T06:31:10.233950+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:31:10.233950+0000","last_undegraded":"2024-09-13T06:31:10.233950+0000","last_fullsized":"2024-09-13T06:31:10.233950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:37.616554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319314+0000","last_change":"2024-09-13T06:29:06.762859+0000","last_active":"2024-09-13T06:30:40.319314+0000","last_peered":"2024-09-13T06:30:40.319314+0000","last_clean":"2024-09-13T06:30:40.319314+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:30:40.319314+0000","last_undegraded":"2024-09-13T06:30:40.319314+0000","last_fullsized":"2024-09-13T06:30:40.319314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:56.472153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570852+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:30:39.570852+0000","last_peered":"2024-09-13T06:30:39.570852+0000","last_clean":"2024-09-13T06:30:39.570852+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:30:39.570852+0000","last_undegraded":"2024-09-13T06:30:39.570852+0000","last_fullsized":"2024-09-13T06:30:39.570852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965070+0000","last_change":"2024-09-13T06:29:00.732260+0000","last_active":"2024-09-13T06:32:13.965070+0000","last_peered":"2024-09-13T06:32:13.965070+0000","last_clean":"2024-09-13T06:32:13.965070+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:32:13.965070+0000","last_undegraded":"2024-09-13T06:32:13.965070+0000","last_fullsized":"2024-09-13T06:32:13.965070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572703+0000","last_change":"2024-09-13T06:28:58.716000+0000","last_active":"2024-09-13T06:30:39.572703+0000","last_peered":"2024-09-13T06:30:39.572703+0000","last_clean":"2024-09-13T06:30:39.572703+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:30:39.572703+0000","last_undegraded":"2024-09-13T06:30:39.572703+0000","last_fullsized":"2024-09-13T06:30:39.572703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574668+0000","last_change":"2024-09-13T06:29:02.718646+0000","last_active":"2024-09-13T06:30:39.574668+0000","last_peered":"2024-09-13T06:30:39.574668+0000","last_clean":"2024-09-13T06:30:39.574668+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:30:39.574668+0000","last_undegraded":"2024-09-13T06:30:39.574668+0000","last_fullsized":"2024-09-13T06:30:39.574668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'37","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.261708+0000","last_change":"2024-09-13T06:29:04.752663+0000","last_active":"2024-09-13T06:32:45.261708+0000","last_peered":"2024-09-13T06:32:45.261708+0000","last_clean":"2024-09-13T06:32:45.261708+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:32:45.261708+0000","last_undegraded":"2024-09-13T06:32:45.261708+0000","last_fullsized":"2024-09-13T06:32:45.261708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:06.350632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321281+0000","last_change":"2024-09-13T06:29:06.766875+0000","last_active":"2024-09-13T06:30:40.321281+0000","last_peered":"2024-09-13T06:30:40.321281+0000","last_clean":"2024-09-13T06:30:40.321281+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:30:40.321281+0000","last_undegraded":"2024-09-13T06:30:40.321281+0000","last_fullsized":"2024-09-13T06:30:40.321281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:25.326753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.653823+0000","last_change":"2024-09-13T06:29:08.769294+0000","last_active":"2024-09-13T06:31:12.653823+0000","last_peered":"2024-09-13T06:31:12.653823+0000","last_clean":"2024-09-13T06:31:12.653823+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:31:12.653823+0000","last_undegraded":"2024-09-13T06:31:12.653823+0000","last_fullsized":"2024-09-13T06:31:12.653823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:00:59.776143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.410858+0000","last_change":"2024-09-13T06:29:00.722796+0000","last_active":"2024-09-13T06:32:13.410858+0000","last_peered":"2024-09-13T06:32:13.410858+0000","last_clean":"2024-09-13T06:32:13.410858+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:32:13.410858+0000","last_undegraded":"2024-09-13T06:32:13.410858+0000","last_fullsized":"2024-09-13T06:32:13.410858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:28.267490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'8","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.757448+0000","last_change":"2024-09-13T06:28:58.705967+0000","last_active":"2024-09-13T06:32:13.757448+0000","last_peered":"2024-09-13T06:32:13.757448+0000","last_clean":"2024-09-13T06:32:13.757448+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:32:13.757448+0000","last_undegraded":"2024-09-13T06:32:13.757448+0000","last_fullsized":"2024-09-13T06:32:13.757448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:49.212428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":32,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319567+0000","last_change":"2024-09-13T06:29:02.727947+0000","last_active":"2024-09-13T06:30:40.319567+0000","last_peered":"2024-09-13T06:30:40.319567+0000","last_clean":"2024-09-13T06:30:40.319567+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:30:40.319567+0000","last_undegraded":"2024-09-13T06:30:40.319567+0000","last_fullsized":"2024-09-13T06:30:40.319567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:43.175259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910215+0000","last_change":"2024-09-13T06:29:04.754166+0000","last_active":"2024-09-13T06:30:39.910215+0000","last_peered":"2024-09-13T06:30:39.910215+0000","last_clean":"2024-09-13T06:30:39.910215+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:30:39.910215+0000","last_undegraded":"2024-09-13T06:30:39.910215+0000","last_fullsized":"2024-09-13T06:30:39.910215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:54.455755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.977868+0000","last_change":"2024-09-13T06:29:06.774577+0000","last_active":"2024-09-13T06:32:13.977868+0000","last_peered":"2024-09-13T06:32:13.977868+0000","last_clean":"2024-09-13T06:32:13.977868+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:32:13.977868+0000","last_undegraded":"2024-09-13T06:32:13.977868+0000","last_fullsized":"2024-09-13T06:32:13.977868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:26.057296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570192+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:30:39.570192+0000","last_peered":"2024-09-13T06:30:39.570192+0000","last_clean":"2024-09-13T06:30:39.570192+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:30:39.570192+0000","last_undegraded":"2024-09-13T06:30:39.570192+0000","last_fullsized":"2024-09-13T06:30:39.570192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.891076+0000","last_change":"2024-09-13T06:29:00.703118+0000","last_active":"2024-09-13T06:32:13.891076+0000","last_peered":"2024-09-13T06:32:13.891076+0000","last_clean":"2024-09-13T06:32:13.891076+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:32:13.891076+0000","last_undegraded":"2024-09-13T06:32:13.891076+0000","last_fullsized":"2024-09-13T06:32:13.891076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318695+0000","last_change":"2024-09-13T06:28:58.727668+0000","last_active":"2024-09-13T06:30:40.318695+0000","last_peered":"2024-09-13T06:30:40.318695+0000","last_clean":"2024-09-13T06:30:40.318695+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:30:40.318695+0000","last_undegraded":"2024-09-13T06:30:40.318695+0000","last_fullsized":"2024-09-13T06:30:40.318695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:44.537548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317498+0000","last_change":"2024-09-13T06:29:02.737035+0000","last_active":"2024-09-13T06:30:40.317498+0000","last_peered":"2024-09-13T06:30:40.317498+0000","last_clean":"2024-09-13T06:30:40.317498+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:30:40.317498+0000","last_undegraded":"2024-09-13T06:30:40.317498+0000","last_fullsized":"2024-09-13T06:30:40.317498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.989322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.216689+0000","last_change":"2024-09-13T06:29:04.736867+0000","last_active":"2024-09-13T06:31:10.216689+0000","last_peered":"2024-09-13T06:31:10.216689+0000","last_clean":"2024-09-13T06:31:10.216689+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:31:10.216689+0000","last_undegraded":"2024-09-13T06:31:10.216689+0000","last_fullsized":"2024-09-13T06:31:10.216689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.266864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903117+0000","last_change":"2024-09-13T06:29:06.755656+0000","last_active":"2024-09-13T06:30:39.903117+0000","last_peered":"2024-09-13T06:30:39.903117+0000","last_clean":"2024-09-13T06:30:39.903117+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:30:39.903117+0000","last_undegraded":"2024-09-13T06:30:39.903117+0000","last_fullsized":"2024-09-13T06:30:39.903117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:08.951294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576139+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:30:39.576139+0000","last_peered":"2024-09-13T06:30:39.576139+0000","last_clean":"2024-09-13T06:30:39.576139+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:30:39.576139+0000","last_undegraded":"2024-09-13T06:30:39.576139+0000","last_fullsized":"2024-09-13T06:30:39.576139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:24.414010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570406+0000","last_change":"2024-09-13T06:29:00.715931+0000","last_active":"2024-09-13T06:32:13.570406+0000","last_peered":"2024-09-13T06:32:13.570406+0000","last_clean":"2024-09-13T06:32:13.570406+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:32:13.570406+0000","last_undegraded":"2024-09-13T06:32:13.570406+0000","last_fullsized":"2024-09-13T06:32:13.570406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:16.645482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.577929+0000","last_change":"2024-09-13T06:28:58.706848+0000","last_active":"2024-09-13T06:30:39.577929+0000","last_peered":"2024-09-13T06:30:39.577929+0000","last_clean":"2024-09-13T06:30:39.577929+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:30:39.577929+0000","last_undegraded":"2024-09-13T06:30:39.577929+0000","last_fullsized":"2024-09-13T06:30:39.577929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:08.398250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572664+0000","last_change":"2024-09-13T06:29:02.715301+0000","last_active":"2024-09-13T06:30:39.572664+0000","last_peered":"2024-09-13T06:30:39.572664+0000","last_clean":"2024-09-13T06:30:39.572664+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:30:39.572664+0000","last_undegraded":"2024-09-13T06:30:39.572664+0000","last_fullsized":"2024-09-13T06:30:39.572664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:19.480041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'33","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.301793+0000","last_change":"2024-09-13T06:29:04.728823+0000","last_active":"2024-09-13T06:32:45.301793+0000","last_peered":"2024-09-13T06:32:45.301793+0000","last_clean":"2024-09-13T06:32:45.301793+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:32:45.301793+0000","last_undegraded":"2024-09-13T06:32:45.301793+0000","last_fullsized":"2024-09-13T06:32:45.301793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:22.717282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571575+0000","last_change":"2024-09-13T06:29:06.774527+0000","last_active":"2024-09-13T06:30:39.571575+0000","last_peered":"2024-09-13T06:30:39.571575+0000","last_clean":"2024-09-13T06:30:39.571575+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:30:39.571575+0000","last_undegraded":"2024-09-13T06:30:39.571575+0000","last_fullsized":"2024-09-13T06:30:39.571575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:17.985155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.457421+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.457421+0000","last_peered":"2024-09-13T06:32:13.457421+0000","last_clean":"2024-09-13T06:32:13.457421+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.457421+0000","last_undegraded":"2024-09-13T06:32:13.457421+0000","last_fullsized":"2024-09-13T06:32:13.457421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:54.961718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777639+0000","last_change":"2024-09-13T06:29:00.710678+0000","last_active":"2024-09-13T06:32:13.777639+0000","last_peered":"2024-09-13T06:32:13.777639+0000","last_clean":"2024-09-13T06:32:13.777639+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:32:13.777639+0000","last_undegraded":"2024-09-13T06:32:13.777639+0000","last_fullsized":"2024-09-13T06:32:13.777639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910338+0000","last_change":"2024-09-13T06:28:58.728835+0000","last_active":"2024-09-13T06:30:39.910338+0000","last_peered":"2024-09-13T06:30:39.910338+0000","last_clean":"2024-09-13T06:30:39.910338+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:30:39.910338+0000","last_undegraded":"2024-09-13T06:30:39.910338+0000","last_fullsized":"2024-09-13T06:30:39.910338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315953+0000","last_change":"2024-09-13T06:29:02.731541+0000","last_active":"2024-09-13T06:30:40.315953+0000","last_peered":"2024-09-13T06:30:40.315953+0000","last_clean":"2024-09-13T06:30:40.315953+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:30:40.315953+0000","last_undegraded":"2024-09-13T06:30:40.315953+0000","last_fullsized":"2024-09-13T06:30:40.315953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:35.369421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.251421+0000","last_change":"2024-09-13T06:29:04.750320+0000","last_active":"2024-09-13T06:32:45.251421+0000","last_peered":"2024-09-13T06:32:45.251421+0000","last_clean":"2024-09-13T06:32:45.251421+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:32:45.251421+0000","last_undegraded":"2024-09-13T06:32:45.251421+0000","last_fullsized":"2024-09-13T06:32:45.251421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:20.698413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571889+0000","last_change":"2024-09-13T06:29:06.744904+0000","last_active":"2024-09-13T06:30:39.571889+0000","last_peered":"2024-09-13T06:30:39.571889+0000","last_clean":"2024-09-13T06:30:39.571889+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:30:39.571889+0000","last_undegraded":"2024-09-13T06:30:39.571889+0000","last_fullsized":"2024-09-13T06:30:39.571889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:03.059130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.857298+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.857298+0000","last_peered":"2024-09-13T06:32:13.857298+0000","last_clean":"2024-09-13T06:32:13.857298+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.857298+0000","last_undegraded":"2024-09-13T06:32:13.857298+0000","last_fullsized":"2024-09-13T06:32:13.857298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:21.044316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888955+0000","last_change":"2024-09-13T06:29:00.723086+0000","last_active":"2024-09-13T06:32:13.888955+0000","last_peered":"2024-09-13T06:32:13.888955+0000","last_clean":"2024-09-13T06:32:13.888955+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:32:13.888955+0000","last_undegraded":"2024-09-13T06:32:13.888955+0000","last_fullsized":"2024-09-13T06:32:13.888955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321598+0000","last_change":"2024-09-13T06:28:58.709396+0000","last_active":"2024-09-13T06:30:40.321598+0000","last_peered":"2024-09-13T06:30:40.321598+0000","last_clean":"2024-09-13T06:30:40.321598+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:30:40.321598+0000","last_undegraded":"2024-09-13T06:30:40.321598+0000","last_fullsized":"2024-09-13T06:30:40.321598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:08.425859+0000","last_change":"2024-09-13T06:29:02.732125+0000","last_active":"2024-09-13T06:31:08.425859+0000","last_peered":"2024-09-13T06:31:08.425859+0000","last_clean":"2024-09-13T06:31:08.425859+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:31:08.425859+0000","last_undegraded":"2024-09-13T06:31:08.425859+0000","last_fullsized":"2024-09-13T06:31:08.425859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:18.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'33","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.708447+0000","last_change":"2024-09-13T06:29:04.732737+0000","last_active":"2024-09-13T06:32:12.708447+0000","last_peered":"2024-09-13T06:32:12.708447+0000","last_clean":"2024-09-13T06:32:12.708447+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:12.708447+0000","last_undegraded":"2024-09-13T06:32:12.708447+0000","last_fullsized":"2024-09-13T06:32:12.708447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:10:29.688497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568199+0000","last_change":"2024-09-13T06:29:06.776200+0000","last_active":"2024-09-13T06:30:39.568199+0000","last_peered":"2024-09-13T06:30:39.568199+0000","last_clean":"2024-09-13T06:30:39.568199+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:30:39.568199+0000","last_undegraded":"2024-09-13T06:30:39.568199+0000","last_fullsized":"2024-09-13T06:30:39.568199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:14.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.287953+0000","last_change":"2024-09-13T06:29:08.770047+0000","last_active":"2024-09-13T06:31:10.287953+0000","last_peered":"2024-09-13T06:31:10.287953+0000","last_clean":"2024-09-13T06:31:10.287953+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:31:10.287953+0000","last_undegraded":"2024-09-13T06:31:10.287953+0000","last_fullsized":"2024-09-13T06:31:10.287953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:12.926423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.322106+0000","last_change":"2024-09-13T06:29:00.723899+0000","last_active":"2024-09-13T06:30:40.322106+0000","last_peered":"2024-09-13T06:30:40.322106+0000","last_clean":"2024-09-13T06:30:40.322106+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:30:40.322106+0000","last_undegraded":"2024-09-13T06:30:40.322106+0000","last_fullsized":"2024-09-13T06:30:40.322106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565933+0000","last_change":"2024-09-13T06:28:58.721562+0000","last_active":"2024-09-13T06:30:39.565933+0000","last_peered":"2024-09-13T06:30:39.565933+0000","last_clean":"2024-09-13T06:30:39.565933+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:30:39.565933+0000","last_undegraded":"2024-09-13T06:30:39.565933+0000","last_fullsized":"2024-09-13T06:30:39.565933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:26.902921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571617+0000","last_change":"2024-09-13T06:29:00.721713+0000","last_active":"2024-09-13T06:32:13.571617+0000","last_peered":"2024-09-13T06:32:13.571617+0000","last_clean":"2024-09-13T06:32:13.571617+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:32:13.571617+0000","last_undegraded":"2024-09-13T06:32:13.571617+0000","last_fullsized":"2024-09-13T06:32:13.571617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:53.230794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.357941+0000","last_change":"2024-09-13T06:28:58.708285+0000","last_active":"2024-09-13T06:31:12.357941+0000","last_peered":"2024-09-13T06:31:12.357941+0000","last_clean":"2024-09-13T06:31:12.357941+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:31:12.357941+0000","last_undegraded":"2024-09-13T06:31:12.357941+0000","last_fullsized":"2024-09-13T06:31:12.357941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:29:28.632008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'5","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:50.502622+0000","last_change":"2024-09-13T06:29:39.540853+0000","last_active":"2024-09-13T06:31:50.502622+0000","last_peered":"2024-09-13T06:31:50.502622+0000","last_clean":"2024-09-13T06:31:50.502622+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:31:50.502622+0000","last_undegraded":"2024-09-13T06:31:50.502622+0000","last_fullsized":"2024-09-13T06:31:50.502622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:10.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905352+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:30:39.905352+0000","last_peered":"2024-09-13T06:30:39.905352+0000","last_clean":"2024-09-13T06:30:39.905352+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:30:39.905352+0000","last_undegraded":"2024-09-13T06:30:39.905352+0000","last_fullsized":"2024-09-13T06:30:39.905352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777960+0000","last_change":"2024-09-13T06:29:00.721804+0000","last_active":"2024-09-13T06:32:13.777960+0000","last_peered":"2024-09-13T06:32:13.777960+0000","last_clean":"2024-09-13T06:32:13.777960+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:32:13.777960+0000","last_undegraded":"2024-09-13T06:32:13.777960+0000","last_fullsized":"2024-09-13T06:32:13.777960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:38.933470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567585+0000","last_change":"2024-09-13T06:28:58.722511+0000","last_active":"2024-09-13T06:30:39.567585+0000","last_peered":"2024-09-13T06:30:39.567585+0000","last_clean":"2024-09-13T06:30:39.567585+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:30:39.567585+0000","last_undegraded":"2024-09-13T06:30:39.567585+0000","last_fullsized":"2024-09-13T06:30:39.567585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:59.470833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.413604+0000","last_change":"2024-09-13T06:29:39.527461+0000","last_active":"2024-09-13T06:32:13.413604+0000","last_peered":"2024-09-13T06:32:13.413604+0000","last_clean":"2024-09-13T06:32:13.413604+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:32:13.413604+0000","last_undegraded":"2024-09-13T06:32:13.413604+0000","last_fullsized":"2024-09-13T06:32:13.413604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:35.974634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910363+0000","last_change":"2024-09-13T06:28:58.724998+0000","last_active":"2024-09-13T06:30:39.910363+0000","last_peered":"2024-09-13T06:30:39.910363+0000","last_clean":"2024-09-13T06:30:39.910363+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:30:39.910363+0000","last_undegraded":"2024-09-13T06:30:39.910363+0000","last_fullsized":"2024-09-13T06:30:39.910363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889884+0000","last_change":"2024-09-13T06:29:00.723960+0000","last_active":"2024-09-13T06:32:13.889884+0000","last_peered":"2024-09-13T06:32:13.889884+0000","last_clean":"2024-09-13T06:32:13.889884+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:32:13.889884+0000","last_undegraded":"2024-09-13T06:32:13.889884+0000","last_fullsized":"2024-09-13T06:32:13.889884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:45.154423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317979+0000","last_change":"2024-09-13T06:28:58.730726+0000","last_active":"2024-09-13T06:30:40.317979+0000","last_peered":"2024-09-13T06:30:40.317979+0000","last_clean":"2024-09-13T06:30:40.317979+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:30:40.317979+0000","last_undegraded":"2024-09-13T06:30:40.317979+0000","last_fullsized":"2024-09-13T06:30:40.317979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905756+0000","last_change":"2024-09-13T06:29:00.718381+0000","last_active":"2024-09-13T06:30:39.905756+0000","last_peered":"2024-09-13T06:30:39.905756+0000","last_clean":"2024-09-13T06:30:39.905756+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:30:39.905756+0000","last_undegraded":"2024-09-13T06:30:39.905756+0000","last_fullsized":"2024-09-13T06:30:39.905756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569016+0000","last_change":"2024-09-13T06:28:58.707516+0000","last_active":"2024-09-13T06:30:39.569016+0000","last_peered":"2024-09-13T06:30:39.569016+0000","last_clean":"2024-09-13T06:30:39.569016+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:30:39.569016+0000","last_undegraded":"2024-09-13T06:30:39.569016+0000","last_fullsized":"2024-09-13T06:30:39.569016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:50:18.113331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570745+0000","last_change":"2024-09-13T06:29:00.715113+0000","last_active":"2024-09-13T06:30:39.570745+0000","last_peered":"2024-09-13T06:30:39.570745+0000","last_clean":"2024-09-13T06:30:39.570745+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:30:39.570745+0000","last_undegraded":"2024-09-13T06:30:39.570745+0000","last_fullsized":"2024-09-13T06:30:39.570745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908260+0000","last_change":"2024-09-13T06:28:58.725590+0000","last_active":"2024-09-13T06:30:39.908260+0000","last_peered":"2024-09-13T06:30:39.908260+0000","last_clean":"2024-09-13T06:30:39.908260+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:30:39.908260+0000","last_undegraded":"2024-09-13T06:30:39.908260+0000","last_fullsized":"2024-09-13T06:30:39.908260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:50.900848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964923+0000","last_change":"2024-09-13T06:29:00.713384+0000","last_active":"2024-09-13T06:32:13.964923+0000","last_peered":"2024-09-13T06:32:13.964923+0000","last_clean":"2024-09-13T06:32:13.964923+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:32:13.964923+0000","last_undegraded":"2024-09-13T06:32:13.964923+0000","last_fullsized":"2024-09-13T06:32:13.964923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.737385+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.737385+0000","last_peered":"2024-09-13T06:32:13.737385+0000","last_clean":"2024-09-13T06:32:13.737385+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.737385+0000","last_undegraded":"2024-09-13T06:32:13.737385+0000","last_fullsized":"2024-09-13T06:32:13.737385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:48.282068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.890443+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:13.890443+0000","last_peered":"2024-09-13T06:32:13.890443+0000","last_clean":"2024-09-13T06:32:13.890443+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:13.890443+0000","last_undegraded":"2024-09-13T06:32:13.890443+0000","last_fullsized":"2024-09-13T06:32:13.890443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905294+0000","last_change":"2024-09-13T06:28:58.705020+0000","last_active":"2024-09-13T06:30:39.905294+0000","last_peered":"2024-09-13T06:30:39.905294+0000","last_clean":"2024-09-13T06:30:39.905294+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:30:39.905294+0000","last_undegraded":"2024-09-13T06:30:39.905294+0000","last_fullsized":"2024-09-13T06:30:39.905294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493929+0000","last_change":"2024-09-13T06:29:00.702900+0000","last_active":"2024-09-13T06:31:15.493929+0000","last_peered":"2024-09-13T06:31:15.493929+0000","last_clean":"2024-09-13T06:31:15.493929+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:31:15.493929+0000","last_undegraded":"2024-09-13T06:31:15.493929+0000","last_fullsized":"2024-09-13T06:31:15.493929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:18.709977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572544+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:30:39.572544+0000","last_peered":"2024-09-13T06:30:39.572544+0000","last_clean":"2024-09-13T06:30:39.572544+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:30:39.572544+0000","last_undegraded":"2024-09-13T06:30:39.572544+0000","last_fullsized":"2024-09-13T06:30:39.572544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:31:36.559365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777954+0000","last_change":"2024-09-13T06:29:00.732329+0000","last_active":"2024-09-13T06:32:13.777954+0000","last_peered":"2024-09-13T06:32:13.777954+0000","last_clean":"2024-09-13T06:32:13.777954+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:32:13.777954+0000","last_undegraded":"2024-09-13T06:32:13.777954+0000","last_fullsized":"2024-09-13T06:32:13.777954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318194+0000","last_change":"2024-09-13T06:28:58.716875+0000","last_active":"2024-09-13T06:30:40.318194+0000","last_peered":"2024-09-13T06:30:40.318194+0000","last_clean":"2024-09-13T06:30:40.318194+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:30:40.318194+0000","last_undegraded":"2024-09-13T06:30:40.318194+0000","last_fullsized":"2024-09-13T06:30:40.318194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:32.384190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888966+0000","last_change":"2024-09-13T06:29:00.716069+0000","last_active":"2024-09-13T06:32:13.888966+0000","last_peered":"2024-09-13T06:32:13.888966+0000","last_clean":"2024-09-13T06:32:13.888966+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:32:13.888966+0000","last_undegraded":"2024-09-13T06:32:13.888966+0000","last_fullsized":"2024-09-13T06:32:13.888966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.758463+0000","last_change":"2024-09-13T06:28:58.725136+0000","last_active":"2024-09-13T06:32:13.758463+0000","last_peered":"2024-09-13T06:32:13.758463+0000","last_clean":"2024-09-13T06:32:13.758463+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:32:13.758463+0000","last_undegraded":"2024-09-13T06:32:13.758463+0000","last_fullsized":"2024-09-13T06:32:13.758463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984562+0000","last_change":"2024-09-13T06:29:00.729388+0000","last_active":"2024-09-13T06:32:13.984562+0000","last_peered":"2024-09-13T06:32:13.984562+0000","last_clean":"2024-09-13T06:32:13.984562+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:32:13.984562+0000","last_undegraded":"2024-09-13T06:32:13.984562+0000","last_fullsized":"2024-09-13T06:32:13.984562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:35.921007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908553+0000","last_change":"2024-09-13T06:28:58.720437+0000","last_active":"2024-09-13T06:30:39.908553+0000","last_peered":"2024-09-13T06:30:39.908553+0000","last_clean":"2024-09-13T06:30:39.908553+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:30:39.908553+0000","last_undegraded":"2024-09-13T06:30:39.908553+0000","last_fullsized":"2024-09-13T06:30:39.908553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904803+0000","last_change":"2024-09-13T06:29:00.722844+0000","last_active":"2024-09-13T06:30:39.904803+0000","last_peered":"2024-09-13T06:30:39.904803+0000","last_clean":"2024-09-13T06:30:39.904803+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:30:39.904803+0000","last_undegraded":"2024-09-13T06:30:39.904803+0000","last_fullsized":"2024-09-13T06:30:39.904803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.765398+0000","last_change":"2024-09-13T06:28:58.707588+0000","last_active":"2024-09-13T06:32:13.765398+0000","last_peered":"2024-09-13T06:32:13.765398+0000","last_clean":"2024-09-13T06:32:13.765398+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:32:13.765398+0000","last_undegraded":"2024-09-13T06:32:13.765398+0000","last_fullsized":"2024-09-13T06:32:13.765398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:13.693638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776869+0000","last_change":"2024-09-13T06:29:00.717476+0000","last_active":"2024-09-13T06:32:13.776869+0000","last_peered":"2024-09-13T06:32:13.776869+0000","last_clean":"2024-09-13T06:32:13.776869+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:32:13.776869+0000","last_undegraded":"2024-09-13T06:32:13.776869+0000","last_fullsized":"2024-09-13T06:32:13.776869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:25:20.841077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908636+0000","last_change":"2024-09-13T06:28:58.720596+0000","last_active":"2024-09-13T06:30:39.908636+0000","last_peered":"2024-09-13T06:30:39.908636+0000","last_clean":"2024-09-13T06:30:39.908636+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:30:39.908636+0000","last_undegraded":"2024-09-13T06:30:39.908636+0000","last_fullsized":"2024-09-13T06:30:39.908636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.599725+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:31:12.599725+0000","last_peered":"2024-09-13T06:31:12.599725+0000","last_clean":"2024-09-13T06:31:12.599725+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:31:12.599725+0000","last_undegraded":"2024-09-13T06:31:12.599725+0000","last_fullsized":"2024-09-13T06:31:12.599725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570695+0000","last_change":"2024-09-13T06:29:00.709102+0000","last_active":"2024-09-13T06:30:39.570695+0000","last_peered":"2024-09-13T06:30:39.570695+0000","last_clean":"2024-09-13T06:30:39.570695+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:30:39.570695+0000","last_undegraded":"2024-09-13T06:30:39.570695+0000","last_fullsized":"2024-09-13T06:30:39.570695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:36.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316128+0000","last_change":"2024-09-13T06:28:58.716677+0000","last_active":"2024-09-13T06:30:40.316128+0000","last_peered":"2024-09-13T06:30:40.316128+0000","last_clean":"2024-09-13T06:30:40.316128+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:30:40.316128+0000","last_undegraded":"2024-09-13T06:30:40.316128+0000","last_fullsized":"2024-09-13T06:30:40.316128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965751+0000","last_change":"2024-09-13T06:29:39.515090+0000","last_active":"2024-09-13T06:32:13.965751+0000","last_peered":"2024-09-13T06:32:13.965751+0000","last_clean":"2024-09-13T06:32:13.965751+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:32:13.965751+0000","last_undegraded":"2024-09-13T06:32:13.965751+0000","last_fullsized":"2024-09-13T06:32:13.965751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:44.609771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1507,"num_read_kb":1296,"num_write":565,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1328,"ondisk_log_size":1328,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":9028480,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":83,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52164,"kb_used_data":16820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319676,"statfs":{"total":96636764160,"available":96583348224,"internally_reserved":0,"allocated":17223680,"data_stored":16928749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49324,"kb_used_data":9820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322516,"statfs":{"total":96636764160,"available":96586256384,"internally_reserved":0,"allocated":10055680,"data_stored":9770864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48664,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323176,"statfs":{"total":96636764160,"available":96586932224,"internally_reserved":0,"allocated":13639680,"data_stored":13325489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":13400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":13721600,"data_stored":13377560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:32:46.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:32:46.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.962+0000 7fe494c6e640 1 Processor -- start 2024-09-13T06:32:46.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.962+0000 7fe494c6e640 1 -- start start 2024-09-13T06:32:46.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe49006ece0 0x7fe490130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49006f750 con 0x7fe49006e1f0 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe490070c10 con 0x7fe49006ece0 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe49006ece0 0x7fe490130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48e59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe49006e1f0 0x7fe49006e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46458/0 (socket says 172.21.15.112:46458) 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48e59c640 1 -- 172.21.15.112:0/2610203575 learned_addr learned my addr 172.21.15.112:0/2610203575 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48dd9b640 1 -- 172.21.15.112:0/2610203575 >> v1:172.21.15.112:6789/0 conn(0x7fe49006e1f0 legacy=0x7fe49006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48dd9b640 1 -- 172.21.15.112:0/2610203575 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4900703f0 con 0x7fe49006ece0 2024-09-13T06:32:46.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48dd9b640 1 --2- 172.21.15.112:0/2610203575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006ece0 0x7fe490130e50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe478009740 tx=0x7fe47801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f48359bfe4fbb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48d59a640 1 -- 172.21.15.112:0/2610203575 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4780b0070 con 0x7fe49006ece0 2024-09-13T06:32:46.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48d59a640 1 -- 172.21.15.112:0/2610203575 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4780ab530 con 0x7fe49006ece0 2024-09-13T06:32:46.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe48d59a640 1 -- 172.21.15.112:0/2610203575 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4780ab830 con 0x7fe49006ece0 2024-09-13T06:32:46.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- 172.21.15.112:0/2610203575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006ece0 msgr2=0x7fe490130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:46.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 --2- 172.21.15.112:0/2610203575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006ece0 0x7fe490130e50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe478009740 tx=0x7fe47801c370 comp rx=0 tx=0).stop 2024-09-13T06:32:46.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- 172.21.15.112:0/2610203575 shutdown_connections 2024-09-13T06:32:46.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 --2- 172.21.15.112:0/2610203575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006ece0 0x7fe490130e50 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:46.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- 172.21.15.112:0/2610203575 >> 172.21.15.112:0/2610203575 conn(0x7fe490099a50 msgr2=0x7fe4900972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:46.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- 172.21.15.112:0/2610203575 shutdown_connections 2024-09-13T06:32:46.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.966+0000 7fe494c6e640 1 -- 172.21.15.112:0/2610203575 wait complete. 2024-09-13T06:32:46.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 Processor -- start 2024-09-13T06:32:46.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 -- start start 2024-09-13T06:32:46.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 0x7fe49008f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe490133d30 con 0x7fe49006e1f0 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe48e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 0x7fe49008f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe48e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 0x7fe49008f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46216/0 (socket says 172.21.15.112:46216) 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe48e59c640 1 -- 172.21.15.112:0/2706003970 learned_addr learned my addr 172.21.15.112:0/2706003970 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe48e59c640 1 -- 172.21.15.112:0/2706003970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe490090370 con 0x7fe49006e1f0 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe48e59c640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 0x7fe49008f520 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe48000cb20 tx=0x7fe48000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe480017070 con 0x7fe49006e1f0 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe48000abf0 con 0x7fe49006e1f0 2024-09-13T06:32:46.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe480012400 con 0x7fe49006e1f0 2024-09-13T06:32:46.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe490091dc0 con 0x7fe49006e1f0 2024-09-13T06:32:46.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49008fa60 con 0x7fe49006e1f0 2024-09-13T06:32:46.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe48001a070 con 0x7fe49006e1f0 2024-09-13T06:32:46.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe490091620 con 0x7fe49006e1f0 2024-09-13T06:32:46.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe486ffd640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe470035db0 0x7fe470038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:46.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fe480048d70 con 0x7fe49006e1f0 2024-09-13T06:32:46.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.970+0000 7fe48dd9b640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe470035db0 0x7fe470038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:46.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.974+0000 7fe48dd9b640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe470035db0 0x7fe470038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe4780ad000 tx=0x7fe4780a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:46.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:46.974+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe490091620 con 0x7fe49006e1f0 2024-09-13T06:32:47.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.138+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe49006e5d0 con 0x7fe49006e1f0 2024-09-13T06:32:47.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe486ffd640 1 -- 172.21.15.112:0/2706003970 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+21335 (secure 0 0 0) 0x7fe4800113a0 con 0x7fe49006e1f0 2024-09-13T06:32:47.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:32:47.145 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":35,"fsid":"80dec8ae-a3b9-43d1-a264-f2d38c8a985d","created":"2024-09-13T06:28:33.704326+0000","modified":"2024-09-13T06:30:39.557606+0000","last_up_change":"2024-09-13T06:28:44.898147+0000","last_in_change":"2024-09-13T06:28:34.872562+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:28:46.475423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:28:49.493974+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T06:28:57.134870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T06:28:59.079283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T06:29:01.036559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T06:29:02.905450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T06:29:04.798169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T06:29:06.961079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec3bcd50-e4f1-4997-81f9-56e0d140212c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6801","nonce":389376018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6803","nonce":389376018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6807","nonce":389376018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":389376018},{"type":"v1","addr":"172.21.15.112:6805","nonce":389376018}]},"public_addr":"172.21.15.112:6801/389376018","cluster_addr":"172.21.15.112:6803/389376018","heartbeat_back_addr":"172.21.15.112:6807/389376018","heartbeat_front_addr":"172.21.15.112:6805/389376018","state":["exists","up"]},{"osd":1,"uuid":"d0a76e97-d8ca-4f0d-9a5d-8b4aa12c3fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6809","nonce":3492903297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6811","nonce":3492903297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6815","nonce":3492903297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3492903297},{"type":"v1","addr":"172.21.15.169:6813","nonce":3492903297}]},"public_addr":"172.21.15.169:6809/3492903297","cluster_addr":"172.21.15.169:6811/3492903297","heartbeat_back_addr":"172.21.15.169:6815/3492903297","heartbeat_front_addr":"172.21.15.169:6813/3492903297","state":["exists","up"]},{"osd":2,"uuid":"671f8491-70ba-44a6-a22f-17f0501b8378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6817","nonce":1749135367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6819","nonce":1749135367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6823","nonce":1749135367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1749135367},{"type":"v1","addr":"172.21.15.169:6821","nonce":1749135367}]},"public_addr":"172.21.15.169:6817/1749135367","cluster_addr":"172.21.15.169:6819/1749135367","heartbeat_back_addr":"172.21.15.169:6823/1749135367","heartbeat_front_addr":"172.21.15.169:6821/1749135367","state":["exists","up"]},{"osd":3,"uuid":"8ef95871-b245-4c2f-be69-6cd8c52f9019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6801","nonce":747740583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6803","nonce":747740583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6807","nonce":747740583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":747740583},{"type":"v1","addr":"172.21.15.169:6805","nonce":747740583}]},"public_addr":"172.21.15.169:6801/747740583","cluster_addr":"172.21.15.169:6803/747740583","heartbeat_back_addr":"172.21.15.169:6807/747740583","heartbeat_front_addr":"172.21.15.169:6805/747740583","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:41.983902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.376898+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.428265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:28:42.208789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.25","mappings":[{"from":0,"to":2}]},{"pgid":"4.36","mappings":[{"from":1,"to":2}]},{"pgid":"5.f","mappings":[{"from":1,"to":2}]},{"pgid":"6.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:32:47.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe470035db0 msgr2=0x7fe470038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe470035db0 0x7fe470038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe4780ad000 tx=0x7fe4780a6000 comp rx=0 tx=0).stop 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 msgr2=0x7fe49008f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 0x7fe49008f520 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe48000cb20 tx=0x7fe48000a060 comp rx=0 tx=0).stop 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 shutdown_connections 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fe470035db0 0x7fe470038270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 --2- 172.21.15.112:0/2706003970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49006e1f0 0x7fe49008f520 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 >> 172.21.15.112:0/2706003970 conn(0x7fe490099a50 msgr2=0x7fe49009a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 shutdown_connections 2024-09-13T06:32:47.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:47.142+0000 7fe494c6e640 1 -- 172.21.15.112:0/2706003970 wait complete. 2024-09-13T06:32:48.165 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T06:32:48.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:32:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63e2823640 1 Processor -- start 2024-09-13T06:32:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63e2823640 1 -- start start 2024-09-13T06:32:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63e2823640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63dc06d170 0x7f63dc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63e2823640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc098840 con 0x7f63dc06da90 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63e2823640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f63dc0709c0 con 0x7f63dc06d170 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63dbfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63dc06d170 0x7f63dc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63db7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f63dc06da90 0x7f63dc130b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46472/0 (socket says 172.21.15.112:46472) 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63db7fe640 1 -- 172.21.15.112:0/1046993824 learned_addr learned my addr 172.21.15.112:0/1046993824 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63dbfff640 1 -- 172.21.15.112:0/1046993824 >> v1:172.21.15.112:6789/0 conn(0x7f63dc06da90 legacy=0x7f63dc130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63dbfff640 1 -- 172.21.15.112:0/1046993824 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc071e20 con 0x7f63dc06d170 2024-09-13T06:32:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.298+0000 7f63daffd640 1 -- 172.21.15.112:0/1046993824 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486712879 0 0) 0x7f63dc098840 con 0x7f63dc06da90 2024-09-13T06:32:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63dbfff640 1 --2- 172.21.15.112:0/1046993824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc06d550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009d90 tx=0x7f63d401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b864256a0c1ad8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63daffd640 1 -- 172.21.15.112:0/1046993824 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63d40b2070 con 0x7f63dc06d170 2024-09-13T06:32:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63daffd640 1 -- 172.21.15.112:0/1046993824 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d40a5740 con 0x7f63dc06d170 2024-09-13T06:32:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63daffd640 1 -- 172.21.15.112:0/1046993824 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63d40a5a40 con 0x7f63dc06d170 2024-09-13T06:32:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- 172.21.15.112:0/1046993824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 msgr2=0x7f63dc06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 --2- 172.21.15.112:0/1046993824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc06d550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009d90 tx=0x7f63d401c8c0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- 172.21.15.112:0/1046993824 shutdown_connections 2024-09-13T06:32:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 --2- 172.21.15.112:0/1046993824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc06d550 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- 172.21.15.112:0/1046993824 >> 172.21.15.112:0/1046993824 conn(0x7f63dc0998a0 msgr2=0x7f63dc099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- 172.21.15.112:0/1046993824 shutdown_connections 2024-09-13T06:32:48.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- 172.21.15.112:0/1046993824 wait complete. 2024-09-13T06:32:48.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 Processor -- start 2024-09-13T06:32:48.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- start start 2024-09-13T06:32:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc12e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63e2823640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc134bf0 con 0x7f63dc06d170 2024-09-13T06:32:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63dbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc12e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63dbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc12e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46236/0 (socket says 172.21.15.112:46236) 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63dbfff640 1 -- 172.21.15.112:0/2498976678 learned_addr learned my addr 172.21.15.112:0/2498976678 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.302+0000 7f63dbfff640 1 -- 172.21.15.112:0/2498976678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc095a40 con 0x7f63dc06d170 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63dbfff640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc12e610 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63d401c900 tx=0x7f63d4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63d40bd030 con 0x7f63dc06d170 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc121fe0 con 0x7f63dc06d170 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d40b85a0 con 0x7f63dc06d170 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc12ed20 con 0x7f63dc06d170 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63d40b2040 con 0x7f63dc06d170 2024-09-13T06:32:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63dc0723e0 con 0x7f63dc06d170 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f63d40c0070 con 0x7f63dc06d170 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63c4035d60 0x7f63c4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f63d40be070 con 0x7f63dc06d170 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f63c4041be0 0x7f63c4044080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63d40a5740 con 0x7f63c4041be0 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f63d40eb050 con 0x7f63dc06d170 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63e0dc0640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f63c4041be0 0x7f63c4044080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63db7fe640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63c4035d60 0x7f63c4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63e0dc0640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f63c4041be0 0x7f63c4044080 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63db7fe640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63c4035d60 0x7f63c4038220 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007fd0 tx=0x7f63c8007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.306+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== osd.0 v2:172.21.15.112:6800/389376018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63d40a5740 con 0x7f63c4041be0 2024-09-13T06:32:48.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 --> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f63dc06d550 con 0x7f63c4041be0 2024-09-13T06:32:48.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63d8ff9640 1 -- 172.21.15.112:0/2498976678 <== osd.0 v2:172.21.15.112:6800/389376018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f63dc06d550 con 0x7f63c4041be0 2024-09-13T06:32:48.324 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-13T06:32:48.324 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:32:48.325 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-13T06:32:48.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f63c4041be0 msgr2=0x7f63c4044080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f63c4041be0 0x7f63c4044080 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63c4035d60 msgr2=0x7f63c4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63c4035d60 0x7f63c4038220 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007fd0 tx=0x7f63c8007980 comp rx=0 tx=0).stop 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 msgr2=0x7f63dc12e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc12e610 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63d401c900 tx=0x7f63d4019660 comp rx=0 tx=0).stop 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 shutdown_connections 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:6800/389376018,v1:172.21.15.112:6801/389376018] conn(0x7f63c4041be0 0x7f63c4044080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f63c4035d60 0x7f63c4038220 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 --2- 172.21.15.112:0/2498976678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc06d170 0x7f63dc12e610 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 >> 172.21.15.112:0/2498976678 conn(0x7f63dc0998a0 msgr2=0x7f63dc08cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 shutdown_connections 2024-09-13T06:32:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.322+0000 7f63e2823640 1 -- 172.21.15.112:0/2498976678 wait complete. 2024-09-13T06:32:48.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T06:32:48.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f636e1b4640 1 Processor -- start 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f636e1b4640 1 -- start start 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f636e1b4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f636806e180 0x7f6368133de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f636e1b4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636806f8a0 con 0x7f636812ed70 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f636e1b4640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f636806eac0 con 0x7f636806e180 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f6366ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f636806e180 0x7f6368133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f63677fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f636812ed70 0x7f636812f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46486/0 (socket says 172.21.15.112:46486) 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f63677fe640 1 -- 172.21.15.112:0/1685101030 learned_addr learned my addr 172.21.15.112:0/1685101030 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:48.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f6366ffd640 1 -- 172.21.15.112:0/1685101030 >> v1:172.21.15.112:6789/0 conn(0x7f636812ed70 legacy=0x7f636812f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f6366ffd640 1 -- 172.21.15.112:0/1685101030 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636806fbb0 con 0x7f636806e180 2024-09-13T06:32:48.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f6366ffd640 1 --2- 172.21.15.112:0/1685101030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f6368133de0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f635c009740 tx=0x7f635c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52490444a64ba44d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f63667fc640 1 -- 172.21.15.112:0/1685101030 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f635c0ab550 con 0x7f636806e180 2024-09-13T06:32:48.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f63667fc640 1 -- 172.21.15.112:0/1685101030 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635c0b0070 con 0x7f636806e180 2024-09-13T06:32:48.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.450+0000 7f63667fc640 1 -- 172.21.15.112:0/1685101030 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f635c0ab840 con 0x7f636806e180 2024-09-13T06:32:48.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1685101030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 msgr2=0x7f6368133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 --2- 172.21.15.112:0/1685101030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f6368133de0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f635c009740 tx=0x7f635c01c400 comp rx=0 tx=0).stop 2024-09-13T06:32:48.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1685101030 shutdown_connections 2024-09-13T06:32:48.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 --2- 172.21.15.112:0/1685101030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f6368133de0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1685101030 >> 172.21.15.112:0/1685101030 conn(0x7f636809cd30 msgr2=0x7f636809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1685101030 shutdown_connections 2024-09-13T06:32:48.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1685101030 wait complete. 2024-09-13T06:32:48.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 Processor -- start 2024-09-13T06:32:48.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- start start 2024-09-13T06:32:48.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f63681c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6368136ed0 con 0x7f636806e180 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f63677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f63681c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f63677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f63681c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46250/0 (socket says 172.21.15.112:46250) 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f63677fe640 1 -- 172.21.15.112:0/1120969997 learned_addr learned my addr 172.21.15.112:0/1120969997 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f63677fe640 1 -- 172.21.15.112:0/1120969997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6368093f70 con 0x7f636806e180 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f63677fe640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f63681c61e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f635800c480 tx=0x7f635800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6358017070 con 0x7f636806e180 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6358005c20 con 0x7f636806e180 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6358007070 con 0x7f636806e180 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6368094740 con 0x7f636806e180 2024-09-13T06:32:48.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63681c6720 con 0x7f636806e180 2024-09-13T06:32:48.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f635801a070 con 0x7f636806e180 2024-09-13T06:32:48.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6368093ad0 con 0x7f636806e180 2024-09-13T06:32:48.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f634ffff640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6354035db0 0x7f6354038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f6358048340 con 0x7f636806e180 2024-09-13T06:32:48.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.454+0000 7f6366ffd640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6354035db0 0x7f6354038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.458+0000 7f6366ffd640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6354035db0 0x7f6354038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f635c009740 tx=0x7f635c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.462+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6358007210 con 0x7f636806e180 2024-09-13T06:32:48.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.614+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f636806e600 con 0x7f6354035db0 2024-09-13T06:32:48.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f634ffff640 1 -- 172.21.15.112:0/1120969997 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f636806e600 con 0x7f6354035db0 2024-09-13T06:32:48.621 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T06:32:48.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6354035db0 msgr2=0x7f6354038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6354035db0 0x7f6354038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f635c009740 tx=0x7f635c0a7000 comp rx=0 tx=0).stop 2024-09-13T06:32:48.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 msgr2=0x7f63681c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f63681c61e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f635800c480 tx=0x7f635800c940 comp rx=0 tx=0).stop 2024-09-13T06:32:48.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 shutdown_connections 2024-09-13T06:32:48.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6354035db0 0x7f6354038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 --2- 172.21.15.112:0/1120969997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f636806e180 0x7f63681c61e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.618+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 >> 172.21.15.112:0/1120969997 conn(0x7f636809cd30 msgr2=0x7f636812fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.622+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 shutdown_connections 2024-09-13T06:32:48.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.622+0000 7f636e1b4640 1 -- 172.21.15.112:0/1120969997 wait complete. 2024-09-13T06:32:48.639 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T06:32:48.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5f436640 1 Processor -- start 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5f436640 1 -- start start 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5f436640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f581281c0 0x7f8f581285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5f436640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f58098840 con 0x7f8f58128ae0 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5f436640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5806f7b0 con 0x7f8f581281c0 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5c9d1640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8f58128ae0 0x7f8f5806e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46490/0 (socket says 172.21.15.112:46490) 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5c9d1640 1 -- 172.21.15.112:0/3807255379 learned_addr learned my addr 172.21.15.112:0/3807255379 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5d1d2640 1 --2- 172.21.15.112:0/3807255379 >> v2:172.21.15.112:3300/0 conn(0x7f8f581281c0 0x7f8f581285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f4ffff640 1 -- 172.21.15.112:0/3807255379 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308303024 0 0) 0x7f8f58098840 con 0x7f8f58128ae0 2024-09-13T06:32:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f4ffff640 1 -- 172.21.15.112:0/3807255379 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f44003530 con 0x7f8f58128ae0 2024-09-13T06:32:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5d1d2640 1 -- 172.21.15.112:0/3807255379 >> v1:172.21.15.112:6789/0 conn(0x7f8f58128ae0 legacy=0x7f8f5806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f4ffff640 1 -- 172.21.15.112:0/3807255379 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2546372427 0 0) 0x7f8f44003530 con 0x7f8f58128ae0 2024-09-13T06:32:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.758+0000 7f8f5d1d2640 1 -- 172.21.15.112:0/3807255379 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f58127fa0 con 0x7f8f581281c0 2024-09-13T06:32:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5d1d2640 1 --2- 172.21.15.112:0/3807255379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f581285a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009770 tx=0x7f8f5401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2f4e7246d3ae4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f4ffff640 1 -- 172.21.15.112:0/3807255379 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f540b0070 con 0x7f8f581281c0 2024-09-13T06:32:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f4ffff640 1 -- 172.21.15.112:0/3807255379 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f540ab400 con 0x7f8f581281c0 2024-09-13T06:32:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f4ffff640 1 -- 172.21.15.112:0/3807255379 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f480015b0 con 0x7f8f581281c0 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 -- 172.21.15.112:0/3807255379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 msgr2=0x7f8f581285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 --2- 172.21.15.112:0/3807255379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f581285a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009770 tx=0x7f8f5401c230 comp rx=0 tx=0).stop 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 -- 172.21.15.112:0/3807255379 shutdown_connections 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 --2- 172.21.15.112:0/3807255379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f581285a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 -- 172.21.15.112:0/3807255379 >> 172.21.15.112:0/3807255379 conn(0x7f8f580998a0 msgr2=0x7f8f58099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 -- 172.21.15.112:0/3807255379 shutdown_connections 2024-09-13T06:32:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 -- 172.21.15.112:0/3807255379 wait complete. 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 Processor -- start 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.762+0000 7f8f5f436640 1 -- start start 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5f436640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f58122100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5f436640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f581338f0 con 0x7f8f581281c0 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d1d2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f58122100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d1d2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f58122100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46268/0 (socket says 172.21.15.112:46268) 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d1d2640 1 -- 172.21.15.112:0/1609740508 learned_addr learned my addr 172.21.15.112:0/1609740508 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d1d2640 1 -- 172.21.15.112:0/1609740508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f581255d0 con 0x7f8f581281c0 2024-09-13T06:32:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d1d2640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f58122100 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8f54019ec0 tx=0x7f8f5401aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f540b0050 con 0x7f8f581281c0 2024-09-13T06:32:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f540b1040 con 0x7f8f581281c0 2024-09-13T06:32:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f58124b20 con 0x7f8f581281c0 2024-09-13T06:32:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f540b75a0 con 0x7f8f581281c0 2024-09-13T06:32:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f58123860 con 0x7f8f581281c0 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f581285a0 con 0x7f8f581281c0 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8f540be030 con 0x7f8f581281c0 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8f3c035db0 0x7f8f3c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f8f540bc070 con 0x7f8f581281c0 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f8f3c041d10 0x7f8f3c0441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f5400af30 con 0x7f8f3c041d10 2024-09-13T06:32:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8f540e5250 con 0x7f8f581281c0 2024-09-13T06:32:48.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5c9d1640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8f3c035db0 0x7f8f3c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d9d3640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f8f3c041d10 0x7f8f3c0441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5d9d3640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f8f3c041d10 0x7f8f3c0441b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.766+0000 7f8f5c9d1640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8f3c035db0 0x7f8f3c038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8f48001e00 tx=0x7f8f48001580 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.770+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== osd.1 v2:172.21.15.169:6808/3492903297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f5400af30 con 0x7f8f3c041d10 2024-09-13T06:32:48.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 --> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f58074a40 con 0x7f8f3c041d10 2024-09-13T06:32:48.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f4dffb640 1 -- 172.21.15.112:0/1609740508 <== osd.1 v2:172.21.15.169:6808/3492903297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f58074a40 con 0x7f8f3c041d10 2024-09-13T06:32:48.787 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-13T06:32:48.787 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:32:48.787 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f8f3c041d10 msgr2=0x7f8f3c0441b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f8f3c041d10 0x7f8f3c0441b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8f3c035db0 msgr2=0x7f8f3c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8f3c035db0 0x7f8f3c038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8f48001e00 tx=0x7f8f48001580 comp rx=0 tx=0).stop 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 msgr2=0x7f8f58122100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f58122100 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8f54019ec0 tx=0x7f8f5401aad0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 shutdown_connections 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6808/3492903297,v1:172.21.15.169:6809/3492903297] conn(0x7f8f3c041d10 0x7f8f3c0441b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f8f3c035db0 0x7f8f3c038270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 --2- 172.21.15.112:0/1609740508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f581281c0 0x7f8f58122100 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 >> 172.21.15.112:0/1609740508 conn(0x7f8f580998a0 msgr2=0x7f8f5806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 shutdown_connections 2024-09-13T06:32:48.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.782+0000 7f8f5f436640 1 -- 172.21.15.112:0/1609740508 wait complete. 2024-09-13T06:32:48.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T06:32:48.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d3c79640 1 Processor -- start 2024-09-13T06:32:48.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d3c79640 1 -- start start 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d3c79640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05cc12f390 0x7f05cc133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d3c79640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05cc0984f0 con 0x7f05cc12e760 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d3c79640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f05cc098dc0 con 0x7f05cc12f390 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d1214640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05cc12f390 0x7f05cc133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d1a15640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f05cc12e760 0x7f05cc12ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46498/0 (socket says 172.21.15.112:46498) 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d1a15640 1 -- 172.21.15.112:0/1267036343 learned_addr learned my addr 172.21.15.112:0/1267036343 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d1214640 1 -- 172.21.15.112:0/1267036343 >> v1:172.21.15.112:6789/0 conn(0x7f05cc12e760 legacy=0x7f05cc12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d0a13640 1 -- 172.21.15.112:0/1267036343 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161337065 0 0) 0x7f05cc0984f0 con 0x7f05cc12e760 2024-09-13T06:32:48.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.910+0000 7f05d1214640 1 -- 172.21.15.112:0/1267036343 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc0981a0 con 0x7f05cc12f390 2024-09-13T06:32:48.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d1214640 1 --2- 172.21.15.112:0/1267036343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12f390 0x7f05cc133a80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009740 tx=0x7f05c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca3e9e3e8120968 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d0a13640 1 -- 172.21.15.112:0/1267036343 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c00b1070 con 0x7f05cc12f390 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d0a13640 1 -- 172.21.15.112:0/1267036343 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c00ac570 con 0x7f05cc12f390 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d0a13640 1 -- 172.21.15.112:0/1267036343 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c00ac870 con 0x7f05cc12f390 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- 172.21.15.112:0/1267036343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12f390 msgr2=0x7f05cc133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 --2- 172.21.15.112:0/1267036343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12f390 0x7f05cc133a80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009740 tx=0x7f05c001c400 comp rx=0 tx=0).stop 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- 172.21.15.112:0/1267036343 shutdown_connections 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 --2- 172.21.15.112:0/1267036343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12f390 0x7f05cc133a80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:48.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- 172.21.15.112:0/1267036343 >> 172.21.15.112:0/1267036343 conn(0x7f05cc0a10a0 msgr2=0x7f05cc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:48.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- 172.21.15.112:0/1267036343 shutdown_connections 2024-09-13T06:32:48.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- 172.21.15.112:0/1267036343 wait complete. 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 Processor -- start 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- start start 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 0x7f05cc12fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc136b70 con 0x7f05cc12e760 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d1a15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 0x7f05cc12fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d1a15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 0x7f05cc12fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46284/0 (socket says 172.21.15.112:46284) 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d1a15640 1 -- 172.21.15.112:0/3595147457 learned_addr learned my addr 172.21.15.112:0/3595147457 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d1a15640 1 -- 172.21.15.112:0/3595147457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc128f50 con 0x7f05cc12e760 2024-09-13T06:32:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d1a15640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 0x7f05cc12fa60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f05c400c840 tx=0x7f05c400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c4018070 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c400a660 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc133240 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.914+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c400a850 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc132380 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc132670 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f05c401b070 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05ca7fc640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f05b8035db0 0x7f05b8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f05c40487c0 con 0x7f05cc12e760 2024-09-13T06:32:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05d1214640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f05b8035db0 0x7f05b8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:48.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.918+0000 7f05d1214640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f05b8035db0 0x7f05b8038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f05c00ae000 tx=0x7f05c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:48.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:48.922+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05cc132670 con 0x7f05cc12e760 2024-09-13T06:32:49.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.078+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f05cc132e90 con 0x7f05b8035db0 2024-09-13T06:32:49.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.078+0000 7f05ca7fc640 1 -- 172.21.15.112:0/3595147457 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f05cc132e90 con 0x7f05b8035db0 2024-09-13T06:32:49.083 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T06:32:49.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f05b8035db0 msgr2=0x7f05b8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f05b8035db0 0x7f05b8038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f05c00ae000 tx=0x7f05c0008040 comp rx=0 tx=0).stop 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 msgr2=0x7f05cc12fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 0x7f05cc12fa60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f05c400c840 tx=0x7f05c400cd00 comp rx=0 tx=0).stop 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 shutdown_connections 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f05b8035db0 0x7f05b8038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 --2- 172.21.15.112:0/3595147457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05cc12e760 0x7f05cc12fa60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 >> 172.21.15.112:0/3595147457 conn(0x7f05cc0a10a0 msgr2=0x7f05cc12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 shutdown_connections 2024-09-13T06:32:49.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.082+0000 7f05d3c79640 1 -- 172.21.15.112:0/3595147457 wait complete. 2024-09-13T06:32:49.100 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T06:32:49.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:32:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.218+0000 7f34ac250640 1 Processor -- start 2024-09-13T06:32:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 -- start start 2024-09-13T06:32:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34a406e410 0x7f34a4133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34a4098840 con 0x7f34a406d170 2024-09-13T06:32:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34a406fb10 con 0x7f34a406e410 2024-09-13T06:32:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a9fec640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f34a406d170 0x7f34a406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46508/0 (socket says 172.21.15.112:46508) 2024-09-13T06:32:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a9fec640 1 -- 172.21.15.112:0/1534165569 learned_addr learned my addr 172.21.15.112:0/1534165569 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a97eb640 1 --2- 172.21.15.112:0/1534165569 >> v2:172.21.15.112:3300/0 conn(0x7f34a406e410 0x7f34a4133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a8fea640 1 -- 172.21.15.112:0/1534165569 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337054263 0 0) 0x7f34a4098840 con 0x7f34a406d170 2024-09-13T06:32:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a8fea640 1 -- 172.21.15.112:0/1534165569 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3490003530 con 0x7f34a406d170 2024-09-13T06:32:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a97eb640 1 -- 172.21.15.112:0/1534165569 >> v1:172.21.15.112:6789/0 conn(0x7f34a406d170 legacy=0x7f34a406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a97eb640 1 -- 172.21.15.112:0/1534165569 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a406f6d0 con 0x7f34a406e410 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a97eb640 1 --2- 172.21.15.112:0/1534165569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406e410 0x7f34a4133d70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3494009740 tx=0x7f349401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890a81827d518f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a8fea640 1 -- 172.21.15.112:0/1534165569 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34940b0070 con 0x7f34a406e410 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a8fea640 1 -- 172.21.15.112:0/1534165569 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34940ab530 con 0x7f34a406e410 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34a8fea640 1 -- 172.21.15.112:0/1534165569 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34940ab830 con 0x7f34a406e410 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 -- 172.21.15.112:0/1534165569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406e410 msgr2=0x7f34a4133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 --2- 172.21.15.112:0/1534165569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406e410 0x7f34a4133d70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3494009740 tx=0x7f349401c370 comp rx=0 tx=0).stop 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 -- 172.21.15.112:0/1534165569 shutdown_connections 2024-09-13T06:32:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 --2- 172.21.15.112:0/1534165569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406e410 0x7f34a4133d70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.222+0000 7f34ac250640 1 -- 172.21.15.112:0/1534165569 >> 172.21.15.112:0/1534165569 conn(0x7f34a40998a0 msgr2=0x7f34a4099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- 172.21.15.112:0/1534165569 shutdown_connections 2024-09-13T06:32:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- 172.21.15.112:0/1534165569 wait complete. 2024-09-13T06:32:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 Processor -- start 2024-09-13T06:32:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- start start 2024-09-13T06:32:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 0x7f34a4093660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4136e60 con 0x7f34a406d170 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34a9fec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 0x7f34a4093660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34a9fec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 0x7f34a4093660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46296/0 (socket says 172.21.15.112:46296) 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34a9fec640 1 -- 172.21.15.112:0/3191798450 learned_addr learned my addr 172.21.15.112:0/3191798450 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34a9fec640 1 -- 172.21.15.112:0/3191798450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a4096390 con 0x7f34a406d170 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34a9fec640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 0x7f34a4093660 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f349c00cb40 tx=0x7f349c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f349c017070 con 0x7f34a406d170 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349c00abf0 con 0x7f34a406d170 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a4094e70 con 0x7f34a406d170 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f349c012400 con 0x7f34a406d170 2024-09-13T06:32:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a4093ba0 con 0x7f34a406d170 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f349c01a070 con 0x7f34a406d170 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34a40947d0 con 0x7f34a406d170 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3488035db0 0x7f3488038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f349c048e10 con 0x7f34a406d170 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3488041d10 0x7f34880441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3488044880 con 0x7f3488041d10 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f349c04b4c0 con 0x7f34a406d170 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34a97eb640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3488035db0 0x7f3488038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.226+0000 7f34aa7ed640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3488041d10 0x7f34880441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.230+0000 7f34a97eb640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3488035db0 0x7f3488038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34940ad000 tx=0x7f3494008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.230+0000 7f34aa7ed640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3488041d10 0x7f34880441b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.230+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== osd.2 v2:172.21.15.169:6816/1749135367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3488044880 con 0x7f3488041d10 2024-09-13T06:32:49.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.242+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 --> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34a4122260 con 0x7f3488041d10 2024-09-13T06:32:49.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.242+0000 7f349a7fc640 1 -- 172.21.15.112:0/3191798450 <== osd.2 v2:172.21.15.169:6816/1749135367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34a4122260 con 0x7f3488041d10 2024-09-13T06:32:49.248 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-13T06:32:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:32:49.248 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3488041d10 msgr2=0x7f34880441b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3488041d10 0x7f34880441b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3488035db0 msgr2=0x7f3488038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3488035db0 0x7f3488038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34940ad000 tx=0x7f3494008040 comp rx=0 tx=0).stop 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 msgr2=0x7f34a4093660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 0x7f34a4093660 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f349c00cb40 tx=0x7f349c00a060 comp rx=0 tx=0).stop 2024-09-13T06:32:49.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 shutdown_connections 2024-09-13T06:32:49.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6816/1749135367,v1:172.21.15.169:6817/1749135367] conn(0x7f3488041d10 0x7f34880441b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f3488035db0 0x7f3488038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 --2- 172.21.15.112:0/3191798450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a406d170 0x7f34a4093660 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 >> 172.21.15.112:0/3191798450 conn(0x7f34a40998a0 msgr2=0x7f34a409b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 shutdown_connections 2024-09-13T06:32:49.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.246+0000 7f34ac250640 1 -- 172.21.15.112:0/3191798450 wait complete. 2024-09-13T06:32:49.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T06:32:49.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd89582e640 1 Processor -- start 2024-09-13T06:32:49.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd89582e640 1 -- start start 2024-09-13T06:32:49.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd89582e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd89006e180 0x7fd890133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd89582e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89006fc40 con 0x7fd89012ed70 2024-09-13T06:32:49.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd89582e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd89006f930 con 0x7fd89006e180 2024-09-13T06:32:49.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd88e7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd89006e180 0x7fd890133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd88effd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd89012ed70 0x7fd89012f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46512/0 (socket says 172.21.15.112:46512) 2024-09-13T06:32:49.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.362+0000 7fd88effd640 1 -- 172.21.15.112:0/3732015127 learned_addr learned my addr 172.21.15.112:0/3732015127 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:49.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88e7fc640 1 -- 172.21.15.112:0/3732015127 >> v1:172.21.15.112:6789/0 conn(0x7fd89012ed70 legacy=0x7fd89012f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88e7fc640 1 -- 172.21.15.112:0/3732015127 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89006ea20 con 0x7fd89006e180 2024-09-13T06:32:49.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88dffb640 1 -- 172.21.15.112:0/3732015127 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43990670 0 0) 0x7fd89006fc40 con 0x7fd89012ed70 2024-09-13T06:32:49.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88e7fc640 1 --2- 172.21.15.112:0/3732015127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd890133e50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd880009740 tx=0x7fd88001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da6bedbc5ded432 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88dffb640 1 -- 172.21.15.112:0/3732015127 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8800b1070 con 0x7fd89006e180 2024-09-13T06:32:49.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88dffb640 1 -- 172.21.15.112:0/3732015127 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8800ac570 con 0x7fd89006e180 2024-09-13T06:32:49.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd88dffb640 1 -- 172.21.15.112:0/3732015127 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8800ac870 con 0x7fd89006e180 2024-09-13T06:32:49.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 -- 172.21.15.112:0/3732015127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 msgr2=0x7fd890133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 --2- 172.21.15.112:0/3732015127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd890133e50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd880009740 tx=0x7fd88001c400 comp rx=0 tx=0).stop 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 -- 172.21.15.112:0/3732015127 shutdown_connections 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 --2- 172.21.15.112:0/3732015127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd890133e50 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 -- 172.21.15.112:0/3732015127 >> 172.21.15.112:0/3732015127 conn(0x7fd89009cd30 msgr2=0x7fd89009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 -- 172.21.15.112:0/3732015127 shutdown_connections 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 -- 172.21.15.112:0/3732015127 wait complete. 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 Processor -- start 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.366+0000 7fd89582e640 1 -- start start 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd89582e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd8901c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd89582e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd890136f40 con 0x7fd89006e180 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd8901c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd8901c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46310/0 (socket says 172.21.15.112:46310) 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88effd640 1 -- 172.21.15.112:0/3422904585 learned_addr learned my addr 172.21.15.112:0/3422904585 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88effd640 1 -- 172.21.15.112:0/3422904585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd890093f70 con 0x7fd89006e180 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88effd640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd8901c6080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd88400c420 tx=0x7fd88400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd884018070 con 0x7fd89006e180 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8840074d0 con 0x7fd89006e180 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd884004960 con 0x7fd89006e180 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd890093ad0 con 0x7fd89006e180 2024-09-13T06:32:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8901c65c0 con 0x7fd89006e180 2024-09-13T06:32:49.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd890094ee0 con 0x7fd89006e180 2024-09-13T06:32:49.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd88401b070 con 0x7fd89006e180 2024-09-13T06:32:49.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd877fff640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd87c035db0 0x7fd87c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fd8840483c0 con 0x7fd89006e180 2024-09-13T06:32:49.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88e7fc640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd87c035db0 0x7fd87c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.370+0000 7fd88e7fc640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd87c035db0 0x7fd87c038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd8800ae000 tx=0x7fd880008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.374+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd88401ae10 con 0x7fd89006e180 2024-09-13T06:32:49.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.538+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd890098500 con 0x7fd87c035db0 2024-09-13T06:32:49.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.538+0000 7fd877fff640 1 -- 172.21.15.112:0/3422904585 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd890098500 con 0x7fd87c035db0 2024-09-13T06:32:49.542 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T06:32:49.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd87c035db0 msgr2=0x7fd87c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd87c035db0 0x7fd87c038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd8800ae000 tx=0x7fd880008040 comp rx=0 tx=0).stop 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 msgr2=0x7fd8901c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd8901c6080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd88400c420 tx=0x7fd88400c8e0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 shutdown_connections 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fd87c035db0 0x7fd87c038270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 --2- 172.21.15.112:0/3422904585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89006e180 0x7fd8901c6080 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 >> 172.21.15.112:0/3422904585 conn(0x7fd89009cd30 msgr2=0x7fd89012fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 shutdown_connections 2024-09-13T06:32:49.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.542+0000 7fd89582e640 1 -- 172.21.15.112:0/3422904585 wait complete. 2024-09-13T06:32:49.560 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T06:32:49.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:32:49.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18fc92640 1 Processor -- start 2024-09-13T06:32:49.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18fc92640 1 -- start start 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18fc92640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc188070370 0x7fc188131610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18fc92640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc188071b60 con 0x7fc18806f880 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18fc92640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc188070930 con 0x7fc188070370 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18da2e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc18806f880 0x7fc18806fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53556/0 (socket says 172.21.15.112:53556) 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18da2e640 1 -- 172.21.15.112:0/2835818971 learned_addr learned my addr 172.21.15.112:0/2835818971 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18d22d640 1 --2- 172.21.15.112:0/2835818971 >> v2:172.21.15.112:3300/0 conn(0x7fc188070370 0x7fc188131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18ca2c640 1 -- 172.21.15.112:0/2835818971 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620272036 0 0) 0x7fc188071b60 con 0x7fc18806f880 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18ca2c640 1 -- 172.21.15.112:0/2835818971 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc174003530 con 0x7fc18806f880 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18d22d640 1 -- 172.21.15.112:0/2835818971 >> v1:172.21.15.112:6789/0 conn(0x7fc18806f880 legacy=0x7fc18806fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18d22d640 1 -- 172.21.15.112:0/2835818971 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc188070f60 con 0x7fc188070370 2024-09-13T06:32:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.678+0000 7fc18d22d640 1 --2- 172.21.15.112:0/2835818971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc188070370 0x7fc188131610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc178009740 tx=0x7fc17801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34956ebbaadcadef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18ca2c640 1 -- 172.21.15.112:0/2835818971 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1780b0070 con 0x7fc188070370 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18ca2c640 1 -- 172.21.15.112:0/2835818971 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1780ab530 con 0x7fc188070370 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18ca2c640 1 -- 172.21.15.112:0/2835818971 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1780ab810 con 0x7fc188070370 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/2835818971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc188070370 msgr2=0x7fc188131610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 --2- 172.21.15.112:0/2835818971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc188070370 0x7fc188131610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc178009740 tx=0x7fc17801c370 comp rx=0 tx=0).stop 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/2835818971 shutdown_connections 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 --2- 172.21.15.112:0/2835818971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc188070370 0x7fc188131610 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/2835818971 >> 172.21.15.112:0/2835818971 conn(0x7fc18809cda0 msgr2=0x7fc18809d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/2835818971 shutdown_connections 2024-09-13T06:32:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/2835818971 wait complete. 2024-09-13T06:32:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 Processor -- start 2024-09-13T06:32:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- start start 2024-09-13T06:32:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 0x7fc188097d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc188134700 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18da2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 0x7fc188097d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18da2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 0x7fc188097d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59360/0 (socket says 172.21.15.112:59360) 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18da2e640 1 -- 172.21.15.112:0/385596656 learned_addr learned my addr 172.21.15.112:0/385596656 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18da2e640 1 -- 172.21.15.112:0/385596656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc188130240 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18da2e640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 0x7fc188097d10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc18400ca20 tx=0x7fc18400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184017070 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18400ab20 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc188126da0 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18400ae60 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc188130ed0 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc18806fc60 con 0x7fc18806f880 2024-09-13T06:32:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc18401a070 con 0x7fc18806f880 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.682+0000 7fc17e7fc640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc16c035d60 0x7fc16c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fc184048db0 con 0x7fc18806f880 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc17e7fc640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fc16c041cc0 0x7fc16c044160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc16c044830 con 0x7fc16c041cc0 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc18404b400 con 0x7fc18806f880 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc18d22d640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc16c035d60 0x7fc16c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc18e22f640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fc16c041cc0 0x7fc16c044160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc18e22f640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fc16c041cc0 0x7fc16c044160 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc18d22d640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc16c035d60 0x7fc16c038220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ad000 tx=0x7fc1780a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.686+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== osd.3 v2:172.21.15.169:6800/747740583 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc16c044830 con 0x7fc16c041cc0 2024-09-13T06:32:49.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.698+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 --> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc188070330 con 0x7fc16c041cc0 2024-09-13T06:32:49.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.698+0000 7fc17e7fc640 1 -- 172.21.15.112:0/385596656 <== osd.3 v2:172.21.15.169:6800/747740583 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc188070330 con 0x7fc16c041cc0 2024-09-13T06:32:49.704 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-13T06:32:49.704 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:32:49.704 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-13T06:32:49.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fc16c041cc0 msgr2=0x7fc16c044160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fc16c041cc0 0x7fc16c044160 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc16c035d60 msgr2=0x7fc16c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc16c035d60 0x7fc16c038220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ad000 tx=0x7fc1780a6000 comp rx=0 tx=0).stop 2024-09-13T06:32:49.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 msgr2=0x7fc188097d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 0x7fc188097d10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc18400ca20 tx=0x7fc18400cee0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 shutdown_connections 2024-09-13T06:32:49.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6800/747740583,v1:172.21.15.169:6801/747740583] conn(0x7fc16c041cc0 0x7fc16c044160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fc16c035d60 0x7fc16c038220 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 --2- 172.21.15.112:0/385596656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18806f880 0x7fc188097d10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 >> 172.21.15.112:0/385596656 conn(0x7fc18809cda0 msgr2=0x7fc188128fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 shutdown_connections 2024-09-13T06:32:49.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.702+0000 7fc18fc92640 1 -- 172.21.15.112:0/385596656 wait complete. 2024-09-13T06:32:49.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T06:32:49.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.818+0000 7f0123b1b640 1 Processor -- start 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.818+0000 7f0123b1b640 1 -- start start 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f011c06dbd0 0x7f011c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c071c10 con 0x7f011c06d0e0 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f011c072230 con 0x7f011c06dbd0 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01210b6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f011c06dbd0 0x7f011c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01210b6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f011c06dbd0 0x7f011c131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59362/0 (socket says 172.21.15.112:59362) 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01218b7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f011c06d0e0 0x7f011c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53562/0 (socket says 172.21.15.112:53562) 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01210b6640 1 -- 172.21.15.112:0/190810434 learned_addr learned my addr 172.21.15.112:0/190810434 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01210b6640 1 -- 172.21.15.112:0/190810434 >> v1:172.21.15.112:6789/0 conn(0x7f011c06d0e0 legacy=0x7f011c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01210b6640 1 -- 172.21.15.112:0/190810434 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c0709e0 con 0x7f011c06dbd0 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01210b6640 1 --2- 172.21.15.112:0/190810434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06dbd0 0x7f011c131e60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f01140097f0 tx=0x7f011401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a551d84aab5f41c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01208b5640 1 -- 172.21.15.112:0/190810434 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01140b0070 con 0x7f011c06dbd0 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01208b5640 1 -- 172.21.15.112:0/190810434 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01140ab530 con 0x7f011c06dbd0 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f01208b5640 1 -- 172.21.15.112:0/190810434 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01140ab830 con 0x7f011c06dbd0 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- 172.21.15.112:0/190810434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06dbd0 msgr2=0x7f011c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 --2- 172.21.15.112:0/190810434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06dbd0 0x7f011c131e60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f01140097f0 tx=0x7f011401c430 comp rx=0 tx=0).stop 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- 172.21.15.112:0/190810434 shutdown_connections 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 --2- 172.21.15.112:0/190810434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06dbd0 0x7f011c131e60 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- 172.21.15.112:0/190810434 >> 172.21.15.112:0/190810434 conn(0x7f011c099a50 msgr2=0x7f011c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- 172.21.15.112:0/190810434 shutdown_connections 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.822+0000 7f0123b1b640 1 -- 172.21.15.112:0/190810434 wait complete. 2024-09-13T06:32:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 Processor -- start 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 -- start start 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 0x7f011c1284c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f011c134d40 con 0x7f011c06d0e0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01218b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 0x7f011c1284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01218b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 0x7f011c1284c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59370/0 (socket says 172.21.15.112:59370) 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01218b7640 1 -- 172.21.15.112:0/1466124703 learned_addr learned my addr 172.21.15.112:0/1466124703 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01218b7640 1 -- 172.21.15.112:0/1466124703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c1281b0 con 0x7f011c06d0e0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01218b7640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 0x7f011c1284c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c7f0 tx=0x7f010c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010c017070 con 0x7f011c06d0e0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c00a610 con 0x7f011c06d0e0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c127600 con 0x7f011c06d0e0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010c00a8f0 con 0x7f011c06d0e0 2024-09-13T06:32:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c128bd0 con 0x7f011c06d0e0 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011c06d4c0 con 0x7f011c06d0e0 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f010c01a070 con 0x7f011c06d0e0 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01127fc640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108035db0 0x7f0108038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f010c048640 con 0x7f011c06d0e0 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.826+0000 7f01210b6640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108035db0 0x7f0108038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.830+0000 7f01210b6640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108035db0 0x7f0108038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f01140ad000 tx=0x7f01140a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.830+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f010c0073f0 con 0x7f011c06d0e0 2024-09-13T06:32:49.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f011c072710 con 0x7f0108035db0 2024-09-13T06:32:49.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f01127fc640 1 -- 172.21.15.112:0/1466124703 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f011c072710 con 0x7f0108035db0 2024-09-13T06:32:49.985 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T06:32:49.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108035db0 msgr2=0x7f0108038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108035db0 0x7f0108038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f01140ad000 tx=0x7f01140a6000 comp rx=0 tx=0).stop 2024-09-13T06:32:49.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 msgr2=0x7f011c1284c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 0x7f011c1284c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c7f0 tx=0x7f010c00ccb0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 shutdown_connections 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f0108035db0 0x7f0108038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 --2- 172.21.15.112:0/1466124703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c06d0e0 0x7f011c1284c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 >> 172.21.15.112:0/1466124703 conn(0x7f011c099a50 msgr2=0x7f011c09b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 shutdown_connections 2024-09-13T06:32:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:49.982+0000 7f0123b1b640 1 -- 172.21.15.112:0/1466124703 wait complete. 2024-09-13T06:32:50.002 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:32:50.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16f551b640 1 Processor -- start 2024-09-13T06:32:50.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16f551b640 1 -- start start 2024-09-13T06:32:50.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16f551b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16f006dbd0 0x7f16f0131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:50.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16f551b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f0071c10 con 0x7f16f006d0e0 2024-09-13T06:32:50.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16f551b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f16f0072230 con 0x7f16f006dbd0 2024-09-13T06:32:50.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16ee7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16f006dbd0 0x7f16f0131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:50.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16eeffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16f006d0e0 0x7f16f006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53570/0 (socket says 172.21.15.112:53570) 2024-09-13T06:32:50.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16ee7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16f006dbd0 0x7f16f0131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59384/0 (socket says 172.21.15.112:59384) 2024-09-13T06:32:50.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16eeffd640 1 -- 172.21.15.112:0/4015131207 learned_addr learned my addr 172.21.15.112:0/4015131207 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:32:50.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16ee7fc640 1 -- 172.21.15.112:0/4015131207 >> v1:172.21.15.112:6789/0 conn(0x7f16f006d0e0 legacy=0x7f16f006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:50.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16ee7fc640 1 -- 172.21.15.112:0/4015131207 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00709e0 con 0x7f16f006dbd0 2024-09-13T06:32:50.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.114+0000 7f16edffb640 1 -- 172.21.15.112:0/4015131207 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737757793 0 0) 0x7f16f0071c10 con 0x7f16f006d0e0 2024-09-13T06:32:50.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16ee7fc640 1 --2- 172.21.15.112:0/4015131207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006dbd0 0x7f16f0131e60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009740 tx=0x7f16e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b509ef3c6a4de3e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:50.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16edffb640 1 -- 172.21.15.112:0/4015131207 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e40b0070 con 0x7f16f006dbd0 2024-09-13T06:32:50.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16edffb640 1 -- 172.21.15.112:0/4015131207 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e40ab530 con 0x7f16f006dbd0 2024-09-13T06:32:50.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16edffb640 1 -- 172.21.15.112:0/4015131207 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e40ab830 con 0x7f16f006dbd0 2024-09-13T06:32:50.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 -- 172.21.15.112:0/4015131207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006dbd0 msgr2=0x7f16f0131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:50.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 --2- 172.21.15.112:0/4015131207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006dbd0 0x7f16f0131e60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009740 tx=0x7f16e401c370 comp rx=0 tx=0).stop 2024-09-13T06:32:50.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 -- 172.21.15.112:0/4015131207 shutdown_connections 2024-09-13T06:32:50.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 --2- 172.21.15.112:0/4015131207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006dbd0 0x7f16f0131e60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:50.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 -- 172.21.15.112:0/4015131207 >> 172.21.15.112:0/4015131207 conn(0x7f16f0099a50 msgr2=0x7f16f00972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:50.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 -- 172.21.15.112:0/4015131207 shutdown_connections 2024-09-13T06:32:50.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 -- 172.21.15.112:0/4015131207 wait complete. 2024-09-13T06:32:50.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 Processor -- start 2024-09-13T06:32:50.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.118+0000 7f16f551b640 1 -- start start 2024-09-13T06:32:50.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16f551b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 0x7f16f01c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:50.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16f551b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0134d40 con 0x7f16f006d0e0 2024-09-13T06:32:50.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16eeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 0x7f16f01c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:50.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16eeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 0x7f16f01c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59386/0 (socket says 172.21.15.112:59386) 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16eeffd640 1 -- 172.21.15.112:0/2166615819 learned_addr learned my addr 172.21.15.112:0/2166615819 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16eeffd640 1 -- 172.21.15.112:0/2166615819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f0121f90 con 0x7f16f006d0e0 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16eeffd640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 0x7f16f01c62b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f16e000c420 tx=0x7f16e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e0018070 con 0x7f16f006d0e0 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e00074d0 con 0x7f16f006d0e0 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f006ffc0 con 0x7f16f006d0e0 2024-09-13T06:32:50.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e0004960 con 0x7f16f006d0e0 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f006f810 con 0x7f16f006d0e0 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16e001b070 con 0x7f16f006d0e0 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f006fb00 con 0x7f16f006d0e0 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16d77fe640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16dc035db0 0x7f16dc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f16e00483c0 con 0x7f16f006d0e0 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16ee7fc640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16dc035db0 0x7f16dc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:32:50.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.122+0000 7f16ee7fc640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16dc035db0 0x7f16dc038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16e40ad000 tx=0x7f16e40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:32:50.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.126+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f16e001ae10 con 0x7f16f006d0e0 2024-09-13T06:32:50.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.274+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16f006d4c0 con 0x7f16dc035db0 2024-09-13T06:32:50.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.318+0000 7f16d77fe640 1 -- 172.21.15.112:0/2166615819 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665525 (secure 0 0 0) 0x7f16f006d4c0 con 0x7f16dc035db0 2024-09-13T06:32:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:32:50.333 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16dc035db0 msgr2=0x7f16dc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16dc035db0 0x7f16dc038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16e40ad000 tx=0x7f16e40a6000 comp rx=0 tx=0).stop 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 msgr2=0x7f16f01c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 0x7f16f01c62b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f16e000c420 tx=0x7f16e000c8e0 comp rx=0 tx=0).stop 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 shutdown_connections 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f16dc035db0 0x7f16dc038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 --2- 172.21.15.112:0/2166615819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16f006d0e0 0x7f16f01c62b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:32:50.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 >> 172.21.15.112:0/2166615819 conn(0x7f16f0099a50 msgr2=0x7f16f008afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:32:50.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 shutdown_connections 2024-09-13T06:32:50.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:32:50.326+0000 7f16f551b640 1 -- 172.21.15.112:0/2166615819 wait complete. 2024-09-13T06:32:50.346 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-13T06:32:48.506944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9635593,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":4997,"num_read_kb":4577,"num_write":2146,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4552,"ondisk_log_size":4552,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198896,"kb_used_data":53360,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288464,"statfs":{"total":386547056640,"available":386343387136,"internally_reserved":0,"allocated":54640640,"data_stored":53402662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16777216,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006641"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576389+0000","last_change":"2024-09-13T06:28:58.716560+0000","last_active":"2024-09-13T06:30:39.576389+0000","last_peered":"2024-09-13T06:30:39.576389+0000","last_clean":"2024-09-13T06:30:39.576389+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:30:39.576389+0000","last_undegraded":"2024-09-13T06:30:39.576389+0000","last_fullsized":"2024-09-13T06:30:39.576389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:38.476549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776956+0000","last_change":"2024-09-13T06:29:00.715147+0000","last_active":"2024-09-13T06:32:13.776956+0000","last_peered":"2024-09-13T06:32:13.776956+0000","last_clean":"2024-09-13T06:32:13.776956+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:32:13.776956+0000","last_undegraded":"2024-09-13T06:32:13.776956+0000","last_fullsized":"2024-09-13T06:32:13.776956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318678+0000","last_change":"2024-09-13T06:28:58.727026+0000","last_active":"2024-09-13T06:30:40.318678+0000","last_peered":"2024-09-13T06:30:40.318678+0000","last_clean":"2024-09-13T06:30:40.318678+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:30:40.318678+0000","last_undegraded":"2024-09-13T06:30:40.318678+0000","last_fullsized":"2024-09-13T06:30:40.318678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.916216+0000","last_change":"2024-09-13T06:29:00.709791+0000","last_active":"2024-09-13T06:31:07.916216+0000","last_peered":"2024-09-13T06:31:07.916216+0000","last_clean":"2024-09-13T06:31:07.916216+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:31:07.916216+0000","last_undegraded":"2024-09-13T06:31:07.916216+0000","last_fullsized":"2024-09-13T06:31:07.916216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.258504+0000","last_change":"2024-09-13T06:28:58.725541+0000","last_active":"2024-09-13T06:32:13.258504+0000","last_peered":"2024-09-13T06:32:13.258504+0000","last_clean":"2024-09-13T06:32:13.258504+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:32:13.258504+0000","last_undegraded":"2024-09-13T06:32:13.258504+0000","last_fullsized":"2024-09-13T06:32:13.258504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495245+0000","last_change":"2024-09-13T06:29:00.707081+0000","last_active":"2024-09-13T06:31:30.495245+0000","last_peered":"2024-09-13T06:31:30.495245+0000","last_clean":"2024-09-13T06:31:30.495245+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:31:30.495245+0000","last_undegraded":"2024-09-13T06:31:30.495245+0000","last_fullsized":"2024-09-13T06:31:30.495245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566859+0000","last_change":"2024-09-13T06:28:58.721790+0000","last_active":"2024-09-13T06:30:39.566859+0000","last_peered":"2024-09-13T06:30:39.566859+0000","last_clean":"2024-09-13T06:30:39.566859+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:30:39.566859+0000","last_undegraded":"2024-09-13T06:30:39.566859+0000","last_fullsized":"2024-09-13T06:30:39.566859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:58.652933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905522+0000","last_change":"2024-09-13T06:29:00.707794+0000","last_active":"2024-09-13T06:30:39.905522+0000","last_peered":"2024-09-13T06:30:39.905522+0000","last_clean":"2024-09-13T06:30:39.905522+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:30:39.905522+0000","last_undegraded":"2024-09-13T06:30:39.905522+0000","last_fullsized":"2024-09-13T06:30:39.905522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572406+0000","last_change":"2024-09-13T06:28:58.707336+0000","last_active":"2024-09-13T06:30:39.572406+0000","last_peered":"2024-09-13T06:30:39.572406+0000","last_clean":"2024-09-13T06:30:39.572406+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:30:39.572406+0000","last_undegraded":"2024-09-13T06:30:39.572406+0000","last_fullsized":"2024-09-13T06:30:39.572406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121211+0000","last_change":"2024-09-13T06:29:00.731442+0000","last_active":"2024-09-13T06:32:14.121211+0000","last_peered":"2024-09-13T06:32:14.121211+0000","last_clean":"2024-09-13T06:32:14.121211+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:32:14.121211+0000","last_undegraded":"2024-09-13T06:32:14.121211+0000","last_fullsized":"2024-09-13T06:32:14.121211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573099+0000","last_change":"2024-09-13T06:28:58.734653+0000","last_active":"2024-09-13T06:30:39.573099+0000","last_peered":"2024-09-13T06:30:39.573099+0000","last_clean":"2024-09-13T06:30:39.573099+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:30:39.573099+0000","last_undegraded":"2024-09-13T06:30:39.573099+0000","last_fullsized":"2024-09-13T06:30:39.573099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.648254+0000","last_change":"2024-09-13T06:29:00.726885+0000","last_active":"2024-09-13T06:31:12.648254+0000","last_peered":"2024-09-13T06:31:12.648254+0000","last_clean":"2024-09-13T06:31:12.648254+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:31:12.648254+0000","last_undegraded":"2024-09-13T06:31:12.648254+0000","last_fullsized":"2024-09-13T06:31:12.648254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904763+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:30:39.904763+0000","last_peered":"2024-09-13T06:30:39.904763+0000","last_clean":"2024-09-13T06:30:39.904763+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:30:39.904763+0000","last_undegraded":"2024-09-13T06:30:39.904763+0000","last_fullsized":"2024-09-13T06:30:39.904763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.650812+0000","last_change":"2024-09-13T06:29:00.727067+0000","last_active":"2024-09-13T06:31:12.650812+0000","last_peered":"2024-09-13T06:31:12.650812+0000","last_clean":"2024-09-13T06:31:12.650812+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:31:12.650812+0000","last_undegraded":"2024-09-13T06:31:12.650812+0000","last_fullsized":"2024-09-13T06:31:12.650812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903907+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:30:39.903907+0000","last_peered":"2024-09-13T06:30:39.903907+0000","last_clean":"2024-09-13T06:30:39.903907+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:30:39.903907+0000","last_undegraded":"2024-09-13T06:30:39.903907+0000","last_fullsized":"2024-09-13T06:30:39.903907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.409976+0000","last_change":"2024-09-13T06:29:00.709914+0000","last_active":"2024-09-13T06:32:13.409976+0000","last_peered":"2024-09-13T06:32:13.409976+0000","last_clean":"2024-09-13T06:32:13.409976+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:32:13.409976+0000","last_undegraded":"2024-09-13T06:32:13.409976+0000","last_fullsized":"2024-09-13T06:32:13.409976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:37.375577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570878+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:13.570878+0000","last_peered":"2024-09-13T06:32:13.570878+0000","last_clean":"2024-09-13T06:32:13.570878+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:13.570878+0000","last_undegraded":"2024-09-13T06:32:13.570878+0000","last_fullsized":"2024-09-13T06:32:13.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321617+0000","last_change":"2024-09-13T06:28:58.730725+0000","last_active":"2024-09-13T06:30:40.321617+0000","last_peered":"2024-09-13T06:30:40.321617+0000","last_clean":"2024-09-13T06:30:40.321617+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:30:40.321617+0000","last_undegraded":"2024-09-13T06:30:40.321617+0000","last_fullsized":"2024-09-13T06:30:40.321617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.569961+0000","last_change":"2024-09-13T06:29:00.723386+0000","last_active":"2024-09-13T06:32:13.569961+0000","last_peered":"2024-09-13T06:32:13.569961+0000","last_clean":"2024-09-13T06:32:13.569961+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:32:13.569961+0000","last_undegraded":"2024-09-13T06:32:13.569961+0000","last_fullsized":"2024-09-13T06:32:13.569961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:22.866631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570235+0000","last_change":"2024-09-13T06:28:58.722377+0000","last_active":"2024-09-13T06:30:39.570235+0000","last_peered":"2024-09-13T06:30:39.570235+0000","last_clean":"2024-09-13T06:30:39.570235+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:30:39.570235+0000","last_undegraded":"2024-09-13T06:30:39.570235+0000","last_fullsized":"2024-09-13T06:30:39.570235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:18.147418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776857+0000","last_change":"2024-09-13T06:29:00.714209+0000","last_active":"2024-09-13T06:32:13.776857+0000","last_peered":"2024-09-13T06:32:13.776857+0000","last_clean":"2024-09-13T06:32:13.776857+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:32:13.776857+0000","last_undegraded":"2024-09-13T06:32:13.776857+0000","last_fullsized":"2024-09-13T06:32:13.776857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:33.364861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578134+0000","last_change":"2024-09-13T06:28:58.735019+0000","last_active":"2024-09-13T06:30:39.578134+0000","last_peered":"2024-09-13T06:30:39.578134+0000","last_clean":"2024-09-13T06:30:39.578134+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:30:39.578134+0000","last_undegraded":"2024-09-13T06:30:39.578134+0000","last_fullsized":"2024-09-13T06:30:39.578134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:38.804190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496657+0000","last_change":"2024-09-13T06:29:00.707042+0000","last_active":"2024-09-13T06:31:25.496657+0000","last_peered":"2024-09-13T06:31:25.496657+0000","last_clean":"2024-09-13T06:31:25.496657+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:31:25.496657+0000","last_undegraded":"2024-09-13T06:31:25.496657+0000","last_fullsized":"2024-09-13T06:31:25.496657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:22.300308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574705+0000","last_change":"2024-09-13T06:28:58.714709+0000","last_active":"2024-09-13T06:30:39.574705+0000","last_peered":"2024-09-13T06:30:39.574705+0000","last_clean":"2024-09-13T06:30:39.574705+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:30:39.574705+0000","last_undegraded":"2024-09-13T06:30:39.574705+0000","last_fullsized":"2024-09-13T06:30:39.574705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.663641+0000","last_change":"2024-09-13T06:29:00.706074+0000","last_active":"2024-09-13T06:31:12.663641+0000","last_peered":"2024-09-13T06:31:12.663641+0000","last_clean":"2024-09-13T06:31:12.663641+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:31:12.663641+0000","last_undegraded":"2024-09-13T06:31:12.663641+0000","last_fullsized":"2024-09-13T06:31:12.663641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:11.542286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905694+0000","last_change":"2024-09-13T06:28:58.710981+0000","last_active":"2024-09-13T06:30:39.905694+0000","last_peered":"2024-09-13T06:30:39.905694+0000","last_clean":"2024-09-13T06:30:39.905694+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:30:39.905694+0000","last_undegraded":"2024-09-13T06:30:39.905694+0000","last_fullsized":"2024-09-13T06:30:39.905694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889912+0000","last_change":"2024-09-13T06:29:00.726304+0000","last_active":"2024-09-13T06:32:13.889912+0000","last_peered":"2024-09-13T06:32:13.889912+0000","last_clean":"2024-09-13T06:32:13.889912+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:32:13.889912+0000","last_undegraded":"2024-09-13T06:32:13.889912+0000","last_fullsized":"2024-09-13T06:32:13.889912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:43.482408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904541+0000","last_change":"2024-09-13T06:28:58.725296+0000","last_active":"2024-09-13T06:30:39.904541+0000","last_peered":"2024-09-13T06:30:39.904541+0000","last_clean":"2024-09-13T06:30:39.904541+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:30:39.904541+0000","last_undegraded":"2024-09-13T06:30:39.904541+0000","last_fullsized":"2024-09-13T06:30:39.904541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.840079+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:13.840079+0000","last_peered":"2024-09-13T06:32:13.840079+0000","last_clean":"2024-09-13T06:32:13.840079+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:13.840079+0000","last_undegraded":"2024-09-13T06:32:13.840079+0000","last_fullsized":"2024-09-13T06:32:13.840079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:03.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888319+0000","last_change":"2024-09-13T06:29:00.723084+0000","last_active":"2024-09-13T06:32:13.888319+0000","last_peered":"2024-09-13T06:32:13.888319+0000","last_clean":"2024-09-13T06:32:13.888319+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:32:13.888319+0000","last_undegraded":"2024-09-13T06:32:13.888319+0000","last_fullsized":"2024-09-13T06:32:13.888319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905169+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:30:39.905169+0000","last_peered":"2024-09-13T06:30:39.905169+0000","last_clean":"2024-09-13T06:30:39.905169+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:30:39.905169+0000","last_undegraded":"2024-09-13T06:30:39.905169+0000","last_fullsized":"2024-09-13T06:30:39.905169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910459+0000","last_change":"2024-09-13T06:29:02.740336+0000","last_active":"2024-09-13T06:30:39.910459+0000","last_peered":"2024-09-13T06:30:39.910459+0000","last_clean":"2024-09-13T06:30:39.910459+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:30:39.910459+0000","last_undegraded":"2024-09-13T06:30:39.910459+0000","last_fullsized":"2024-09-13T06:30:39.910459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'33","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.447012+0000","last_change":"2024-09-13T06:29:04.756002+0000","last_active":"2024-09-13T06:32:45.447012+0000","last_peered":"2024-09-13T06:32:45.447012+0000","last_clean":"2024-09-13T06:32:45.447012+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:32:45.447012+0000","last_undegraded":"2024-09-13T06:32:45.447012+0000","last_fullsized":"2024-09-13T06:32:45.447012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:14.061458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578407+0000","last_change":"2024-09-13T06:29:06.774781+0000","last_active":"2024-09-13T06:30:39.578407+0000","last_peered":"2024-09-13T06:30:39.578407+0000","last_clean":"2024-09-13T06:30:39.578407+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:30:39.578407+0000","last_undegraded":"2024-09-13T06:30:39.578407+0000","last_fullsized":"2024-09-13T06:30:39.578407+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:56.034092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570612+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:30:39.570612+0000","last_peered":"2024-09-13T06:30:39.570612+0000","last_clean":"2024-09-13T06:30:39.570612+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:30:39.570612+0000","last_undegraded":"2024-09-13T06:30:39.570612+0000","last_fullsized":"2024-09-13T06:30:39.570612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:17.606468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.412627+0000","last_change":"2024-09-13T06:29:00.707011+0000","last_active":"2024-09-13T06:32:13.412627+0000","last_peered":"2024-09-13T06:32:13.412627+0000","last_clean":"2024-09-13T06:32:13.412627+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:32:13.412627+0000","last_undegraded":"2024-09-13T06:32:13.412627+0000","last_fullsized":"2024-09-13T06:32:13.412627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567903+0000","last_change":"2024-09-13T06:28:58.722224+0000","last_active":"2024-09-13T06:30:39.567903+0000","last_peered":"2024-09-13T06:30:39.567903+0000","last_clean":"2024-09-13T06:30:39.567903+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:30:39.567903+0000","last_undegraded":"2024-09-13T06:30:39.567903+0000","last_fullsized":"2024-09-13T06:30:39.567903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:01.378918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"24'1","reported_seq":224,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.095087+0000","last_change":"2024-09-13T06:29:02.717632+0000","last_active":"2024-09-13T06:32:45.095087+0000","last_peered":"2024-09-13T06:32:45.095087+0000","last_clean":"2024-09-13T06:32:45.095087+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:32:45.095087+0000","last_undegraded":"2024-09-13T06:32:45.095087+0000","last_fullsized":"2024-09-13T06:32:45.095087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319748+0000","last_change":"2024-09-13T06:29:04.739615+0000","last_active":"2024-09-13T06:30:40.319748+0000","last_peered":"2024-09-13T06:30:40.319748+0000","last_clean":"2024-09-13T06:30:40.319748+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:30:40.319748+0000","last_undegraded":"2024-09-13T06:30:40.319748+0000","last_fullsized":"2024-09-13T06:30:40.319748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:15.527728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.573848+0000","last_change":"2024-09-13T06:29:06.774338+0000","last_active":"2024-09-13T06:30:39.573848+0000","last_peered":"2024-09-13T06:30:39.573848+0000","last_clean":"2024-09-13T06:30:39.573848+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:30:39.573848+0000","last_undegraded":"2024-09-13T06:30:39.573848+0000","last_fullsized":"2024-09-13T06:30:39.573848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:37.772201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903912+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:30:39.903912+0000","last_peered":"2024-09-13T06:30:39.903912+0000","last_clean":"2024-09-13T06:30:39.903912+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:30:39.903912+0000","last_undegraded":"2024-09-13T06:30:39.903912+0000","last_fullsized":"2024-09-13T06:30:39.903912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:11.691804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908288+0000","last_change":"2024-09-13T06:29:00.718205+0000","last_active":"2024-09-13T06:30:39.908288+0000","last_peered":"2024-09-13T06:30:39.908288+0000","last_clean":"2024-09-13T06:30:39.908288+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:30:39.908288+0000","last_undegraded":"2024-09-13T06:30:39.908288+0000","last_fullsized":"2024-09-13T06:30:39.908288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:46.759480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570600+0000","last_change":"2024-09-13T06:28:58.716607+0000","last_active":"2024-09-13T06:30:39.570600+0000","last_peered":"2024-09-13T06:30:39.570600+0000","last_clean":"2024-09-13T06:30:39.570600+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:30:39.570600+0000","last_undegraded":"2024-09-13T06:30:39.570600+0000","last_fullsized":"2024-09-13T06:30:39.570600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:45.537089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908756+0000","last_change":"2024-09-13T06:29:02.744274+0000","last_active":"2024-09-13T06:30:39.908756+0000","last_peered":"2024-09-13T06:30:39.908756+0000","last_clean":"2024-09-13T06:30:39.908756+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:30:39.908756+0000","last_undegraded":"2024-09-13T06:30:39.908756+0000","last_fullsized":"2024-09-13T06:30:39.908756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:14.111953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.918645+0000","last_change":"2024-09-13T06:29:04.723996+0000","last_active":"2024-09-13T06:31:07.918645+0000","last_peered":"2024-09-13T06:31:07.918645+0000","last_clean":"2024-09-13T06:31:07.918645+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:31:07.918645+0000","last_undegraded":"2024-09-13T06:31:07.918645+0000","last_fullsized":"2024-09-13T06:31:07.918645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:51.065801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.299299+0000","last_change":"2024-09-13T06:29:06.751269+0000","last_active":"2024-09-13T06:32:14.299299+0000","last_peered":"2024-09-13T06:32:14.299299+0000","last_clean":"2024-09-13T06:32:14.299299+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:32:14.299299+0000","last_undegraded":"2024-09-13T06:32:14.299299+0000","last_fullsized":"2024-09-13T06:32:14.299299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:53.815753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.125083+0000","last_change":"2024-09-13T06:29:08.762118+0000","last_active":"2024-09-13T06:32:14.125083+0000","last_peered":"2024-09-13T06:32:14.125083+0000","last_clean":"2024-09-13T06:32:14.125083+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:14.125083+0000","last_undegraded":"2024-09-13T06:32:14.125083+0000","last_fullsized":"2024-09-13T06:32:14.125083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.846533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910532+0000","last_change":"2024-09-13T06:29:00.733199+0000","last_active":"2024-09-13T06:30:39.910532+0000","last_peered":"2024-09-13T06:30:39.910532+0000","last_clean":"2024-09-13T06:30:39.910532+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:30:39.910532+0000","last_undegraded":"2024-09-13T06:30:39.910532+0000","last_fullsized":"2024-09-13T06:30:39.910532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570421+0000","last_change":"2024-09-13T06:28:58.715013+0000","last_active":"2024-09-13T06:30:39.570421+0000","last_peered":"2024-09-13T06:30:39.570421+0000","last_clean":"2024-09-13T06:30:39.570421+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:30:39.570421+0000","last_undegraded":"2024-09-13T06:30:39.570421+0000","last_fullsized":"2024-09-13T06:30:39.570421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:30.316190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575935+0000","last_change":"2024-09-13T06:29:02.715794+0000","last_active":"2024-09-13T06:30:39.575935+0000","last_peered":"2024-09-13T06:30:39.575935+0000","last_clean":"2024-09-13T06:30:39.575935+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:30:39.575935+0000","last_undegraded":"2024-09-13T06:30:39.575935+0000","last_fullsized":"2024-09-13T06:30:39.575935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:41.286736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.240501+0000","last_change":"2024-09-13T06:29:04.733210+0000","last_active":"2024-09-13T06:31:10.240501+0000","last_peered":"2024-09-13T06:31:10.240501+0000","last_clean":"2024-09-13T06:31:10.240501+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:31:10.240501+0000","last_undegraded":"2024-09-13T06:31:10.240501+0000","last_fullsized":"2024-09-13T06:31:10.240501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:44.479614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":409,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.140888+0000","last_change":"2024-09-13T06:29:06.768162+0000","last_active":"2024-09-13T06:32:45.140888+0000","last_peered":"2024-09-13T06:32:45.140888+0000","last_clean":"2024-09-13T06:32:45.140888+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:32:45.140888+0000","last_undegraded":"2024-09-13T06:32:45.140888+0000","last_fullsized":"2024-09-13T06:32:45.140888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:18.825186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965940+0000","last_change":"2024-09-13T06:29:39.532873+0000","last_active":"2024-09-13T06:32:13.965940+0000","last_peered":"2024-09-13T06:32:13.965940+0000","last_clean":"2024-09-13T06:32:13.965940+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:32:13.965940+0000","last_undegraded":"2024-09-13T06:32:13.965940+0000","last_fullsized":"2024-09-13T06:32:13.965940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:46:04.879833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'1","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493366+0000","last_change":"2024-09-13T06:28:58.715791+0000","last_active":"2024-09-13T06:31:14.493366+0000","last_peered":"2024-09-13T06:31:14.493366+0000","last_clean":"2024-09-13T06:31:14.493366+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:31:14.493366+0000","last_undegraded":"2024-09-13T06:31:14.493366+0000","last_fullsized":"2024-09-13T06:31:14.493366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:36.060034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318177+0000","last_change":"2024-09-13T06:29:02.732052+0000","last_active":"2024-09-13T06:30:40.318177+0000","last_peered":"2024-09-13T06:30:40.318177+0000","last_clean":"2024-09-13T06:30:40.318177+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:30:40.318177+0000","last_undegraded":"2024-09-13T06:30:40.318177+0000","last_fullsized":"2024-09-13T06:30:40.318177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:52.113549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'41","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493106+0000","last_change":"2024-09-13T06:29:04.731973+0000","last_active":"2024-09-13T06:31:14.493106+0000","last_peered":"2024-09-13T06:31:14.493106+0000","last_clean":"2024-09-13T06:31:14.493106+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:31:14.493106+0000","last_undegraded":"2024-09-13T06:31:14.493106+0000","last_fullsized":"2024-09-13T06:31:14.493106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:07.767226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316676+0000","last_change":"2024-09-13T06:29:06.747941+0000","last_active":"2024-09-13T06:30:40.316676+0000","last_peered":"2024-09-13T06:30:40.316676+0000","last_clean":"2024-09-13T06:30:40.316676+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:30:40.316676+0000","last_undegraded":"2024-09-13T06:30:40.316676+0000","last_fullsized":"2024-09-13T06:30:40.316676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:08.367030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568553+0000","last_change":"2024-09-13T06:29:08.791498+0000","last_active":"2024-09-13T06:30:39.568553+0000","last_peered":"2024-09-13T06:30:39.568553+0000","last_clean":"2024-09-13T06:30:39.568553+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:30:39.568553+0000","last_undegraded":"2024-09-13T06:30:39.568553+0000","last_fullsized":"2024-09-13T06:30:39.568553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:55.628851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'25","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908109+0000","last_change":"2024-09-13T06:29:00.726697+0000","last_active":"2024-09-13T06:32:13.908109+0000","last_peered":"2024-09-13T06:32:13.908109+0000","last_clean":"2024-09-13T06:32:13.908109+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:32:13.908109+0000","last_undegraded":"2024-09-13T06:32:13.908109+0000","last_fullsized":"2024-09-13T06:32:13.908109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.526443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493313+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:31:14.493313+0000","last_peered":"2024-09-13T06:31:14.493313+0000","last_clean":"2024-09-13T06:31:14.493313+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:31:14.493313+0000","last_undegraded":"2024-09-13T06:31:14.493313+0000","last_fullsized":"2024-09-13T06:31:14.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:12.552536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567535+0000","last_change":"2024-09-13T06:29:02.724597+0000","last_active":"2024-09-13T06:30:39.567535+0000","last_peered":"2024-09-13T06:30:39.567535+0000","last_clean":"2024-09-13T06:30:39.567535+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:30:39.567535+0000","last_undegraded":"2024-09-13T06:30:39.567535+0000","last_fullsized":"2024-09-13T06:30:39.567535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:30.887850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'33","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.307152+0000","last_change":"2024-09-13T06:29:04.754051+0000","last_active":"2024-09-13T06:32:45.307152+0000","last_peered":"2024-09-13T06:32:45.307152+0000","last_clean":"2024-09-13T06:32:45.307152+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:32:45.307152+0000","last_undegraded":"2024-09-13T06:32:45.307152+0000","last_fullsized":"2024-09-13T06:32:45.307152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:21.961022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907432+0000","last_change":"2024-09-13T06:29:06.762829+0000","last_active":"2024-09-13T06:30:39.907432+0000","last_peered":"2024-09-13T06:30:39.907432+0000","last_clean":"2024-09-13T06:30:39.907432+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:30:39.907432+0000","last_undegraded":"2024-09-13T06:30:39.907432+0000","last_fullsized":"2024-09-13T06:30:39.907432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:01.035464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317329+0000","last_change":"2024-09-13T06:29:08.766459+0000","last_active":"2024-09-13T06:30:40.317329+0000","last_peered":"2024-09-13T06:30:40.317329+0000","last_clean":"2024-09-13T06:30:40.317329+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:30:40.317329+0000","last_undegraded":"2024-09-13T06:30:40.317329+0000","last_fullsized":"2024-09-13T06:30:40.317329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:15.266692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.913863+0000","last_change":"2024-09-13T06:29:00.717664+0000","last_active":"2024-09-13T06:31:07.913863+0000","last_peered":"2024-09-13T06:31:07.913863+0000","last_clean":"2024-09-13T06:31:07.913863+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:31:07.913863+0000","last_undegraded":"2024-09-13T06:31:07.913863+0000","last_fullsized":"2024-09-13T06:31:07.913863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:51.974933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576427+0000","last_change":"2024-09-13T06:28:58.734667+0000","last_active":"2024-09-13T06:30:39.576427+0000","last_peered":"2024-09-13T06:30:39.576427+0000","last_clean":"2024-09-13T06:30:39.576427+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:30:39.576427+0000","last_undegraded":"2024-09-13T06:30:39.576427+0000","last_fullsized":"2024-09-13T06:30:39.576427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:44.299300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567032+0000","last_change":"2024-09-13T06:29:02.722214+0000","last_active":"2024-09-13T06:30:39.567032+0000","last_peered":"2024-09-13T06:30:39.567032+0000","last_clean":"2024-09-13T06:30:39.567032+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:30:39.567032+0000","last_undegraded":"2024-09-13T06:30:39.567032+0000","last_fullsized":"2024-09-13T06:30:39.567032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:53.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.263596+0000","last_change":"2024-09-13T06:29:04.732118+0000","last_active":"2024-09-13T06:31:10.263596+0000","last_peered":"2024-09-13T06:31:10.263596+0000","last_clean":"2024-09-13T06:31:10.263596+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:31:10.263596+0000","last_undegraded":"2024-09-13T06:31:10.263596+0000","last_fullsized":"2024-09-13T06:31:10.263596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:17.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":356,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.142179+0000","last_change":"2024-09-13T06:29:06.772585+0000","last_active":"2024-09-13T06:32:45.142179+0000","last_peered":"2024-09-13T06:32:45.142179+0000","last_clean":"2024-09-13T06:32:45.142179+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:45.142179+0000","last_undegraded":"2024-09-13T06:32:45.142179+0000","last_fullsized":"2024-09-13T06:32:45.142179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:31.824682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319032+0000","last_change":"2024-09-13T06:29:08.777939+0000","last_active":"2024-09-13T06:30:40.319032+0000","last_peered":"2024-09-13T06:30:40.319032+0000","last_clean":"2024-09-13T06:30:40.319032+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:30:40.319032+0000","last_undegraded":"2024-09-13T06:30:40.319032+0000","last_fullsized":"2024-09-13T06:30:40.319032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:59.485064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965033+0000","last_change":"2024-09-13T06:29:00.718738+0000","last_active":"2024-09-13T06:32:13.965033+0000","last_peered":"2024-09-13T06:32:13.965033+0000","last_clean":"2024-09-13T06:32:13.965033+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:32:13.965033+0000","last_undegraded":"2024-09-13T06:32:13.965033+0000","last_fullsized":"2024-09-13T06:32:13.965033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:39:59.890086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'3","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493208+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:31:14.493208+0000","last_peered":"2024-09-13T06:31:14.493208+0000","last_clean":"2024-09-13T06:31:14.493208+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:31:14.493208+0000","last_undegraded":"2024-09-13T06:31:14.493208+0000","last_fullsized":"2024-09-13T06:31:14.493208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.897247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567233+0000","last_change":"2024-09-13T06:29:02.741159+0000","last_active":"2024-09-13T06:30:39.567233+0000","last_peered":"2024-09-13T06:30:39.567233+0000","last_clean":"2024-09-13T06:30:39.567233+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:30:39.567233+0000","last_undegraded":"2024-09-13T06:30:39.567233+0000","last_fullsized":"2024-09-13T06:30:39.567233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:49.008324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'61","reported_seq":129,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.337272+0000","last_change":"2024-09-13T06:29:04.748682+0000","last_active":"2024-09-13T06:32:45.337272+0000","last_peered":"2024-09-13T06:32:45.337272+0000","last_clean":"2024-09-13T06:32:45.337272+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:32:45.337272+0000","last_undegraded":"2024-09-13T06:32:45.337272+0000","last_fullsized":"2024-09-13T06:32:45.337272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:57:59.868813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567773+0000","last_change":"2024-09-13T06:29:06.761508+0000","last_active":"2024-09-13T06:30:39.567773+0000","last_peered":"2024-09-13T06:30:39.567773+0000","last_clean":"2024-09-13T06:30:39.567773+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:30:39.567773+0000","last_undegraded":"2024-09-13T06:30:39.567773+0000","last_fullsized":"2024-09-13T06:30:39.567773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:26.451521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.257072+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:14.257072+0000","last_peered":"2024-09-13T06:32:14.257072+0000","last_clean":"2024-09-13T06:32:14.257072+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:14.257072+0000","last_undegraded":"2024-09-13T06:32:14.257072+0000","last_fullsized":"2024-09-13T06:32:14.257072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:13.465995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.915876+0000","last_change":"2024-09-13T06:29:00.728932+0000","last_active":"2024-09-13T06:31:07.915876+0000","last_peered":"2024-09-13T06:31:07.915876+0000","last_clean":"2024-09-13T06:31:07.915876+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:31:07.915876+0000","last_undegraded":"2024-09-13T06:31:07.915876+0000","last_fullsized":"2024-09-13T06:31:07.915876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:17.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904865+0000","last_change":"2024-09-13T06:28:58.719722+0000","last_active":"2024-09-13T06:30:39.904865+0000","last_peered":"2024-09-13T06:30:39.904865+0000","last_clean":"2024-09-13T06:30:39.904865+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:30:39.904865+0000","last_undegraded":"2024-09-13T06:30:39.904865+0000","last_fullsized":"2024-09-13T06:30:39.904865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:21.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569358+0000","last_change":"2024-09-13T06:29:02.713294+0000","last_active":"2024-09-13T06:30:39.569358+0000","last_peered":"2024-09-13T06:30:39.569358+0000","last_clean":"2024-09-13T06:30:39.569358+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:30:39.569358+0000","last_undegraded":"2024-09-13T06:30:39.569358+0000","last_fullsized":"2024-09-13T06:30:39.569358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:48.621894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.228501+0000","last_change":"2024-09-13T06:29:04.731052+0000","last_active":"2024-09-13T06:31:10.228501+0000","last_peered":"2024-09-13T06:31:10.228501+0000","last_clean":"2024-09-13T06:31:10.228501+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:31:10.228501+0000","last_undegraded":"2024-09-13T06:31:10.228501+0000","last_fullsized":"2024-09-13T06:31:10.228501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:15.859442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907352+0000","last_change":"2024-09-13T06:29:06.772900+0000","last_active":"2024-09-13T06:30:39.907352+0000","last_peered":"2024-09-13T06:30:39.907352+0000","last_clean":"2024-09-13T06:30:39.907352+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:30:39.907352+0000","last_undegraded":"2024-09-13T06:30:39.907352+0000","last_fullsized":"2024-09-13T06:30:39.907352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:13.253864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489704+0000","last_change":"2024-09-13T06:29:08.785484+0000","last_active":"2024-09-13T06:31:10.489704+0000","last_peered":"2024-09-13T06:31:10.489704+0000","last_clean":"2024-09-13T06:31:10.489704+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:31:10.489704+0000","last_undegraded":"2024-09-13T06:31:10.489704+0000","last_fullsized":"2024-09-13T06:31:10.489704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.070123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.665886+0000","last_change":"2024-09-13T06:29:00.714668+0000","last_active":"2024-09-13T06:31:12.665886+0000","last_peered":"2024-09-13T06:31:12.665886+0000","last_clean":"2024-09-13T06:31:12.665886+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:31:12.665886+0000","last_undegraded":"2024-09-13T06:31:12.665886+0000","last_fullsized":"2024-09-13T06:31:12.665886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:52.851818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572293+0000","last_change":"2024-09-13T06:28:58.716633+0000","last_active":"2024-09-13T06:30:39.572293+0000","last_peered":"2024-09-13T06:30:39.572293+0000","last_clean":"2024-09-13T06:30:39.572293+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:30:39.572293+0000","last_undegraded":"2024-09-13T06:30:39.572293+0000","last_fullsized":"2024-09-13T06:30:39.572293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316839+0000","last_change":"2024-09-13T06:29:02.730107+0000","last_active":"2024-09-13T06:30:40.316839+0000","last_peered":"2024-09-13T06:30:40.316839+0000","last_clean":"2024-09-13T06:30:40.316839+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:30:40.316839+0000","last_undegraded":"2024-09-13T06:30:40.316839+0000","last_fullsized":"2024-09-13T06:30:40.316839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:11.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'39","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.288829+0000","last_change":"2024-09-13T06:29:04.746327+0000","last_active":"2024-09-13T06:32:45.288829+0000","last_peered":"2024-09-13T06:32:45.288829+0000","last_clean":"2024-09-13T06:32:45.288829+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:32:45.288829+0000","last_undegraded":"2024-09-13T06:32:45.288829+0000","last_fullsized":"2024-09-13T06:32:45.288829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:05.773239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.135851+0000","last_change":"2024-09-13T06:29:06.761923+0000","last_active":"2024-09-13T06:32:45.135851+0000","last_peered":"2024-09-13T06:32:45.135851+0000","last_clean":"2024-09-13T06:32:45.135851+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:45.135851+0000","last_undegraded":"2024-09-13T06:32:45.135851+0000","last_fullsized":"2024-09-13T06:32:45.135851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:01.791112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.911859+0000","last_change":"2024-09-13T06:29:08.773016+0000","last_active":"2024-09-13T06:32:13.911859+0000","last_peered":"2024-09-13T06:32:13.911859+0000","last_clean":"2024-09-13T06:32:13.911859+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:32:13.911859+0000","last_undegraded":"2024-09-13T06:32:13.911859+0000","last_fullsized":"2024-09-13T06:32:13.911859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:10.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984706+0000","last_change":"2024-09-13T06:29:00.705902+0000","last_active":"2024-09-13T06:32:13.984706+0000","last_peered":"2024-09-13T06:32:13.984706+0000","last_clean":"2024-09-13T06:32:13.984706+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:32:13.984706+0000","last_undegraded":"2024-09-13T06:32:13.984706+0000","last_fullsized":"2024-09-13T06:32:13.984706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:13.530929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.744249+0000","last_change":"2024-09-13T06:28:58.720215+0000","last_active":"2024-09-13T06:32:13.744249+0000","last_peered":"2024-09-13T06:32:13.744249+0000","last_clean":"2024-09-13T06:32:13.744249+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:32:13.744249+0000","last_undegraded":"2024-09-13T06:32:13.744249+0000","last_fullsized":"2024-09-13T06:32:13.744249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.763219+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:31:11.763219+0000","last_peered":"2024-09-13T06:31:11.763219+0000","last_clean":"2024-09-13T06:31:11.763219+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:31:11.763219+0000","last_undegraded":"2024-09-13T06:31:11.763219+0000","last_fullsized":"2024-09-13T06:31:11.763219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:18.248897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910468+0000","last_change":"2024-09-13T06:29:04.749190+0000","last_active":"2024-09-13T06:30:39.910468+0000","last_peered":"2024-09-13T06:30:39.910468+0000","last_clean":"2024-09-13T06:30:39.910468+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:30:39.910468+0000","last_undegraded":"2024-09-13T06:30:39.910468+0000","last_fullsized":"2024-09-13T06:30:39.910468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:38.367590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":470,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.131279+0000","last_change":"2024-09-13T06:29:06.751363+0000","last_active":"2024-09-13T06:32:14.131279+0000","last_peered":"2024-09-13T06:32:14.131279+0000","last_clean":"2024-09-13T06:32:14.131279+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:32:14.131279+0000","last_undegraded":"2024-09-13T06:32:14.131279+0000","last_fullsized":"2024-09-13T06:32:14.131279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:20.636655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.114868+0000","last_change":"2024-09-13T06:29:08.792692+0000","last_active":"2024-09-13T06:31:12.114868+0000","last_peered":"2024-09-13T06:31:12.114868+0000","last_clean":"2024-09-13T06:31:12.114868+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:31:12.114868+0000","last_undegraded":"2024-09-13T06:31:12.114868+0000","last_fullsized":"2024-09-13T06:31:12.114868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:44.557550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494543+0000","last_change":"2024-09-13T06:29:00.731625+0000","last_active":"2024-09-13T06:31:15.494543+0000","last_peered":"2024-09-13T06:31:15.494543+0000","last_clean":"2024-09-13T06:31:15.494543+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:31:15.494543+0000","last_undegraded":"2024-09-13T06:31:15.494543+0000","last_fullsized":"2024-09-13T06:31:15.494543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:43.633574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.326110+0000","last_change":"2024-09-13T06:28:58.719501+0000","last_active":"2024-09-13T06:32:45.326110+0000","last_peered":"2024-09-13T06:32:45.326110+0000","last_clean":"2024-09-13T06:32:45.326110+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:32:45.326110+0000","last_undegraded":"2024-09-13T06:32:45.326110+0000","last_fullsized":"2024-09-13T06:32:45.326110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:07:21.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908571+0000","last_change":"2024-09-13T06:29:02.721649+0000","last_active":"2024-09-13T06:30:39.908571+0000","last_peered":"2024-09-13T06:30:39.908571+0000","last_clean":"2024-09-13T06:30:39.908571+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:30:39.908571+0000","last_undegraded":"2024-09-13T06:30:39.908571+0000","last_fullsized":"2024-09-13T06:30:39.908571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:42.633548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.252844+0000","last_change":"2024-09-13T06:29:04.736682+0000","last_active":"2024-09-13T06:31:10.252844+0000","last_peered":"2024-09-13T06:31:10.252844+0000","last_clean":"2024-09-13T06:31:10.252844+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:31:10.252844+0000","last_undegraded":"2024-09-13T06:31:10.252844+0000","last_fullsized":"2024-09-13T06:31:10.252844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:59.443857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575252+0000","last_change":"2024-09-13T06:29:06.765942+0000","last_active":"2024-09-13T06:30:39.575252+0000","last_peered":"2024-09-13T06:30:39.575252+0000","last_clean":"2024-09-13T06:30:39.575252+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:30:39.575252+0000","last_undegraded":"2024-09-13T06:30:39.575252+0000","last_fullsized":"2024-09-13T06:30:39.575252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:40.247898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.062083+0000","last_change":"2024-09-13T06:29:08.765210+0000","last_active":"2024-09-13T06:32:14.062083+0000","last_peered":"2024-09-13T06:32:14.062083+0000","last_clean":"2024-09-13T06:32:14.062083+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:32:14.062083+0000","last_undegraded":"2024-09-13T06:32:14.062083+0000","last_fullsized":"2024-09-13T06:32:14.062083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:19.888668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889442+0000","last_change":"2024-09-13T06:29:00.723363+0000","last_active":"2024-09-13T06:32:13.889442+0000","last_peered":"2024-09-13T06:32:13.889442+0000","last_clean":"2024-09-13T06:32:13.889442+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:32:13.889442+0000","last_undegraded":"2024-09-13T06:32:13.889442+0000","last_fullsized":"2024-09-13T06:32:13.889442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:19:56.144098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.314554+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:30:40.314554+0000","last_peered":"2024-09-13T06:30:40.314554+0000","last_clean":"2024-09-13T06:30:40.314554+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:30:40.314554+0000","last_undegraded":"2024-09-13T06:30:40.314554+0000","last_fullsized":"2024-09-13T06:30:40.314554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:19.132984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572517+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:30:39.572517+0000","last_peered":"2024-09-13T06:30:39.572517+0000","last_clean":"2024-09-13T06:30:39.572517+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:30:39.572517+0000","last_undegraded":"2024-09-13T06:30:39.572517+0000","last_fullsized":"2024-09-13T06:30:39.572517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.927955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.893869+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:31:07.893869+0000","last_peered":"2024-09-13T06:31:07.893869+0000","last_clean":"2024-09-13T06:31:07.893869+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:31:07.893869+0000","last_undegraded":"2024-09-13T06:31:07.893869+0000","last_fullsized":"2024-09-13T06:31:07.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317017+0000","last_change":"2024-09-13T06:29:02.723791+0000","last_active":"2024-09-13T06:30:40.317017+0000","last_peered":"2024-09-13T06:30:40.317017+0000","last_clean":"2024-09-13T06:30:40.317017+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:30:40.317017+0000","last_undegraded":"2024-09-13T06:30:40.317017+0000","last_fullsized":"2024-09-13T06:30:40.317017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":149,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.275042+0000","last_change":"2024-09-13T06:29:04.750793+0000","last_active":"2024-09-13T06:31:10.275042+0000","last_peered":"2024-09-13T06:31:10.275042+0000","last_clean":"2024-09-13T06:31:10.275042+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:31:10.275042+0000","last_undegraded":"2024-09-13T06:31:10.275042+0000","last_fullsized":"2024-09-13T06:31:10.275042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:10:59.019066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.906152+0000","last_change":"2024-09-13T06:29:06.774102+0000","last_active":"2024-09-13T06:30:39.906152+0000","last_peered":"2024-09-13T06:30:39.906152+0000","last_clean":"2024-09-13T06:30:39.906152+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:30:39.906152+0000","last_undegraded":"2024-09-13T06:30:39.906152+0000","last_fullsized":"2024-09-13T06:30:39.906152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:32.602209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.993878+0000","last_change":"2024-09-13T06:29:08.791090+0000","last_active":"2024-09-13T06:32:13.993878+0000","last_peered":"2024-09-13T06:32:13.993878+0000","last_clean":"2024-09-13T06:32:13.993878+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:32:13.993878+0000","last_undegraded":"2024-09-13T06:32:13.993878+0000","last_fullsized":"2024-09-13T06:32:13.993878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:33.250567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908198+0000","last_change":"2024-09-13T06:29:00.724256+0000","last_active":"2024-09-13T06:30:39.908198+0000","last_peered":"2024-09-13T06:30:39.908198+0000","last_clean":"2024-09-13T06:30:39.908198+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:30:39.908198+0000","last_undegraded":"2024-09-13T06:30:39.908198+0000","last_fullsized":"2024-09-13T06:30:39.908198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:49:41.555088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571368+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:30:39.571368+0000","last_peered":"2024-09-13T06:30:39.571368+0000","last_clean":"2024-09-13T06:30:39.571368+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:30:39.571368+0000","last_undegraded":"2024-09-13T06:30:39.571368+0000","last_fullsized":"2024-09-13T06:30:39.571368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:55.462615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318457+0000","last_change":"2024-09-13T06:28:58.711388+0000","last_active":"2024-09-13T06:30:40.318457+0000","last_peered":"2024-09-13T06:30:40.318457+0000","last_clean":"2024-09-13T06:30:40.318457+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:30:40.318457+0000","last_undegraded":"2024-09-13T06:30:40.318457+0000","last_fullsized":"2024-09-13T06:30:40.318457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:51.413163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576408+0000","last_change":"2024-09-13T06:29:02.739238+0000","last_active":"2024-09-13T06:30:39.576408+0000","last_peered":"2024-09-13T06:30:39.576408+0000","last_clean":"2024-09-13T06:30:39.576408+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:30:39.576408+0000","last_undegraded":"2024-09-13T06:30:39.576408+0000","last_fullsized":"2024-09-13T06:30:39.576408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:36.820291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'284","reported_seq":505,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.421070+0000","last_change":"2024-09-13T06:29:04.740633+0000","last_active":"2024-09-13T06:32:45.421070+0000","last_peered":"2024-09-13T06:32:45.421070+0000","last_clean":"2024-09-13T06:32:45.421070+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:32:45.421070+0000","last_undegraded":"2024-09-13T06:32:45.421070+0000","last_fullsized":"2024-09-13T06:32:45.421070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:21.488854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905987+0000","last_change":"2024-09-13T06:29:06.768289+0000","last_active":"2024-09-13T06:30:39.905987+0000","last_peered":"2024-09-13T06:30:39.905987+0000","last_clean":"2024-09-13T06:30:39.905987+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:30:39.905987+0000","last_undegraded":"2024-09-13T06:30:39.905987+0000","last_fullsized":"2024-09-13T06:30:39.905987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.453168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.657752+0000","last_change":"2024-09-13T06:29:08.785933+0000","last_active":"2024-09-13T06:31:12.657752+0000","last_peered":"2024-09-13T06:31:12.657752+0000","last_clean":"2024-09-13T06:31:12.657752+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:31:12.657752+0000","last_undegraded":"2024-09-13T06:31:12.657752+0000","last_fullsized":"2024-09-13T06:31:12.657752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:34.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965135+0000","last_change":"2024-09-13T06:29:00.726943+0000","last_active":"2024-09-13T06:32:13.965135+0000","last_peered":"2024-09-13T06:32:13.965135+0000","last_clean":"2024-09-13T06:32:13.965135+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:32:13.965135+0000","last_undegraded":"2024-09-13T06:32:13.965135+0000","last_fullsized":"2024-09-13T06:32:13.965135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567910+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:30:39.567910+0000","last_peered":"2024-09-13T06:30:39.567910+0000","last_clean":"2024-09-13T06:30:39.567910+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:30:39.567910+0000","last_undegraded":"2024-09-13T06:30:39.567910+0000","last_fullsized":"2024-09-13T06:30:39.567910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:05.399184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315650+0000","last_change":"2024-09-13T06:28:58.710601+0000","last_active":"2024-09-13T06:30:40.315650+0000","last_peered":"2024-09-13T06:30:40.315650+0000","last_clean":"2024-09-13T06:30:40.315650+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:30:40.315650+0000","last_undegraded":"2024-09-13T06:30:40.315650+0000","last_fullsized":"2024-09-13T06:30:40.315650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:06.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570571+0000","last_change":"2024-09-13T06:29:02.715757+0000","last_active":"2024-09-13T06:30:39.570571+0000","last_peered":"2024-09-13T06:30:39.570571+0000","last_clean":"2024-09-13T06:30:39.570571+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:30:39.570571+0000","last_undegraded":"2024-09-13T06:30:39.570571+0000","last_fullsized":"2024-09-13T06:30:39.570571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:41.827034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.977483+0000","last_change":"2024-09-13T06:29:04.730506+0000","last_active":"2024-09-13T06:32:12.977483+0000","last_peered":"2024-09-13T06:32:12.977483+0000","last_clean":"2024-09-13T06:32:12.977483+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:12.977483+0000","last_undegraded":"2024-09-13T06:32:12.977483+0000","last_fullsized":"2024-09-13T06:32:12.977483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:06.934896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317336+0000","last_change":"2024-09-13T06:29:06.766201+0000","last_active":"2024-09-13T06:30:40.317336+0000","last_peered":"2024-09-13T06:30:40.317336+0000","last_clean":"2024-09-13T06:30:40.317336+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:30:40.317336+0000","last_undegraded":"2024-09-13T06:30:40.317336+0000","last_fullsized":"2024-09-13T06:30:40.317336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:14.063090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907100+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:30:39.907100+0000","last_peered":"2024-09-13T06:30:39.907100+0000","last_clean":"2024-09-13T06:30:39.907100+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:30:39.907100+0000","last_undegraded":"2024-09-13T06:30:39.907100+0000","last_fullsized":"2024-09-13T06:30:39.907100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:16.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.414514+0000","last_change":"2024-09-13T06:29:00.721955+0000","last_active":"2024-09-13T06:32:13.414514+0000","last_peered":"2024-09-13T06:32:13.414514+0000","last_clean":"2024-09-13T06:32:13.414514+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:32:13.414514+0000","last_undegraded":"2024-09-13T06:32:13.414514+0000","last_fullsized":"2024-09-13T06:32:13.414514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:13:45.974916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572122+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:30:39.572122+0000","last_peered":"2024-09-13T06:30:39.572122+0000","last_clean":"2024-09-13T06:30:39.572122+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:30:39.572122+0000","last_undegraded":"2024-09-13T06:30:39.572122+0000","last_fullsized":"2024-09-13T06:30:39.572122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:57.119174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572256+0000","last_change":"2024-09-13T06:28:58.714825+0000","last_active":"2024-09-13T06:30:39.572256+0000","last_peered":"2024-09-13T06:30:39.572256+0000","last_clean":"2024-09-13T06:30:39.572256+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:30:39.572256+0000","last_undegraded":"2024-09-13T06:30:39.572256+0000","last_fullsized":"2024-09-13T06:30:39.572256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319184+0000","last_change":"2024-09-13T06:29:02.726548+0000","last_active":"2024-09-13T06:30:40.319184+0000","last_peered":"2024-09-13T06:30:40.319184+0000","last_clean":"2024-09-13T06:30:40.319184+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:30:40.319184+0000","last_undegraded":"2024-09-13T06:30:40.319184+0000","last_fullsized":"2024-09-13T06:30:40.319184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.698111+0000","last_change":"2024-09-13T06:29:04.753220+0000","last_active":"2024-09-13T06:32:12.698111+0000","last_peered":"2024-09-13T06:32:12.698111+0000","last_clean":"2024-09-13T06:32:12.698111+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:32:12.698111+0000","last_undegraded":"2024-09-13T06:32:12.698111+0000","last_fullsized":"2024-09-13T06:32:12.698111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:23.310355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907445+0000","last_change":"2024-09-13T06:29:06.776644+0000","last_active":"2024-09-13T06:30:39.907445+0000","last_peered":"2024-09-13T06:30:39.907445+0000","last_clean":"2024-09-13T06:30:39.907445+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:30:39.907445+0000","last_undegraded":"2024-09-13T06:30:39.907445+0000","last_fullsized":"2024-09-13T06:30:39.907445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:07.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.916234+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:12.916234+0000","last_peered":"2024-09-13T06:32:12.916234+0000","last_clean":"2024-09-13T06:32:12.916234+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:12.916234+0000","last_undegraded":"2024-09-13T06:32:12.916234+0000","last_fullsized":"2024-09-13T06:32:12.916234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:03.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965048+0000","last_change":"2024-09-13T06:29:00.729564+0000","last_active":"2024-09-13T06:32:13.965048+0000","last_peered":"2024-09-13T06:32:13.965048+0000","last_clean":"2024-09-13T06:32:13.965048+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:32:13.965048+0000","last_undegraded":"2024-09-13T06:32:13.965048+0000","last_fullsized":"2024-09-13T06:32:13.965048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:52:03.871675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576292+0000","last_change":"2024-09-13T06:28:58.734084+0000","last_active":"2024-09-13T06:30:39.576292+0000","last_peered":"2024-09-13T06:30:39.576292+0000","last_clean":"2024-09-13T06:30:39.576292+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:30:39.576292+0000","last_undegraded":"2024-09-13T06:30:39.576292+0000","last_fullsized":"2024-09-13T06:30:39.576292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:04.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317623+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:30:40.317623+0000","last_peered":"2024-09-13T06:30:40.317623+0000","last_clean":"2024-09-13T06:30:40.317623+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:30:40.317623+0000","last_undegraded":"2024-09-13T06:30:40.317623+0000","last_fullsized":"2024-09-13T06:30:40.317623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:56:03.965231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.331107+0000","last_change":"2024-09-13T06:29:02.741057+0000","last_active":"2024-09-13T06:32:14.331107+0000","last_peered":"2024-09-13T06:32:14.331107+0000","last_clean":"2024-09-13T06:32:14.331107+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:32:14.331107+0000","last_undegraded":"2024-09-13T06:32:14.331107+0000","last_fullsized":"2024-09-13T06:32:14.331107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:19.872981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'67","reported_seq":138,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.409477+0000","last_change":"2024-09-13T06:29:04.747105+0000","last_active":"2024-09-13T06:32:45.409477+0000","last_peered":"2024-09-13T06:32:45.409477+0000","last_clean":"2024-09-13T06:32:45.409477+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:32:45.409477+0000","last_undegraded":"2024-09-13T06:32:45.409477+0000","last_fullsized":"2024-09-13T06:32:45.409477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:20.114697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571995+0000","last_change":"2024-09-13T06:29:06.756361+0000","last_active":"2024-09-13T06:30:39.571995+0000","last_peered":"2024-09-13T06:30:39.571995+0000","last_clean":"2024-09-13T06:30:39.571995+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:30:39.571995+0000","last_undegraded":"2024-09-13T06:30:39.571995+0000","last_fullsized":"2024-09-13T06:30:39.571995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:29.424661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.495367+0000","last_change":"2024-09-13T06:29:08.775523+0000","last_active":"2024-09-13T06:31:12.495367+0000","last_peered":"2024-09-13T06:31:12.495367+0000","last_clean":"2024-09-13T06:31:12.495367+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:31:12.495367+0000","last_undegraded":"2024-09-13T06:31:12.495367+0000","last_fullsized":"2024-09-13T06:31:12.495367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:26.621827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317034+0000","last_change":"2024-09-13T06:29:00.726613+0000","last_active":"2024-09-13T06:30:40.317034+0000","last_peered":"2024-09-13T06:30:40.317034+0000","last_clean":"2024-09-13T06:30:40.317034+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:30:40.317034+0000","last_undegraded":"2024-09-13T06:30:40.317034+0000","last_fullsized":"2024-09-13T06:30:40.317034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:24.356329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318422+0000","last_change":"2024-09-13T06:28:58.709334+0000","last_active":"2024-09-13T06:30:40.318422+0000","last_peered":"2024-09-13T06:30:40.318422+0000","last_clean":"2024-09-13T06:30:40.318422+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:30:40.318422+0000","last_undegraded":"2024-09-13T06:30:40.318422+0000","last_fullsized":"2024-09-13T06:30:40.318422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:24.215160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576205+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:30:39.576205+0000","last_peered":"2024-09-13T06:30:39.576205+0000","last_clean":"2024-09-13T06:30:39.576205+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:30:39.576205+0000","last_undegraded":"2024-09-13T06:30:39.576205+0000","last_fullsized":"2024-09-13T06:30:39.576205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:39:32.946230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571971+0000","last_change":"2024-09-13T06:29:02.747586+0000","last_active":"2024-09-13T06:30:39.571971+0000","last_peered":"2024-09-13T06:30:39.571971+0000","last_clean":"2024-09-13T06:30:39.571971+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:30:39.571971+0000","last_undegraded":"2024-09-13T06:30:39.571971+0000","last_fullsized":"2024-09-13T06:30:39.571971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:52.363598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318311+0000","last_change":"2024-09-13T06:29:04.747057+0000","last_active":"2024-09-13T06:30:40.318311+0000","last_peered":"2024-09-13T06:30:40.318311+0000","last_clean":"2024-09-13T06:30:40.318311+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:30:40.318311+0000","last_undegraded":"2024-09-13T06:30:40.318311+0000","last_fullsized":"2024-09-13T06:30:40.318311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:43.295549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":363,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.132352+0000","last_change":"2024-09-13T06:29:06.772300+0000","last_active":"2024-09-13T06:32:45.132352+0000","last_peered":"2024-09-13T06:32:45.132352+0000","last_clean":"2024-09-13T06:32:45.132352+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:45.132352+0000","last_undegraded":"2024-09-13T06:32:45.132352+0000","last_fullsized":"2024-09-13T06:32:45.132352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:40.383988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907997+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:30:39.907997+0000","last_peered":"2024-09-13T06:30:39.907997+0000","last_clean":"2024-09-13T06:30:39.907997+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:30:39.907997+0000","last_undegraded":"2024-09-13T06:30:39.907997+0000","last_fullsized":"2024-09-13T06:30:39.907997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964847+0000","last_change":"2024-09-13T06:29:00.723308+0000","last_active":"2024-09-13T06:32:13.964847+0000","last_peered":"2024-09-13T06:32:13.964847+0000","last_clean":"2024-09-13T06:32:13.964847+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:32:13.964847+0000","last_undegraded":"2024-09-13T06:32:13.964847+0000","last_fullsized":"2024-09-13T06:32:13.964847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:27.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.313741+0000","last_change":"2024-09-13T06:28:58.724803+0000","last_active":"2024-09-13T06:32:13.313741+0000","last_peered":"2024-09-13T06:32:13.313741+0000","last_clean":"2024-09-13T06:32:13.313741+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:32:13.313741+0000","last_undegraded":"2024-09-13T06:32:13.313741+0000","last_fullsized":"2024-09-13T06:32:13.313741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:49.487926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318345+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:30:40.318345+0000","last_peered":"2024-09-13T06:30:40.318345+0000","last_clean":"2024-09-13T06:30:40.318345+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:30:40.318345+0000","last_undegraded":"2024-09-13T06:30:40.318345+0000","last_fullsized":"2024-09-13T06:30:40.318345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:58.129743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571648+0000","last_change":"2024-09-13T06:29:02.716108+0000","last_active":"2024-09-13T06:30:39.571648+0000","last_peered":"2024-09-13T06:30:39.571648+0000","last_clean":"2024-09-13T06:30:39.571648+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:30:39.571648+0000","last_undegraded":"2024-09-13T06:30:39.571648+0000","last_fullsized":"2024-09-13T06:30:39.571648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:34.365503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'12","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489787+0000","last_change":"2024-09-13T06:29:04.749361+0000","last_active":"2024-09-13T06:31:10.489787+0000","last_peered":"2024-09-13T06:31:10.489787+0000","last_clean":"2024-09-13T06:31:10.489787+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:31:10.489787+0000","last_undegraded":"2024-09-13T06:31:10.489787+0000","last_fullsized":"2024-09-13T06:31:10.489787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:35:45.201511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":437,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.139274+0000","last_change":"2024-09-13T06:29:06.773446+0000","last_active":"2024-09-13T06:32:45.139274+0000","last_peered":"2024-09-13T06:32:45.139274+0000","last_clean":"2024-09-13T06:32:45.139274+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:32:45.139274+0000","last_undegraded":"2024-09-13T06:32:45.139274+0000","last_fullsized":"2024-09-13T06:32:45.139274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:17.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316421+0000","last_change":"2024-09-13T06:29:08.789911+0000","last_active":"2024-09-13T06:30:40.316421+0000","last_peered":"2024-09-13T06:30:40.316421+0000","last_clean":"2024-09-13T06:30:40.316421+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:30:40.316421+0000","last_undegraded":"2024-09-13T06:30:40.316421+0000","last_fullsized":"2024-09-13T06:30:40.316421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:20.838014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566835+0000","last_change":"2024-09-13T06:29:00.703730+0000","last_active":"2024-09-13T06:30:39.566835+0000","last_peered":"2024-09-13T06:30:39.566835+0000","last_clean":"2024-09-13T06:30:39.566835+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:30:39.566835+0000","last_undegraded":"2024-09-13T06:30:39.566835+0000","last_fullsized":"2024-09-13T06:30:39.566835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:12.971383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318815+0000","last_change":"2024-09-13T06:28:58.716525+0000","last_active":"2024-09-13T06:30:40.318815+0000","last_peered":"2024-09-13T06:30:40.318815+0000","last_clean":"2024-09-13T06:30:40.318815+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:30:40.318815+0000","last_undegraded":"2024-09-13T06:30:40.318815+0000","last_fullsized":"2024-09-13T06:30:40.318815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:33.025321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575105+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:30:39.575105+0000","last_peered":"2024-09-13T06:30:39.575105+0000","last_clean":"2024-09-13T06:30:39.575105+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:30:39.575105+0000","last_undegraded":"2024-09-13T06:30:39.575105+0000","last_fullsized":"2024-09-13T06:30:39.575105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:16:00.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903968+0000","last_change":"2024-09-13T06:29:02.744270+0000","last_active":"2024-09-13T06:30:39.903968+0000","last_peered":"2024-09-13T06:30:39.903968+0000","last_clean":"2024-09-13T06:30:39.903968+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:30:39.903968+0000","last_undegraded":"2024-09-13T06:30:39.903968+0000","last_fullsized":"2024-09-13T06:30:39.903968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:36.770269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'83","reported_seq":159,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.248360+0000","last_change":"2024-09-13T06:29:04.732298+0000","last_active":"2024-09-13T06:31:10.248360+0000","last_peered":"2024-09-13T06:31:10.248360+0000","last_clean":"2024-09-13T06:31:10.248360+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:31:10.248360+0000","last_undegraded":"2024-09-13T06:31:10.248360+0000","last_fullsized":"2024-09-13T06:31:10.248360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:26.343883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905084+0000","last_change":"2024-09-13T06:29:06.767247+0000","last_active":"2024-09-13T06:30:39.905084+0000","last_peered":"2024-09-13T06:30:39.905084+0000","last_clean":"2024-09-13T06:30:39.905084+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:30:39.905084+0000","last_undegraded":"2024-09-13T06:30:39.905084+0000","last_fullsized":"2024-09-13T06:30:39.905084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:37:57.472237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570309+0000","last_change":"2024-09-13T06:29:08.778016+0000","last_active":"2024-09-13T06:30:39.570309+0000","last_peered":"2024-09-13T06:30:39.570309+0000","last_clean":"2024-09-13T06:30:39.570309+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:30:39.570309+0000","last_undegraded":"2024-09-13T06:30:39.570309+0000","last_fullsized":"2024-09-13T06:30:39.570309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.627161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569024+0000","last_change":"2024-09-13T06:29:08.775423+0000","last_active":"2024-09-13T06:30:39.569024+0000","last_peered":"2024-09-13T06:30:39.569024+0000","last_clean":"2024-09-13T06:30:39.569024+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:30:39.569024+0000","last_undegraded":"2024-09-13T06:30:39.569024+0000","last_fullsized":"2024-09-13T06:30:39.569024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:37.906807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777693+0000","last_change":"2024-09-13T06:29:00.706756+0000","last_active":"2024-09-13T06:32:13.777693+0000","last_peered":"2024-09-13T06:32:13.777693+0000","last_clean":"2024-09-13T06:32:13.777693+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:32:13.777693+0000","last_undegraded":"2024-09-13T06:32:13.777693+0000","last_fullsized":"2024-09-13T06:32:13.777693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:51.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.952185+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:13.952185+0000","last_peered":"2024-09-13T06:32:13.952185+0000","last_clean":"2024-09-13T06:32:13.952185+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:13.952185+0000","last_undegraded":"2024-09-13T06:32:13.952185+0000","last_fullsized":"2024-09-13T06:32:13.952185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316032+0000","last_change":"2024-09-13T06:29:02.737913+0000","last_active":"2024-09-13T06:30:40.316032+0000","last_peered":"2024-09-13T06:30:40.316032+0000","last_clean":"2024-09-13T06:30:40.316032+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:30:40.316032+0000","last_undegraded":"2024-09-13T06:30:40.316032+0000","last_fullsized":"2024-09-13T06:30:40.316032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'35","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.239635+0000","last_change":"2024-09-13T06:29:04.751781+0000","last_active":"2024-09-13T06:32:45.239635+0000","last_peered":"2024-09-13T06:32:45.239635+0000","last_clean":"2024-09-13T06:32:45.239635+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:32:45.239635+0000","last_undegraded":"2024-09-13T06:32:45.239635+0000","last_fullsized":"2024-09-13T06:32:45.239635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:17.156772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904554+0000","last_change":"2024-09-13T06:29:06.768895+0000","last_active":"2024-09-13T06:30:39.904554+0000","last_peered":"2024-09-13T06:30:39.904554+0000","last_clean":"2024-09-13T06:30:39.904554+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:30:39.904554+0000","last_undegraded":"2024-09-13T06:30:39.904554+0000","last_fullsized":"2024-09-13T06:30:39.904554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:59.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:09.813655+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:31:09.813655+0000","last_peered":"2024-09-13T06:31:09.813655+0000","last_clean":"2024-09-13T06:31:09.813655+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:31:09.813655+0000","last_undegraded":"2024-09-13T06:31:09.813655+0000","last_fullsized":"2024-09-13T06:31:09.813655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:50.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495777+0000","last_change":"2024-09-13T06:29:00.724056+0000","last_active":"2024-09-13T06:31:20.495777+0000","last_peered":"2024-09-13T06:31:20.495777+0000","last_clean":"2024-09-13T06:31:20.495777+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:31:20.495777+0000","last_undegraded":"2024-09-13T06:31:20.495777+0000","last_fullsized":"2024-09-13T06:31:20.495777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:17.805986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568468+0000","last_change":"2024-09-13T06:28:58.722577+0000","last_active":"2024-09-13T06:30:39.568468+0000","last_peered":"2024-09-13T06:30:39.568468+0000","last_clean":"2024-09-13T06:30:39.568468+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:30:39.568468+0000","last_undegraded":"2024-09-13T06:30:39.568468+0000","last_fullsized":"2024-09-13T06:30:39.568468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:49.189520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905810+0000","last_change":"2024-09-13T06:29:02.740396+0000","last_active":"2024-09-13T06:30:39.905810+0000","last_peered":"2024-09-13T06:30:39.905810+0000","last_clean":"2024-09-13T06:30:39.905810+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:30:39.905810+0000","last_undegraded":"2024-09-13T06:30:39.905810+0000","last_fullsized":"2024-09-13T06:30:39.905810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:57.073334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.707084+0000","last_change":"2024-09-13T06:29:04.741028+0000","last_active":"2024-09-13T06:32:12.707084+0000","last_peered":"2024-09-13T06:32:12.707084+0000","last_clean":"2024-09-13T06:32:12.707084+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:32:12.707084+0000","last_undegraded":"2024-09-13T06:32:12.707084+0000","last_fullsized":"2024-09-13T06:32:12.707084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:36.374316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.566162+0000","last_change":"2024-09-13T06:29:06.765377+0000","last_active":"2024-09-13T06:30:39.566162+0000","last_peered":"2024-09-13T06:30:39.566162+0000","last_clean":"2024-09-13T06:30:39.566162+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:30:39.566162+0000","last_undegraded":"2024-09-13T06:30:39.566162+0000","last_fullsized":"2024-09-13T06:30:39.566162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:44.482785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317385+0000","last_change":"2024-09-13T06:29:08.787430+0000","last_active":"2024-09-13T06:30:40.317385+0000","last_peered":"2024-09-13T06:30:40.317385+0000","last_clean":"2024-09-13T06:30:40.317385+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:30:40.317385+0000","last_undegraded":"2024-09-13T06:30:40.317385+0000","last_fullsized":"2024-09-13T06:30:40.317385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:01.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'7","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492082+0000","last_change":"2024-09-13T06:29:00.709739+0000","last_active":"2024-09-13T06:31:20.492082+0000","last_peered":"2024-09-13T06:31:20.492082+0000","last_clean":"2024-09-13T06:31:20.492082+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:31:20.492082+0000","last_undegraded":"2024-09-13T06:31:20.492082+0000","last_fullsized":"2024-09-13T06:31:20.492082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:45.428694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.575239+0000","last_change":"2024-09-13T06:28:58.717681+0000","last_active":"2024-09-13T06:30:39.575239+0000","last_peered":"2024-09-13T06:30:39.575239+0000","last_clean":"2024-09-13T06:30:39.575239+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:30:39.575239+0000","last_undegraded":"2024-09-13T06:30:39.575239+0000","last_fullsized":"2024-09-13T06:30:39.575239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:27.815067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:11.749307+0000","last_change":"2024-09-13T06:29:02.727813+0000","last_active":"2024-09-13T06:31:11.749307+0000","last_peered":"2024-09-13T06:31:11.749307+0000","last_clean":"2024-09-13T06:31:11.749307+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:31:11.749307+0000","last_undegraded":"2024-09-13T06:31:11.749307+0000","last_fullsized":"2024-09-13T06:31:11.749307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:24.145601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'43","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.391991+0000","last_change":"2024-09-13T06:29:04.750547+0000","last_active":"2024-09-13T06:32:45.391991+0000","last_peered":"2024-09-13T06:32:45.391991+0000","last_clean":"2024-09-13T06:32:45.391991+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:45.391991+0000","last_undegraded":"2024-09-13T06:32:45.391991+0000","last_fullsized":"2024-09-13T06:32:45.391991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:12.046692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315686+0000","last_change":"2024-09-13T06:29:06.765688+0000","last_active":"2024-09-13T06:30:40.315686+0000","last_peered":"2024-09-13T06:30:40.315686+0000","last_clean":"2024-09-13T06:30:40.315686+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:30:40.315686+0000","last_undegraded":"2024-09-13T06:30:40.315686+0000","last_fullsized":"2024-09-13T06:30:40.315686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:19.173170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905501+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:30:39.905501+0000","last_peered":"2024-09-13T06:30:39.905501+0000","last_clean":"2024-09-13T06:30:39.905501+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:30:39.905501+0000","last_undegraded":"2024-09-13T06:30:39.905501+0000","last_fullsized":"2024-09-13T06:30:39.905501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:15.759918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565768+0000","last_change":"2024-09-13T06:29:39.508832+0000","last_active":"2024-09-13T06:30:39.565768+0000","last_peered":"2024-09-13T06:30:39.565768+0000","last_clean":"2024-09-13T06:30:39.565768+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:30:39.565768+0000","last_undegraded":"2024-09-13T06:30:39.565768+0000","last_fullsized":"2024-09-13T06:30:39.565768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:22:26.112599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321498+0000","last_change":"2024-09-13T06:28:58.716514+0000","last_active":"2024-09-13T06:30:40.321498+0000","last_peered":"2024-09-13T06:30:40.321498+0000","last_clean":"2024-09-13T06:30:40.321498+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:30:40.321498+0000","last_undegraded":"2024-09-13T06:30:40.321498+0000","last_fullsized":"2024-09-13T06:30:40.321498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:04:07.711913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.907794+0000","last_change":"2024-09-13T06:29:02.718645+0000","last_active":"2024-09-13T06:30:39.907794+0000","last_peered":"2024-09-13T06:30:39.907794+0000","last_clean":"2024-09-13T06:30:39.907794+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:30:39.907794+0000","last_undegraded":"2024-09-13T06:30:39.907794+0000","last_fullsized":"2024-09-13T06:30:39.907794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:22.422950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.231976+0000","last_change":"2024-09-13T06:29:04.733778+0000","last_active":"2024-09-13T06:31:10.231976+0000","last_peered":"2024-09-13T06:31:10.231976+0000","last_clean":"2024-09-13T06:31:10.231976+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:31:10.231976+0000","last_undegraded":"2024-09-13T06:31:10.231976+0000","last_fullsized":"2024-09-13T06:31:10.231976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:56.673325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568833+0000","last_change":"2024-09-13T06:29:06.762809+0000","last_active":"2024-09-13T06:30:39.568833+0000","last_peered":"2024-09-13T06:30:39.568833+0000","last_clean":"2024-09-13T06:30:39.568833+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:30:39.568833+0000","last_undegraded":"2024-09-13T06:30:39.568833+0000","last_fullsized":"2024-09-13T06:30:39.568833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:34.809800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571091+0000","last_change":"2024-09-13T06:29:00.717648+0000","last_active":"2024-09-13T06:32:13.571091+0000","last_peered":"2024-09-13T06:32:13.571091+0000","last_clean":"2024-09-13T06:32:13.571091+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:32:13.571091+0000","last_undegraded":"2024-09-13T06:32:13.571091+0000","last_fullsized":"2024-09-13T06:32:13.571091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903356+0000","last_change":"2024-09-13T06:28:58.719660+0000","last_active":"2024-09-13T06:30:39.903356+0000","last_peered":"2024-09-13T06:30:39.903356+0000","last_clean":"2024-09-13T06:30:39.903356+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:30:39.903356+0000","last_undegraded":"2024-09-13T06:30:39.903356+0000","last_fullsized":"2024-09-13T06:30:39.903356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319720+0000","last_change":"2024-09-13T06:29:02.737808+0000","last_active":"2024-09-13T06:30:40.319720+0000","last_peered":"2024-09-13T06:30:40.319720+0000","last_clean":"2024-09-13T06:30:40.319720+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:30:40.319720+0000","last_undegraded":"2024-09-13T06:30:40.319720+0000","last_fullsized":"2024-09-13T06:30:40.319720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:20.566898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":146,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.355177+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:32:45.355177+0000","last_peered":"2024-09-13T06:32:45.355177+0000","last_clean":"2024-09-13T06:32:45.355177+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:32:45.355177+0000","last_undegraded":"2024-09-13T06:32:45.355177+0000","last_fullsized":"2024-09-13T06:32:45.355177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568263+0000","last_change":"2024-09-13T06:29:06.770864+0000","last_active":"2024-09-13T06:30:39.568263+0000","last_peered":"2024-09-13T06:30:39.568263+0000","last_clean":"2024-09-13T06:30:39.568263+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:30:39.568263+0000","last_undegraded":"2024-09-13T06:30:39.568263+0000","last_fullsized":"2024-09-13T06:30:39.568263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:21.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.485917+0000","last_change":"2024-09-13T06:29:08.784874+0000","last_active":"2024-09-13T06:31:12.485917+0000","last_peered":"2024-09-13T06:31:12.485917+0000","last_clean":"2024-09-13T06:31:12.485917+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:31:12.485917+0000","last_undegraded":"2024-09-13T06:31:12.485917+0000","last_fullsized":"2024-09-13T06:31:12.485917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:36.951899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319331+0000","last_change":"2024-09-13T06:29:00.731362+0000","last_active":"2024-09-13T06:30:40.319331+0000","last_peered":"2024-09-13T06:30:40.319331+0000","last_clean":"2024-09-13T06:30:40.319331+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:30:40.319331+0000","last_undegraded":"2024-09-13T06:30:40.319331+0000","last_fullsized":"2024-09-13T06:30:40.319331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:19.896337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315793+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:30:40.315793+0000","last_peered":"2024-09-13T06:30:40.315793+0000","last_clean":"2024-09-13T06:30:40.315793+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:30:40.315793+0000","last_undegraded":"2024-09-13T06:30:40.315793+0000","last_fullsized":"2024-09-13T06:30:40.315793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.495874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.578114+0000","last_change":"2024-09-13T06:29:02.720915+0000","last_active":"2024-09-13T06:30:39.578114+0000","last_peered":"2024-09-13T06:30:39.578114+0000","last_clean":"2024-09-13T06:30:39.578114+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:30:39.578114+0000","last_undegraded":"2024-09-13T06:30:39.578114+0000","last_fullsized":"2024-09-13T06:30:39.578114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:13.518915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'38","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.233950+0000","last_change":"2024-09-13T06:29:04.732931+0000","last_active":"2024-09-13T06:31:10.233950+0000","last_peered":"2024-09-13T06:31:10.233950+0000","last_clean":"2024-09-13T06:31:10.233950+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:31:10.233950+0000","last_undegraded":"2024-09-13T06:31:10.233950+0000","last_fullsized":"2024-09-13T06:31:10.233950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:37.616554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319314+0000","last_change":"2024-09-13T06:29:06.762859+0000","last_active":"2024-09-13T06:30:40.319314+0000","last_peered":"2024-09-13T06:30:40.319314+0000","last_clean":"2024-09-13T06:30:40.319314+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:30:40.319314+0000","last_undegraded":"2024-09-13T06:30:40.319314+0000","last_fullsized":"2024-09-13T06:30:40.319314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:56.472153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570852+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:30:39.570852+0000","last_peered":"2024-09-13T06:30:39.570852+0000","last_clean":"2024-09-13T06:30:39.570852+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:30:39.570852+0000","last_undegraded":"2024-09-13T06:30:39.570852+0000","last_fullsized":"2024-09-13T06:30:39.570852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965070+0000","last_change":"2024-09-13T06:29:00.732260+0000","last_active":"2024-09-13T06:32:13.965070+0000","last_peered":"2024-09-13T06:32:13.965070+0000","last_clean":"2024-09-13T06:32:13.965070+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:32:13.965070+0000","last_undegraded":"2024-09-13T06:32:13.965070+0000","last_fullsized":"2024-09-13T06:32:13.965070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572703+0000","last_change":"2024-09-13T06:28:58.716000+0000","last_active":"2024-09-13T06:30:39.572703+0000","last_peered":"2024-09-13T06:30:39.572703+0000","last_clean":"2024-09-13T06:30:39.572703+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:30:39.572703+0000","last_undegraded":"2024-09-13T06:30:39.572703+0000","last_fullsized":"2024-09-13T06:30:39.572703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.574668+0000","last_change":"2024-09-13T06:29:02.718646+0000","last_active":"2024-09-13T06:30:39.574668+0000","last_peered":"2024-09-13T06:30:39.574668+0000","last_clean":"2024-09-13T06:30:39.574668+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:30:39.574668+0000","last_undegraded":"2024-09-13T06:30:39.574668+0000","last_fullsized":"2024-09-13T06:30:39.574668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:18.105884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'37","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.261708+0000","last_change":"2024-09-13T06:29:04.752663+0000","last_active":"2024-09-13T06:32:45.261708+0000","last_peered":"2024-09-13T06:32:45.261708+0000","last_clean":"2024-09-13T06:32:45.261708+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:32:45.261708+0000","last_undegraded":"2024-09-13T06:32:45.261708+0000","last_fullsized":"2024-09-13T06:32:45.261708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:09:06.350632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321281+0000","last_change":"2024-09-13T06:29:06.766875+0000","last_active":"2024-09-13T06:30:40.321281+0000","last_peered":"2024-09-13T06:30:40.321281+0000","last_clean":"2024-09-13T06:30:40.321281+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:30:40.321281+0000","last_undegraded":"2024-09-13T06:30:40.321281+0000","last_fullsized":"2024-09-13T06:30:40.321281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:25.326753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.653823+0000","last_change":"2024-09-13T06:29:08.769294+0000","last_active":"2024-09-13T06:31:12.653823+0000","last_peered":"2024-09-13T06:31:12.653823+0000","last_clean":"2024-09-13T06:31:12.653823+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:31:12.653823+0000","last_undegraded":"2024-09-13T06:31:12.653823+0000","last_fullsized":"2024-09-13T06:31:12.653823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:00:59.776143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.410858+0000","last_change":"2024-09-13T06:29:00.722796+0000","last_active":"2024-09-13T06:32:13.410858+0000","last_peered":"2024-09-13T06:32:13.410858+0000","last_clean":"2024-09-13T06:32:13.410858+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:32:13.410858+0000","last_undegraded":"2024-09-13T06:32:13.410858+0000","last_fullsized":"2024-09-13T06:32:13.410858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:28.267490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'8","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.757448+0000","last_change":"2024-09-13T06:28:58.705967+0000","last_active":"2024-09-13T06:32:13.757448+0000","last_peered":"2024-09-13T06:32:13.757448+0000","last_clean":"2024-09-13T06:32:13.757448+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:32:13.757448+0000","last_undegraded":"2024-09-13T06:32:13.757448+0000","last_fullsized":"2024-09-13T06:32:13.757448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:49.212428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":32,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.319567+0000","last_change":"2024-09-13T06:29:02.727947+0000","last_active":"2024-09-13T06:30:40.319567+0000","last_peered":"2024-09-13T06:30:40.319567+0000","last_clean":"2024-09-13T06:30:40.319567+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:30:40.319567+0000","last_undegraded":"2024-09-13T06:30:40.319567+0000","last_fullsized":"2024-09-13T06:30:40.319567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:43.175259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910215+0000","last_change":"2024-09-13T06:29:04.754166+0000","last_active":"2024-09-13T06:30:39.910215+0000","last_peered":"2024-09-13T06:30:39.910215+0000","last_clean":"2024-09-13T06:30:39.910215+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:30:39.910215+0000","last_undegraded":"2024-09-13T06:30:39.910215+0000","last_fullsized":"2024-09-13T06:30:39.910215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:54.455755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.977868+0000","last_change":"2024-09-13T06:29:06.774577+0000","last_active":"2024-09-13T06:32:13.977868+0000","last_peered":"2024-09-13T06:32:13.977868+0000","last_clean":"2024-09-13T06:32:13.977868+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:32:13.977868+0000","last_undegraded":"2024-09-13T06:32:13.977868+0000","last_fullsized":"2024-09-13T06:32:13.977868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:26.057296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570192+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:30:39.570192+0000","last_peered":"2024-09-13T06:30:39.570192+0000","last_clean":"2024-09-13T06:30:39.570192+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:30:39.570192+0000","last_undegraded":"2024-09-13T06:30:39.570192+0000","last_fullsized":"2024-09-13T06:30:39.570192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:56.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.891076+0000","last_change":"2024-09-13T06:29:00.703118+0000","last_active":"2024-09-13T06:32:13.891076+0000","last_peered":"2024-09-13T06:32:13.891076+0000","last_clean":"2024-09-13T06:32:13.891076+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:32:13.891076+0000","last_undegraded":"2024-09-13T06:32:13.891076+0000","last_fullsized":"2024-09-13T06:32:13.891076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318695+0000","last_change":"2024-09-13T06:28:58.727668+0000","last_active":"2024-09-13T06:30:40.318695+0000","last_peered":"2024-09-13T06:30:40.318695+0000","last_clean":"2024-09-13T06:30:40.318695+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:30:40.318695+0000","last_undegraded":"2024-09-13T06:30:40.318695+0000","last_fullsized":"2024-09-13T06:30:40.318695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:44.537548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317498+0000","last_change":"2024-09-13T06:29:02.737035+0000","last_active":"2024-09-13T06:30:40.317498+0000","last_peered":"2024-09-13T06:30:40.317498+0000","last_clean":"2024-09-13T06:30:40.317498+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:30:40.317498+0000","last_undegraded":"2024-09-13T06:30:40.317498+0000","last_fullsized":"2024-09-13T06:30:40.317498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.989322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.216689+0000","last_change":"2024-09-13T06:29:04.736867+0000","last_active":"2024-09-13T06:31:10.216689+0000","last_peered":"2024-09-13T06:31:10.216689+0000","last_clean":"2024-09-13T06:31:10.216689+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:31:10.216689+0000","last_undegraded":"2024-09-13T06:31:10.216689+0000","last_fullsized":"2024-09-13T06:31:10.216689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.266864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.903117+0000","last_change":"2024-09-13T06:29:06.755656+0000","last_active":"2024-09-13T06:30:39.903117+0000","last_peered":"2024-09-13T06:30:39.903117+0000","last_clean":"2024-09-13T06:30:39.903117+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:30:39.903117+0000","last_undegraded":"2024-09-13T06:30:39.903117+0000","last_fullsized":"2024-09-13T06:30:39.903117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:08.951294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.576139+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:30:39.576139+0000","last_peered":"2024-09-13T06:30:39.576139+0000","last_clean":"2024-09-13T06:30:39.576139+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:30:39.576139+0000","last_undegraded":"2024-09-13T06:30:39.576139+0000","last_fullsized":"2024-09-13T06:30:39.576139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:24.414010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.570406+0000","last_change":"2024-09-13T06:29:00.715931+0000","last_active":"2024-09-13T06:32:13.570406+0000","last_peered":"2024-09-13T06:32:13.570406+0000","last_clean":"2024-09-13T06:32:13.570406+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:32:13.570406+0000","last_undegraded":"2024-09-13T06:32:13.570406+0000","last_fullsized":"2024-09-13T06:32:13.570406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:16.645482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.577929+0000","last_change":"2024-09-13T06:28:58.706848+0000","last_active":"2024-09-13T06:30:39.577929+0000","last_peered":"2024-09-13T06:30:39.577929+0000","last_clean":"2024-09-13T06:30:39.577929+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:30:39.577929+0000","last_undegraded":"2024-09-13T06:30:39.577929+0000","last_fullsized":"2024-09-13T06:30:39.577929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:08.398250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572664+0000","last_change":"2024-09-13T06:29:02.715301+0000","last_active":"2024-09-13T06:30:39.572664+0000","last_peered":"2024-09-13T06:30:39.572664+0000","last_clean":"2024-09-13T06:30:39.572664+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:30:39.572664+0000","last_undegraded":"2024-09-13T06:30:39.572664+0000","last_fullsized":"2024-09-13T06:30:39.572664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:53:19.480041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'33","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.301793+0000","last_change":"2024-09-13T06:29:04.728823+0000","last_active":"2024-09-13T06:32:45.301793+0000","last_peered":"2024-09-13T06:32:45.301793+0000","last_clean":"2024-09-13T06:32:45.301793+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:32:45.301793+0000","last_undegraded":"2024-09-13T06:32:45.301793+0000","last_fullsized":"2024-09-13T06:32:45.301793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:22.717282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571575+0000","last_change":"2024-09-13T06:29:06.774527+0000","last_active":"2024-09-13T06:30:39.571575+0000","last_peered":"2024-09-13T06:30:39.571575+0000","last_clean":"2024-09-13T06:30:39.571575+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:30:39.571575+0000","last_undegraded":"2024-09-13T06:30:39.571575+0000","last_fullsized":"2024-09-13T06:30:39.571575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:17.985155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.457421+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.457421+0000","last_peered":"2024-09-13T06:32:13.457421+0000","last_clean":"2024-09-13T06:32:13.457421+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.457421+0000","last_undegraded":"2024-09-13T06:32:13.457421+0000","last_fullsized":"2024-09-13T06:32:13.457421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:54.961718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777639+0000","last_change":"2024-09-13T06:29:00.710678+0000","last_active":"2024-09-13T06:32:13.777639+0000","last_peered":"2024-09-13T06:32:13.777639+0000","last_clean":"2024-09-13T06:32:13.777639+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:32:13.777639+0000","last_undegraded":"2024-09-13T06:32:13.777639+0000","last_fullsized":"2024-09-13T06:32:13.777639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910338+0000","last_change":"2024-09-13T06:28:58.728835+0000","last_active":"2024-09-13T06:30:39.910338+0000","last_peered":"2024-09-13T06:30:39.910338+0000","last_clean":"2024-09-13T06:30:39.910338+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:30:39.910338+0000","last_undegraded":"2024-09-13T06:30:39.910338+0000","last_fullsized":"2024-09-13T06:30:39.910338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:59.130229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.315953+0000","last_change":"2024-09-13T06:29:02.731541+0000","last_active":"2024-09-13T06:30:40.315953+0000","last_peered":"2024-09-13T06:30:40.315953+0000","last_clean":"2024-09-13T06:30:40.315953+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:30:40.315953+0000","last_undegraded":"2024-09-13T06:30:40.315953+0000","last_fullsized":"2024-09-13T06:30:40.315953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:35.369421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.251421+0000","last_change":"2024-09-13T06:29:04.750320+0000","last_active":"2024-09-13T06:32:45.251421+0000","last_peered":"2024-09-13T06:32:45.251421+0000","last_clean":"2024-09-13T06:32:45.251421+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:32:45.251421+0000","last_undegraded":"2024-09-13T06:32:45.251421+0000","last_fullsized":"2024-09-13T06:32:45.251421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:20.698413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.571889+0000","last_change":"2024-09-13T06:29:06.744904+0000","last_active":"2024-09-13T06:30:39.571889+0000","last_peered":"2024-09-13T06:30:39.571889+0000","last_clean":"2024-09-13T06:30:39.571889+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:30:39.571889+0000","last_undegraded":"2024-09-13T06:30:39.571889+0000","last_fullsized":"2024-09-13T06:30:39.571889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:03.059130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.857298+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.857298+0000","last_peered":"2024-09-13T06:32:13.857298+0000","last_clean":"2024-09-13T06:32:13.857298+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.857298+0000","last_undegraded":"2024-09-13T06:32:13.857298+0000","last_fullsized":"2024-09-13T06:32:13.857298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:21.044316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888955+0000","last_change":"2024-09-13T06:29:00.723086+0000","last_active":"2024-09-13T06:32:13.888955+0000","last_peered":"2024-09-13T06:32:13.888955+0000","last_clean":"2024-09-13T06:32:13.888955+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:32:13.888955+0000","last_undegraded":"2024-09-13T06:32:13.888955+0000","last_fullsized":"2024-09-13T06:32:13.888955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:55.219294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.321598+0000","last_change":"2024-09-13T06:28:58.709396+0000","last_active":"2024-09-13T06:30:40.321598+0000","last_peered":"2024-09-13T06:30:40.321598+0000","last_clean":"2024-09-13T06:30:40.321598+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:30:40.321598+0000","last_undegraded":"2024-09-13T06:30:40.321598+0000","last_fullsized":"2024-09-13T06:30:40.321598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:38.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:08.425859+0000","last_change":"2024-09-13T06:29:02.732125+0000","last_active":"2024-09-13T06:31:08.425859+0000","last_peered":"2024-09-13T06:31:08.425859+0000","last_clean":"2024-09-13T06:31:08.425859+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:31:08.425859+0000","last_undegraded":"2024-09-13T06:31:08.425859+0000","last_fullsized":"2024-09-13T06:31:08.425859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:18.650043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'33","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.708447+0000","last_change":"2024-09-13T06:29:04.732737+0000","last_active":"2024-09-13T06:32:12.708447+0000","last_peered":"2024-09-13T06:32:12.708447+0000","last_clean":"2024-09-13T06:32:12.708447+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:12.708447+0000","last_undegraded":"2024-09-13T06:32:12.708447+0000","last_fullsized":"2024-09-13T06:32:12.708447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:10:29.688497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.568199+0000","last_change":"2024-09-13T06:29:06.776200+0000","last_active":"2024-09-13T06:30:39.568199+0000","last_peered":"2024-09-13T06:30:39.568199+0000","last_clean":"2024-09-13T06:30:39.568199+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:30:39.568199+0000","last_undegraded":"2024-09-13T06:30:39.568199+0000","last_fullsized":"2024-09-13T06:30:39.568199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:14.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.287953+0000","last_change":"2024-09-13T06:29:08.770047+0000","last_active":"2024-09-13T06:31:10.287953+0000","last_peered":"2024-09-13T06:31:10.287953+0000","last_clean":"2024-09-13T06:31:10.287953+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:31:10.287953+0000","last_undegraded":"2024-09-13T06:31:10.287953+0000","last_fullsized":"2024-09-13T06:31:10.287953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:12.926423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.322106+0000","last_change":"2024-09-13T06:29:00.723899+0000","last_active":"2024-09-13T06:30:40.322106+0000","last_peered":"2024-09-13T06:30:40.322106+0000","last_clean":"2024-09-13T06:30:40.322106+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:30:40.322106+0000","last_undegraded":"2024-09-13T06:30:40.322106+0000","last_fullsized":"2024-09-13T06:30:40.322106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.565933+0000","last_change":"2024-09-13T06:28:58.721562+0000","last_active":"2024-09-13T06:30:39.565933+0000","last_peered":"2024-09-13T06:30:39.565933+0000","last_clean":"2024-09-13T06:30:39.565933+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:30:39.565933+0000","last_undegraded":"2024-09-13T06:30:39.565933+0000","last_fullsized":"2024-09-13T06:30:39.565933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:26.902921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.571617+0000","last_change":"2024-09-13T06:29:00.721713+0000","last_active":"2024-09-13T06:32:13.571617+0000","last_peered":"2024-09-13T06:32:13.571617+0000","last_clean":"2024-09-13T06:32:13.571617+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:32:13.571617+0000","last_undegraded":"2024-09-13T06:32:13.571617+0000","last_fullsized":"2024-09-13T06:32:13.571617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:53.230794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.357941+0000","last_change":"2024-09-13T06:28:58.708285+0000","last_active":"2024-09-13T06:31:12.357941+0000","last_peered":"2024-09-13T06:31:12.357941+0000","last_clean":"2024-09-13T06:31:12.357941+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:31:12.357941+0000","last_undegraded":"2024-09-13T06:31:12.357941+0000","last_fullsized":"2024-09-13T06:31:12.357941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:29:28.632008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'5","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:50.502622+0000","last_change":"2024-09-13T06:29:39.540853+0000","last_active":"2024-09-13T06:31:50.502622+0000","last_peered":"2024-09-13T06:31:50.502622+0000","last_clean":"2024-09-13T06:31:50.502622+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:31:50.502622+0000","last_undegraded":"2024-09-13T06:31:50.502622+0000","last_fullsized":"2024-09-13T06:31:50.502622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:10.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905352+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:30:39.905352+0000","last_peered":"2024-09-13T06:30:39.905352+0000","last_clean":"2024-09-13T06:30:39.905352+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:30:39.905352+0000","last_undegraded":"2024-09-13T06:30:39.905352+0000","last_fullsized":"2024-09-13T06:30:39.905352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:23.639949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777960+0000","last_change":"2024-09-13T06:29:00.721804+0000","last_active":"2024-09-13T06:32:13.777960+0000","last_peered":"2024-09-13T06:32:13.777960+0000","last_clean":"2024-09-13T06:32:13.777960+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:32:13.777960+0000","last_undegraded":"2024-09-13T06:32:13.777960+0000","last_fullsized":"2024-09-13T06:32:13.777960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:38.933470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.567585+0000","last_change":"2024-09-13T06:28:58.722511+0000","last_active":"2024-09-13T06:30:39.567585+0000","last_peered":"2024-09-13T06:30:39.567585+0000","last_clean":"2024-09-13T06:30:39.567585+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:30:39.567585+0000","last_undegraded":"2024-09-13T06:30:39.567585+0000","last_fullsized":"2024-09-13T06:30:39.567585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:59.470833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.413604+0000","last_change":"2024-09-13T06:29:39.527461+0000","last_active":"2024-09-13T06:32:13.413604+0000","last_peered":"2024-09-13T06:32:13.413604+0000","last_clean":"2024-09-13T06:32:13.413604+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:32:13.413604+0000","last_undegraded":"2024-09-13T06:32:13.413604+0000","last_fullsized":"2024-09-13T06:32:13.413604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:35.974634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.910363+0000","last_change":"2024-09-13T06:28:58.724998+0000","last_active":"2024-09-13T06:30:39.910363+0000","last_peered":"2024-09-13T06:30:39.910363+0000","last_clean":"2024-09-13T06:30:39.910363+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:30:39.910363+0000","last_undegraded":"2024-09-13T06:30:39.910363+0000","last_fullsized":"2024-09-13T06:30:39.910363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:40:40.438587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.889884+0000","last_change":"2024-09-13T06:29:00.723960+0000","last_active":"2024-09-13T06:32:13.889884+0000","last_peered":"2024-09-13T06:32:13.889884+0000","last_clean":"2024-09-13T06:32:13.889884+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:32:13.889884+0000","last_undegraded":"2024-09-13T06:32:13.889884+0000","last_fullsized":"2024-09-13T06:32:13.889884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:45.154423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.317979+0000","last_change":"2024-09-13T06:28:58.730726+0000","last_active":"2024-09-13T06:30:40.317979+0000","last_peered":"2024-09-13T06:30:40.317979+0000","last_clean":"2024-09-13T06:30:40.317979+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:30:40.317979+0000","last_undegraded":"2024-09-13T06:30:40.317979+0000","last_fullsized":"2024-09-13T06:30:40.317979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:07.196942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905756+0000","last_change":"2024-09-13T06:29:00.718381+0000","last_active":"2024-09-13T06:30:39.905756+0000","last_peered":"2024-09-13T06:30:39.905756+0000","last_clean":"2024-09-13T06:30:39.905756+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:30:39.905756+0000","last_undegraded":"2024-09-13T06:30:39.905756+0000","last_fullsized":"2024-09-13T06:30:39.905756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.569016+0000","last_change":"2024-09-13T06:28:58.707516+0000","last_active":"2024-09-13T06:30:39.569016+0000","last_peered":"2024-09-13T06:30:39.569016+0000","last_clean":"2024-09-13T06:30:39.569016+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:30:39.569016+0000","last_undegraded":"2024-09-13T06:30:39.569016+0000","last_fullsized":"2024-09-13T06:30:39.569016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:50:18.113331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570745+0000","last_change":"2024-09-13T06:29:00.715113+0000","last_active":"2024-09-13T06:30:39.570745+0000","last_peered":"2024-09-13T06:30:39.570745+0000","last_clean":"2024-09-13T06:30:39.570745+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:30:39.570745+0000","last_undegraded":"2024-09-13T06:30:39.570745+0000","last_fullsized":"2024-09-13T06:30:39.570745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:53:36.324716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908260+0000","last_change":"2024-09-13T06:28:58.725590+0000","last_active":"2024-09-13T06:30:39.908260+0000","last_peered":"2024-09-13T06:30:39.908260+0000","last_clean":"2024-09-13T06:30:39.908260+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:30:39.908260+0000","last_undegraded":"2024-09-13T06:30:39.908260+0000","last_fullsized":"2024-09-13T06:30:39.908260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:50.900848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.964923+0000","last_change":"2024-09-13T06:29:00.713384+0000","last_active":"2024-09-13T06:32:13.964923+0000","last_peered":"2024-09-13T06:32:13.964923+0000","last_clean":"2024-09-13T06:32:13.964923+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:32:13.964923+0000","last_undegraded":"2024-09-13T06:32:13.964923+0000","last_fullsized":"2024-09-13T06:32:13.964923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:07.469900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.737385+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.737385+0000","last_peered":"2024-09-13T06:32:13.737385+0000","last_clean":"2024-09-13T06:32:13.737385+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.737385+0000","last_undegraded":"2024-09-13T06:32:13.737385+0000","last_fullsized":"2024-09-13T06:32:13.737385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:48.282068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.890443+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:13.890443+0000","last_peered":"2024-09-13T06:32:13.890443+0000","last_clean":"2024-09-13T06:32:13.890443+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:13.890443+0000","last_undegraded":"2024-09-13T06:32:13.890443+0000","last_fullsized":"2024-09-13T06:32:13.890443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:13.878425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.905294+0000","last_change":"2024-09-13T06:28:58.705020+0000","last_active":"2024-09-13T06:30:39.905294+0000","last_peered":"2024-09-13T06:30:39.905294+0000","last_clean":"2024-09-13T06:30:39.905294+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:30:39.905294+0000","last_undegraded":"2024-09-13T06:30:39.905294+0000","last_fullsized":"2024-09-13T06:30:39.905294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:07.535078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'1","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493929+0000","last_change":"2024-09-13T06:29:00.702900+0000","last_active":"2024-09-13T06:31:15.493929+0000","last_peered":"2024-09-13T06:31:15.493929+0000","last_clean":"2024-09-13T06:31:15.493929+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:31:15.493929+0000","last_undegraded":"2024-09-13T06:31:15.493929+0000","last_fullsized":"2024-09-13T06:31:15.493929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:18.709977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.572544+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:30:39.572544+0000","last_peered":"2024-09-13T06:30:39.572544+0000","last_clean":"2024-09-13T06:30:39.572544+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:30:39.572544+0000","last_undegraded":"2024-09-13T06:30:39.572544+0000","last_fullsized":"2024-09-13T06:30:39.572544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:31:36.559365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.777954+0000","last_change":"2024-09-13T06:29:00.732329+0000","last_active":"2024-09-13T06:32:13.777954+0000","last_peered":"2024-09-13T06:32:13.777954+0000","last_clean":"2024-09-13T06:32:13.777954+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:32:13.777954+0000","last_undegraded":"2024-09-13T06:32:13.777954+0000","last_fullsized":"2024-09-13T06:32:13.777954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:44.800297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.318194+0000","last_change":"2024-09-13T06:28:58.716875+0000","last_active":"2024-09-13T06:30:40.318194+0000","last_peered":"2024-09-13T06:30:40.318194+0000","last_clean":"2024-09-13T06:30:40.318194+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:30:40.318194+0000","last_undegraded":"2024-09-13T06:30:40.318194+0000","last_fullsized":"2024-09-13T06:30:40.318194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:32.384190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.888966+0000","last_change":"2024-09-13T06:29:00.716069+0000","last_active":"2024-09-13T06:32:13.888966+0000","last_peered":"2024-09-13T06:32:13.888966+0000","last_clean":"2024-09-13T06:32:13.888966+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:32:13.888966+0000","last_undegraded":"2024-09-13T06:32:13.888966+0000","last_fullsized":"2024-09-13T06:32:13.888966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:44.026864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.758463+0000","last_change":"2024-09-13T06:28:58.725136+0000","last_active":"2024-09-13T06:32:13.758463+0000","last_peered":"2024-09-13T06:32:13.758463+0000","last_clean":"2024-09-13T06:32:13.758463+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:32:13.758463+0000","last_undegraded":"2024-09-13T06:32:13.758463+0000","last_fullsized":"2024-09-13T06:32:13.758463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:34.127181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984562+0000","last_change":"2024-09-13T06:29:00.729388+0000","last_active":"2024-09-13T06:32:13.984562+0000","last_peered":"2024-09-13T06:32:13.984562+0000","last_clean":"2024-09-13T06:32:13.984562+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:32:13.984562+0000","last_undegraded":"2024-09-13T06:32:13.984562+0000","last_fullsized":"2024-09-13T06:32:13.984562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:35.921007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908553+0000","last_change":"2024-09-13T06:28:58.720437+0000","last_active":"2024-09-13T06:30:39.908553+0000","last_peered":"2024-09-13T06:30:39.908553+0000","last_clean":"2024-09-13T06:30:39.908553+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:30:39.908553+0000","last_undegraded":"2024-09-13T06:30:39.908553+0000","last_fullsized":"2024-09-13T06:30:39.908553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.289926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.904803+0000","last_change":"2024-09-13T06:29:00.722844+0000","last_active":"2024-09-13T06:30:39.904803+0000","last_peered":"2024-09-13T06:30:39.904803+0000","last_clean":"2024-09-13T06:30:39.904803+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:30:39.904803+0000","last_undegraded":"2024-09-13T06:30:39.904803+0000","last_fullsized":"2024-09-13T06:30:39.904803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:46.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.765398+0000","last_change":"2024-09-13T06:28:58.707588+0000","last_active":"2024-09-13T06:32:13.765398+0000","last_peered":"2024-09-13T06:32:13.765398+0000","last_clean":"2024-09-13T06:32:13.765398+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:32:13.765398+0000","last_undegraded":"2024-09-13T06:32:13.765398+0000","last_fullsized":"2024-09-13T06:32:13.765398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:13.693638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.776869+0000","last_change":"2024-09-13T06:29:00.717476+0000","last_active":"2024-09-13T06:32:13.776869+0000","last_peered":"2024-09-13T06:32:13.776869+0000","last_clean":"2024-09-13T06:32:13.776869+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:32:13.776869+0000","last_undegraded":"2024-09-13T06:32:13.776869+0000","last_fullsized":"2024-09-13T06:32:13.776869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:25:20.841077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.908636+0000","last_change":"2024-09-13T06:28:58.720596+0000","last_active":"2024-09-13T06:30:39.908636+0000","last_peered":"2024-09-13T06:30:39.908636+0000","last_clean":"2024-09-13T06:30:39.908636+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:30:39.908636+0000","last_undegraded":"2024-09-13T06:30:39.908636+0000","last_fullsized":"2024-09-13T06:30:39.908636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:34.484193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.599725+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:31:12.599725+0000","last_peered":"2024-09-13T06:31:12.599725+0000","last_clean":"2024-09-13T06:31:12.599725+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:31:12.599725+0000","last_undegraded":"2024-09-13T06:31:12.599725+0000","last_fullsized":"2024-09-13T06:31:12.599725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:57.417284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:39.570695+0000","last_change":"2024-09-13T06:29:00.709102+0000","last_active":"2024-09-13T06:30:39.570695+0000","last_peered":"2024-09-13T06:30:39.570695+0000","last_clean":"2024-09-13T06:30:39.570695+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:30:39.570695+0000","last_undegraded":"2024-09-13T06:30:39.570695+0000","last_fullsized":"2024-09-13T06:30:39.570695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:36.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:30:40.316128+0000","last_change":"2024-09-13T06:28:58.716677+0000","last_active":"2024-09-13T06:30:40.316128+0000","last_peered":"2024-09-13T06:30:40.316128+0000","last_clean":"2024-09-13T06:30:40.316128+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:30:40.316128+0000","last_undegraded":"2024-09-13T06:30:40.316128+0000","last_fullsized":"2024-09-13T06:30:40.316128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:53.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.965751+0000","last_change":"2024-09-13T06:29:39.515090+0000","last_active":"2024-09-13T06:32:13.965751+0000","last_peered":"2024-09-13T06:32:13.965751+0000","last_clean":"2024-09-13T06:32:13.965751+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:32:13.965751+0000","last_undegraded":"2024-09-13T06:32:13.965751+0000","last_fullsized":"2024-09-13T06:32:13.965751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:44.609771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1507,"num_read_kb":1296,"num_write":565,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1328,"ondisk_log_size":1328,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":9028480,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":83,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52164,"kb_used_data":16820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319676,"statfs":{"total":96636764160,"available":96583348224,"internally_reserved":0,"allocated":17223680,"data_stored":16928749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49324,"kb_used_data":9820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322516,"statfs":{"total":96636764160,"available":96586256384,"internally_reserved":0,"allocated":10055680,"data_stored":9770864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48664,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323176,"statfs":{"total":96636764160,"available":96586932224,"internally_reserved":0,"allocated":13639680,"data_stored":13325489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":13400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":13721600,"data_stored":13377560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.358 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.359 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.360 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.361 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.362 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.363 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.364 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.365 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.366 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.367 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.368 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:28:46.906198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.369 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.370 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.371 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.372 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.373 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.374 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.375 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.376 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.377 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.378 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.379 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.380 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.381 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.382 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.383 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.384 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.385 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.386 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.387 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:32:50.388 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:33:10.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:33:10.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.514+0000 7f606b207640 1 Processor -- start 2024-09-13T06:33:10.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.514+0000 7f606b207640 1 -- start start 2024-09-13T06:33:10.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f606b207640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f606406dbd0 0x7f6064131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:10.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f606b207640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6064071c10 con 0x7f606406d0e0 2024-09-13T06:33:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f606b207640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6064072230 con 0x7f606406dbd0 2024-09-13T06:33:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f6063fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f606406dbd0 0x7f6064131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f6068fa3640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f606406d0e0 0x7f606406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41992/0 (socket says 172.21.15.112:41992) 2024-09-13T06:33:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f6068fa3640 1 -- 172.21.15.112:0/985292253 learned_addr learned my addr 172.21.15.112:0/985292253 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:33:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f6063fff640 1 -- 172.21.15.112:0/985292253 >> v1:172.21.15.112:6789/0 conn(0x7f606406d0e0 legacy=0x7f606406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f60637fe640 1 -- 172.21.15.112:0/985292253 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932194177 0 0) 0x7f6064071c10 con 0x7f606406d0e0 2024-09-13T06:33:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f6063fff640 1 -- 172.21.15.112:0/985292253 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60640709e0 con 0x7f606406dbd0 2024-09-13T06:33:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f6063fff640 1 --2- 172.21.15.112:0/985292253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406dbd0 0x7f6064131e60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6054009740 tx=0x7f605401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4122223f4d4d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:10.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f60637fe640 1 -- 172.21.15.112:0/985292253 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60540b0070 con 0x7f606406dbd0 2024-09-13T06:33:10.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f60637fe640 1 -- 172.21.15.112:0/985292253 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60540ab530 con 0x7f606406dbd0 2024-09-13T06:33:10.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.518+0000 7f60637fe640 1 -- 172.21.15.112:0/985292253 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60540ab830 con 0x7f606406dbd0 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/985292253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406dbd0 msgr2=0x7f6064131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 --2- 172.21.15.112:0/985292253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406dbd0 0x7f6064131e60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6054009740 tx=0x7f605401c370 comp rx=0 tx=0).stop 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/985292253 shutdown_connections 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 --2- 172.21.15.112:0/985292253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406dbd0 0x7f6064131e60 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/985292253 >> 172.21.15.112:0/985292253 conn(0x7f6064099a50 msgr2=0x7f60640972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/985292253 shutdown_connections 2024-09-13T06:33:10.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/985292253 wait complete. 2024-09-13T06:33:10.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 Processor -- start 2024-09-13T06:33:10.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- start start 2024-09-13T06:33:10.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 0x7f606406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:10.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6064134d40 con 0x7f606406d0e0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f6068fa3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 0x7f606406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f6068fa3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 0x7f606406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35516/0 (socket says 172.21.15.112:35516) 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f6068fa3640 1 -- 172.21.15.112:0/1888748301 learned_addr learned my addr 172.21.15.112:0/1888748301 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f6068fa3640 1 -- 172.21.15.112:0/1888748301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606412ae70 con 0x7f606406d0e0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f6068fa3640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 0x7f606406e1f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f605800c420 tx=0x7f605800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6058018070 con 0x7f606406d0e0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60580074d0 con 0x7f606406d0e0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606406fa10 con 0x7f606406d0e0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6058004960 con 0x7f606406d0e0 2024-09-13T06:33:10.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606406fed0 con 0x7f606406d0e0 2024-09-13T06:33:10.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.522+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f606406d4c0 con 0x7f606406d0e0 2024-09-13T06:33:10.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.526+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f605801b070 con 0x7f606406d0e0 2024-09-13T06:33:10.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.526+0000 7f60617fa640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6050035db0 0x7f6050038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:10.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.526+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f60580483f0 con 0x7f606406d0e0 2024-09-13T06:33:10.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.526+0000 7f6063fff640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6050035db0 0x7f6050038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:10.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.526+0000 7f6063fff640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6050035db0 0x7f6050038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f60540ad000 tx=0x7f60540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:10.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.530+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f60580119b0 con 0x7f606406d0e0 2024-09-13T06:33:10.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.686+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6064073790 con 0x7f6050035db0 2024-09-13T06:33:10.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.730+0000 7f60617fa640 1 -- 172.21.15.112:0/1888748301 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658334 (secure 0 0 0) 0x7f605415bbb0 con 0x7f6050035db0 2024-09-13T06:33:10.735 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:33:10.745 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:33:10.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6050035db0 msgr2=0x7f6050038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:10.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6050035db0 0x7f6050038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f60540ad000 tx=0x7f60540a6000 comp rx=0 tx=0).stop 2024-09-13T06:33:10.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 msgr2=0x7f606406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:10.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 0x7f606406e1f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f605800c420 tx=0x7f605800c8e0 comp rx=0 tx=0).stop 2024-09-13T06:33:10.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 shutdown_connections 2024-09-13T06:33:10.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6050035db0 0x7f6050038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:10.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 --2- 172.21.15.112:0/1888748301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f606406d0e0 0x7f606406e1f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:10.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 >> 172.21.15.112:0/1888748301 conn(0x7f6064099a50 msgr2=0x7f606409b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:33:10.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 shutdown_connections 2024-09-13T06:33:10.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:10.738+0000 7f606b207640 1 -- 172.21.15.112:0/1888748301 wait complete. 2024-09-13T06:33:10.763 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-13T06:33:10.518093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5100,"num_read_kb":4685,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4733,"ondisk_log_size":4733,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1787848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1680,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006003"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622855+0000","last_change":"2024-09-13T06:28:58.716560+0000","last_active":"2024-09-13T06:32:48.622855+0000","last_peered":"2024-09-13T06:32:48.622855+0000","last_clean":"2024-09-13T06:32:48.622855+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:32:48.622855+0000","last_undegraded":"2024-09-13T06:32:48.622855+0000","last_fullsized":"2024-09-13T06:32:48.622855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.795205+0000","last_change":"2024-09-13T06:29:00.715147+0000","last_active":"2024-09-13T06:32:13.795205+0000","last_peered":"2024-09-13T06:32:13.795205+0000","last_clean":"2024-09-13T06:32:13.795205+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:32:13.795205+0000","last_undegraded":"2024-09-13T06:32:13.795205+0000","last_fullsized":"2024-09-13T06:32:13.795205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491555+0000","last_change":"2024-09-13T06:28:58.727026+0000","last_active":"2024-09-13T06:31:05.491555+0000","last_peered":"2024-09-13T06:31:05.491555+0000","last_clean":"2024-09-13T06:31:05.491555+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:31:05.491555+0000","last_undegraded":"2024-09-13T06:31:05.491555+0000","last_fullsized":"2024-09-13T06:31:05.491555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495200+0000","last_change":"2024-09-13T06:29:00.709791+0000","last_active":"2024-09-13T06:31:30.495200+0000","last_peered":"2024-09-13T06:31:30.495200+0000","last_clean":"2024-09-13T06:31:30.495200+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:31:30.495200+0000","last_undegraded":"2024-09-13T06:31:30.495200+0000","last_fullsized":"2024-09-13T06:31:30.495200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.325704+0000","last_change":"2024-09-13T06:28:58.725541+0000","last_active":"2024-09-13T06:32:45.325704+0000","last_peered":"2024-09-13T06:32:45.325704+0000","last_clean":"2024-09-13T06:32:45.325704+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:32:45.325704+0000","last_undegraded":"2024-09-13T06:32:45.325704+0000","last_fullsized":"2024-09-13T06:32:45.325704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.118712+0000","last_change":"2024-09-13T06:29:00.707081+0000","last_active":"2024-09-13T06:32:14.118712+0000","last_peered":"2024-09-13T06:32:14.118712+0000","last_clean":"2024-09-13T06:32:14.118712+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:32:14.118712+0000","last_undegraded":"2024-09-13T06:32:14.118712+0000","last_fullsized":"2024-09-13T06:32:14.118712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.544622+0000","last_change":"2024-09-13T06:28:58.721790+0000","last_active":"2024-09-13T06:32:49.544622+0000","last_peered":"2024-09-13T06:32:49.544622+0000","last_clean":"2024-09-13T06:32:49.544622+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:32:49.544622+0000","last_undegraded":"2024-09-13T06:32:49.544622+0000","last_fullsized":"2024-09-13T06:32:49.544622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495326+0000","last_change":"2024-09-13T06:29:00.707794+0000","last_active":"2024-09-13T06:31:30.495326+0000","last_peered":"2024-09-13T06:31:30.495326+0000","last_clean":"2024-09-13T06:31:30.495326+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:31:30.495326+0000","last_undegraded":"2024-09-13T06:31:30.495326+0000","last_fullsized":"2024-09-13T06:31:30.495326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497037+0000","last_change":"2024-09-13T06:28:58.707336+0000","last_active":"2024-09-13T06:31:29.497037+0000","last_peered":"2024-09-13T06:31:29.497037+0000","last_clean":"2024-09-13T06:31:29.497037+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:31:29.497037+0000","last_undegraded":"2024-09-13T06:31:29.497037+0000","last_fullsized":"2024-09-13T06:31:29.497037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.086256+0000","last_change":"2024-09-13T06:29:00.731442+0000","last_active":"2024-09-13T06:32:49.086256+0000","last_peered":"2024-09-13T06:32:49.086256+0000","last_clean":"2024-09-13T06:32:49.086256+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:32:49.086256+0000","last_undegraded":"2024-09-13T06:32:49.086256+0000","last_fullsized":"2024-09-13T06:32:49.086256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497005+0000","last_change":"2024-09-13T06:28:58.734653+0000","last_active":"2024-09-13T06:31:29.497005+0000","last_peered":"2024-09-13T06:31:29.497005+0000","last_clean":"2024-09-13T06:31:29.497005+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:31:29.497005+0000","last_undegraded":"2024-09-13T06:31:29.497005+0000","last_fullsized":"2024-09-13T06:31:29.497005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.665522+0000","last_change":"2024-09-13T06:29:00.726885+0000","last_active":"2024-09-13T06:31:12.665522+0000","last_peered":"2024-09-13T06:31:12.665522+0000","last_clean":"2024-09-13T06:31:12.665522+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:31:12.665522+0000","last_undegraded":"2024-09-13T06:31:12.665522+0000","last_fullsized":"2024-09-13T06:31:12.665522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495163+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:31:30.495163+0000","last_peered":"2024-09-13T06:31:30.495163+0000","last_clean":"2024-09-13T06:31:30.495163+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:31:30.495163+0000","last_undegraded":"2024-09-13T06:31:30.495163+0000","last_fullsized":"2024-09-13T06:31:30.495163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.664933+0000","last_change":"2024-09-13T06:29:00.727067+0000","last_active":"2024-09-13T06:31:12.664933+0000","last_peered":"2024-09-13T06:31:12.664933+0000","last_clean":"2024-09-13T06:31:12.664933+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:31:12.664933+0000","last_undegraded":"2024-09-13T06:31:12.664933+0000","last_fullsized":"2024-09-13T06:31:12.664933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495042+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:31:30.495042+0000","last_peered":"2024-09-13T06:31:30.495042+0000","last_clean":"2024-09-13T06:31:30.495042+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:31:30.495042+0000","last_undegraded":"2024-09-13T06:31:30.495042+0000","last_fullsized":"2024-09-13T06:31:30.495042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.432367+0000","last_change":"2024-09-13T06:29:00.709914+0000","last_active":"2024-09-13T06:32:13.432367+0000","last_peered":"2024-09-13T06:32:13.432367+0000","last_clean":"2024-09-13T06:32:13.432367+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:32:13.432367+0000","last_undegraded":"2024-09-13T06:32:13.432367+0000","last_fullsized":"2024-09-13T06:32:13.432367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.587248+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:13.587248+0000","last_peered":"2024-09-13T06:32:13.587248+0000","last_clean":"2024-09-13T06:32:13.587248+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:13.587248+0000","last_undegraded":"2024-09-13T06:32:13.587248+0000","last_fullsized":"2024-09-13T06:32:13.587248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497603+0000","last_change":"2024-09-13T06:28:58.730725+0000","last_active":"2024-09-13T06:31:25.497603+0000","last_peered":"2024-09-13T06:31:25.497603+0000","last_clean":"2024-09-13T06:31:25.497603+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:31:25.497603+0000","last_undegraded":"2024-09-13T06:31:25.497603+0000","last_fullsized":"2024-09-13T06:31:25.497603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.587155+0000","last_change":"2024-09-13T06:29:00.723386+0000","last_active":"2024-09-13T06:32:13.587155+0000","last_peered":"2024-09-13T06:32:13.587155+0000","last_clean":"2024-09-13T06:32:13.587155+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:32:13.587155+0000","last_undegraded":"2024-09-13T06:32:13.587155+0000","last_fullsized":"2024-09-13T06:32:13.587155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496971+0000","last_change":"2024-09-13T06:28:58.722377+0000","last_active":"2024-09-13T06:31:25.496971+0000","last_peered":"2024-09-13T06:31:25.496971+0000","last_clean":"2024-09-13T06:31:25.496971+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:31:25.496971+0000","last_undegraded":"2024-09-13T06:31:25.496971+0000","last_fullsized":"2024-09-13T06:31:25.496971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.795535+0000","last_change":"2024-09-13T06:29:00.714209+0000","last_active":"2024-09-13T06:32:13.795535+0000","last_peered":"2024-09-13T06:32:13.795535+0000","last_clean":"2024-09-13T06:32:13.795535+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:32:13.795535+0000","last_undegraded":"2024-09-13T06:32:13.795535+0000","last_fullsized":"2024-09-13T06:32:13.795535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:24.495825+0000","last_change":"2024-09-13T06:28:58.735019+0000","last_active":"2024-09-13T06:31:24.495825+0000","last_peered":"2024-09-13T06:31:24.495825+0000","last_clean":"2024-09-13T06:31:24.495825+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:31:24.495825+0000","last_undegraded":"2024-09-13T06:31:24.495825+0000","last_fullsized":"2024-09-13T06:31:24.495825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121247+0000","last_change":"2024-09-13T06:29:00.707042+0000","last_active":"2024-09-13T06:32:14.121247+0000","last_peered":"2024-09-13T06:32:14.121247+0000","last_clean":"2024-09-13T06:32:14.121247+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:32:14.121247+0000","last_undegraded":"2024-09-13T06:32:14.121247+0000","last_fullsized":"2024-09-13T06:32:14.121247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:24.495729+0000","last_change":"2024-09-13T06:28:58.714709+0000","last_active":"2024-09-13T06:31:24.495729+0000","last_peered":"2024-09-13T06:31:24.495729+0000","last_clean":"2024-09-13T06:31:24.495729+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:31:24.495729+0000","last_undegraded":"2024-09-13T06:31:24.495729+0000","last_fullsized":"2024-09-13T06:31:24.495729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496746+0000","last_change":"2024-09-13T06:29:00.706074+0000","last_active":"2024-09-13T06:31:25.496746+0000","last_peered":"2024-09-13T06:31:25.496746+0000","last_clean":"2024-09-13T06:31:25.496746+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:31:25.496746+0000","last_undegraded":"2024-09-13T06:31:25.496746+0000","last_fullsized":"2024-09-13T06:31:25.496746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493916+0000","last_change":"2024-09-13T06:28:58.710981+0000","last_active":"2024-09-13T06:31:25.493916+0000","last_peered":"2024-09-13T06:31:25.493916+0000","last_clean":"2024-09-13T06:31:25.493916+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:31:25.493916+0000","last_undegraded":"2024-09-13T06:31:25.493916+0000","last_fullsized":"2024-09-13T06:31:25.493916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.905447+0000","last_change":"2024-09-13T06:29:00.726304+0000","last_active":"2024-09-13T06:32:13.905447+0000","last_peered":"2024-09-13T06:32:13.905447+0000","last_clean":"2024-09-13T06:32:13.905447+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:32:13.905447+0000","last_undegraded":"2024-09-13T06:32:13.905447+0000","last_fullsized":"2024-09-13T06:32:13.905447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492167+0000","last_change":"2024-09-13T06:28:58.725296+0000","last_active":"2024-09-13T06:31:20.492167+0000","last_peered":"2024-09-13T06:31:20.492167+0000","last_clean":"2024-09-13T06:31:20.492167+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:31:20.492167+0000","last_undegraded":"2024-09-13T06:31:20.492167+0000","last_fullsized":"2024-09-13T06:31:20.492167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.009354+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:14.009354+0000","last_peered":"2024-09-13T06:32:14.009354+0000","last_clean":"2024-09-13T06:32:14.009354+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:14.009354+0000","last_undegraded":"2024-09-13T06:32:14.009354+0000","last_fullsized":"2024-09-13T06:32:14.009354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908654+0000","last_change":"2024-09-13T06:29:00.723084+0000","last_active":"2024-09-13T06:32:13.908654+0000","last_peered":"2024-09-13T06:32:13.908654+0000","last_clean":"2024-09-13T06:32:13.908654+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:32:13.908654+0000","last_undegraded":"2024-09-13T06:32:13.908654+0000","last_fullsized":"2024-09-13T06:32:13.908654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492288+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:31:20.492288+0000","last_peered":"2024-09-13T06:31:20.492288+0000","last_clean":"2024-09-13T06:31:20.492288+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:31:20.492288+0000","last_undegraded":"2024-09-13T06:31:20.492288+0000","last_fullsized":"2024-09-13T06:31:20.492288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495442+0000","last_change":"2024-09-13T06:29:02.740336+0000","last_active":"2024-09-13T06:31:30.495442+0000","last_peered":"2024-09-13T06:31:30.495442+0000","last_clean":"2024-09-13T06:31:30.495442+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:31:30.495442+0000","last_undegraded":"2024-09-13T06:31:30.495442+0000","last_fullsized":"2024-09-13T06:31:30.495442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.894997+0000","last_change":"2024-09-13T06:33:04.895065+0000","last_active":"2024-09-13T06:33:04.894997+0000","last_peered":"2024-09-13T06:33:04.894997+0000","last_clean":"2024-09-13T06:33:04.894997+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:33:04.894997+0000","last_undegraded":"2024-09-13T06:33:04.894997+0000","last_fullsized":"2024-09-13T06:33:04.894997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.894816+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:27.810903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498516+0000","last_change":"2024-09-13T06:29:06.774781+0000","last_active":"2024-09-13T06:31:34.498516+0000","last_peered":"2024-09-13T06:31:34.498516+0000","last_clean":"2024-09-13T06:31:34.498516+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:31:34.498516+0000","last_undegraded":"2024-09-13T06:31:34.498516+0000","last_fullsized":"2024-09-13T06:31:34.498516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498132+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:31:34.498132+0000","last_peered":"2024-09-13T06:31:34.498132+0000","last_clean":"2024-09-13T06:31:34.498132+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:31:34.498132+0000","last_undegraded":"2024-09-13T06:31:34.498132+0000","last_fullsized":"2024-09-13T06:31:34.498132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.434487+0000","last_change":"2024-09-13T06:29:00.707011+0000","last_active":"2024-09-13T06:32:13.434487+0000","last_peered":"2024-09-13T06:32:13.434487+0000","last_clean":"2024-09-13T06:32:13.434487+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:32:13.434487+0000","last_undegraded":"2024-09-13T06:32:13.434487+0000","last_fullsized":"2024-09-13T06:32:13.434487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495307+0000","last_change":"2024-09-13T06:28:58.722224+0000","last_active":"2024-09-13T06:31:20.495307+0000","last_peered":"2024-09-13T06:31:20.495307+0000","last_clean":"2024-09-13T06:31:20.495307+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:31:20.495307+0000","last_undegraded":"2024-09-13T06:31:20.495307+0000","last_fullsized":"2024-09-13T06:31:20.495307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"24'1","reported_seq":225,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.125836+0000","last_change":"2024-09-13T06:29:02.717632+0000","last_active":"2024-09-13T06:32:45.125836+0000","last_peered":"2024-09-13T06:32:45.125836+0000","last_clean":"2024-09-13T06:32:45.125836+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:32:45.125836+0000","last_undegraded":"2024-09-13T06:32:45.125836+0000","last_fullsized":"2024-09-13T06:32:45.125836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.637045+0000","last_change":"2024-09-13T06:33:03.637131+0000","last_active":"2024-09-13T06:33:03.637045+0000","last_peered":"2024-09-13T06:33:03.637045+0000","last_clean":"2024-09-13T06:33:03.637045+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:33:03.637045+0000","last_undegraded":"2024-09-13T06:33:03.637045+0000","last_fullsized":"2024-09-13T06:33:03.637045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.636833+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:45.356483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498431+0000","last_change":"2024-09-13T06:29:06.774338+0000","last_active":"2024-09-13T06:31:34.498431+0000","last_peered":"2024-09-13T06:31:34.498431+0000","last_clean":"2024-09-13T06:31:34.498431+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:31:34.498431+0000","last_undegraded":"2024-09-13T06:31:34.498431+0000","last_fullsized":"2024-09-13T06:31:34.498431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.497745+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:31:40.497745+0000","last_peered":"2024-09-13T06:31:40.497745+0000","last_clean":"2024-09-13T06:31:40.497745+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:31:40.497745+0000","last_undegraded":"2024-09-13T06:31:40.497745+0000","last_fullsized":"2024-09-13T06:31:40.497745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.494079+0000","last_change":"2024-09-13T06:29:00.718205+0000","last_active":"2024-09-13T06:31:25.494079+0000","last_peered":"2024-09-13T06:31:25.494079+0000","last_clean":"2024-09-13T06:31:25.494079+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:31:25.494079+0000","last_undegraded":"2024-09-13T06:31:25.494079+0000","last_fullsized":"2024-09-13T06:31:25.494079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494332+0000","last_change":"2024-09-13T06:28:58.716607+0000","last_active":"2024-09-13T06:31:19.494332+0000","last_peered":"2024-09-13T06:31:19.494332+0000","last_clean":"2024-09-13T06:31:19.494332+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:31:19.494332+0000","last_undegraded":"2024-09-13T06:31:19.494332+0000","last_fullsized":"2024-09-13T06:31:19.494332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.848302+0000","last_change":"2024-09-13T06:32:56.848353+0000","last_active":"2024-09-13T06:32:56.848302+0000","last_peered":"2024-09-13T06:32:56.848302+0000","last_clean":"2024-09-13T06:32:56.848302+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:32:56.848302+0000","last_undegraded":"2024-09-13T06:32:56.848302+0000","last_fullsized":"2024-09-13T06:32:56.848302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.848110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:46.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'16","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.240901+0000","last_change":"2024-09-13T06:33:03.240975+0000","last_active":"2024-09-13T06:33:03.240901+0000","last_peered":"2024-09-13T06:33:03.240901+0000","last_clean":"2024-09-13T06:33:03.240901+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:33:03.240901+0000","last_undegraded":"2024-09-13T06:33:03.240901+0000","last_fullsized":"2024-09-13T06:33:03.240901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.240667+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:49.440163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.778213+0000","last_change":"2024-09-13T06:33:01.778272+0000","last_active":"2024-09-13T06:33:01.778213+0000","last_peered":"2024-09-13T06:33:01.778213+0000","last_clean":"2024-09-13T06:33:01.778213+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:33:01.778213+0000","last_undegraded":"2024-09-13T06:33:01.778213+0000","last_fullsized":"2024-09-13T06:33:01.778213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.777993+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:14.895259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'3","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.159993+0000","last_change":"2024-09-13T06:32:50.160119+0000","last_active":"2024-09-13T06:32:50.159993+0000","last_peered":"2024-09-13T06:32:50.159993+0000","last_clean":"2024-09-13T06:32:50.159993+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:50.159993+0000","last_undegraded":"2024-09-13T06:32:50.159993+0000","last_fullsized":"2024-09-13T06:32:50.159993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.159726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:36:19.505279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.494167+0000","last_change":"2024-09-13T06:29:00.733199+0000","last_active":"2024-09-13T06:31:25.494167+0000","last_peered":"2024-09-13T06:31:25.494167+0000","last_clean":"2024-09-13T06:31:25.494167+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:31:25.494167+0000","last_undegraded":"2024-09-13T06:31:25.494167+0000","last_fullsized":"2024-09-13T06:31:25.494167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494247+0000","last_change":"2024-09-13T06:28:58.715013+0000","last_active":"2024-09-13T06:31:19.494247+0000","last_peered":"2024-09-13T06:31:19.494247+0000","last_clean":"2024-09-13T06:31:19.494247+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:31:19.494247+0000","last_undegraded":"2024-09-13T06:31:19.494247+0000","last_fullsized":"2024-09-13T06:31:19.494247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497208+0000","last_change":"2024-09-13T06:29:02.715794+0000","last_active":"2024-09-13T06:31:29.497208+0000","last_peered":"2024-09-13T06:31:29.497208+0000","last_clean":"2024-09-13T06:31:29.497208+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:31:29.497208+0000","last_undegraded":"2024-09-13T06:31:29.497208+0000","last_fullsized":"2024-09-13T06:31:29.497208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'33","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.403683+0000","last_change":"2024-09-13T06:29:04.733210+0000","last_active":"2024-09-13T06:32:45.403683+0000","last_peered":"2024-09-13T06:32:45.403683+0000","last_clean":"2024-09-13T06:32:45.403683+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:32:45.403683+0000","last_undegraded":"2024-09-13T06:32:45.403683+0000","last_fullsized":"2024-09-13T06:32:45.403683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":410,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.471658+0000","last_change":"2024-09-13T06:29:06.768162+0000","last_active":"2024-09-13T06:32:45.471658+0000","last_peered":"2024-09-13T06:32:45.471658+0000","last_clean":"2024-09-13T06:32:45.471658+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:32:45.471658+0000","last_undegraded":"2024-09-13T06:32:45.471658+0000","last_fullsized":"2024-09-13T06:32:45.471658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984448+0000","last_change":"2024-09-13T06:29:39.532873+0000","last_active":"2024-09-13T06:32:13.984448+0000","last_peered":"2024-09-13T06:32:13.984448+0000","last_clean":"2024-09-13T06:32:13.984448+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:32:13.984448+0000","last_undegraded":"2024-09-13T06:32:13.984448+0000","last_fullsized":"2024-09-13T06:32:13.984448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.326368+0000","last_change":"2024-09-13T06:28:58.715791+0000","last_active":"2024-09-13T06:32:45.326368+0000","last_peered":"2024-09-13T06:32:45.326368+0000","last_clean":"2024-09-13T06:32:45.326368+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:32:45.326368+0000","last_undegraded":"2024-09-13T06:32:45.326368+0000","last_fullsized":"2024-09-13T06:32:45.326368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494123+0000","last_change":"2024-09-13T06:29:02.732052+0000","last_active":"2024-09-13T06:31:15.494123+0000","last_peered":"2024-09-13T06:31:15.494123+0000","last_clean":"2024-09-13T06:31:15.494123+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:31:15.494123+0000","last_undegraded":"2024-09-13T06:31:15.494123+0000","last_fullsized":"2024-09-13T06:31:15.494123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'52","reported_seq":116,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.790070+0000","last_change":"2024-09-13T06:32:50.790158+0000","last_active":"2024-09-13T06:32:50.790070+0000","last_peered":"2024-09-13T06:32:50.790070+0000","last_clean":"2024-09-13T06:32:50.790070+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:32:50.790070+0000","last_undegraded":"2024-09-13T06:32:50.790070+0000","last_fullsized":"2024-09-13T06:32:50.790070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'52","last_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_deep_scrub":"35'52","last_deep_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.789873+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:31.896380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.587545+0000","last_change":"2024-09-13T06:32:56.587596+0000","last_active":"2024-09-13T06:32:56.587545+0000","last_peered":"2024-09-13T06:32:56.587545+0000","last_clean":"2024-09-13T06:32:56.587545+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:32:56.587545+0000","last_undegraded":"2024-09-13T06:32:56.587545+0000","last_fullsized":"2024-09-13T06:32:56.587545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.587340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:07:15.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493874+0000","last_change":"2024-09-13T06:29:08.791498+0000","last_active":"2024-09-13T06:31:15.493874+0000","last_peered":"2024-09-13T06:31:15.493874+0000","last_clean":"2024-09-13T06:31:15.493874+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:31:15.493874+0000","last_undegraded":"2024-09-13T06:31:15.493874+0000","last_fullsized":"2024-09-13T06:31:15.493874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'25","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121248+0000","last_change":"2024-09-13T06:29:00.726697+0000","last_active":"2024-09-13T06:32:14.121248+0000","last_peered":"2024-09-13T06:32:14.121248+0000","last_clean":"2024-09-13T06:32:14.121248+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:32:14.121248+0000","last_undegraded":"2024-09-13T06:32:14.121248+0000","last_fullsized":"2024-09-13T06:32:14.121248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.325354+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:32:45.325354+0000","last_peered":"2024-09-13T06:32:45.325354+0000","last_clean":"2024-09-13T06:32:45.325354+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:32:45.325354+0000","last_undegraded":"2024-09-13T06:32:45.325354+0000","last_fullsized":"2024-09-13T06:32:45.325354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493587+0000","last_change":"2024-09-13T06:29:02.724597+0000","last_active":"2024-09-13T06:31:15.493587+0000","last_peered":"2024-09-13T06:31:15.493587+0000","last_clean":"2024-09-13T06:31:15.493587+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:31:15.493587+0000","last_undegraded":"2024-09-13T06:31:15.493587+0000","last_fullsized":"2024-09-13T06:31:15.493587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'33","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.309264+0000","last_change":"2024-09-13T06:29:04.754051+0000","last_active":"2024-09-13T06:32:45.309264+0000","last_peered":"2024-09-13T06:32:45.309264+0000","last_clean":"2024-09-13T06:32:45.309264+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:32:45.309264+0000","last_undegraded":"2024-09-13T06:32:45.309264+0000","last_fullsized":"2024-09-13T06:32:45.309264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.875639+0000","last_change":"2024-09-13T06:33:02.875693+0000","last_active":"2024-09-13T06:33:02.875639+0000","last_peered":"2024-09-13T06:33:02.875639+0000","last_clean":"2024-09-13T06:33:02.875639+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:33:02.875639+0000","last_undegraded":"2024-09-13T06:33:02.875639+0000","last_fullsized":"2024-09-13T06:33:02.875639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.875433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:23.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494450+0000","last_change":"2024-09-13T06:29:08.766459+0000","last_active":"2024-09-13T06:31:15.494450+0000","last_peered":"2024-09-13T06:31:15.494450+0000","last_clean":"2024-09-13T06:31:15.494450+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:31:15.494450+0000","last_undegraded":"2024-09-13T06:31:15.494450+0000","last_fullsized":"2024-09-13T06:31:15.494450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493157+0000","last_change":"2024-09-13T06:29:00.717664+0000","last_active":"2024-09-13T06:31:14.493157+0000","last_peered":"2024-09-13T06:31:14.493157+0000","last_clean":"2024-09-13T06:31:14.493157+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:31:14.493157+0000","last_undegraded":"2024-09-13T06:31:14.493157+0000","last_fullsized":"2024-09-13T06:31:14.493157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493270+0000","last_change":"2024-09-13T06:28:58.734667+0000","last_active":"2024-09-13T06:31:14.493270+0000","last_peered":"2024-09-13T06:31:14.493270+0000","last_clean":"2024-09-13T06:31:14.493270+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:31:14.493270+0000","last_undegraded":"2024-09-13T06:31:14.493270+0000","last_fullsized":"2024-09-13T06:31:14.493270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495352+0000","last_change":"2024-09-13T06:29:02.722214+0000","last_active":"2024-09-13T06:31:20.495352+0000","last_peered":"2024-09-13T06:31:20.495352+0000","last_clean":"2024-09-13T06:31:20.495352+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:31:20.495352+0000","last_undegraded":"2024-09-13T06:31:20.495352+0000","last_fullsized":"2024-09-13T06:31:20.495352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.700600+0000","last_change":"2024-09-13T06:32:52.700748+0000","last_active":"2024-09-13T06:32:52.700600+0000","last_peered":"2024-09-13T06:32:52.700600+0000","last_clean":"2024-09-13T06:32:52.700600+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:32:52.700600+0000","last_undegraded":"2024-09-13T06:32:52.700600+0000","last_fullsized":"2024-09-13T06:32:52.700600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.700351+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.206602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":365,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.207659+0000","last_change":"2024-09-13T06:32:52.207721+0000","last_active":"2024-09-13T06:32:52.207659+0000","last_peered":"2024-09-13T06:32:52.207659+0000","last_clean":"2024-09-13T06:32:52.207659+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:52.207659+0000","last_undegraded":"2024-09-13T06:32:52.207659+0000","last_fullsized":"2024-09-13T06:32:52.207659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.207476+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:15:03.889652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495986+0000","last_change":"2024-09-13T06:29:08.777939+0000","last_active":"2024-09-13T06:31:20.495986+0000","last_peered":"2024-09-13T06:31:20.495986+0000","last_clean":"2024-09-13T06:31:20.495986+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:31:20.495986+0000","last_undegraded":"2024-09-13T06:31:20.495986+0000","last_fullsized":"2024-09-13T06:31:20.495986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.987729+0000","last_change":"2024-09-13T06:29:00.718738+0000","last_active":"2024-09-13T06:32:13.987729+0000","last_peered":"2024-09-13T06:32:13.987729+0000","last_clean":"2024-09-13T06:32:13.987729+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:32:13.987729+0000","last_undegraded":"2024-09-13T06:32:13.987729+0000","last_fullsized":"2024-09-13T06:32:13.987729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.323194+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:32:45.323194+0000","last_peered":"2024-09-13T06:32:45.323194+0000","last_clean":"2024-09-13T06:32:45.323194+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:32:45.323194+0000","last_undegraded":"2024-09-13T06:32:45.323194+0000","last_fullsized":"2024-09-13T06:32:45.323194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.223591+0000","last_change":"2024-09-13T06:33:04.223643+0000","last_active":"2024-09-13T06:33:04.223591+0000","last_peered":"2024-09-13T06:33:04.223591+0000","last_clean":"2024-09-13T06:33:04.223591+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:33:04.223591+0000","last_undegraded":"2024-09-13T06:33:04.223591+0000","last_fullsized":"2024-09-13T06:33:04.223591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.223407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:38.136551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'64","reported_seq":141,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.859546+0000","last_change":"2024-09-13T06:32:54.859700+0000","last_active":"2024-09-13T06:32:54.859546+0000","last_peered":"2024-09-13T06:32:54.859546+0000","last_clean":"2024-09-13T06:32:54.859546+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:32:54.859546+0000","last_undegraded":"2024-09-13T06:32:54.859546+0000","last_fullsized":"2024-09-13T06:32:54.859546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'64","last_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_deep_scrub":"35'64","last_deep_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.859285+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:01.758392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.285574+0000","last_change":"2024-09-13T06:32:59.285702+0000","last_active":"2024-09-13T06:32:59.285574+0000","last_peered":"2024-09-13T06:32:59.285574+0000","last_clean":"2024-09-13T06:32:59.285574+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:32:59.285574+0000","last_undegraded":"2024-09-13T06:32:59.285574+0000","last_fullsized":"2024-09-13T06:32:59.285574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.285313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:24.231597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.266173+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:14.266173+0000","last_peered":"2024-09-13T06:32:14.266173+0000","last_clean":"2024-09-13T06:32:14.266173+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:14.266173+0000","last_undegraded":"2024-09-13T06:32:14.266173+0000","last_fullsized":"2024-09-13T06:32:14.266173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494402+0000","last_change":"2024-09-13T06:29:00.728932+0000","last_active":"2024-09-13T06:31:15.494402+0000","last_peered":"2024-09-13T06:31:15.494402+0000","last_clean":"2024-09-13T06:31:15.494402+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:31:15.494402+0000","last_undegraded":"2024-09-13T06:31:15.494402+0000","last_fullsized":"2024-09-13T06:31:15.494402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.490947+0000","last_change":"2024-09-13T06:28:58.719722+0000","last_active":"2024-09-13T06:31:15.490947+0000","last_peered":"2024-09-13T06:31:15.490947+0000","last_clean":"2024-09-13T06:31:15.490947+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:31:15.490947+0000","last_undegraded":"2024-09-13T06:31:15.490947+0000","last_fullsized":"2024-09-13T06:31:15.490947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495505+0000","last_change":"2024-09-13T06:29:02.713294+0000","last_active":"2024-09-13T06:31:20.495505+0000","last_peered":"2024-09-13T06:31:20.495505+0000","last_clean":"2024-09-13T06:31:20.495505+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:31:20.495505+0000","last_undegraded":"2024-09-13T06:31:20.495505+0000","last_fullsized":"2024-09-13T06:31:20.495505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.766256+0000","last_change":"2024-09-13T06:32:48.766296+0000","last_active":"2024-09-13T06:32:48.766256+0000","last_peered":"2024-09-13T06:32:48.766256+0000","last_clean":"2024-09-13T06:32:48.766256+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:32:48.766256+0000","last_undegraded":"2024-09-13T06:32:48.766256+0000","last_fullsized":"2024-09-13T06:32:48.766256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_clean_scrub_stamp":"2024-09-13T06:32:48.766165+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:25.779327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.494113+0000","last_change":"2024-09-13T06:29:06.772900+0000","last_active":"2024-09-13T06:31:25.494113+0000","last_peered":"2024-09-13T06:31:25.494113+0000","last_clean":"2024-09-13T06:31:25.494113+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:31:25.494113+0000","last_undegraded":"2024-09-13T06:31:25.494113+0000","last_fullsized":"2024-09-13T06:31:25.494113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'5","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.130250+0000","last_change":"2024-09-13T06:29:08.785484+0000","last_active":"2024-09-13T06:32:14.130250+0000","last_peered":"2024-09-13T06:32:14.130250+0000","last_clean":"2024-09-13T06:32:14.130250+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:32:14.130250+0000","last_undegraded":"2024-09-13T06:32:14.130250+0000","last_fullsized":"2024-09-13T06:32:14.130250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494558+0000","last_change":"2024-09-13T06:29:00.714668+0000","last_active":"2024-09-13T06:31:19.494558+0000","last_peered":"2024-09-13T06:31:19.494558+0000","last_clean":"2024-09-13T06:31:19.494558+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:31:19.494558+0000","last_undegraded":"2024-09-13T06:31:19.494558+0000","last_fullsized":"2024-09-13T06:31:19.494558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:09.491846+0000","last_change":"2024-09-13T06:28:58.716633+0000","last_active":"2024-09-13T06:31:09.491846+0000","last_peered":"2024-09-13T06:31:09.491846+0000","last_clean":"2024-09-13T06:31:09.491846+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:31:09.491846+0000","last_undegraded":"2024-09-13T06:31:09.491846+0000","last_fullsized":"2024-09-13T06:31:09.491846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495898+0000","last_change":"2024-09-13T06:29:02.730107+0000","last_active":"2024-09-13T06:31:20.495898+0000","last_peered":"2024-09-13T06:31:20.495898+0000","last_clean":"2024-09-13T06:31:20.495898+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:31:20.495898+0000","last_undegraded":"2024-09-13T06:31:20.495898+0000","last_fullsized":"2024-09-13T06:31:20.495898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.303390+0000","last_change":"2024-09-13T06:33:00.303475+0000","last_active":"2024-09-13T06:33:00.303390+0000","last_peered":"2024-09-13T06:33:00.303390+0000","last_clean":"2024-09-13T06:33:00.303390+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:33:00.303390+0000","last_undegraded":"2024-09-13T06:33:00.303390+0000","last_fullsized":"2024-09-13T06:33:00.303390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.303147+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:58.846618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":420,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.270651+0000","last_change":"2024-09-13T06:32:58.270712+0000","last_active":"2024-09-13T06:32:58.270651+0000","last_peered":"2024-09-13T06:32:58.270651+0000","last_clean":"2024-09-13T06:32:58.270651+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:58.270651+0000","last_undegraded":"2024-09-13T06:32:58.270651+0000","last_fullsized":"2024-09-13T06:32:58.270651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.270455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:12.264581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.134927+0000","last_change":"2024-09-13T06:29:08.773016+0000","last_active":"2024-09-13T06:32:14.134927+0000","last_peered":"2024-09-13T06:32:14.134927+0000","last_clean":"2024-09-13T06:32:14.134927+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:32:14.134927+0000","last_undegraded":"2024-09-13T06:32:14.134927+0000","last_fullsized":"2024-09-13T06:32:14.134927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.985451+0000","last_change":"2024-09-13T06:29:00.705902+0000","last_active":"2024-09-13T06:32:13.985451+0000","last_peered":"2024-09-13T06:32:13.985451+0000","last_clean":"2024-09-13T06:32:13.985451+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:32:13.985451+0000","last_undegraded":"2024-09-13T06:32:13.985451+0000","last_fullsized":"2024-09-13T06:32:13.985451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.750092+0000","last_change":"2024-09-13T06:28:58.720215+0000","last_active":"2024-09-13T06:32:13.750092+0000","last_peered":"2024-09-13T06:32:13.750092+0000","last_clean":"2024-09-13T06:32:13.750092+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:32:13.750092+0000","last_undegraded":"2024-09-13T06:32:13.750092+0000","last_fullsized":"2024-09-13T06:32:13.750092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":433,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.124492+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:32:45.124492+0000","last_peered":"2024-09-13T06:32:45.124492+0000","last_clean":"2024-09-13T06:32:45.124492+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:32:45.124492+0000","last_undegraded":"2024-09-13T06:32:45.124492+0000","last_fullsized":"2024-09-13T06:32:45.124492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.883473+0000","last_change":"2024-09-13T06:32:52.883556+0000","last_active":"2024-09-13T06:32:52.883473+0000","last_peered":"2024-09-13T06:32:52.883473+0000","last_clean":"2024-09-13T06:32:52.883473+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:32:52.883473+0000","last_undegraded":"2024-09-13T06:32:52.883473+0000","last_fullsized":"2024-09-13T06:32:52.883473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.883251+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:35.305885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":482,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.772355+0000","last_change":"2024-09-13T06:33:00.772503+0000","last_active":"2024-09-13T06:33:00.772355+0000","last_peered":"2024-09-13T06:33:00.772355+0000","last_clean":"2024-09-13T06:33:00.772355+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:33:00.772355+0000","last_undegraded":"2024-09-13T06:33:00.772355+0000","last_fullsized":"2024-09-13T06:33:00.772355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.772062+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:06.999075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.493681+0000","last_change":"2024-09-13T06:29:08.792692+0000","last_active":"2024-09-13T06:31:15.493681+0000","last_peered":"2024-09-13T06:31:15.493681+0000","last_clean":"2024-09-13T06:31:15.493681+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:31:15.493681+0000","last_undegraded":"2024-09-13T06:31:15.493681+0000","last_fullsized":"2024-09-13T06:31:15.493681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'3","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121494+0000","last_change":"2024-09-13T06:29:00.731625+0000","last_active":"2024-09-13T06:32:14.121494+0000","last_peered":"2024-09-13T06:32:14.121494+0000","last_clean":"2024-09-13T06:32:14.121494+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:32:14.121494+0000","last_undegraded":"2024-09-13T06:32:14.121494+0000","last_fullsized":"2024-09-13T06:32:14.121494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.327097+0000","last_change":"2024-09-13T06:28:58.719501+0000","last_active":"2024-09-13T06:32:45.327097+0000","last_peered":"2024-09-13T06:32:45.327097+0000","last_clean":"2024-09-13T06:32:45.327097+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:32:45.327097+0000","last_undegraded":"2024-09-13T06:32:45.327097+0000","last_fullsized":"2024-09-13T06:32:45.327097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492654+0000","last_change":"2024-09-13T06:29:02.721649+0000","last_active":"2024-09-13T06:31:20.492654+0000","last_peered":"2024-09-13T06:31:20.492654+0000","last_clean":"2024-09-13T06:31:20.492654+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:31:20.492654+0000","last_undegraded":"2024-09-13T06:31:20.492654+0000","last_fullsized":"2024-09-13T06:31:20.492654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.873933+0000","last_change":"2024-09-13T06:33:07.874009+0000","last_active":"2024-09-13T06:33:07.873933+0000","last_peered":"2024-09-13T06:33:07.873933+0000","last_clean":"2024-09-13T06:33:07.873933+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:33:07.873933+0000","last_undegraded":"2024-09-13T06:33:07.873933+0000","last_fullsized":"2024-09-13T06:33:07.873933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.873746+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:28.536287+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.843252+0000","last_change":"2024-09-13T06:33:06.843311+0000","last_active":"2024-09-13T06:33:06.843252+0000","last_peered":"2024-09-13T06:33:06.843252+0000","last_clean":"2024-09-13T06:33:06.843252+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:33:06.843252+0000","last_undegraded":"2024-09-13T06:33:06.843252+0000","last_fullsized":"2024-09-13T06:33:06.843252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.843049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:01.227917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.680312+0000","last_change":"2024-09-13T06:33:02.680373+0000","last_active":"2024-09-13T06:33:02.680312+0000","last_peered":"2024-09-13T06:33:02.680312+0000","last_clean":"2024-09-13T06:33:02.680312+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:33:02.680312+0000","last_undegraded":"2024-09-13T06:33:02.680312+0000","last_fullsized":"2024-09-13T06:33:02.680312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.680110+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:47.873890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.907956+0000","last_change":"2024-09-13T06:29:00.723363+0000","last_active":"2024-09-13T06:32:13.907956+0000","last_peered":"2024-09-13T06:32:13.907956+0000","last_clean":"2024-09-13T06:32:13.907956+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:32:13.907956+0000","last_undegraded":"2024-09-13T06:32:13.907956+0000","last_fullsized":"2024-09-13T06:32:13.907956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085357+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:32:49.085357+0000","last_peered":"2024-09-13T06:32:49.085357+0000","last_clean":"2024-09-13T06:32:49.085357+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:32:49.085357+0000","last_undegraded":"2024-09-13T06:32:49.085357+0000","last_fullsized":"2024-09-13T06:32:49.085357+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622346+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:32:48.622346+0000","last_peered":"2024-09-13T06:32:48.622346+0000","last_clean":"2024-09-13T06:32:48.622346+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:32:48.622346+0000","last_undegraded":"2024-09-13T06:32:48.622346+0000","last_fullsized":"2024-09-13T06:32:48.622346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:07.897777+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:31:07.897777+0000","last_peered":"2024-09-13T06:31:07.897777+0000","last_clean":"2024-09-13T06:31:07.897777+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:31:07.897777+0000","last_undegraded":"2024-09-13T06:31:07.897777+0000","last_fullsized":"2024-09-13T06:31:07.897777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492251+0000","last_change":"2024-09-13T06:29:02.723791+0000","last_active":"2024-09-13T06:31:10.492251+0000","last_peered":"2024-09-13T06:31:10.492251+0000","last_clean":"2024-09-13T06:31:10.492251+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:31:10.492251+0000","last_undegraded":"2024-09-13T06:31:10.492251+0000","last_fullsized":"2024-09-13T06:31:10.492251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'87","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.821977+0000","last_change":"2024-09-13T06:33:04.822144+0000","last_active":"2024-09-13T06:33:04.821977+0000","last_peered":"2024-09-13T06:33:04.821977+0000","last_clean":"2024-09-13T06:33:04.821977+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:33:04.821977+0000","last_undegraded":"2024-09-13T06:33:04.821977+0000","last_fullsized":"2024-09-13T06:33:04.821977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'87","last_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_deep_scrub":"35'87","last_deep_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.821761+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:28.535913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492559+0000","last_change":"2024-09-13T06:29:06.774102+0000","last_active":"2024-09-13T06:31:20.492559+0000","last_peered":"2024-09-13T06:31:20.492559+0000","last_clean":"2024-09-13T06:31:20.492559+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:31:20.492559+0000","last_undegraded":"2024-09-13T06:31:20.492559+0000","last_fullsized":"2024-09-13T06:31:20.492559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.252272+0000","last_change":"2024-09-13T06:33:05.252336+0000","last_active":"2024-09-13T06:33:05.252272+0000","last_peered":"2024-09-13T06:33:05.252272+0000","last_clean":"2024-09-13T06:33:05.252272+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:33:05.252272+0000","last_undegraded":"2024-09-13T06:33:05.252272+0000","last_fullsized":"2024-09-13T06:33:05.252272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.252089+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:32.271264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489875+0000","last_change":"2024-09-13T06:29:00.724256+0000","last_active":"2024-09-13T06:31:10.489875+0000","last_peered":"2024-09-13T06:31:10.489875+0000","last_clean":"2024-09-13T06:31:10.489875+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:31:10.489875+0000","last_undegraded":"2024-09-13T06:31:10.489875+0000","last_fullsized":"2024-09-13T06:31:10.489875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622325+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:32:48.622325+0000","last_peered":"2024-09-13T06:32:48.622325+0000","last_clean":"2024-09-13T06:32:48.622325+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:32:48.622325+0000","last_undegraded":"2024-09-13T06:32:48.622325+0000","last_fullsized":"2024-09-13T06:32:48.622325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491281+0000","last_change":"2024-09-13T06:28:58.711388+0000","last_active":"2024-09-13T06:31:05.491281+0000","last_peered":"2024-09-13T06:31:05.491281+0000","last_clean":"2024-09-13T06:31:05.491281+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:31:05.491281+0000","last_undegraded":"2024-09-13T06:31:05.491281+0000","last_fullsized":"2024-09-13T06:31:05.491281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.659789+0000","last_change":"2024-09-13T06:32:53.659844+0000","last_active":"2024-09-13T06:32:53.659789+0000","last_peered":"2024-09-13T06:32:53.659789+0000","last_clean":"2024-09-13T06:32:53.659789+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:32:53.659789+0000","last_undegraded":"2024-09-13T06:32:53.659789+0000","last_fullsized":"2024-09-13T06:32:53.659789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.659599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:12.730571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":520,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.680120+0000","last_change":"2024-09-13T06:33:01.680200+0000","last_active":"2024-09-13T06:33:01.680120+0000","last_peered":"2024-09-13T06:33:01.680120+0000","last_clean":"2024-09-13T06:33:01.680120+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:33:01.680120+0000","last_undegraded":"2024-09-13T06:33:01.680120+0000","last_fullsized":"2024-09-13T06:33:01.680120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.679952+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:20.338166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.834404+0000","last_change":"2024-09-13T06:32:59.834458+0000","last_active":"2024-09-13T06:32:59.834404+0000","last_peered":"2024-09-13T06:32:59.834404+0000","last_clean":"2024-09-13T06:32:59.834404+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:32:59.834404+0000","last_undegraded":"2024-09-13T06:32:59.834404+0000","last_fullsized":"2024-09-13T06:32:59.834404+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.834212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:30.694348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495829+0000","last_change":"2024-09-13T06:29:08.785933+0000","last_active":"2024-09-13T06:31:20.495829+0000","last_peered":"2024-09-13T06:31:20.495829+0000","last_clean":"2024-09-13T06:31:20.495829+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:31:20.495829+0000","last_undegraded":"2024-09-13T06:31:20.495829+0000","last_fullsized":"2024-09-13T06:31:20.495829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.987945+0000","last_change":"2024-09-13T06:29:00.726943+0000","last_active":"2024-09-13T06:32:13.987945+0000","last_peered":"2024-09-13T06:32:13.987945+0000","last_clean":"2024-09-13T06:32:13.987945+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:32:13.987945+0000","last_undegraded":"2024-09-13T06:32:13.987945+0000","last_fullsized":"2024-09-13T06:32:13.987945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.544469+0000","last_change":"2024-09-13T06:28:53.498788+0000","last_active":"2024-09-13T06:32:49.544469+0000","last_peered":"2024-09-13T06:32:49.544469+0000","last_clean":"2024-09-13T06:32:49.544469+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:32:49.544469+0000","last_undegraded":"2024-09-13T06:32:49.544469+0000","last_fullsized":"2024-09-13T06:32:49.544469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085154+0000","last_change":"2024-09-13T06:28:58.710601+0000","last_active":"2024-09-13T06:32:49.085154+0000","last_peered":"2024-09-13T06:32:49.085154+0000","last_clean":"2024-09-13T06:32:49.085154+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:32:49.085154+0000","last_undegraded":"2024-09-13T06:32:49.085154+0000","last_fullsized":"2024-09-13T06:32:49.085154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494004+0000","last_change":"2024-09-13T06:29:02.715757+0000","last_active":"2024-09-13T06:31:15.494004+0000","last_peered":"2024-09-13T06:31:15.494004+0000","last_clean":"2024-09-13T06:31:15.494004+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:31:15.494004+0000","last_undegraded":"2024-09-13T06:31:15.494004+0000","last_fullsized":"2024-09-13T06:31:15.494004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.784155+0000","last_change":"2024-09-13T06:32:49.784194+0000","last_active":"2024-09-13T06:32:49.784155+0000","last_peered":"2024-09-13T06:32:49.784155+0000","last_clean":"2024-09-13T06:32:49.784155+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:49.784155+0000","last_undegraded":"2024-09-13T06:32:49.784155+0000","last_fullsized":"2024-09-13T06:32:49.784155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.784073+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:56.683180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.634604+0000","last_change":"2024-09-13T06:32:52.634660+0000","last_active":"2024-09-13T06:32:52.634604+0000","last_peered":"2024-09-13T06:32:52.634604+0000","last_clean":"2024-09-13T06:32:52.634604+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:32:52.634604+0000","last_undegraded":"2024-09-13T06:32:52.634604+0000","last_fullsized":"2024-09-13T06:32:52.634604+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.634413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:42.199135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493950+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:31:25.493950+0000","last_peered":"2024-09-13T06:31:25.493950+0000","last_clean":"2024-09-13T06:31:25.493950+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:31:25.493950+0000","last_undegraded":"2024-09-13T06:31:25.493950+0000","last_fullsized":"2024-09-13T06:31:25.493950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.434509+0000","last_change":"2024-09-13T06:29:00.721955+0000","last_active":"2024-09-13T06:32:13.434509+0000","last_peered":"2024-09-13T06:32:13.434509+0000","last_clean":"2024-09-13T06:32:13.434509+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:32:13.434509+0000","last_undegraded":"2024-09-13T06:32:13.434509+0000","last_fullsized":"2024-09-13T06:32:13.434509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622325+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:32:48.622325+0000","last_peered":"2024-09-13T06:32:48.622325+0000","last_clean":"2024-09-13T06:32:48.622325+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:32:48.622325+0000","last_undegraded":"2024-09-13T06:32:48.622325+0000","last_fullsized":"2024-09-13T06:32:48.622325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622396+0000","last_change":"2024-09-13T06:28:58.714825+0000","last_active":"2024-09-13T06:32:48.622396+0000","last_peered":"2024-09-13T06:32:48.622396+0000","last_clean":"2024-09-13T06:32:48.622396+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:32:48.622396+0000","last_undegraded":"2024-09-13T06:32:48.622396+0000","last_fullsized":"2024-09-13T06:32:48.622396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492320+0000","last_change":"2024-09-13T06:29:02.726548+0000","last_active":"2024-09-13T06:31:10.492320+0000","last_peered":"2024-09-13T06:31:10.492320+0000","last_clean":"2024-09-13T06:31:10.492320+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:31:10.492320+0000","last_undegraded":"2024-09-13T06:31:10.492320+0000","last_fullsized":"2024-09-13T06:31:10.492320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:12.738257+0000","last_change":"2024-09-13T06:29:04.753220+0000","last_active":"2024-09-13T06:32:12.738257+0000","last_peered":"2024-09-13T06:32:12.738257+0000","last_clean":"2024-09-13T06:32:12.738257+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:32:12.738257+0000","last_undegraded":"2024-09-13T06:32:12.738257+0000","last_fullsized":"2024-09-13T06:32:12.738257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492712+0000","last_change":"2024-09-13T06:29:06.776644+0000","last_active":"2024-09-13T06:31:20.492712+0000","last_peered":"2024-09-13T06:31:20.492712+0000","last_clean":"2024-09-13T06:31:20.492712+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:31:20.492712+0000","last_undegraded":"2024-09-13T06:31:20.492712+0000","last_fullsized":"2024-09-13T06:31:20.492712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.425468+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:13.425468+0000","last_peered":"2024-09-13T06:32:13.425468+0000","last_clean":"2024-09-13T06:32:13.425468+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:13.425468+0000","last_undegraded":"2024-09-13T06:32:13.425468+0000","last_fullsized":"2024-09-13T06:32:13.425468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.985368+0000","last_change":"2024-09-13T06:29:00.729564+0000","last_active":"2024-09-13T06:32:13.985368+0000","last_peered":"2024-09-13T06:32:13.985368+0000","last_clean":"2024-09-13T06:32:13.985368+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:32:13.985368+0000","last_undegraded":"2024-09-13T06:32:13.985368+0000","last_fullsized":"2024-09-13T06:32:13.985368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622622+0000","last_change":"2024-09-13T06:28:58.734084+0000","last_active":"2024-09-13T06:32:48.622622+0000","last_peered":"2024-09-13T06:32:48.622622+0000","last_clean":"2024-09-13T06:32:48.622622+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:32:48.622622+0000","last_undegraded":"2024-09-13T06:32:48.622622+0000","last_fullsized":"2024-09-13T06:32:48.622622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085099+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:32:49.085099+0000","last_peered":"2024-09-13T06:32:49.085099+0000","last_clean":"2024-09-13T06:32:49.085099+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:32:49.085099+0000","last_undegraded":"2024-09-13T06:32:49.085099+0000","last_fullsized":"2024-09-13T06:32:49.085099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.126437+0000","last_change":"2024-09-13T06:29:02.741057+0000","last_active":"2024-09-13T06:32:45.126437+0000","last_peered":"2024-09-13T06:32:45.126437+0000","last_clean":"2024-09-13T06:32:45.126437+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:32:45.126437+0000","last_undegraded":"2024-09-13T06:32:45.126437+0000","last_fullsized":"2024-09-13T06:32:45.126437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.618221+0000","last_change":"2024-09-13T06:32:57.618221+0000","last_active":"2024-09-13T06:32:57.618221+0000","last_peered":"2024-09-13T06:32:57.618221+0000","last_clean":"2024-09-13T06:32:57.618221+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:32:57.618221+0000","last_undegraded":"2024-09-13T06:32:57.618221+0000","last_fullsized":"2024-09-13T06:32:57.618221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.617910+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:37.547222+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.822056+0000","last_change":"2024-09-13T06:33:02.822112+0000","last_active":"2024-09-13T06:33:02.822056+0000","last_peered":"2024-09-13T06:33:02.822056+0000","last_clean":"2024-09-13T06:33:02.822056+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:33:02.822056+0000","last_undegraded":"2024-09-13T06:33:02.822056+0000","last_fullsized":"2024-09-13T06:33:02.822056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.821863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:01.519357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.306949+0000","last_change":"2024-09-13T06:32:57.307014+0000","last_active":"2024-09-13T06:32:57.306949+0000","last_peered":"2024-09-13T06:32:57.306949+0000","last_clean":"2024-09-13T06:32:57.306949+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:32:57.306949+0000","last_undegraded":"2024-09-13T06:32:57.306949+0000","last_fullsized":"2024-09-13T06:32:57.306949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.306761+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:57.594334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491370+0000","last_change":"2024-09-13T06:29:00.726613+0000","last_active":"2024-09-13T06:31:05.491370+0000","last_peered":"2024-09-13T06:31:05.491370+0000","last_clean":"2024-09-13T06:31:05.491370+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:31:05.491370+0000","last_undegraded":"2024-09-13T06:31:05.491370+0000","last_fullsized":"2024-09-13T06:31:05.491370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491422+0000","last_change":"2024-09-13T06:28:58.709334+0000","last_active":"2024-09-13T06:31:05.491422+0000","last_peered":"2024-09-13T06:31:05.491422+0000","last_clean":"2024-09-13T06:31:05.491422+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:31:05.491422+0000","last_undegraded":"2024-09-13T06:31:05.491422+0000","last_fullsized":"2024-09-13T06:31:05.491422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622461+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:32:48.622461+0000","last_peered":"2024-09-13T06:32:48.622461+0000","last_clean":"2024-09-13T06:32:48.622461+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:32:48.622461+0000","last_undegraded":"2024-09-13T06:32:48.622461+0000","last_fullsized":"2024-09-13T06:32:48.622461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.733011+0000","last_change":"2024-09-13T06:32:51.733063+0000","last_active":"2024-09-13T06:32:51.733011+0000","last_peered":"2024-09-13T06:32:51.733011+0000","last_clean":"2024-09-13T06:32:51.733011+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:32:51.733011+0000","last_undegraded":"2024-09-13T06:32:51.733011+0000","last_fullsized":"2024-09-13T06:32:51.733011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.732823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:41.778673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.654219+0000","last_change":"2024-09-13T06:32:59.654307+0000","last_active":"2024-09-13T06:32:59.654219+0000","last_peered":"2024-09-13T06:32:59.654219+0000","last_clean":"2024-09-13T06:32:59.654219+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:32:59.654219+0000","last_undegraded":"2024-09-13T06:32:59.654219+0000","last_fullsized":"2024-09-13T06:32:59.654219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.654023+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:07.752313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":372,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.632883+0000","last_change":"2024-09-13T06:32:58.632949+0000","last_active":"2024-09-13T06:32:58.632883+0000","last_peered":"2024-09-13T06:32:58.632883+0000","last_clean":"2024-09-13T06:32:58.632883+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:58.632883+0000","last_undegraded":"2024-09-13T06:32:58.632883+0000","last_fullsized":"2024-09-13T06:32:58.632883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.632636+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:48.468583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.494139+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:31:25.494139+0000","last_peered":"2024-09-13T06:31:25.494139+0000","last_clean":"2024-09-13T06:31:25.494139+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:31:25.494139+0000","last_undegraded":"2024-09-13T06:31:25.494139+0000","last_fullsized":"2024-09-13T06:31:25.494139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988466+0000","last_change":"2024-09-13T06:29:00.723308+0000","last_active":"2024-09-13T06:32:49.988466+0000","last_peered":"2024-09-13T06:32:49.988466+0000","last_clean":"2024-09-13T06:32:49.988466+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:32:49.988466+0000","last_undegraded":"2024-09-13T06:32:49.988466+0000","last_fullsized":"2024-09-13T06:32:49.988466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.322399+0000","last_change":"2024-09-13T06:28:58.724803+0000","last_active":"2024-09-13T06:32:13.322399+0000","last_peered":"2024-09-13T06:32:13.322399+0000","last_clean":"2024-09-13T06:32:13.322399+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:32:13.322399+0000","last_undegraded":"2024-09-13T06:32:13.322399+0000","last_fullsized":"2024-09-13T06:32:13.322399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:00.490346+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:31:00.490346+0000","last_peered":"2024-09-13T06:31:00.490346+0000","last_clean":"2024-09-13T06:31:00.490346+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:31:00.490346+0000","last_undegraded":"2024-09-13T06:31:00.490346+0000","last_fullsized":"2024-09-13T06:31:00.490346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.771714+0000","last_change":"2024-09-13T06:32:59.771819+0000","last_active":"2024-09-13T06:32:59.771714+0000","last_peered":"2024-09-13T06:32:59.771714+0000","last_clean":"2024-09-13T06:32:59.771714+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:32:59.771714+0000","last_undegraded":"2024-09-13T06:32:59.771714+0000","last_fullsized":"2024-09-13T06:32:59.771714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.771488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:22.687574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.946452+0000","last_change":"2024-09-13T06:32:50.946526+0000","last_active":"2024-09-13T06:32:50.946452+0000","last_peered":"2024-09-13T06:32:50.946452+0000","last_clean":"2024-09-13T06:32:50.946452+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:32:50.946452+0000","last_undegraded":"2024-09-13T06:32:50.946452+0000","last_fullsized":"2024-09-13T06:32:50.946452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.946266+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:40.782214+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":438,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.469166+0000","last_change":"2024-09-13T06:29:06.773446+0000","last_active":"2024-09-13T06:32:45.469166+0000","last_peered":"2024-09-13T06:32:45.469166+0000","last_clean":"2024-09-13T06:32:45.469166+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:32:45.469166+0000","last_undegraded":"2024-09-13T06:32:45.469166+0000","last_fullsized":"2024-09-13T06:32:45.469166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497423+0000","last_change":"2024-09-13T06:29:08.789911+0000","last_active":"2024-09-13T06:31:25.497423+0000","last_peered":"2024-09-13T06:31:25.497423+0000","last_clean":"2024-09-13T06:31:25.497423+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:31:25.497423+0000","last_undegraded":"2024-09-13T06:31:25.497423+0000","last_fullsized":"2024-09-13T06:31:25.497423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491779+0000","last_change":"2024-09-13T06:29:00.703730+0000","last_active":"2024-09-13T06:31:05.491779+0000","last_peered":"2024-09-13T06:31:05.491779+0000","last_clean":"2024-09-13T06:31:05.491779+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:31:05.491779+0000","last_undegraded":"2024-09-13T06:31:05.491779+0000","last_fullsized":"2024-09-13T06:31:05.491779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492349+0000","last_change":"2024-09-13T06:28:58.716525+0000","last_active":"2024-09-13T06:31:10.492349+0000","last_peered":"2024-09-13T06:31:10.492349+0000","last_clean":"2024-09-13T06:31:10.492349+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:31:10.492349+0000","last_undegraded":"2024-09-13T06:31:10.492349+0000","last_fullsized":"2024-09-13T06:31:10.492349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:04.490825+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:31:04.490825+0000","last_peered":"2024-09-13T06:31:04.490825+0000","last_clean":"2024-09-13T06:31:04.490825+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:31:04.490825+0000","last_undegraded":"2024-09-13T06:31:04.490825+0000","last_fullsized":"2024-09-13T06:31:04.490825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.863331+0000","last_change":"2024-09-13T06:32:55.863331+0000","last_active":"2024-09-13T06:32:55.863331+0000","last_peered":"2024-09-13T06:32:55.863331+0000","last_clean":"2024-09-13T06:32:55.863331+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:32:55.863331+0000","last_undegraded":"2024-09-13T06:32:55.863331+0000","last_fullsized":"2024-09-13T06:32:55.863331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.863065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:36.969572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'98","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.660084+0000","last_change":"2024-09-13T06:32:54.660166+0000","last_active":"2024-09-13T06:32:54.660084+0000","last_peered":"2024-09-13T06:32:54.660084+0000","last_clean":"2024-09-13T06:32:54.660084+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:32:54.660084+0000","last_undegraded":"2024-09-13T06:32:54.660084+0000","last_fullsized":"2024-09-13T06:32:54.660084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'98","last_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_deep_scrub":"35'98","last_deep_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.659885+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:25.520020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.816296+0000","last_change":"2024-09-13T06:33:00.816350+0000","last_active":"2024-09-13T06:33:00.816296+0000","last_peered":"2024-09-13T06:33:00.816296+0000","last_clean":"2024-09-13T06:33:00.816296+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:33:00.816296+0000","last_undegraded":"2024-09-13T06:33:00.816296+0000","last_fullsized":"2024-09-13T06:33:00.816296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.816103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:13.549745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.317433+0000","last_change":"2024-09-13T06:33:01.317544+0000","last_active":"2024-09-13T06:33:01.317433+0000","last_peered":"2024-09-13T06:33:01.317433+0000","last_clean":"2024-09-13T06:33:01.317433+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:33:01.317433+0000","last_undegraded":"2024-09-13T06:33:01.317433+0000","last_fullsized":"2024-09-13T06:33:01.317433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.317139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:36:04.823983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.229695+0000","last_change":"2024-09-13T06:32:53.229760+0000","last_active":"2024-09-13T06:32:53.229695+0000","last_peered":"2024-09-13T06:32:53.229695+0000","last_clean":"2024-09-13T06:32:53.229695+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:32:53.229695+0000","last_undegraded":"2024-09-13T06:32:53.229695+0000","last_fullsized":"2024-09-13T06:32:53.229695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.229470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:36.522566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.797474+0000","last_change":"2024-09-13T06:29:00.706756+0000","last_active":"2024-09-13T06:32:13.797474+0000","last_peered":"2024-09-13T06:32:13.797474+0000","last_clean":"2024-09-13T06:32:13.797474+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:32:13.797474+0000","last_undegraded":"2024-09-13T06:32:13.797474+0000","last_fullsized":"2024-09-13T06:32:13.797474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.958506+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:13.958506+0000","last_peered":"2024-09-13T06:32:13.958506+0000","last_clean":"2024-09-13T06:32:13.958506+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:13.958506+0000","last_undegraded":"2024-09-13T06:32:13.958506+0000","last_fullsized":"2024-09-13T06:32:13.958506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.713010+0000","last_change":"2024-09-13T06:32:50.713077+0000","last_active":"2024-09-13T06:32:50.713010+0000","last_peered":"2024-09-13T06:32:50.713010+0000","last_clean":"2024-09-13T06:32:50.713010+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:32:50.713010+0000","last_undegraded":"2024-09-13T06:32:50.713010+0000","last_fullsized":"2024-09-13T06:32:50.713010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.712808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:55.564878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.849497+0000","last_change":"2024-09-13T06:32:57.849575+0000","last_active":"2024-09-13T06:32:57.849497+0000","last_peered":"2024-09-13T06:32:57.849497+0000","last_clean":"2024-09-13T06:32:57.849497+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:32:57.849497+0000","last_undegraded":"2024-09-13T06:32:57.849497+0000","last_fullsized":"2024-09-13T06:32:57.849497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.849298+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:27.355549+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.864609+0000","last_change":"2024-09-13T06:33:01.864660+0000","last_active":"2024-09-13T06:33:01.864609+0000","last_peered":"2024-09-13T06:33:01.864609+0000","last_clean":"2024-09-13T06:33:01.864609+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:33:01.864609+0000","last_undegraded":"2024-09-13T06:33:01.864609+0000","last_fullsized":"2024-09-13T06:33:01.864609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.864411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:27.499351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489857+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:31:10.489857+0000","last_peered":"2024-09-13T06:31:10.489857+0000","last_clean":"2024-09-13T06:31:10.489857+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:31:10.489857+0000","last_undegraded":"2024-09-13T06:31:10.489857+0000","last_fullsized":"2024-09-13T06:31:10.489857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.119082+0000","last_change":"2024-09-13T06:29:00.724056+0000","last_active":"2024-09-13T06:32:14.119082+0000","last_peered":"2024-09-13T06:32:14.119082+0000","last_clean":"2024-09-13T06:32:14.119082+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:32:14.119082+0000","last_undegraded":"2024-09-13T06:32:14.119082+0000","last_fullsized":"2024-09-13T06:32:14.119082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.496834+0000","last_change":"2024-09-13T06:28:58.722577+0000","last_active":"2024-09-13T06:31:25.496834+0000","last_peered":"2024-09-13T06:31:25.496834+0000","last_clean":"2024-09-13T06:31:25.496834+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:31:25.496834+0000","last_undegraded":"2024-09-13T06:31:25.496834+0000","last_fullsized":"2024-09-13T06:31:25.496834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.849576+0000","last_change":"2024-09-13T06:32:58.849630+0000","last_active":"2024-09-13T06:32:58.849576+0000","last_peered":"2024-09-13T06:32:58.849576+0000","last_clean":"2024-09-13T06:32:58.849576+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:32:58.849576+0000","last_undegraded":"2024-09-13T06:32:58.849576+0000","last_fullsized":"2024-09-13T06:32:58.849576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.849384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:17.920356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.666350+0000","last_change":"2024-09-13T06:33:00.666422+0000","last_active":"2024-09-13T06:33:00.666350+0000","last_peered":"2024-09-13T06:33:00.666350+0000","last_clean":"2024-09-13T06:33:00.666350+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:33:00.666350+0000","last_undegraded":"2024-09-13T06:33:00.666350+0000","last_fullsized":"2024-09-13T06:33:00.666350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.666162+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:43.088796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.237414+0000","last_change":"2024-09-13T06:32:55.237529+0000","last_active":"2024-09-13T06:32:55.237414+0000","last_peered":"2024-09-13T06:32:55.237414+0000","last_clean":"2024-09-13T06:32:55.237414+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:32:55.237414+0000","last_undegraded":"2024-09-13T06:32:55.237414+0000","last_fullsized":"2024-09-13T06:32:55.237414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.237184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:16.278907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.501115+0000","last_change":"2024-09-13T06:29:08.787430+0000","last_active":"2024-09-13T06:31:40.501115+0000","last_peered":"2024-09-13T06:31:40.501115+0000","last_clean":"2024-09-13T06:31:40.501115+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:31:40.501115+0000","last_undegraded":"2024-09-13T06:31:40.501115+0000","last_fullsized":"2024-09-13T06:31:40.501115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'7","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.118786+0000","last_change":"2024-09-13T06:29:00.709739+0000","last_active":"2024-09-13T06:32:14.118786+0000","last_peered":"2024-09-13T06:32:14.118786+0000","last_clean":"2024-09-13T06:32:14.118786+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:32:14.118786+0000","last_undegraded":"2024-09-13T06:32:14.118786+0000","last_fullsized":"2024-09-13T06:32:14.118786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:24.495860+0000","last_change":"2024-09-13T06:28:58.717681+0000","last_active":"2024-09-13T06:31:24.495860+0000","last_peered":"2024-09-13T06:31:24.495860+0000","last_clean":"2024-09-13T06:31:24.495860+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:31:24.495860+0000","last_undegraded":"2024-09-13T06:31:24.495860+0000","last_fullsized":"2024-09-13T06:31:24.495860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'5","reported_seq":242,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.667969+0000","last_change":"2024-09-13T06:32:55.668036+0000","last_active":"2024-09-13T06:32:55.667969+0000","last_peered":"2024-09-13T06:32:55.667969+0000","last_clean":"2024-09-13T06:32:55.667969+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:32:55.667969+0000","last_undegraded":"2024-09-13T06:32:55.667969+0000","last_fullsized":"2024-09-13T06:32:55.667969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.667780+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:08.401422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'48","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.901988+0000","last_change":"2024-09-13T06:32:53.902064+0000","last_active":"2024-09-13T06:32:53.901988+0000","last_peered":"2024-09-13T06:32:53.901988+0000","last_clean":"2024-09-13T06:32:53.901988+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:53.901988+0000","last_undegraded":"2024-09-13T06:32:53.901988+0000","last_fullsized":"2024-09-13T06:32:53.901988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.901815+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:12.560029+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.629520+0000","last_change":"2024-09-13T06:32:53.629571+0000","last_active":"2024-09-13T06:32:53.629520+0000","last_peered":"2024-09-13T06:32:53.629520+0000","last_clean":"2024-09-13T06:32:53.629520+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:32:53.629520+0000","last_undegraded":"2024-09-13T06:32:53.629520+0000","last_fullsized":"2024-09-13T06:32:53.629520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.629307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:49.351038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.497847+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:31:40.497847+0000","last_peered":"2024-09-13T06:31:40.497847+0000","last_clean":"2024-09-13T06:31:40.497847+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:31:40.497847+0000","last_undegraded":"2024-09-13T06:31:40.497847+0000","last_fullsized":"2024-09-13T06:31:40.497847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:00.504694+0000","last_change":"2024-09-13T06:29:39.508832+0000","last_active":"2024-09-13T06:32:00.504694+0000","last_peered":"2024-09-13T06:32:00.504694+0000","last_clean":"2024-09-13T06:32:00.504694+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:32:00.504694+0000","last_undegraded":"2024-09-13T06:32:00.504694+0000","last_fullsized":"2024-09-13T06:32:00.504694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497563+0000","last_change":"2024-09-13T06:28:58.716514+0000","last_active":"2024-09-13T06:31:25.497563+0000","last_peered":"2024-09-13T06:31:25.497563+0000","last_clean":"2024-09-13T06:31:25.497563+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:31:25.497563+0000","last_undegraded":"2024-09-13T06:31:25.497563+0000","last_fullsized":"2024-09-13T06:31:25.497563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493820+0000","last_change":"2024-09-13T06:29:02.718645+0000","last_active":"2024-09-13T06:31:25.493820+0000","last_peered":"2024-09-13T06:31:25.493820+0000","last_clean":"2024-09-13T06:31:25.493820+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:31:25.493820+0000","last_undegraded":"2024-09-13T06:31:25.493820+0000","last_fullsized":"2024-09-13T06:31:25.493820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.919638+0000","last_change":"2024-09-13T06:33:08.919713+0000","last_active":"2024-09-13T06:33:08.919638+0000","last_peered":"2024-09-13T06:33:08.919638+0000","last_clean":"2024-09-13T06:33:08.919638+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:33:08.919638+0000","last_undegraded":"2024-09-13T06:33:08.919638+0000","last_fullsized":"2024-09-13T06:33:08.919638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.919447+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:31.817162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.257208+0000","last_change":"2024-09-13T06:32:56.257263+0000","last_active":"2024-09-13T06:32:56.257208+0000","last_peered":"2024-09-13T06:32:56.257208+0000","last_clean":"2024-09-13T06:32:56.257208+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:32:56.257208+0000","last_undegraded":"2024-09-13T06:32:56.257208+0000","last_fullsized":"2024-09-13T06:32:56.257208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.256983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:15.836617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.586582+0000","last_change":"2024-09-13T06:29:00.717648+0000","last_active":"2024-09-13T06:32:13.586582+0000","last_peered":"2024-09-13T06:32:13.586582+0000","last_clean":"2024-09-13T06:32:13.586582+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:32:13.586582+0000","last_undegraded":"2024-09-13T06:32:13.586582+0000","last_fullsized":"2024-09-13T06:32:13.586582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493692+0000","last_change":"2024-09-13T06:28:58.719660+0000","last_active":"2024-09-13T06:31:25.493692+0000","last_peered":"2024-09-13T06:31:25.493692+0000","last_clean":"2024-09-13T06:31:25.493692+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:31:25.493692+0000","last_undegraded":"2024-09-13T06:31:25.493692+0000","last_fullsized":"2024-09-13T06:31:25.493692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.753509+0000","last_change":"2024-09-13T06:32:49.753509+0000","last_active":"2024-09-13T06:32:49.753509+0000","last_peered":"2024-09-13T06:32:49.753509+0000","last_clean":"2024-09-13T06:32:49.753509+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:32:49.753509+0000","last_undegraded":"2024-09-13T06:32:49.753509+0000","last_fullsized":"2024-09-13T06:32:49.753509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.753224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:01.369372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.357261+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:32:45.357261+0000","last_peered":"2024-09-13T06:32:45.357261+0000","last_clean":"2024-09-13T06:32:45.357261+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:32:45.357261+0000","last_undegraded":"2024-09-13T06:32:45.357261+0000","last_fullsized":"2024-09-13T06:32:45.357261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.274398+0000","last_change":"2024-09-13T06:32:54.274454+0000","last_active":"2024-09-13T06:32:54.274398+0000","last_peered":"2024-09-13T06:32:54.274398+0000","last_clean":"2024-09-13T06:32:54.274398+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:32:54.274398+0000","last_undegraded":"2024-09-13T06:32:54.274398+0000","last_fullsized":"2024-09-13T06:32:54.274398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.274196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:07.867699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495271+0000","last_change":"2024-09-13T06:29:08.784874+0000","last_active":"2024-09-13T06:31:30.495271+0000","last_peered":"2024-09-13T06:31:30.495271+0000","last_clean":"2024-09-13T06:31:30.495271+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:31:30.495271+0000","last_undegraded":"2024-09-13T06:31:30.495271+0000","last_fullsized":"2024-09-13T06:31:30.495271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085838+0000","last_change":"2024-09-13T06:29:00.731362+0000","last_active":"2024-09-13T06:32:49.085838+0000","last_peered":"2024-09-13T06:32:49.085838+0000","last_clean":"2024-09-13T06:32:49.085838+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:32:49.085838+0000","last_undegraded":"2024-09-13T06:32:49.085838+0000","last_fullsized":"2024-09-13T06:32:49.085838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497301+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:31:25.497301+0000","last_peered":"2024-09-13T06:31:25.497301+0000","last_clean":"2024-09-13T06:31:25.497301+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:31:25.497301+0000","last_undegraded":"2024-09-13T06:31:25.497301+0000","last_fullsized":"2024-09-13T06:31:25.497301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.697848+0000","last_change":"2024-09-13T06:32:56.697900+0000","last_active":"2024-09-13T06:32:56.697848+0000","last_peered":"2024-09-13T06:32:56.697848+0000","last_clean":"2024-09-13T06:32:56.697848+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:32:56.697848+0000","last_undegraded":"2024-09-13T06:32:56.697848+0000","last_fullsized":"2024-09-13T06:32:56.697848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.697652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:22.332592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'41","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.375649+0000","last_change":"2024-09-13T06:29:04.732931+0000","last_active":"2024-09-13T06:32:45.375649+0000","last_peered":"2024-09-13T06:32:45.375649+0000","last_clean":"2024-09-13T06:32:45.375649+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:32:45.375649+0000","last_undegraded":"2024-09-13T06:32:45.375649+0000","last_fullsized":"2024-09-13T06:32:45.375649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.617551+0000","last_change":"2024-09-13T06:32:55.617654+0000","last_active":"2024-09-13T06:32:55.617551+0000","last_peered":"2024-09-13T06:32:55.617551+0000","last_clean":"2024-09-13T06:32:55.617551+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:32:55.617551+0000","last_undegraded":"2024-09-13T06:32:55.617551+0000","last_fullsized":"2024-09-13T06:32:55.617551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.617324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:18.790664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496938+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:31:29.496938+0000","last_peered":"2024-09-13T06:31:29.496938+0000","last_clean":"2024-09-13T06:31:29.496938+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:31:29.496938+0000","last_undegraded":"2024-09-13T06:31:29.496938+0000","last_fullsized":"2024-09-13T06:31:29.496938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.987727+0000","last_change":"2024-09-13T06:29:00.732260+0000","last_active":"2024-09-13T06:32:13.987727+0000","last_peered":"2024-09-13T06:32:13.987727+0000","last_clean":"2024-09-13T06:32:13.987727+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:32:13.987727+0000","last_undegraded":"2024-09-13T06:32:13.987727+0000","last_fullsized":"2024-09-13T06:32:13.987727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496979+0000","last_change":"2024-09-13T06:28:58.716000+0000","last_active":"2024-09-13T06:31:29.496979+0000","last_peered":"2024-09-13T06:31:29.496979+0000","last_clean":"2024-09-13T06:31:29.496979+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:31:29.496979+0000","last_undegraded":"2024-09-13T06:31:29.496979+0000","last_fullsized":"2024-09-13T06:31:29.496979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.707846+0000","last_change":"2024-09-13T06:32:57.707902+0000","last_active":"2024-09-13T06:32:57.707846+0000","last_peered":"2024-09-13T06:32:57.707846+0000","last_clean":"2024-09-13T06:32:57.707846+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:32:57.707846+0000","last_undegraded":"2024-09-13T06:32:57.707846+0000","last_fullsized":"2024-09-13T06:32:57.707846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.707651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:17.993090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'37","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.263783+0000","last_change":"2024-09-13T06:29:04.752663+0000","last_active":"2024-09-13T06:32:45.263783+0000","last_peered":"2024-09-13T06:32:45.263783+0000","last_clean":"2024-09-13T06:32:45.263783+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:32:45.263783+0000","last_undegraded":"2024-09-13T06:32:45.263783+0000","last_fullsized":"2024-09-13T06:32:45.263783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.614260+0000","last_change":"2024-09-13T06:32:54.614320+0000","last_active":"2024-09-13T06:32:54.614260+0000","last_peered":"2024-09-13T06:32:54.614260+0000","last_clean":"2024-09-13T06:32:54.614260+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:32:54.614260+0000","last_undegraded":"2024-09-13T06:32:54.614260+0000","last_fullsized":"2024-09-13T06:32:54.614260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.614081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:41.070050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496915+0000","last_change":"2024-09-13T06:29:08.769294+0000","last_active":"2024-09-13T06:31:29.496915+0000","last_peered":"2024-09-13T06:31:29.496915+0000","last_clean":"2024-09-13T06:31:29.496915+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:31:29.496915+0000","last_undegraded":"2024-09-13T06:31:29.496915+0000","last_fullsized":"2024-09-13T06:31:29.496915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.435250+0000","last_change":"2024-09-13T06:29:00.722796+0000","last_active":"2024-09-13T06:32:13.435250+0000","last_peered":"2024-09-13T06:32:13.435250+0000","last_clean":"2024-09-13T06:32:13.435250+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:32:13.435250+0000","last_undegraded":"2024-09-13T06:32:13.435250+0000","last_fullsized":"2024-09-13T06:32:13.435250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.327818+0000","last_change":"2024-09-13T06:28:58.705967+0000","last_active":"2024-09-13T06:32:45.327818+0000","last_peered":"2024-09-13T06:32:45.327818+0000","last_clean":"2024-09-13T06:32:45.327818+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:32:45.327818+0000","last_undegraded":"2024-09-13T06:32:45.327818+0000","last_fullsized":"2024-09-13T06:32:45.327818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":32,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:35.500083+0000","last_change":"2024-09-13T06:29:02.727947+0000","last_active":"2024-09-13T06:31:35.500083+0000","last_peered":"2024-09-13T06:31:35.500083+0000","last_clean":"2024-09-13T06:31:35.500083+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:31:35.500083+0000","last_undegraded":"2024-09-13T06:31:35.500083+0000","last_fullsized":"2024-09-13T06:31:35.500083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.989839+0000","last_change":"2024-09-13T06:29:04.754166+0000","last_active":"2024-09-13T06:32:49.989839+0000","last_peered":"2024-09-13T06:32:49.989839+0000","last_clean":"2024-09-13T06:32:49.989839+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:32:49.989839+0000","last_undegraded":"2024-09-13T06:32:49.989839+0000","last_fullsized":"2024-09-13T06:32:49.989839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":426,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.456314+0000","last_change":"2024-09-13T06:29:06.774577+0000","last_active":"2024-09-13T06:32:45.456314+0000","last_peered":"2024-09-13T06:32:45.456314+0000","last_clean":"2024-09-13T06:32:45.456314+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:32:45.456314+0000","last_undegraded":"2024-09-13T06:32:45.456314+0000","last_fullsized":"2024-09-13T06:32:45.456314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496734+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:31:29.496734+0000","last_peered":"2024-09-13T06:31:29.496734+0000","last_clean":"2024-09-13T06:31:29.496734+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:31:29.496734+0000","last_undegraded":"2024-09-13T06:31:29.496734+0000","last_fullsized":"2024-09-13T06:31:29.496734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.909290+0000","last_change":"2024-09-13T06:29:00.703118+0000","last_active":"2024-09-13T06:32:13.909290+0000","last_peered":"2024-09-13T06:32:13.909290+0000","last_clean":"2024-09-13T06:32:13.909290+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:32:13.909290+0000","last_undegraded":"2024-09-13T06:32:13.909290+0000","last_fullsized":"2024-09-13T06:32:13.909290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.498755+0000","last_change":"2024-09-13T06:28:58.727668+0000","last_active":"2024-09-13T06:31:30.498755+0000","last_peered":"2024-09-13T06:31:30.498755+0000","last_clean":"2024-09-13T06:31:30.498755+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:31:30.498755+0000","last_undegraded":"2024-09-13T06:31:30.498755+0000","last_fullsized":"2024-09-13T06:31:30.498755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.672367+0000","last_change":"2024-09-13T06:32:51.672474+0000","last_active":"2024-09-13T06:32:51.672367+0000","last_peered":"2024-09-13T06:32:51.672367+0000","last_clean":"2024-09-13T06:32:51.672367+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:32:51.672367+0000","last_undegraded":"2024-09-13T06:32:51.672367+0000","last_fullsized":"2024-09-13T06:32:51.672367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.672122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:22.074076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.867341+0000","last_change":"2024-09-13T06:33:05.867420+0000","last_active":"2024-09-13T06:33:05.867341+0000","last_peered":"2024-09-13T06:33:05.867341+0000","last_clean":"2024-09-13T06:33:05.867341+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:33:05.867341+0000","last_undegraded":"2024-09-13T06:33:05.867341+0000","last_fullsized":"2024-09-13T06:33:05.867341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.867149+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:29.643610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.863742+0000","last_change":"2024-09-13T06:33:03.863795+0000","last_active":"2024-09-13T06:33:03.863742+0000","last_peered":"2024-09-13T06:33:03.863742+0000","last_clean":"2024-09-13T06:33:03.863742+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:33:03.863742+0000","last_undegraded":"2024-09-13T06:33:03.863742+0000","last_fullsized":"2024-09-13T06:33:03.863742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:06.532657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498484+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:31:34.498484+0000","last_peered":"2024-09-13T06:31:34.498484+0000","last_clean":"2024-09-13T06:31:34.498484+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:31:34.498484+0000","last_undegraded":"2024-09-13T06:31:34.498484+0000","last_fullsized":"2024-09-13T06:31:34.498484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.585858+0000","last_change":"2024-09-13T06:29:00.715931+0000","last_active":"2024-09-13T06:32:13.585858+0000","last_peered":"2024-09-13T06:32:13.585858+0000","last_clean":"2024-09-13T06:32:13.585858+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:32:13.585858+0000","last_undegraded":"2024-09-13T06:32:13.585858+0000","last_fullsized":"2024-09-13T06:32:13.585858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497159+0000","last_change":"2024-09-13T06:28:58.706848+0000","last_active":"2024-09-13T06:31:29.497159+0000","last_peered":"2024-09-13T06:31:29.497159+0000","last_clean":"2024-09-13T06:31:29.497159+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:31:29.497159+0000","last_undegraded":"2024-09-13T06:31:29.497159+0000","last_fullsized":"2024-09-13T06:31:29.497159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498290+0000","last_change":"2024-09-13T06:29:02.715301+0000","last_active":"2024-09-13T06:31:34.498290+0000","last_peered":"2024-09-13T06:31:34.498290+0000","last_clean":"2024-09-13T06:31:34.498290+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:31:34.498290+0000","last_undegraded":"2024-09-13T06:31:34.498290+0000","last_fullsized":"2024-09-13T06:31:34.498290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.274280+0000","last_change":"2024-09-13T06:33:02.274362+0000","last_active":"2024-09-13T06:33:02.274280+0000","last_peered":"2024-09-13T06:33:02.274280+0000","last_clean":"2024-09-13T06:33:02.274280+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:33:02.274280+0000","last_undegraded":"2024-09-13T06:33:02.274280+0000","last_fullsized":"2024-09-13T06:33:02.274280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.274058+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:13.067392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498166+0000","last_change":"2024-09-13T06:29:06.774527+0000","last_active":"2024-09-13T06:31:34.498166+0000","last_peered":"2024-09-13T06:31:34.498166+0000","last_clean":"2024-09-13T06:31:34.498166+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:31:34.498166+0000","last_undegraded":"2024-09-13T06:31:34.498166+0000","last_fullsized":"2024-09-13T06:31:34.498166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:05.715530+0000","last_clean_scrub_stamp":"2024-09-13T06:29:05.715530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.789069+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.789069+0000","last_peered":"2024-09-13T06:32:13.789069+0000","last_clean":"2024-09-13T06:32:13.789069+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.789069+0000","last_undegraded":"2024-09-13T06:32:13.789069+0000","last_fullsized":"2024-09-13T06:32:13.789069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.796828+0000","last_change":"2024-09-13T06:29:00.710678+0000","last_active":"2024-09-13T06:32:13.796828+0000","last_peered":"2024-09-13T06:32:13.796828+0000","last_clean":"2024-09-13T06:32:13.796828+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:32:13.796828+0000","last_undegraded":"2024-09-13T06:32:13.796828+0000","last_fullsized":"2024-09-13T06:32:13.796828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987954+0000","last_change":"2024-09-13T06:28:58.728835+0000","last_active":"2024-09-13T06:32:49.987954+0000","last_peered":"2024-09-13T06:32:49.987954+0000","last_clean":"2024-09-13T06:32:49.987954+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:32:49.987954+0000","last_undegraded":"2024-09-13T06:32:49.987954+0000","last_fullsized":"2024-09-13T06:32:49.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.498527+0000","last_change":"2024-09-13T06:29:02.731541+0000","last_active":"2024-09-13T06:31:30.498527+0000","last_peered":"2024-09-13T06:31:30.498527+0000","last_clean":"2024-09-13T06:31:30.498527+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:31:30.498527+0000","last_undegraded":"2024-09-13T06:31:30.498527+0000","last_fullsized":"2024-09-13T06:31:30.498527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'31","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.922489+0000","last_change":"2024-09-13T06:32:51.922559+0000","last_active":"2024-09-13T06:32:51.922489+0000","last_peered":"2024-09-13T06:32:51.922489+0000","last_clean":"2024-09-13T06:32:51.922489+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:32:51.922489+0000","last_undegraded":"2024-09-13T06:32:51.922489+0000","last_fullsized":"2024-09-13T06:32:51.922489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31","last_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_deep_scrub":"35'31","last_deep_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.922288+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:42.602059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.849119+0000","last_change":"2024-09-13T06:33:03.849171+0000","last_active":"2024-09-13T06:33:03.849119+0000","last_peered":"2024-09-13T06:33:03.849119+0000","last_clean":"2024-09-13T06:33:03.849119+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:33:03.849119+0000","last_undegraded":"2024-09-13T06:33:03.849119+0000","last_fullsized":"2024-09-13T06:33:03.849119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:53.988212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.976294+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.976294+0000","last_peered":"2024-09-13T06:32:13.976294+0000","last_clean":"2024-09-13T06:32:13.976294+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.976294+0000","last_undegraded":"2024-09-13T06:32:13.976294+0000","last_fullsized":"2024-09-13T06:32:13.976294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.907949+0000","last_change":"2024-09-13T06:29:00.723086+0000","last_active":"2024-09-13T06:32:13.907949+0000","last_peered":"2024-09-13T06:32:13.907949+0000","last_clean":"2024-09-13T06:32:13.907949+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:32:13.907949+0000","last_undegraded":"2024-09-13T06:32:13.907949+0000","last_fullsized":"2024-09-13T06:32:13.907949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491637+0000","last_change":"2024-09-13T06:28:58.709396+0000","last_active":"2024-09-13T06:31:05.491637+0000","last_peered":"2024-09-13T06:31:05.491637+0000","last_clean":"2024-09-13T06:31:05.491637+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:31:05.491637+0000","last_undegraded":"2024-09-13T06:31:05.491637+0000","last_fullsized":"2024-09-13T06:31:05.491637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.629912+0000","last_change":"2024-09-13T06:33:04.629973+0000","last_active":"2024-09-13T06:33:04.629912+0000","last_peered":"2024-09-13T06:33:04.629912+0000","last_clean":"2024-09-13T06:33:04.629912+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:33:04.629912+0000","last_undegraded":"2024-09-13T06:33:04.629912+0000","last_fullsized":"2024-09-13T06:33:04.629912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.629731+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:04.692060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.731460+0000","last_change":"2024-09-13T06:32:58.731638+0000","last_active":"2024-09-13T06:32:58.731460+0000","last_peered":"2024-09-13T06:32:58.731460+0000","last_clean":"2024-09-13T06:32:58.731460+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:58.731460+0000","last_undegraded":"2024-09-13T06:32:58.731460+0000","last_fullsized":"2024-09-13T06:32:58.731460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.731244+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:01.400357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.185822+0000","last_change":"2024-09-13T06:32:51.185958+0000","last_active":"2024-09-13T06:32:51.185822+0000","last_peered":"2024-09-13T06:32:51.185822+0000","last_clean":"2024-09-13T06:32:51.185822+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:32:51.185822+0000","last_undegraded":"2024-09-13T06:32:51.185822+0000","last_fullsized":"2024-09-13T06:32:51.185822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.185604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:49.642143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497070+0000","last_change":"2024-09-13T06:29:08.770047+0000","last_active":"2024-09-13T06:31:29.497070+0000","last_peered":"2024-09-13T06:31:29.497070+0000","last_clean":"2024-09-13T06:31:29.497070+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:31:29.497070+0000","last_undegraded":"2024-09-13T06:31:29.497070+0000","last_fullsized":"2024-09-13T06:31:29.497070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.493044+0000","last_change":"2024-09-13T06:29:00.723899+0000","last_active":"2024-09-13T06:31:10.493044+0000","last_peered":"2024-09-13T06:31:10.493044+0000","last_clean":"2024-09-13T06:31:10.493044+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:31:10.493044+0000","last_undegraded":"2024-09-13T06:31:10.493044+0000","last_fullsized":"2024-09-13T06:31:10.493044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491694+0000","last_change":"2024-09-13T06:28:58.721562+0000","last_active":"2024-09-13T06:31:05.491694+0000","last_peered":"2024-09-13T06:31:05.491694+0000","last_clean":"2024-09-13T06:31:05.491694+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:31:05.491694+0000","last_undegraded":"2024-09-13T06:31:05.491694+0000","last_fullsized":"2024-09-13T06:31:05.491694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.587795+0000","last_change":"2024-09-13T06:29:00.721713+0000","last_active":"2024-09-13T06:32:13.587795+0000","last_peered":"2024-09-13T06:32:13.587795+0000","last_clean":"2024-09-13T06:32:13.587795+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:32:13.587795+0000","last_undegraded":"2024-09-13T06:32:13.587795+0000","last_fullsized":"2024-09-13T06:32:13.587795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:12.364309+0000","last_change":"2024-09-13T06:28:58.708285+0000","last_active":"2024-09-13T06:31:12.364309+0000","last_peered":"2024-09-13T06:31:12.364309+0000","last_clean":"2024-09-13T06:31:12.364309+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:31:12.364309+0000","last_undegraded":"2024-09-13T06:31:12.364309+0000","last_fullsized":"2024-09-13T06:31:12.364309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121391+0000","last_change":"2024-09-13T06:29:39.540853+0000","last_active":"2024-09-13T06:32:14.121391+0000","last_peered":"2024-09-13T06:32:14.121391+0000","last_clean":"2024-09-13T06:32:14.121391+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:32:14.121391+0000","last_undegraded":"2024-09-13T06:32:14.121391+0000","last_fullsized":"2024-09-13T06:32:14.121391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.488959+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:31:05.488959+0000","last_peered":"2024-09-13T06:31:05.488959+0000","last_clean":"2024-09-13T06:31:05.488959+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:31:05.488959+0000","last_undegraded":"2024-09-13T06:31:05.488959+0000","last_fullsized":"2024-09-13T06:31:05.488959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.796921+0000","last_change":"2024-09-13T06:29:00.721804+0000","last_active":"2024-09-13T06:32:13.796921+0000","last_peered":"2024-09-13T06:32:13.796921+0000","last_clean":"2024-09-13T06:32:13.796921+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:32:13.796921+0000","last_undegraded":"2024-09-13T06:32:13.796921+0000","last_fullsized":"2024-09-13T06:32:13.796921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.491882+0000","last_change":"2024-09-13T06:28:58.722511+0000","last_active":"2024-09-13T06:31:05.491882+0000","last_peered":"2024-09-13T06:31:05.491882+0000","last_clean":"2024-09-13T06:31:05.491882+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:31:05.491882+0000","last_undegraded":"2024-09-13T06:31:05.491882+0000","last_fullsized":"2024-09-13T06:31:05.491882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.433374+0000","last_change":"2024-09-13T06:29:39.527461+0000","last_active":"2024-09-13T06:32:13.433374+0000","last_peered":"2024-09-13T06:32:13.433374+0000","last_clean":"2024-09-13T06:32:13.433374+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:32:13.433374+0000","last_undegraded":"2024-09-13T06:32:13.433374+0000","last_fullsized":"2024-09-13T06:32:13.433374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489832+0000","last_change":"2024-09-13T06:28:58.724998+0000","last_active":"2024-09-13T06:31:10.489832+0000","last_peered":"2024-09-13T06:31:10.489832+0000","last_clean":"2024-09-13T06:31:10.489832+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:31:10.489832+0000","last_undegraded":"2024-09-13T06:31:10.489832+0000","last_fullsized":"2024-09-13T06:31:10.489832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.905558+0000","last_change":"2024-09-13T06:29:00.723960+0000","last_active":"2024-09-13T06:32:13.905558+0000","last_peered":"2024-09-13T06:32:13.905558+0000","last_clean":"2024-09-13T06:32:13.905558+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:32:13.905558+0000","last_undegraded":"2024-09-13T06:32:13.905558+0000","last_fullsized":"2024-09-13T06:32:13.905558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492299+0000","last_change":"2024-09-13T06:28:58.730726+0000","last_active":"2024-09-13T06:31:10.492299+0000","last_peered":"2024-09-13T06:31:10.492299+0000","last_clean":"2024-09-13T06:31:10.492299+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:31:10.492299+0000","last_undegraded":"2024-09-13T06:31:10.492299+0000","last_fullsized":"2024-09-13T06:31:10.492299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:05.488897+0000","last_change":"2024-09-13T06:29:00.718381+0000","last_active":"2024-09-13T06:31:05.488897+0000","last_peered":"2024-09-13T06:31:05.488897+0000","last_clean":"2024-09-13T06:31:05.488897+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:31:05.488897+0000","last_undegraded":"2024-09-13T06:31:05.488897+0000","last_fullsized":"2024-09-13T06:31:05.488897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.492698+0000","last_change":"2024-09-13T06:28:58.707516+0000","last_active":"2024-09-13T06:31:10.492698+0000","last_peered":"2024-09-13T06:31:10.492698+0000","last_clean":"2024-09-13T06:31:10.492698+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:31:10.492698+0000","last_undegraded":"2024-09-13T06:31:10.492698+0000","last_fullsized":"2024-09-13T06:31:10.492698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:09.491706+0000","last_change":"2024-09-13T06:29:00.715113+0000","last_active":"2024-09-13T06:31:09.491706+0000","last_peered":"2024-09-13T06:31:09.491706+0000","last_clean":"2024-09-13T06:31:09.491706+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:31:09.491706+0000","last_undegraded":"2024-09-13T06:31:09.491706+0000","last_fullsized":"2024-09-13T06:31:09.491706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:10.489910+0000","last_change":"2024-09-13T06:28:58.725590+0000","last_active":"2024-09-13T06:31:10.489910+0000","last_peered":"2024-09-13T06:31:10.489910+0000","last_clean":"2024-09-13T06:31:10.489910+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:31:10.489910+0000","last_undegraded":"2024-09-13T06:31:10.489910+0000","last_fullsized":"2024-09-13T06:31:10.489910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.985025+0000","last_change":"2024-09-13T06:29:00.713384+0000","last_active":"2024-09-13T06:32:13.985025+0000","last_peered":"2024-09-13T06:32:13.985025+0000","last_clean":"2024-09-13T06:32:13.985025+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:32:13.985025+0000","last_undegraded":"2024-09-13T06:32:13.985025+0000","last_fullsized":"2024-09-13T06:32:13.985025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.743269+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.743269+0000","last_peered":"2024-09-13T06:32:13.743269+0000","last_clean":"2024-09-13T06:32:13.743269+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.743269+0000","last_undegraded":"2024-09-13T06:32:13.743269+0000","last_fullsized":"2024-09-13T06:32:13.743269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908221+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:13.908221+0000","last_peered":"2024-09-13T06:32:13.908221+0000","last_clean":"2024-09-13T06:32:13.908221+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:13.908221+0000","last_undegraded":"2024-09-13T06:32:13.908221+0000","last_fullsized":"2024-09-13T06:32:13.908221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.490796+0000","last_change":"2024-09-13T06:28:58.705020+0000","last_active":"2024-09-13T06:31:15.490796+0000","last_peered":"2024-09-13T06:31:15.490796+0000","last_clean":"2024-09-13T06:31:15.490796+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:31:15.490796+0000","last_undegraded":"2024-09-13T06:31:15.490796+0000","last_fullsized":"2024-09-13T06:31:15.490796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121352+0000","last_change":"2024-09-13T06:29:00.702900+0000","last_active":"2024-09-13T06:32:14.121352+0000","last_peered":"2024-09-13T06:32:14.121352+0000","last_clean":"2024-09-13T06:32:14.121352+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:32:14.121352+0000","last_undegraded":"2024-09-13T06:32:14.121352+0000","last_fullsized":"2024-09-13T06:32:14.121352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:14.493128+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:31:14.493128+0000","last_peered":"2024-09-13T06:31:14.493128+0000","last_clean":"2024-09-13T06:31:14.493128+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:31:14.493128+0000","last_undegraded":"2024-09-13T06:31:14.493128+0000","last_fullsized":"2024-09-13T06:31:14.493128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.795495+0000","last_change":"2024-09-13T06:29:00.732329+0000","last_active":"2024-09-13T06:32:13.795495+0000","last_peered":"2024-09-13T06:32:13.795495+0000","last_clean":"2024-09-13T06:32:13.795495+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:32:13.795495+0000","last_undegraded":"2024-09-13T06:32:13.795495+0000","last_fullsized":"2024-09-13T06:32:13.795495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.494311+0000","last_change":"2024-09-13T06:28:58.716875+0000","last_active":"2024-09-13T06:31:15.494311+0000","last_peered":"2024-09-13T06:31:15.494311+0000","last_clean":"2024-09-13T06:31:15.494311+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:31:15.494311+0000","last_undegraded":"2024-09-13T06:31:15.494311+0000","last_fullsized":"2024-09-13T06:31:15.494311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.905074+0000","last_change":"2024-09-13T06:29:00.716069+0000","last_active":"2024-09-13T06:32:13.905074+0000","last_peered":"2024-09-13T06:32:13.905074+0000","last_clean":"2024-09-13T06:32:13.905074+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:32:13.905074+0000","last_undegraded":"2024-09-13T06:32:13.905074+0000","last_fullsized":"2024-09-13T06:32:13.905074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.764403+0000","last_change":"2024-09-13T06:28:58.725136+0000","last_active":"2024-09-13T06:32:13.764403+0000","last_peered":"2024-09-13T06:32:13.764403+0000","last_clean":"2024-09-13T06:32:13.764403+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:32:13.764403+0000","last_undegraded":"2024-09-13T06:32:13.764403+0000","last_fullsized":"2024-09-13T06:32:13.764403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'7","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.119294+0000","last_change":"2024-09-13T06:29:00.729388+0000","last_active":"2024-09-13T06:32:14.119294+0000","last_peered":"2024-09-13T06:32:14.119294+0000","last_clean":"2024-09-13T06:32:14.119294+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:32:14.119294+0000","last_undegraded":"2024-09-13T06:32:14.119294+0000","last_fullsized":"2024-09-13T06:32:14.119294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.491059+0000","last_change":"2024-09-13T06:28:58.720437+0000","last_active":"2024-09-13T06:31:15.491059+0000","last_peered":"2024-09-13T06:31:15.491059+0000","last_clean":"2024-09-13T06:31:15.491059+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:31:15.491059+0000","last_undegraded":"2024-09-13T06:31:15.491059+0000","last_fullsized":"2024-09-13T06:31:15.491059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:15.490756+0000","last_change":"2024-09-13T06:29:00.722844+0000","last_active":"2024-09-13T06:31:15.490756+0000","last_peered":"2024-09-13T06:31:15.490756+0000","last_clean":"2024-09-13T06:31:15.490756+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:31:15.490756+0000","last_undegraded":"2024-09-13T06:31:15.490756+0000","last_fullsized":"2024-09-13T06:31:15.490756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.771986+0000","last_change":"2024-09-13T06:28:58.707588+0000","last_active":"2024-09-13T06:32:13.771986+0000","last_peered":"2024-09-13T06:32:13.771986+0000","last_clean":"2024-09-13T06:32:13.771986+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:32:13.771986+0000","last_undegraded":"2024-09-13T06:32:13.771986+0000","last_fullsized":"2024-09-13T06:32:13.771986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.794943+0000","last_change":"2024-09-13T06:29:00.717476+0000","last_active":"2024-09-13T06:32:13.794943+0000","last_peered":"2024-09-13T06:32:13.794943+0000","last_clean":"2024-09-13T06:32:13.794943+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:32:13.794943+0000","last_undegraded":"2024-09-13T06:32:13.794943+0000","last_fullsized":"2024-09-13T06:32:13.794943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492786+0000","last_change":"2024-09-13T06:28:58.720596+0000","last_active":"2024-09-13T06:31:20.492786+0000","last_peered":"2024-09-13T06:31:20.492786+0000","last_clean":"2024-09-13T06:31:20.492786+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:31:20.492786+0000","last_undegraded":"2024-09-13T06:31:20.492786+0000","last_fullsized":"2024-09-13T06:31:20.492786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494281+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:31:19.494281+0000","last_peered":"2024-09-13T06:31:19.494281+0000","last_clean":"2024-09-13T06:31:19.494281+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:31:19.494281+0000","last_undegraded":"2024-09-13T06:31:19.494281+0000","last_fullsized":"2024-09-13T06:31:19.494281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497064+0000","last_change":"2024-09-13T06:29:00.709102+0000","last_active":"2024-09-13T06:31:25.497064+0000","last_peered":"2024-09-13T06:31:25.497064+0000","last_clean":"2024-09-13T06:31:25.497064+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:31:25.497064+0000","last_undegraded":"2024-09-13T06:31:25.497064+0000","last_fullsized":"2024-09-13T06:31:25.497064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495693+0000","last_change":"2024-09-13T06:28:58.716677+0000","last_active":"2024-09-13T06:31:20.495693+0000","last_peered":"2024-09-13T06:31:20.495693+0000","last_clean":"2024-09-13T06:31:20.495693+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:31:20.495693+0000","last_undegraded":"2024-09-13T06:31:20.495693+0000","last_fullsized":"2024-09-13T06:31:20.495693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.987735+0000","last_change":"2024-09-13T06:29:39.515090+0000","last_active":"2024-09-13T06:32:13.987735+0000","last_peered":"2024-09-13T06:32:13.987735+0000","last_clean":"2024-09-13T06:32:13.987735+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:32:13.987735+0000","last_undegraded":"2024-09-13T06:32:13.987735+0000","last_fullsized":"2024-09-13T06:32:13.987735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1493,"ondisk_log_size":1493,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":446464,"data_stored":151533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673016,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":740673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":742577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":153065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.775 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.776 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.777 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.778 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.779 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.780 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.781 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.782 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.783 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:28:46.906198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.784 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.785 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.785 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.785 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.785 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.785 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.785 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.786 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.787 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.788 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.789 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.790 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.791 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.792 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.793 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T06:29:05.715530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.793 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.793 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.794 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.794 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.794 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.795 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.795 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.795 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.796 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.796 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.796 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.796 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.796 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.797 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.797 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.797 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.797 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.798 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.798 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.798 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.798 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.798 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.798 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.799 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.799 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.799 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.799 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.799 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.799 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.800 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.800 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.800 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.800 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.800 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.800 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.801 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.802 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.802 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:10.802 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:33:30.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:33:30.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.929+0000 7f1c012b8640 1 Processor -- start 2024-09-13T06:33:30.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.929+0000 7f1c012b8640 1 -- start start 2024-09-13T06:33:30.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1c012b8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1bfc06d0e0 0x7f1bfc06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:30.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1c012b8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bfc071c10 con 0x7f1bfc06da00 2024-09-13T06:33:30.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1c012b8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1bfc072230 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bfaffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1bfc06d0e0 0x7f1bfc06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:30.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bfa7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1bfc06da00 0x7f1bfc12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:50364/0 (socket says 172.21.15.112:50364) 2024-09-13T06:33:30.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bfa7fc640 1 -- 172.21.15.112:0/747039815 learned_addr learned my addr 172.21.15.112:0/747039815 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:33:30.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bfaffd640 1 -- 172.21.15.112:0/747039815 >> v1:172.21.15.112:6789/0 conn(0x7f1bfc06da00 legacy=0x7f1bfc12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:30.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bfaffd640 1 -- 172.21.15.112:0/747039815 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc0709e0 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bfaffd640 1 --2- 172.21.15.112:0/747039815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc06d4c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009d90 tx=0x7f1bf401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569a524500b67660 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:30.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bf9ffb640 1 -- 172.21.15.112:0/747039815 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40a6560 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bf9ffb640 1 -- 172.21.15.112:0/747039815 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf40a6700 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.933+0000 7f1bf9ffb640 1 -- 172.21.15.112:0/747039815 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40a6a00 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/747039815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 msgr2=0x7f1bfc06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 --2- 172.21.15.112:0/747039815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc06d4c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009d90 tx=0x7f1bf401c8c0 comp rx=0 tx=0).stop 2024-09-13T06:33:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/747039815 shutdown_connections 2024-09-13T06:33:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 --2- 172.21.15.112:0/747039815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc06d4c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/747039815 >> 172.21.15.112:0/747039815 conn(0x7f1bfc099a50 msgr2=0x7f1bfc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:33:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/747039815 shutdown_connections 2024-09-13T06:33:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/747039815 wait complete. 2024-09-13T06:33:30.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 Processor -- start 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- start start 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc128c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc134e80 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc128c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51756/0 (socket says 172.21.15.112:51756) 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bfaffd640 1 -- 172.21.15.112:0/1228277083 learned_addr learned my addr 172.21.15.112:0/1228277083 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bfaffd640 1 -- 172.21.15.112:0/1228277083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc12a3a0 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bfaffd640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc128c50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1bf401a4f0 tx=0x7f1bf4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40bb570 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf40c0070 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc12b010 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40bb860 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc12b6a0 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bfc06d4c0 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bf40bba00 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bf37fe640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1bdc035db0 0x7f1bdc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:30.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.937+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f1bf40e4440 con 0x7f1bfc06d0e0 2024-09-13T06:33:30.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.941+0000 7f1bfa7fc640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1bdc035db0 0x7f1bdc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:30.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.941+0000 7f1bfa7fc640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1bdc035db0 0x7f1bdc038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1be4001610 tx=0x7f1be4007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:30.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:30.945+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1bf40ac030 con 0x7f1bfc06d0e0 2024-09-13T06:33:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.101+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bfc073790 con 0x7f1bdc035db0 2024-09-13T06:33:31.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.145+0000 7f1bf37fe640 1 -- 172.21.15.112:0/1228277083 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662034 (secure 0 0 0) 0x7f1bfc073790 con 0x7f1bdc035db0 2024-09-13T06:33:31.152 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1bdc035db0 msgr2=0x7f1bdc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1bdc035db0 0x7f1bdc038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1be4001610 tx=0x7f1be4007ad0 comp rx=0 tx=0).stop 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 msgr2=0x7f1bfc128c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc128c50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1bf401a4f0 tx=0x7f1bf4019660 comp rx=0 tx=0).stop 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 shutdown_connections 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f1bdc035db0 0x7f1bdc038270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 --2- 172.21.15.112:0/1228277083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc06d0e0 0x7f1bfc128c50 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 >> 172.21.15.112:0/1228277083 conn(0x7f1bfc099a50 msgr2=0x7f1bfc1b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 shutdown_connections 2024-09-13T06:33:31.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:31.149+0000 7f1c012b8640 1 -- 172.21.15.112:0/1228277083 wait complete. 2024-09-13T06:33:31.174 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-09-13T06:33:30.528969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5100,"num_read_kb":4685,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4774,"ondisk_log_size":4774,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1787848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005932"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622855+0000","last_change":"2024-09-13T06:28:58.716560+0000","last_active":"2024-09-13T06:32:48.622855+0000","last_peered":"2024-09-13T06:32:48.622855+0000","last_clean":"2024-09-13T06:32:48.622855+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:32:48.622855+0000","last_undegraded":"2024-09-13T06:32:48.622855+0000","last_fullsized":"2024-09-13T06:32:48.622855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.071994+0000","last_change":"2024-09-13T06:33:29.072054+0000","last_active":"2024-09-13T06:33:29.071994+0000","last_peered":"2024-09-13T06:33:29.071994+0000","last_clean":"2024-09-13T06:33:29.071994+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:33:29.071994+0000","last_undegraded":"2024-09-13T06:33:29.071994+0000","last_fullsized":"2024-09-13T06:33:29.071994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:29.071796+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:29.071796+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.071796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:41.533368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085585+0000","last_change":"2024-09-13T06:28:58.727026+0000","last_active":"2024-09-13T06:32:49.085585+0000","last_peered":"2024-09-13T06:32:49.085585+0000","last_clean":"2024-09-13T06:32:49.085585+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:32:49.085585+0000","last_undegraded":"2024-09-13T06:32:49.085585+0000","last_fullsized":"2024-09-13T06:32:49.085585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.953235+0000","last_change":"2024-09-13T06:33:28.953296+0000","last_active":"2024-09-13T06:33:28.953235+0000","last_peered":"2024-09-13T06:33:28.953235+0000","last_clean":"2024-09-13T06:33:28.953235+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:33:28.953235+0000","last_undegraded":"2024-09-13T06:33:28.953235+0000","last_fullsized":"2024-09-13T06:33:28.953235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:28.953054+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:28.953054+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.953054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:07.494409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988465+0000","last_change":"2024-09-13T06:28:58.725541+0000","last_active":"2024-09-13T06:32:49.988465+0000","last_peered":"2024-09-13T06:32:49.988465+0000","last_clean":"2024-09-13T06:32:49.988465+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:32:49.988465+0000","last_undegraded":"2024-09-13T06:32:49.988465+0000","last_fullsized":"2024-09-13T06:32:49.988465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.118712+0000","last_change":"2024-09-13T06:29:00.707081+0000","last_active":"2024-09-13T06:32:14.118712+0000","last_peered":"2024-09-13T06:32:14.118712+0000","last_clean":"2024-09-13T06:32:14.118712+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:32:14.118712+0000","last_undegraded":"2024-09-13T06:32:14.118712+0000","last_fullsized":"2024-09-13T06:32:14.118712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.058932+0000","last_change":"2024-09-13T06:33:28.058989+0000","last_active":"2024-09-13T06:33:28.058932+0000","last_peered":"2024-09-13T06:33:28.058932+0000","last_clean":"2024-09-13T06:33:28.058932+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:33:28.058932+0000","last_undegraded":"2024-09-13T06:33:28.058932+0000","last_fullsized":"2024-09-13T06:33:28.058932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:28.058693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:28.058693+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.058693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:14.652930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495326+0000","last_change":"2024-09-13T06:29:00.707794+0000","last_active":"2024-09-13T06:31:30.495326+0000","last_peered":"2024-09-13T06:31:30.495326+0000","last_clean":"2024-09-13T06:31:30.495326+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:31:30.495326+0000","last_undegraded":"2024-09-13T06:31:30.495326+0000","last_fullsized":"2024-09-13T06:31:30.495326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497037+0000","last_change":"2024-09-13T06:28:58.707336+0000","last_active":"2024-09-13T06:31:29.497037+0000","last_peered":"2024-09-13T06:31:29.497037+0000","last_clean":"2024-09-13T06:31:29.497037+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:31:29.497037+0000","last_undegraded":"2024-09-13T06:31:29.497037+0000","last_fullsized":"2024-09-13T06:31:29.497037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.653904+0000","last_change":"2024-09-13T06:33:15.653971+0000","last_active":"2024-09-13T06:33:15.653904+0000","last_peered":"2024-09-13T06:33:15.653904+0000","last_clean":"2024-09-13T06:33:15.653904+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:33:15.653904+0000","last_undegraded":"2024-09-13T06:33:15.653904+0000","last_fullsized":"2024-09-13T06:33:15.653904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:15.653721+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:15.653721+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.653721+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:58.261366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497005+0000","last_change":"2024-09-13T06:28:58.734653+0000","last_active":"2024-09-13T06:31:29.497005+0000","last_peered":"2024-09-13T06:31:29.497005+0000","last_clean":"2024-09-13T06:31:29.497005+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:31:29.497005+0000","last_undegraded":"2024-09-13T06:31:29.497005+0000","last_fullsized":"2024-09-13T06:31:29.497005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.975152+0000","last_change":"2024-09-13T06:33:16.975268+0000","last_active":"2024-09-13T06:33:16.975152+0000","last_peered":"2024-09-13T06:33:16.975152+0000","last_clean":"2024-09-13T06:33:16.975152+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:33:16.975152+0000","last_undegraded":"2024-09-13T06:33:16.975152+0000","last_fullsized":"2024-09-13T06:33:16.975152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:16.974924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:16.974924+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.974924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:32.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495163+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:31:30.495163+0000","last_peered":"2024-09-13T06:31:30.495163+0000","last_clean":"2024-09-13T06:31:30.495163+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:31:30.495163+0000","last_undegraded":"2024-09-13T06:31:30.495163+0000","last_fullsized":"2024-09-13T06:31:30.495163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.944658+0000","last_change":"2024-09-13T06:33:15.944720+0000","last_active":"2024-09-13T06:33:15.944658+0000","last_peered":"2024-09-13T06:33:15.944658+0000","last_clean":"2024-09-13T06:33:15.944658+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:33:15.944658+0000","last_undegraded":"2024-09-13T06:33:15.944658+0000","last_fullsized":"2024-09-13T06:33:15.944658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:15.944444+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:15.944444+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.944444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:43.352704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495042+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:31:30.495042+0000","last_peered":"2024-09-13T06:31:30.495042+0000","last_clean":"2024-09-13T06:31:30.495042+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:31:30.495042+0000","last_undegraded":"2024-09-13T06:31:30.495042+0000","last_fullsized":"2024-09-13T06:31:30.495042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.112970+0000","last_change":"2024-09-13T06:33:11.113036+0000","last_active":"2024-09-13T06:33:11.112970+0000","last_peered":"2024-09-13T06:33:11.112970+0000","last_clean":"2024-09-13T06:33:11.112970+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:33:11.112970+0000","last_undegraded":"2024-09-13T06:33:11.112970+0000","last_fullsized":"2024-09-13T06:33:11.112970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:11.112754+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:11.112754+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.112754+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:55:36.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.587248+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:13.587248+0000","last_peered":"2024-09-13T06:32:13.587248+0000","last_clean":"2024-09-13T06:32:13.587248+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:13.587248+0000","last_undegraded":"2024-09-13T06:32:13.587248+0000","last_fullsized":"2024-09-13T06:32:13.587248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.836970+0000","last_change":"2024-09-13T06:33:27.837021+0000","last_active":"2024-09-13T06:33:27.836970+0000","last_peered":"2024-09-13T06:33:27.836970+0000","last_clean":"2024-09-13T06:33:27.836970+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:33:27.836970+0000","last_undegraded":"2024-09-13T06:33:27.836970+0000","last_fullsized":"2024-09-13T06:33:27.836970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:27.836778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:27.836778+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.836778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:55.245038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.996038+0000","last_change":"2024-09-13T06:33:17.996229+0000","last_active":"2024-09-13T06:33:17.996038+0000","last_peered":"2024-09-13T06:33:17.996038+0000","last_clean":"2024-09-13T06:33:17.996038+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:33:17.996038+0000","last_undegraded":"2024-09-13T06:33:17.996038+0000","last_fullsized":"2024-09-13T06:33:17.996038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:17.995815+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:17.995815+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.995815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:56.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.068460+0000","last_change":"2024-09-13T06:33:30.068513+0000","last_active":"2024-09-13T06:33:30.068460+0000","last_peered":"2024-09-13T06:33:30.068460+0000","last_clean":"2024-09-13T06:33:30.068460+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:33:30.068460+0000","last_undegraded":"2024-09-13T06:33:30.068460+0000","last_fullsized":"2024-09-13T06:33:30.068460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:30.068258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:30.068258+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.068258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:55.393231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.795535+0000","last_change":"2024-09-13T06:29:00.714209+0000","last_active":"2024-09-13T06:32:13.795535+0000","last_peered":"2024-09-13T06:32:13.795535+0000","last_clean":"2024-09-13T06:32:13.795535+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:32:13.795535+0000","last_undegraded":"2024-09-13T06:32:13.795535+0000","last_fullsized":"2024-09-13T06:32:13.795535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:24.495825+0000","last_change":"2024-09-13T06:28:58.735019+0000","last_active":"2024-09-13T06:31:24.495825+0000","last_peered":"2024-09-13T06:31:24.495825+0000","last_clean":"2024-09-13T06:31:24.495825+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:31:24.495825+0000","last_undegraded":"2024-09-13T06:31:24.495825+0000","last_fullsized":"2024-09-13T06:31:24.495825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.253118+0000","last_change":"2024-09-13T06:33:07.253201+0000","last_active":"2024-09-13T06:33:07.253118+0000","last_peered":"2024-09-13T06:33:07.253118+0000","last_clean":"2024-09-13T06:33:07.253118+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:33:07.253118+0000","last_undegraded":"2024-09-13T06:33:07.253118+0000","last_fullsized":"2024-09-13T06:33:07.253118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:07.252909+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:07.252909+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.252909+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:11.908729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:24.495729+0000","last_change":"2024-09-13T06:28:58.714709+0000","last_active":"2024-09-13T06:31:24.495729+0000","last_peered":"2024-09-13T06:31:24.495729+0000","last_clean":"2024-09-13T06:31:24.495729+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:31:24.495729+0000","last_undegraded":"2024-09-13T06:31:24.495729+0000","last_fullsized":"2024-09-13T06:31:24.495729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.148008+0000","last_change":"2024-09-13T06:33:10.148134+0000","last_active":"2024-09-13T06:33:10.148008+0000","last_peered":"2024-09-13T06:33:10.148008+0000","last_clean":"2024-09-13T06:33:10.148008+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:33:10.148008+0000","last_undegraded":"2024-09-13T06:33:10.148008+0000","last_fullsized":"2024-09-13T06:33:10.148008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:10.147709+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:10.147709+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.147709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.231738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493916+0000","last_change":"2024-09-13T06:28:58.710981+0000","last_active":"2024-09-13T06:31:25.493916+0000","last_peered":"2024-09-13T06:31:25.493916+0000","last_clean":"2024-09-13T06:31:25.493916+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:31:25.493916+0000","last_undegraded":"2024-09-13T06:31:25.493916+0000","last_fullsized":"2024-09-13T06:31:25.493916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.905447+0000","last_change":"2024-09-13T06:29:00.726304+0000","last_active":"2024-09-13T06:32:13.905447+0000","last_peered":"2024-09-13T06:32:13.905447+0000","last_clean":"2024-09-13T06:32:13.905447+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:32:13.905447+0000","last_undegraded":"2024-09-13T06:32:13.905447+0000","last_fullsized":"2024-09-13T06:32:13.905447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492167+0000","last_change":"2024-09-13T06:28:58.725296+0000","last_active":"2024-09-13T06:31:20.492167+0000","last_peered":"2024-09-13T06:31:20.492167+0000","last_clean":"2024-09-13T06:31:20.492167+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:31:20.492167+0000","last_undegraded":"2024-09-13T06:31:20.492167+0000","last_fullsized":"2024-09-13T06:31:20.492167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.009354+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:14.009354+0000","last_peered":"2024-09-13T06:32:14.009354+0000","last_clean":"2024-09-13T06:32:14.009354+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:14.009354+0000","last_undegraded":"2024-09-13T06:32:14.009354+0000","last_fullsized":"2024-09-13T06:32:14.009354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.904866+0000","last_change":"2024-09-13T06:33:22.905011+0000","last_active":"2024-09-13T06:33:22.904866+0000","last_peered":"2024-09-13T06:33:22.904866+0000","last_clean":"2024-09-13T06:33:22.904866+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:33:22.904866+0000","last_undegraded":"2024-09-13T06:33:22.904866+0000","last_fullsized":"2024-09-13T06:33:22.904866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:22.904618+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:22.904618+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.904618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:50:01.871288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492288+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:31:20.492288+0000","last_peered":"2024-09-13T06:31:20.492288+0000","last_clean":"2024-09-13T06:31:20.492288+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:31:20.492288+0000","last_undegraded":"2024-09-13T06:31:20.492288+0000","last_fullsized":"2024-09-13T06:31:20.492288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.834815+0000","last_change":"2024-09-13T06:33:11.834872+0000","last_active":"2024-09-13T06:33:11.834815+0000","last_peered":"2024-09-13T06:33:11.834815+0000","last_clean":"2024-09-13T06:33:11.834815+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:33:11.834815+0000","last_undegraded":"2024-09-13T06:33:11.834815+0000","last_fullsized":"2024-09-13T06:33:11.834815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:11.834596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:11.834596+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.834596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:06.219464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.894997+0000","last_change":"2024-09-13T06:33:04.895065+0000","last_active":"2024-09-13T06:33:04.894997+0000","last_peered":"2024-09-13T06:33:04.894997+0000","last_clean":"2024-09-13T06:33:04.894997+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:33:04.894997+0000","last_undegraded":"2024-09-13T06:33:04.894997+0000","last_fullsized":"2024-09-13T06:33:04.894997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.894816+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:27.810903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.054401+0000","last_change":"2024-09-13T06:33:23.054454+0000","last_active":"2024-09-13T06:33:23.054401+0000","last_peered":"2024-09-13T06:33:23.054401+0000","last_clean":"2024-09-13T06:33:23.054401+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:33:23.054401+0000","last_undegraded":"2024-09-13T06:33:23.054401+0000","last_fullsized":"2024-09-13T06:33:23.054401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:23.054208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:23.054208+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.054208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:28.175323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498132+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:31:34.498132+0000","last_peered":"2024-09-13T06:31:34.498132+0000","last_clean":"2024-09-13T06:31:34.498132+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:31:34.498132+0000","last_undegraded":"2024-09-13T06:31:34.498132+0000","last_fullsized":"2024-09-13T06:31:34.498132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.434487+0000","last_change":"2024-09-13T06:29:00.707011+0000","last_active":"2024-09-13T06:32:13.434487+0000","last_peered":"2024-09-13T06:32:13.434487+0000","last_clean":"2024-09-13T06:32:13.434487+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:32:13.434487+0000","last_undegraded":"2024-09-13T06:32:13.434487+0000","last_fullsized":"2024-09-13T06:32:13.434487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.069328+0000","last_change":"2024-09-13T06:33:29.069387+0000","last_active":"2024-09-13T06:33:29.069328+0000","last_peered":"2024-09-13T06:33:29.069328+0000","last_clean":"2024-09-13T06:33:29.069328+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:33:29.069328+0000","last_undegraded":"2024-09-13T06:33:29.069328+0000","last_fullsized":"2024-09-13T06:33:29.069328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:29.069109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:29.069109+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.069109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:06.525435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":234,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.805421+0000","last_change":"2024-09-13T06:33:15.805487+0000","last_active":"2024-09-13T06:33:15.805421+0000","last_peered":"2024-09-13T06:33:15.805421+0000","last_clean":"2024-09-13T06:33:15.805421+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:33:15.805421+0000","last_undegraded":"2024-09-13T06:33:15.805421+0000","last_fullsized":"2024-09-13T06:33:15.805421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:15.805232+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:15.805232+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.805232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:47.324786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.637045+0000","last_change":"2024-09-13T06:33:03.637131+0000","last_active":"2024-09-13T06:33:03.637045+0000","last_peered":"2024-09-13T06:33:03.637045+0000","last_clean":"2024-09-13T06:33:03.637045+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:33:03.637045+0000","last_undegraded":"2024-09-13T06:33:03.637045+0000","last_fullsized":"2024-09-13T06:33:03.637045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.636833+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:45.356483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.925817+0000","last_change":"2024-09-13T06:33:10.925869+0000","last_active":"2024-09-13T06:33:10.925817+0000","last_peered":"2024-09-13T06:33:10.925817+0000","last_clean":"2024-09-13T06:33:10.925817+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:33:10.925817+0000","last_undegraded":"2024-09-13T06:33:10.925817+0000","last_fullsized":"2024-09-13T06:33:10.925817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:10.925618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:10.925618+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.925618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:42.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.497745+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:31:40.497745+0000","last_peered":"2024-09-13T06:31:40.497745+0000","last_clean":"2024-09-13T06:31:40.497745+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:31:40.497745+0000","last_undegraded":"2024-09-13T06:31:40.497745+0000","last_fullsized":"2024-09-13T06:31:40.497745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.922790+0000","last_change":"2024-09-13T06:33:26.922941+0000","last_active":"2024-09-13T06:33:26.922790+0000","last_peered":"2024-09-13T06:33:26.922790+0000","last_clean":"2024-09-13T06:33:26.922790+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:33:26.922790+0000","last_undegraded":"2024-09-13T06:33:26.922790+0000","last_fullsized":"2024-09-13T06:33:26.922790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T06:33:26.922557+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.922557+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.922557+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:01.027984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494332+0000","last_change":"2024-09-13T06:28:58.716607+0000","last_active":"2024-09-13T06:31:19.494332+0000","last_peered":"2024-09-13T06:31:19.494332+0000","last_clean":"2024-09-13T06:31:19.494332+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:31:19.494332+0000","last_undegraded":"2024-09-13T06:31:19.494332+0000","last_fullsized":"2024-09-13T06:31:19.494332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.848302+0000","last_change":"2024-09-13T06:32:56.848353+0000","last_active":"2024-09-13T06:32:56.848302+0000","last_peered":"2024-09-13T06:32:56.848302+0000","last_clean":"2024-09-13T06:32:56.848302+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:32:56.848302+0000","last_undegraded":"2024-09-13T06:32:56.848302+0000","last_fullsized":"2024-09-13T06:32:56.848302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.848110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:46.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'16","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.240901+0000","last_change":"2024-09-13T06:33:03.240975+0000","last_active":"2024-09-13T06:33:03.240901+0000","last_peered":"2024-09-13T06:33:03.240901+0000","last_clean":"2024-09-13T06:33:03.240901+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:33:03.240901+0000","last_undegraded":"2024-09-13T06:33:03.240901+0000","last_fullsized":"2024-09-13T06:33:03.240901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.240667+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:49.440163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.778213+0000","last_change":"2024-09-13T06:33:01.778272+0000","last_active":"2024-09-13T06:33:01.778213+0000","last_peered":"2024-09-13T06:33:01.778213+0000","last_clean":"2024-09-13T06:33:01.778213+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:33:01.778213+0000","last_undegraded":"2024-09-13T06:33:01.778213+0000","last_fullsized":"2024-09-13T06:33:01.778213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.777993+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:14.895259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'3","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.159993+0000","last_change":"2024-09-13T06:32:50.160119+0000","last_active":"2024-09-13T06:32:50.159993+0000","last_peered":"2024-09-13T06:32:50.159993+0000","last_clean":"2024-09-13T06:32:50.159993+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:50.159993+0000","last_undegraded":"2024-09-13T06:32:50.159993+0000","last_fullsized":"2024-09-13T06:32:50.159993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.159726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:36:19.505279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.839473+0000","last_change":"2024-09-13T06:33:16.839536+0000","last_active":"2024-09-13T06:33:16.839473+0000","last_peered":"2024-09-13T06:33:16.839473+0000","last_clean":"2024-09-13T06:33:16.839473+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:33:16.839473+0000","last_undegraded":"2024-09-13T06:33:16.839473+0000","last_fullsized":"2024-09-13T06:33:16.839473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:16.839234+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:16.839234+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.839234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:56.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494247+0000","last_change":"2024-09-13T06:28:58.715013+0000","last_active":"2024-09-13T06:31:19.494247+0000","last_peered":"2024-09-13T06:31:19.494247+0000","last_clean":"2024-09-13T06:31:19.494247+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:31:19.494247+0000","last_undegraded":"2024-09-13T06:31:19.494247+0000","last_fullsized":"2024-09-13T06:31:19.494247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.951734+0000","last_change":"2024-09-13T06:33:12.951791+0000","last_active":"2024-09-13T06:33:12.951734+0000","last_peered":"2024-09-13T06:33:12.951734+0000","last_clean":"2024-09-13T06:33:12.951734+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:33:12.951734+0000","last_undegraded":"2024-09-13T06:33:12.951734+0000","last_fullsized":"2024-09-13T06:33:12.951734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.951537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.951537+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.951537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:01.784492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.920916+0000","last_change":"2024-09-13T06:33:09.920987+0000","last_active":"2024-09-13T06:33:09.920916+0000","last_peered":"2024-09-13T06:33:09.920916+0000","last_clean":"2024-09-13T06:33:09.920916+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:33:09.920916+0000","last_undegraded":"2024-09-13T06:33:09.920916+0000","last_fullsized":"2024-09-13T06:33:09.920916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:09.920723+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:09.920723+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.920723+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:18:43.608859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.878020+0000","last_change":"2024-09-13T06:33:09.878079+0000","last_active":"2024-09-13T06:33:09.878020+0000","last_peered":"2024-09-13T06:33:09.878020+0000","last_clean":"2024-09-13T06:33:09.878020+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:33:09.878020+0000","last_undegraded":"2024-09-13T06:33:09.878020+0000","last_fullsized":"2024-09-13T06:33:09.878020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:09.877840+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:09.877840+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.877840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:33.591992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.984448+0000","last_change":"2024-09-13T06:29:39.532873+0000","last_active":"2024-09-13T06:32:13.984448+0000","last_peered":"2024-09-13T06:32:13.984448+0000","last_clean":"2024-09-13T06:32:13.984448+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:32:13.984448+0000","last_undegraded":"2024-09-13T06:32:13.984448+0000","last_fullsized":"2024-09-13T06:32:13.984448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622664+0000","last_change":"2024-09-13T06:28:58.715791+0000","last_active":"2024-09-13T06:32:48.622664+0000","last_peered":"2024-09-13T06:32:48.622664+0000","last_clean":"2024-09-13T06:32:48.622664+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:32:48.622664+0000","last_undegraded":"2024-09-13T06:32:48.622664+0000","last_fullsized":"2024-09-13T06:32:48.622664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.602144+0000","last_change":"2024-09-13T06:33:05.602144+0000","last_active":"2024-09-13T06:33:05.602144+0000","last_peered":"2024-09-13T06:33:05.602144+0000","last_clean":"2024-09-13T06:33:05.602144+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:33:05.602144+0000","last_undegraded":"2024-09-13T06:33:05.602144+0000","last_fullsized":"2024-09-13T06:33:05.602144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:05.601881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:05.601881+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.601881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:26.049665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'52","reported_seq":117,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.790158+0000","last_change":"2024-09-13T06:32:50.790158+0000","last_active":"2024-09-13T06:32:50.790158+0000","last_peered":"2024-09-13T06:32:50.790158+0000","last_clean":"2024-09-13T06:32:50.790158+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:32:50.790158+0000","last_undegraded":"2024-09-13T06:32:50.790158+0000","last_fullsized":"2024-09-13T06:32:50.790158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'52","last_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_deep_scrub":"35'52","last_deep_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.789873+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:31.896380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.587545+0000","last_change":"2024-09-13T06:32:56.587596+0000","last_active":"2024-09-13T06:32:56.587545+0000","last_peered":"2024-09-13T06:32:56.587545+0000","last_clean":"2024-09-13T06:32:56.587545+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:32:56.587545+0000","last_undegraded":"2024-09-13T06:32:56.587545+0000","last_fullsized":"2024-09-13T06:32:56.587545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.587340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:07:15.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.545765+0000","last_change":"2024-09-13T06:29:08.791498+0000","last_active":"2024-09-13T06:32:49.545765+0000","last_peered":"2024-09-13T06:32:49.545765+0000","last_clean":"2024-09-13T06:32:49.545765+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:32:49.545765+0000","last_undegraded":"2024-09-13T06:32:49.545765+0000","last_fullsized":"2024-09-13T06:32:49.545765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'25","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085719+0000","last_change":"2024-09-13T06:29:00.726697+0000","last_active":"2024-09-13T06:32:49.085719+0000","last_peered":"2024-09-13T06:32:49.085719+0000","last_clean":"2024-09-13T06:32:49.085719+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:32:49.085719+0000","last_undegraded":"2024-09-13T06:32:49.085719+0000","last_fullsized":"2024-09-13T06:32:49.085719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622588+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:32:48.622588+0000","last_peered":"2024-09-13T06:32:48.622588+0000","last_clean":"2024-09-13T06:32:48.622588+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:32:48.622588+0000","last_undegraded":"2024-09-13T06:32:48.622588+0000","last_fullsized":"2024-09-13T06:32:48.622588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.545632+0000","last_change":"2024-09-13T06:29:02.724597+0000","last_active":"2024-09-13T06:32:49.545632+0000","last_peered":"2024-09-13T06:32:49.545632+0000","last_clean":"2024-09-13T06:32:49.545632+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:32:49.545632+0000","last_undegraded":"2024-09-13T06:32:49.545632+0000","last_fullsized":"2024-09-13T06:32:49.545632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.915695+0000","last_change":"2024-09-13T06:33:07.915760+0000","last_active":"2024-09-13T06:33:07.915695+0000","last_peered":"2024-09-13T06:33:07.915695+0000","last_clean":"2024-09-13T06:33:07.915695+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:33:07.915695+0000","last_undegraded":"2024-09-13T06:33:07.915695+0000","last_fullsized":"2024-09-13T06:33:07.915695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:07.915512+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:07.915512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.915512+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:06.613007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.875693+0000","last_change":"2024-09-13T06:33:02.875693+0000","last_active":"2024-09-13T06:33:02.875693+0000","last_peered":"2024-09-13T06:33:02.875693+0000","last_clean":"2024-09-13T06:33:02.875693+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:33:02.875693+0000","last_undegraded":"2024-09-13T06:33:02.875693+0000","last_fullsized":"2024-09-13T06:33:02.875693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.875433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:23.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"35'4","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.634982+0000","last_change":"2024-09-13T06:33:06.634982+0000","last_active":"2024-09-13T06:33:06.634982+0000","last_peered":"2024-09-13T06:33:06.634982+0000","last_clean":"2024-09-13T06:33:06.634982+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:33:06.634982+0000","last_undegraded":"2024-09-13T06:33:06.634982+0000","last_fullsized":"2024-09-13T06:33:06.634982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:06.634723+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:06.634723+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.634723+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:25.705695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.013201+0000","last_change":"2024-09-13T06:33:22.013201+0000","last_active":"2024-09-13T06:33:22.013201+0000","last_peered":"2024-09-13T06:33:22.013201+0000","last_clean":"2024-09-13T06:33:22.013201+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:33:22.013201+0000","last_undegraded":"2024-09-13T06:33:22.013201+0000","last_fullsized":"2024-09-13T06:33:22.013201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:22.012950+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:22.012950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.012950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:56.118377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622756+0000","last_change":"2024-09-13T06:28:58.734667+0000","last_active":"2024-09-13T06:32:48.622756+0000","last_peered":"2024-09-13T06:32:48.622756+0000","last_clean":"2024-09-13T06:32:48.622756+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:32:48.622756+0000","last_undegraded":"2024-09-13T06:32:48.622756+0000","last_fullsized":"2024-09-13T06:32:48.622756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.061645+0000","last_change":"2024-09-13T06:33:21.061702+0000","last_active":"2024-09-13T06:33:21.061645+0000","last_peered":"2024-09-13T06:33:21.061645+0000","last_clean":"2024-09-13T06:33:21.061645+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:33:21.061645+0000","last_undegraded":"2024-09-13T06:33:21.061645+0000","last_fullsized":"2024-09-13T06:33:21.061645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:21.061418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:21.061418+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.061418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:06.847057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.700748+0000","last_change":"2024-09-13T06:32:52.700748+0000","last_active":"2024-09-13T06:32:52.700748+0000","last_peered":"2024-09-13T06:32:52.700748+0000","last_clean":"2024-09-13T06:32:52.700748+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:32:52.700748+0000","last_undegraded":"2024-09-13T06:32:52.700748+0000","last_fullsized":"2024-09-13T06:32:52.700748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.700351+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.206602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":366,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.207721+0000","last_change":"2024-09-13T06:32:52.207721+0000","last_active":"2024-09-13T06:32:52.207721+0000","last_peered":"2024-09-13T06:32:52.207721+0000","last_clean":"2024-09-13T06:32:52.207721+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:52.207721+0000","last_undegraded":"2024-09-13T06:32:52.207721+0000","last_fullsized":"2024-09-13T06:32:52.207721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.207476+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:15:03.889652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.619884+0000","last_change":"2024-09-13T06:33:14.619884+0000","last_active":"2024-09-13T06:33:14.619884+0000","last_peered":"2024-09-13T06:33:14.619884+0000","last_clean":"2024-09-13T06:33:14.619884+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:33:14.619884+0000","last_undegraded":"2024-09-13T06:33:14.619884+0000","last_fullsized":"2024-09-13T06:33:14.619884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.619652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.619652+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.619652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:27.736918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.135567+0000","last_change":"2024-09-13T06:33:13.135567+0000","last_active":"2024-09-13T06:33:13.135567+0000","last_peered":"2024-09-13T06:33:13.135567+0000","last_clean":"2024-09-13T06:33:13.135567+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:33:13.135567+0000","last_undegraded":"2024-09-13T06:33:13.135567+0000","last_fullsized":"2024-09-13T06:33:13.135567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:13.135326+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:13.135326+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.135326+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622484+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:32:48.622484+0000","last_peered":"2024-09-13T06:32:48.622484+0000","last_clean":"2024-09-13T06:32:48.622484+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:32:48.622484+0000","last_undegraded":"2024-09-13T06:32:48.622484+0000","last_fullsized":"2024-09-13T06:32:48.622484+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.223643+0000","last_change":"2024-09-13T06:33:04.223643+0000","last_active":"2024-09-13T06:33:04.223643+0000","last_peered":"2024-09-13T06:33:04.223643+0000","last_clean":"2024-09-13T06:33:04.223643+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:33:04.223643+0000","last_undegraded":"2024-09-13T06:33:04.223643+0000","last_fullsized":"2024-09-13T06:33:04.223643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.223407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:38.136551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'64","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.859700+0000","last_change":"2024-09-13T06:32:54.859700+0000","last_active":"2024-09-13T06:32:54.859700+0000","last_peered":"2024-09-13T06:32:54.859700+0000","last_clean":"2024-09-13T06:32:54.859700+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:32:54.859700+0000","last_undegraded":"2024-09-13T06:32:54.859700+0000","last_fullsized":"2024-09-13T06:32:54.859700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'64","last_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_deep_scrub":"35'64","last_deep_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.859285+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:01.758392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.285702+0000","last_change":"2024-09-13T06:32:59.285702+0000","last_active":"2024-09-13T06:32:59.285702+0000","last_peered":"2024-09-13T06:32:59.285702+0000","last_clean":"2024-09-13T06:32:59.285702+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:32:59.285702+0000","last_undegraded":"2024-09-13T06:32:59.285702+0000","last_fullsized":"2024-09-13T06:32:59.285702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.285313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:24.231597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.087324+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:49.087324+0000","last_peered":"2024-09-13T06:32:49.087324+0000","last_clean":"2024-09-13T06:32:49.087324+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:49.087324+0000","last_undegraded":"2024-09-13T06:32:49.087324+0000","last_fullsized":"2024-09-13T06:32:49.087324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.739584+0000","last_change":"2024-09-13T06:33:21.739584+0000","last_active":"2024-09-13T06:33:21.739584+0000","last_peered":"2024-09-13T06:33:21.739584+0000","last_clean":"2024-09-13T06:33:21.739584+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:33:21.739584+0000","last_undegraded":"2024-09-13T06:33:21.739584+0000","last_fullsized":"2024-09-13T06:33:21.739584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:21.739350+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:21.739350+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.739350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.637065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987763+0000","last_change":"2024-09-13T06:28:58.719722+0000","last_active":"2024-09-13T06:32:49.987763+0000","last_peered":"2024-09-13T06:32:49.987763+0000","last_clean":"2024-09-13T06:32:49.987763+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:32:49.987763+0000","last_undegraded":"2024-09-13T06:32:49.987763+0000","last_fullsized":"2024-09-13T06:32:49.987763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.082598+0000","last_change":"2024-09-13T06:33:17.082652+0000","last_active":"2024-09-13T06:33:17.082598+0000","last_peered":"2024-09-13T06:33:17.082598+0000","last_clean":"2024-09-13T06:33:17.082598+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:33:17.082598+0000","last_undegraded":"2024-09-13T06:33:17.082598+0000","last_fullsized":"2024-09-13T06:33:17.082598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:17.082403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:17.082403+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.082403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:38:22.197973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.766256+0000","last_change":"2024-09-13T06:32:48.766296+0000","last_active":"2024-09-13T06:32:48.766256+0000","last_peered":"2024-09-13T06:32:48.766256+0000","last_clean":"2024-09-13T06:32:48.766256+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:32:48.766256+0000","last_undegraded":"2024-09-13T06:32:48.766256+0000","last_fullsized":"2024-09-13T06:32:48.766256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_clean_scrub_stamp":"2024-09-13T06:32:48.766165+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:25.779327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.914243+0000","last_change":"2024-09-13T06:33:05.914294+0000","last_active":"2024-09-13T06:33:05.914243+0000","last_peered":"2024-09-13T06:33:05.914243+0000","last_clean":"2024-09-13T06:33:05.914243+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:33:05.914243+0000","last_undegraded":"2024-09-13T06:33:05.914243+0000","last_fullsized":"2024-09-13T06:33:05.914243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:05.914013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:05.914013+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.914013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.141026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.922077+0000","last_change":"2024-09-13T06:33:29.922140+0000","last_active":"2024-09-13T06:33:29.922077+0000","last_peered":"2024-09-13T06:33:29.922077+0000","last_clean":"2024-09-13T06:33:29.922077+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:33:29.922077+0000","last_undegraded":"2024-09-13T06:33:29.922077+0000","last_fullsized":"2024-09-13T06:33:29.922077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:29.921858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:29.921858+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.921858+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:48.275561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494558+0000","last_change":"2024-09-13T06:29:00.714668+0000","last_active":"2024-09-13T06:31:19.494558+0000","last_peered":"2024-09-13T06:31:19.494558+0000","last_clean":"2024-09-13T06:31:19.494558+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:31:19.494558+0000","last_undegraded":"2024-09-13T06:31:19.494558+0000","last_fullsized":"2024-09-13T06:31:19.494558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622656+0000","last_change":"2024-09-13T06:28:58.716633+0000","last_active":"2024-09-13T06:32:48.622656+0000","last_peered":"2024-09-13T06:32:48.622656+0000","last_clean":"2024-09-13T06:32:48.622656+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:32:48.622656+0000","last_undegraded":"2024-09-13T06:32:48.622656+0000","last_fullsized":"2024-09-13T06:32:48.622656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.582463+0000","last_change":"2024-09-13T06:33:08.582513+0000","last_active":"2024-09-13T06:33:08.582463+0000","last_peered":"2024-09-13T06:33:08.582463+0000","last_clean":"2024-09-13T06:33:08.582463+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:33:08.582463+0000","last_undegraded":"2024-09-13T06:33:08.582463+0000","last_fullsized":"2024-09-13T06:33:08.582463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:08.582269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:08.582269+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.582269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:12.495423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.303390+0000","last_change":"2024-09-13T06:33:00.303475+0000","last_active":"2024-09-13T06:33:00.303390+0000","last_peered":"2024-09-13T06:33:00.303390+0000","last_clean":"2024-09-13T06:33:00.303390+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:33:00.303390+0000","last_undegraded":"2024-09-13T06:33:00.303390+0000","last_fullsized":"2024-09-13T06:33:00.303390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.303147+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:58.846618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":420,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.270651+0000","last_change":"2024-09-13T06:32:58.270712+0000","last_active":"2024-09-13T06:32:58.270651+0000","last_peered":"2024-09-13T06:32:58.270651+0000","last_clean":"2024-09-13T06:32:58.270651+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:58.270651+0000","last_undegraded":"2024-09-13T06:32:58.270651+0000","last_fullsized":"2024-09-13T06:32:58.270651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.270455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:12.264581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'15","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.561385+0000","last_change":"2024-09-13T06:33:10.561385+0000","last_active":"2024-09-13T06:33:10.561385+0000","last_peered":"2024-09-13T06:33:10.561385+0000","last_clean":"2024-09-13T06:33:10.561385+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:33:10.561385+0000","last_undegraded":"2024-09-13T06:33:10.561385+0000","last_fullsized":"2024-09-13T06:33:10.561385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:33:10.561099+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:33:10.561099+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.561099+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:30.846539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.087093+0000","last_change":"2024-09-13T06:33:12.087093+0000","last_active":"2024-09-13T06:33:12.087093+0000","last_peered":"2024-09-13T06:33:12.087093+0000","last_clean":"2024-09-13T06:33:12.087093+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:33:12.087093+0000","last_undegraded":"2024-09-13T06:33:12.087093+0000","last_fullsized":"2024-09-13T06:33:12.087093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:12.086827+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:12.086827+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.086827+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:09.434984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987727+0000","last_change":"2024-09-13T06:28:58.720215+0000","last_active":"2024-09-13T06:32:49.987727+0000","last_peered":"2024-09-13T06:32:49.987727+0000","last_clean":"2024-09-13T06:32:49.987727+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:32:49.987727+0000","last_undegraded":"2024-09-13T06:32:49.987727+0000","last_fullsized":"2024-09-13T06:32:49.987727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":433,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.124492+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:32:45.124492+0000","last_peered":"2024-09-13T06:32:45.124492+0000","last_clean":"2024-09-13T06:32:45.124492+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:32:45.124492+0000","last_undegraded":"2024-09-13T06:32:45.124492+0000","last_fullsized":"2024-09-13T06:32:45.124492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.883473+0000","last_change":"2024-09-13T06:32:52.883556+0000","last_active":"2024-09-13T06:32:52.883473+0000","last_peered":"2024-09-13T06:32:52.883473+0000","last_clean":"2024-09-13T06:32:52.883473+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:32:52.883473+0000","last_undegraded":"2024-09-13T06:32:52.883473+0000","last_fullsized":"2024-09-13T06:32:52.883473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.883251+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:35.305885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":482,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.772355+0000","last_change":"2024-09-13T06:33:00.772503+0000","last_active":"2024-09-13T06:33:00.772355+0000","last_peered":"2024-09-13T06:33:00.772355+0000","last_clean":"2024-09-13T06:33:00.772355+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:33:00.772355+0000","last_undegraded":"2024-09-13T06:33:00.772355+0000","last_fullsized":"2024-09-13T06:33:00.772355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.772062+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:06.999075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.545885+0000","last_change":"2024-09-13T06:29:08.792692+0000","last_active":"2024-09-13T06:32:49.545885+0000","last_peered":"2024-09-13T06:32:49.545885+0000","last_clean":"2024-09-13T06:32:49.545885+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:32:49.545885+0000","last_undegraded":"2024-09-13T06:32:49.545885+0000","last_fullsized":"2024-09-13T06:32:49.545885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.640866+0000","last_change":"2024-09-13T06:33:16.640866+0000","last_active":"2024-09-13T06:33:16.640866+0000","last_peered":"2024-09-13T06:33:16.640866+0000","last_clean":"2024-09-13T06:33:16.640866+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:33:16.640866+0000","last_undegraded":"2024-09-13T06:33:16.640866+0000","last_fullsized":"2024-09-13T06:33:16.640866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:16.640589+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:16.640589+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.640589+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:17:00.531843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988039+0000","last_change":"2024-09-13T06:28:58.719501+0000","last_active":"2024-09-13T06:32:49.988039+0000","last_peered":"2024-09-13T06:32:49.988039+0000","last_clean":"2024-09-13T06:32:49.988039+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:32:49.988039+0000","last_undegraded":"2024-09-13T06:32:49.988039+0000","last_fullsized":"2024-09-13T06:32:49.988039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.787505+0000","last_change":"2024-09-13T06:33:12.787639+0000","last_active":"2024-09-13T06:33:12.787505+0000","last_peered":"2024-09-13T06:33:12.787505+0000","last_clean":"2024-09-13T06:33:12.787505+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:33:12.787505+0000","last_undegraded":"2024-09-13T06:33:12.787505+0000","last_fullsized":"2024-09-13T06:33:12.787505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.787273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.787273+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.787273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:37:33.223408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.873933+0000","last_change":"2024-09-13T06:33:07.874009+0000","last_active":"2024-09-13T06:33:07.873933+0000","last_peered":"2024-09-13T06:33:07.873933+0000","last_clean":"2024-09-13T06:33:07.873933+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:33:07.873933+0000","last_undegraded":"2024-09-13T06:33:07.873933+0000","last_fullsized":"2024-09-13T06:33:07.873933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.873746+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:28.536287+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.843252+0000","last_change":"2024-09-13T06:33:06.843311+0000","last_active":"2024-09-13T06:33:06.843252+0000","last_peered":"2024-09-13T06:33:06.843252+0000","last_clean":"2024-09-13T06:33:06.843252+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:33:06.843252+0000","last_undegraded":"2024-09-13T06:33:06.843252+0000","last_fullsized":"2024-09-13T06:33:06.843252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.843049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:01.227917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.680373+0000","last_change":"2024-09-13T06:33:02.680373+0000","last_active":"2024-09-13T06:33:02.680373+0000","last_peered":"2024-09-13T06:33:02.680373+0000","last_clean":"2024-09-13T06:33:02.680373+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:33:02.680373+0000","last_undegraded":"2024-09-13T06:33:02.680373+0000","last_fullsized":"2024-09-13T06:33:02.680373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.680110+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:47.873890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.996699+0000","last_change":"2024-09-13T06:33:19.996757+0000","last_active":"2024-09-13T06:33:19.996699+0000","last_peered":"2024-09-13T06:33:19.996699+0000","last_clean":"2024-09-13T06:33:19.996699+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:33:19.996699+0000","last_undegraded":"2024-09-13T06:33:19.996699+0000","last_fullsized":"2024-09-13T06:33:19.996699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:19.996506+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:19.996506+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.996506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:32.959583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085357+0000","last_change":"2024-09-13T06:28:48.280514+0000","last_active":"2024-09-13T06:32:49.085357+0000","last_peered":"2024-09-13T06:32:49.085357+0000","last_clean":"2024-09-13T06:32:49.085357+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:32:49.085357+0000","last_undegraded":"2024-09-13T06:32:49.085357+0000","last_fullsized":"2024-09-13T06:32:49.085357+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:46.906198+0000","last_clean_scrub_stamp":"2024-09-13T06:28:46.906198+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622346+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:32:48.622346+0000","last_peered":"2024-09-13T06:32:48.622346+0000","last_clean":"2024-09-13T06:32:48.622346+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:32:48.622346+0000","last_undegraded":"2024-09-13T06:32:48.622346+0000","last_fullsized":"2024-09-13T06:32:48.622346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987769+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:32:49.987769+0000","last_peered":"2024-09-13T06:32:49.987769+0000","last_clean":"2024-09-13T06:32:49.987769+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:32:49.987769+0000","last_undegraded":"2024-09-13T06:32:49.987769+0000","last_fullsized":"2024-09-13T06:32:49.987769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.600470+0000","last_change":"2024-09-13T06:33:12.600470+0000","last_active":"2024-09-13T06:33:12.600470+0000","last_peered":"2024-09-13T06:33:12.600470+0000","last_clean":"2024-09-13T06:33:12.600470+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:33:12.600470+0000","last_undegraded":"2024-09-13T06:33:12.600470+0000","last_fullsized":"2024-09-13T06:33:12.600470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.600063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.600063+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.600063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:35.516149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'87","reported_seq":182,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.822144+0000","last_change":"2024-09-13T06:33:04.822144+0000","last_active":"2024-09-13T06:33:04.822144+0000","last_peered":"2024-09-13T06:33:04.822144+0000","last_clean":"2024-09-13T06:33:04.822144+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:33:04.822144+0000","last_undegraded":"2024-09-13T06:33:04.822144+0000","last_fullsized":"2024-09-13T06:33:04.822144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'87","last_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_deep_scrub":"35'87","last_deep_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.821761+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:28.535913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.856678+0000","last_change":"2024-09-13T06:33:17.856678+0000","last_active":"2024-09-13T06:33:17.856678+0000","last_peered":"2024-09-13T06:33:17.856678+0000","last_clean":"2024-09-13T06:33:17.856678+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:33:17.856678+0000","last_undegraded":"2024-09-13T06:33:17.856678+0000","last_fullsized":"2024-09-13T06:33:17.856678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:17.856435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:17.856435+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.856435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:06.689390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.252336+0000","last_change":"2024-09-13T06:33:05.252336+0000","last_active":"2024-09-13T06:33:05.252336+0000","last_peered":"2024-09-13T06:33:05.252336+0000","last_clean":"2024-09-13T06:33:05.252336+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:33:05.252336+0000","last_undegraded":"2024-09-13T06:33:05.252336+0000","last_fullsized":"2024-09-13T06:33:05.252336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.252089+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:32.271264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.883826+0000","last_change":"2024-09-13T06:33:19.883826+0000","last_active":"2024-09-13T06:33:19.883826+0000","last_peered":"2024-09-13T06:33:19.883826+0000","last_clean":"2024-09-13T06:33:19.883826+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:33:19.883826+0000","last_undegraded":"2024-09-13T06:33:19.883826+0000","last_fullsized":"2024-09-13T06:33:19.883826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:19.883447+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:19.883447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.883447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:21.935843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622325+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:32:48.622325+0000","last_peered":"2024-09-13T06:32:48.622325+0000","last_clean":"2024-09-13T06:32:48.622325+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:32:48.622325+0000","last_undegraded":"2024-09-13T06:32:48.622325+0000","last_fullsized":"2024-09-13T06:32:48.622325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085124+0000","last_change":"2024-09-13T06:28:58.711388+0000","last_active":"2024-09-13T06:32:49.085124+0000","last_peered":"2024-09-13T06:32:49.085124+0000","last_clean":"2024-09-13T06:32:49.085124+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:32:49.085124+0000","last_undegraded":"2024-09-13T06:32:49.085124+0000","last_fullsized":"2024-09-13T06:32:49.085124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.659844+0000","last_change":"2024-09-13T06:32:53.659844+0000","last_active":"2024-09-13T06:32:53.659844+0000","last_peered":"2024-09-13T06:32:53.659844+0000","last_clean":"2024-09-13T06:32:53.659844+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:32:53.659844+0000","last_undegraded":"2024-09-13T06:32:53.659844+0000","last_fullsized":"2024-09-13T06:32:53.659844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.659599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:12.730571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":521,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.680200+0000","last_change":"2024-09-13T06:33:01.680200+0000","last_active":"2024-09-13T06:33:01.680200+0000","last_peered":"2024-09-13T06:33:01.680200+0000","last_clean":"2024-09-13T06:33:01.680200+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:33:01.680200+0000","last_undegraded":"2024-09-13T06:33:01.680200+0000","last_fullsized":"2024-09-13T06:33:01.680200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.679952+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:20.338166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.834458+0000","last_change":"2024-09-13T06:32:59.834458+0000","last_active":"2024-09-13T06:32:59.834458+0000","last_peered":"2024-09-13T06:32:59.834458+0000","last_clean":"2024-09-13T06:32:59.834458+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:32:59.834458+0000","last_undegraded":"2024-09-13T06:32:59.834458+0000","last_fullsized":"2024-09-13T06:32:59.834458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.834212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:30.694348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.688785+0000","last_change":"2024-09-13T06:33:18.688785+0000","last_active":"2024-09-13T06:33:18.688785+0000","last_peered":"2024-09-13T06:33:18.688785+0000","last_clean":"2024-09-13T06:33:18.688785+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:33:18.688785+0000","last_undegraded":"2024-09-13T06:33:18.688785+0000","last_fullsized":"2024-09-13T06:33:18.688785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:33:18.688519+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:33:18.688519+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.688519+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:20.053682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.806444+0000","last_change":"2024-09-13T06:33:23.806507+0000","last_active":"2024-09-13T06:33:23.806444+0000","last_peered":"2024-09-13T06:33:23.806444+0000","last_clean":"2024-09-13T06:33:23.806444+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:33:23.806444+0000","last_undegraded":"2024-09-13T06:33:23.806444+0000","last_fullsized":"2024-09-13T06:33:23.806444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:23.806244+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:23.806244+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.806244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:32.624319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.025941+0000","last_change":"2024-09-13T06:33:23.025994+0000","last_active":"2024-09-13T06:33:23.025941+0000","last_peered":"2024-09-13T06:33:23.025941+0000","last_clean":"2024-09-13T06:33:23.025941+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:33:23.025941+0000","last_undegraded":"2024-09-13T06:33:23.025941+0000","last_fullsized":"2024-09-13T06:33:23.025941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:23.025749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:23.025749+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.025749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:38:38.648553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085154+0000","last_change":"2024-09-13T06:28:58.710601+0000","last_active":"2024-09-13T06:32:49.085154+0000","last_peered":"2024-09-13T06:32:49.085154+0000","last_clean":"2024-09-13T06:32:49.085154+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:32:49.085154+0000","last_undegraded":"2024-09-13T06:32:49.085154+0000","last_fullsized":"2024-09-13T06:32:49.085154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.076554+0000","last_change":"2024-09-13T06:33:19.076554+0000","last_active":"2024-09-13T06:33:19.076554+0000","last_peered":"2024-09-13T06:33:19.076554+0000","last_clean":"2024-09-13T06:33:19.076554+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:33:19.076554+0000","last_undegraded":"2024-09-13T06:33:19.076554+0000","last_fullsized":"2024-09-13T06:33:19.076554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:19.076294+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:19.076294+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.076294+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:30.638206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.784194+0000","last_change":"2024-09-13T06:32:49.784194+0000","last_active":"2024-09-13T06:32:49.784194+0000","last_peered":"2024-09-13T06:32:49.784194+0000","last_clean":"2024-09-13T06:32:49.784194+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:49.784194+0000","last_undegraded":"2024-09-13T06:32:49.784194+0000","last_fullsized":"2024-09-13T06:32:49.784194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.784073+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:56.683180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.634660+0000","last_change":"2024-09-13T06:32:52.634660+0000","last_active":"2024-09-13T06:32:52.634660+0000","last_peered":"2024-09-13T06:32:52.634660+0000","last_clean":"2024-09-13T06:32:52.634660+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:32:52.634660+0000","last_undegraded":"2024-09-13T06:32:52.634660+0000","last_fullsized":"2024-09-13T06:32:52.634660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.634413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:42.199135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493950+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:31:25.493950+0000","last_peered":"2024-09-13T06:31:25.493950+0000","last_clean":"2024-09-13T06:31:25.493950+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:31:25.493950+0000","last_undegraded":"2024-09-13T06:31:25.493950+0000","last_fullsized":"2024-09-13T06:31:25.493950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.789715+0000","last_change":"2024-09-13T06:33:28.789779+0000","last_active":"2024-09-13T06:33:28.789715+0000","last_peered":"2024-09-13T06:33:28.789715+0000","last_clean":"2024-09-13T06:33:28.789715+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:33:28.789715+0000","last_undegraded":"2024-09-13T06:33:28.789715+0000","last_fullsized":"2024-09-13T06:33:28.789715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:28.789499+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:28.789499+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.789499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:44.042017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622325+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:32:48.622325+0000","last_peered":"2024-09-13T06:32:48.622325+0000","last_clean":"2024-09-13T06:32:48.622325+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:32:48.622325+0000","last_undegraded":"2024-09-13T06:32:48.622325+0000","last_fullsized":"2024-09-13T06:32:48.622325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622396+0000","last_change":"2024-09-13T06:28:58.714825+0000","last_active":"2024-09-13T06:32:48.622396+0000","last_peered":"2024-09-13T06:32:48.622396+0000","last_clean":"2024-09-13T06:32:48.622396+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:32:48.622396+0000","last_undegraded":"2024-09-13T06:32:48.622396+0000","last_fullsized":"2024-09-13T06:32:48.622396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.568967+0000","last_change":"2024-09-13T06:33:11.568967+0000","last_active":"2024-09-13T06:33:11.568967+0000","last_peered":"2024-09-13T06:33:11.568967+0000","last_clean":"2024-09-13T06:33:11.568967+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:33:11.568967+0000","last_undegraded":"2024-09-13T06:33:11.568967+0000","last_fullsized":"2024-09-13T06:33:11.568967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:11.568707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:11.568707+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.568707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:51.583587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.926512+0000","last_change":"2024-09-13T06:33:08.926512+0000","last_active":"2024-09-13T06:33:08.926512+0000","last_peered":"2024-09-13T06:33:08.926512+0000","last_clean":"2024-09-13T06:33:08.926512+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:33:08.926512+0000","last_undegraded":"2024-09-13T06:33:08.926512+0000","last_fullsized":"2024-09-13T06:33:08.926512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:33:08.926230+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:33:08.926230+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.926230+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:59.065492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.902142+0000","last_change":"2024-09-13T06:33:21.902142+0000","last_active":"2024-09-13T06:33:21.902142+0000","last_peered":"2024-09-13T06:33:21.902142+0000","last_clean":"2024-09-13T06:33:21.902142+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:33:21.902142+0000","last_undegraded":"2024-09-13T06:33:21.902142+0000","last_fullsized":"2024-09-13T06:33:21.902142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:21.901902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:21.901902+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.901902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:37.154420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.087343+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:49.087343+0000","last_peered":"2024-09-13T06:32:49.087343+0000","last_clean":"2024-09-13T06:32:49.087343+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:49.087343+0000","last_undegraded":"2024-09-13T06:32:49.087343+0000","last_fullsized":"2024-09-13T06:32:49.087343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.656394+0000","last_change":"2024-09-13T06:33:19.656461+0000","last_active":"2024-09-13T06:33:19.656394+0000","last_peered":"2024-09-13T06:33:19.656394+0000","last_clean":"2024-09-13T06:33:19.656394+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:33:19.656394+0000","last_undegraded":"2024-09-13T06:33:19.656394+0000","last_fullsized":"2024-09-13T06:33:19.656394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:19.656196+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:19.656196+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.656196+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:18.571062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622622+0000","last_change":"2024-09-13T06:28:58.734084+0000","last_active":"2024-09-13T06:32:48.622622+0000","last_peered":"2024-09-13T06:32:48.622622+0000","last_clean":"2024-09-13T06:32:48.622622+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:32:48.622622+0000","last_undegraded":"2024-09-13T06:32:48.622622+0000","last_fullsized":"2024-09-13T06:32:48.622622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085099+0000","last_change":"2024-09-13T06:28:52.951782+0000","last_active":"2024-09-13T06:32:49.085099+0000","last_peered":"2024-09-13T06:32:49.085099+0000","last_clean":"2024-09-13T06:32:49.085099+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:32:49.085099+0000","last_undegraded":"2024-09-13T06:32:49.085099+0000","last_fullsized":"2024-09-13T06:32:49.085099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.252073+0000","last_change":"2024-09-13T06:33:06.252073+0000","last_active":"2024-09-13T06:33:06.252073+0000","last_peered":"2024-09-13T06:33:06.252073+0000","last_clean":"2024-09-13T06:33:06.252073+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:33:06.252073+0000","last_undegraded":"2024-09-13T06:33:06.252073+0000","last_fullsized":"2024-09-13T06:33:06.252073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:06.251809+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:06.251809+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.251809+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:29.249309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.618221+0000","last_change":"2024-09-13T06:32:57.618221+0000","last_active":"2024-09-13T06:32:57.618221+0000","last_peered":"2024-09-13T06:32:57.618221+0000","last_clean":"2024-09-13T06:32:57.618221+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:32:57.618221+0000","last_undegraded":"2024-09-13T06:32:57.618221+0000","last_fullsized":"2024-09-13T06:32:57.618221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.617910+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:37.547222+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.822112+0000","last_change":"2024-09-13T06:33:02.822112+0000","last_active":"2024-09-13T06:33:02.822112+0000","last_peered":"2024-09-13T06:33:02.822112+0000","last_clean":"2024-09-13T06:33:02.822112+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:33:02.822112+0000","last_undegraded":"2024-09-13T06:33:02.822112+0000","last_fullsized":"2024-09-13T06:33:02.822112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.821863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:01.519357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.306949+0000","last_change":"2024-09-13T06:32:57.307014+0000","last_active":"2024-09-13T06:32:57.306949+0000","last_peered":"2024-09-13T06:32:57.306949+0000","last_clean":"2024-09-13T06:32:57.306949+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:32:57.306949+0000","last_undegraded":"2024-09-13T06:32:57.306949+0000","last_fullsized":"2024-09-13T06:32:57.306949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.306761+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:57.594334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085636+0000","last_change":"2024-09-13T06:29:00.726613+0000","last_active":"2024-09-13T06:32:49.085636+0000","last_peered":"2024-09-13T06:32:49.085636+0000","last_clean":"2024-09-13T06:32:49.085636+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:32:49.085636+0000","last_undegraded":"2024-09-13T06:32:49.085636+0000","last_fullsized":"2024-09-13T06:32:49.085636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085512+0000","last_change":"2024-09-13T06:28:58.709334+0000","last_active":"2024-09-13T06:32:49.085512+0000","last_peered":"2024-09-13T06:32:49.085512+0000","last_clean":"2024-09-13T06:32:49.085512+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:32:49.085512+0000","last_undegraded":"2024-09-13T06:32:49.085512+0000","last_fullsized":"2024-09-13T06:32:49.085512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622461+0000","last_change":"2024-09-13T06:28:52.960647+0000","last_active":"2024-09-13T06:32:48.622461+0000","last_peered":"2024-09-13T06:32:48.622461+0000","last_clean":"2024-09-13T06:32:48.622461+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:32:48.622461+0000","last_undegraded":"2024-09-13T06:32:48.622461+0000","last_fullsized":"2024-09-13T06:32:48.622461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.733063+0000","last_change":"2024-09-13T06:32:51.733063+0000","last_active":"2024-09-13T06:32:51.733063+0000","last_peered":"2024-09-13T06:32:51.733063+0000","last_clean":"2024-09-13T06:32:51.733063+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:32:51.733063+0000","last_undegraded":"2024-09-13T06:32:51.733063+0000","last_fullsized":"2024-09-13T06:32:51.733063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.732823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:41.778673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.654307+0000","last_change":"2024-09-13T06:32:59.654307+0000","last_active":"2024-09-13T06:32:59.654307+0000","last_peered":"2024-09-13T06:32:59.654307+0000","last_clean":"2024-09-13T06:32:59.654307+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:32:59.654307+0000","last_undegraded":"2024-09-13T06:32:59.654307+0000","last_fullsized":"2024-09-13T06:32:59.654307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.654023+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:07.752313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":373,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.632949+0000","last_change":"2024-09-13T06:32:58.632949+0000","last_active":"2024-09-13T06:32:58.632949+0000","last_peered":"2024-09-13T06:32:58.632949+0000","last_clean":"2024-09-13T06:32:58.632949+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:58.632949+0000","last_undegraded":"2024-09-13T06:32:58.632949+0000","last_fullsized":"2024-09-13T06:32:58.632949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.632636+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:48.468583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.494139+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:31:25.494139+0000","last_peered":"2024-09-13T06:31:25.494139+0000","last_clean":"2024-09-13T06:31:25.494139+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:31:25.494139+0000","last_undegraded":"2024-09-13T06:31:25.494139+0000","last_fullsized":"2024-09-13T06:31:25.494139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.859873+0000","last_change":"2024-09-13T06:33:20.859949+0000","last_active":"2024-09-13T06:33:20.859873+0000","last_peered":"2024-09-13T06:33:20.859873+0000","last_clean":"2024-09-13T06:33:20.859873+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:33:20.859873+0000","last_undegraded":"2024-09-13T06:33:20.859873+0000","last_fullsized":"2024-09-13T06:33:20.859873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:20.859664+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:20.859664+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.859664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:48.267924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987769+0000","last_change":"2024-09-13T06:28:58.724803+0000","last_active":"2024-09-13T06:32:49.987769+0000","last_peered":"2024-09-13T06:32:49.987769+0000","last_clean":"2024-09-13T06:32:49.987769+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:32:49.987769+0000","last_undegraded":"2024-09-13T06:32:49.987769+0000","last_fullsized":"2024-09-13T06:32:49.987769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085083+0000","last_change":"2024-09-13T06:28:52.951796+0000","last_active":"2024-09-13T06:32:49.085083+0000","last_peered":"2024-09-13T06:32:49.085083+0000","last_clean":"2024-09-13T06:32:49.085083+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:32:49.085083+0000","last_undegraded":"2024-09-13T06:32:49.085083+0000","last_fullsized":"2024-09-13T06:32:49.085083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.771819+0000","last_change":"2024-09-13T06:32:59.771819+0000","last_active":"2024-09-13T06:32:59.771819+0000","last_peered":"2024-09-13T06:32:59.771819+0000","last_clean":"2024-09-13T06:32:59.771819+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:32:59.771819+0000","last_undegraded":"2024-09-13T06:32:59.771819+0000","last_fullsized":"2024-09-13T06:32:59.771819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.771488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:22.687574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.946526+0000","last_change":"2024-09-13T06:32:50.946526+0000","last_active":"2024-09-13T06:32:50.946526+0000","last_peered":"2024-09-13T06:32:50.946526+0000","last_clean":"2024-09-13T06:32:50.946526+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:32:50.946526+0000","last_undegraded":"2024-09-13T06:32:50.946526+0000","last_fullsized":"2024-09-13T06:32:50.946526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.946266+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:40.782214+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.832186+0000","last_change":"2024-09-13T06:33:13.832186+0000","last_active":"2024-09-13T06:33:13.832186+0000","last_peered":"2024-09-13T06:33:13.832186+0000","last_clean":"2024-09-13T06:33:13.832186+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:33:13.832186+0000","last_undegraded":"2024-09-13T06:33:13.832186+0000","last_fullsized":"2024-09-13T06:33:13.832186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:13.831936+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:13.831936+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.831936+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:36.729651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497423+0000","last_change":"2024-09-13T06:29:08.789911+0000","last_active":"2024-09-13T06:31:25.497423+0000","last_peered":"2024-09-13T06:31:25.497423+0000","last_clean":"2024-09-13T06:31:25.497423+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:31:25.497423+0000","last_undegraded":"2024-09-13T06:31:25.497423+0000","last_fullsized":"2024-09-13T06:31:25.497423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.125509+0000","last_change":"2024-09-13T06:33:16.125567+0000","last_active":"2024-09-13T06:33:16.125509+0000","last_peered":"2024-09-13T06:33:16.125509+0000","last_clean":"2024-09-13T06:33:16.125509+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:33:16.125509+0000","last_undegraded":"2024-09-13T06:33:16.125509+0000","last_fullsized":"2024-09-13T06:33:16.125509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:16.125320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:16.125320+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.125320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:47.327725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085292+0000","last_change":"2024-09-13T06:28:58.716525+0000","last_active":"2024-09-13T06:32:49.085292+0000","last_peered":"2024-09-13T06:32:49.085292+0000","last_clean":"2024-09-13T06:32:49.085292+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:32:49.085292+0000","last_undegraded":"2024-09-13T06:32:49.085292+0000","last_fullsized":"2024-09-13T06:32:49.085292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622542+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:32:48.622542+0000","last_peered":"2024-09-13T06:32:48.622542+0000","last_clean":"2024-09-13T06:32:48.622542+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:32:48.622542+0000","last_undegraded":"2024-09-13T06:32:48.622542+0000","last_fullsized":"2024-09-13T06:32:48.622542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.863331+0000","last_change":"2024-09-13T06:32:55.863331+0000","last_active":"2024-09-13T06:32:55.863331+0000","last_peered":"2024-09-13T06:32:55.863331+0000","last_clean":"2024-09-13T06:32:55.863331+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:32:55.863331+0000","last_undegraded":"2024-09-13T06:32:55.863331+0000","last_fullsized":"2024-09-13T06:32:55.863331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.863065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:36.969572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'98","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.660166+0000","last_change":"2024-09-13T06:32:54.660166+0000","last_active":"2024-09-13T06:32:54.660166+0000","last_peered":"2024-09-13T06:32:54.660166+0000","last_clean":"2024-09-13T06:32:54.660166+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:32:54.660166+0000","last_undegraded":"2024-09-13T06:32:54.660166+0000","last_fullsized":"2024-09-13T06:32:54.660166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'98","last_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_deep_scrub":"35'98","last_deep_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.659885+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:25.520020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.816350+0000","last_change":"2024-09-13T06:33:00.816350+0000","last_active":"2024-09-13T06:33:00.816350+0000","last_peered":"2024-09-13T06:33:00.816350+0000","last_clean":"2024-09-13T06:33:00.816350+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:33:00.816350+0000","last_undegraded":"2024-09-13T06:33:00.816350+0000","last_fullsized":"2024-09-13T06:33:00.816350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.816103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:13.549745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.317433+0000","last_change":"2024-09-13T06:33:01.317544+0000","last_active":"2024-09-13T06:33:01.317433+0000","last_peered":"2024-09-13T06:33:01.317433+0000","last_clean":"2024-09-13T06:33:01.317433+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:33:01.317433+0000","last_undegraded":"2024-09-13T06:33:01.317433+0000","last_fullsized":"2024-09-13T06:33:01.317433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.317139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:36:04.823983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.229760+0000","last_change":"2024-09-13T06:32:53.229760+0000","last_active":"2024-09-13T06:32:53.229760+0000","last_peered":"2024-09-13T06:32:53.229760+0000","last_clean":"2024-09-13T06:32:53.229760+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:32:53.229760+0000","last_undegraded":"2024-09-13T06:32:53.229760+0000","last_fullsized":"2024-09-13T06:32:53.229760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.229470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:36.522566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.230996+0000","last_change":"2024-09-13T06:33:08.231055+0000","last_active":"2024-09-13T06:33:08.230996+0000","last_peered":"2024-09-13T06:33:08.230996+0000","last_clean":"2024-09-13T06:33:08.230996+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:33:08.230996+0000","last_undegraded":"2024-09-13T06:33:08.230996+0000","last_fullsized":"2024-09-13T06:33:08.230996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:08.230807+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:08.230807+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.230807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:34.071921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.958506+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:13.958506+0000","last_peered":"2024-09-13T06:32:13.958506+0000","last_clean":"2024-09-13T06:32:13.958506+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:13.958506+0000","last_undegraded":"2024-09-13T06:32:13.958506+0000","last_fullsized":"2024-09-13T06:32:13.958506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.713010+0000","last_change":"2024-09-13T06:32:50.713077+0000","last_active":"2024-09-13T06:32:50.713010+0000","last_peered":"2024-09-13T06:32:50.713010+0000","last_clean":"2024-09-13T06:32:50.713010+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:32:50.713010+0000","last_undegraded":"2024-09-13T06:32:50.713010+0000","last_fullsized":"2024-09-13T06:32:50.713010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.712808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:55.564878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.849497+0000","last_change":"2024-09-13T06:32:57.849575+0000","last_active":"2024-09-13T06:32:57.849497+0000","last_peered":"2024-09-13T06:32:57.849497+0000","last_clean":"2024-09-13T06:32:57.849497+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:32:57.849497+0000","last_undegraded":"2024-09-13T06:32:57.849497+0000","last_fullsized":"2024-09-13T06:32:57.849497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.849298+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:27.355549+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.864609+0000","last_change":"2024-09-13T06:33:01.864660+0000","last_active":"2024-09-13T06:33:01.864609+0000","last_peered":"2024-09-13T06:33:01.864609+0000","last_clean":"2024-09-13T06:33:01.864609+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:33:01.864609+0000","last_undegraded":"2024-09-13T06:33:01.864609+0000","last_fullsized":"2024-09-13T06:33:01.864609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.864411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:27.499351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.990248+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:32:49.990248+0000","last_peered":"2024-09-13T06:32:49.990248+0000","last_clean":"2024-09-13T06:32:49.990248+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:32:49.990248+0000","last_undegraded":"2024-09-13T06:32:49.990248+0000","last_fullsized":"2024-09-13T06:32:49.990248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.119082+0000","last_change":"2024-09-13T06:29:00.724056+0000","last_active":"2024-09-13T06:32:14.119082+0000","last_peered":"2024-09-13T06:32:14.119082+0000","last_clean":"2024-09-13T06:32:14.119082+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:32:14.119082+0000","last_undegraded":"2024-09-13T06:32:14.119082+0000","last_fullsized":"2024-09-13T06:32:14.119082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.107466+0000","last_change":"2024-09-13T06:33:20.107595+0000","last_active":"2024-09-13T06:33:20.107466+0000","last_peered":"2024-09-13T06:33:20.107466+0000","last_clean":"2024-09-13T06:33:20.107466+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:33:20.107466+0000","last_undegraded":"2024-09-13T06:33:20.107466+0000","last_fullsized":"2024-09-13T06:33:20.107466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:20.107242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:20.107242+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.107242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:23.355872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.849576+0000","last_change":"2024-09-13T06:32:58.849630+0000","last_active":"2024-09-13T06:32:58.849576+0000","last_peered":"2024-09-13T06:32:58.849576+0000","last_clean":"2024-09-13T06:32:58.849576+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:32:58.849576+0000","last_undegraded":"2024-09-13T06:32:58.849576+0000","last_fullsized":"2024-09-13T06:32:58.849576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.849384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:17.920356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.666350+0000","last_change":"2024-09-13T06:33:00.666422+0000","last_active":"2024-09-13T06:33:00.666350+0000","last_peered":"2024-09-13T06:33:00.666350+0000","last_clean":"2024-09-13T06:33:00.666350+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:33:00.666350+0000","last_undegraded":"2024-09-13T06:33:00.666350+0000","last_fullsized":"2024-09-13T06:33:00.666350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.666162+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:43.088796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.237414+0000","last_change":"2024-09-13T06:32:55.237529+0000","last_active":"2024-09-13T06:32:55.237414+0000","last_peered":"2024-09-13T06:32:55.237414+0000","last_clean":"2024-09-13T06:32:55.237414+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:32:55.237414+0000","last_undegraded":"2024-09-13T06:32:55.237414+0000","last_fullsized":"2024-09-13T06:32:55.237414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.237184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:16.278907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.768692+0000","last_change":"2024-09-13T06:33:22.768779+0000","last_active":"2024-09-13T06:33:22.768692+0000","last_peered":"2024-09-13T06:33:22.768692+0000","last_clean":"2024-09-13T06:33:22.768692+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:33:22.768692+0000","last_undegraded":"2024-09-13T06:33:22.768692+0000","last_fullsized":"2024-09-13T06:33:22.768692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T06:33:22.768486+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T06:33:22.768486+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.768486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:11.301142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'7","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.118786+0000","last_change":"2024-09-13T06:29:00.709739+0000","last_active":"2024-09-13T06:32:14.118786+0000","last_peered":"2024-09-13T06:32:14.118786+0000","last_clean":"2024-09-13T06:32:14.118786+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:32:14.118786+0000","last_undegraded":"2024-09-13T06:32:14.118786+0000","last_fullsized":"2024-09-13T06:32:14.118786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:24.495860+0000","last_change":"2024-09-13T06:28:58.717681+0000","last_active":"2024-09-13T06:31:24.495860+0000","last_peered":"2024-09-13T06:31:24.495860+0000","last_clean":"2024-09-13T06:31:24.495860+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:31:24.495860+0000","last_undegraded":"2024-09-13T06:31:24.495860+0000","last_fullsized":"2024-09-13T06:31:24.495860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'5","reported_seq":242,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.667969+0000","last_change":"2024-09-13T06:32:55.668036+0000","last_active":"2024-09-13T06:32:55.667969+0000","last_peered":"2024-09-13T06:32:55.667969+0000","last_clean":"2024-09-13T06:32:55.667969+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:32:55.667969+0000","last_undegraded":"2024-09-13T06:32:55.667969+0000","last_fullsized":"2024-09-13T06:32:55.667969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.667780+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:08.401422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'48","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.901988+0000","last_change":"2024-09-13T06:32:53.902064+0000","last_active":"2024-09-13T06:32:53.901988+0000","last_peered":"2024-09-13T06:32:53.901988+0000","last_clean":"2024-09-13T06:32:53.901988+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:53.901988+0000","last_undegraded":"2024-09-13T06:32:53.901988+0000","last_fullsized":"2024-09-13T06:32:53.901988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.901815+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:12.560029+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.629520+0000","last_change":"2024-09-13T06:32:53.629571+0000","last_active":"2024-09-13T06:32:53.629520+0000","last_peered":"2024-09-13T06:32:53.629520+0000","last_clean":"2024-09-13T06:32:53.629520+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:32:53.629520+0000","last_undegraded":"2024-09-13T06:32:53.629520+0000","last_fullsized":"2024-09-13T06:32:53.629520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.629307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:49.351038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.497847+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:31:40.497847+0000","last_peered":"2024-09-13T06:31:40.497847+0000","last_clean":"2024-09-13T06:31:40.497847+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:31:40.497847+0000","last_undegraded":"2024-09-13T06:31:40.497847+0000","last_fullsized":"2024-09-13T06:31:40.497847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:00.504694+0000","last_change":"2024-09-13T06:29:39.508832+0000","last_active":"2024-09-13T06:32:00.504694+0000","last_peered":"2024-09-13T06:32:00.504694+0000","last_clean":"2024-09-13T06:32:00.504694+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:32:00.504694+0000","last_undegraded":"2024-09-13T06:32:00.504694+0000","last_fullsized":"2024-09-13T06:32:00.504694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497563+0000","last_change":"2024-09-13T06:28:58.716514+0000","last_active":"2024-09-13T06:31:25.497563+0000","last_peered":"2024-09-13T06:31:25.497563+0000","last_clean":"2024-09-13T06:31:25.497563+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:31:25.497563+0000","last_undegraded":"2024-09-13T06:31:25.497563+0000","last_fullsized":"2024-09-13T06:31:25.497563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.851323+0000","last_change":"2024-09-13T06:33:14.851375+0000","last_active":"2024-09-13T06:33:14.851323+0000","last_peered":"2024-09-13T06:33:14.851323+0000","last_clean":"2024-09-13T06:33:14.851323+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:33:14.851323+0000","last_undegraded":"2024-09-13T06:33:14.851323+0000","last_fullsized":"2024-09-13T06:33:14.851323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.851131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.851131+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.851131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:18:48.539267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.919638+0000","last_change":"2024-09-13T06:33:08.919713+0000","last_active":"2024-09-13T06:33:08.919638+0000","last_peered":"2024-09-13T06:33:08.919638+0000","last_clean":"2024-09-13T06:33:08.919638+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:33:08.919638+0000","last_undegraded":"2024-09-13T06:33:08.919638+0000","last_fullsized":"2024-09-13T06:33:08.919638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.919447+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:31.817162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.257208+0000","last_change":"2024-09-13T06:32:56.257263+0000","last_active":"2024-09-13T06:32:56.257208+0000","last_peered":"2024-09-13T06:32:56.257208+0000","last_clean":"2024-09-13T06:32:56.257208+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:32:56.257208+0000","last_undegraded":"2024-09-13T06:32:56.257208+0000","last_fullsized":"2024-09-13T06:32:56.257208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.256983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:15.836617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.024597+0000","last_change":"2024-09-13T06:33:24.024657+0000","last_active":"2024-09-13T06:33:24.024597+0000","last_peered":"2024-09-13T06:33:24.024597+0000","last_clean":"2024-09-13T06:33:24.024597+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:33:24.024597+0000","last_undegraded":"2024-09-13T06:33:24.024597+0000","last_fullsized":"2024-09-13T06:33:24.024597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:24.024411+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:24.024411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.024411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:02.565766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.493692+0000","last_change":"2024-09-13T06:28:58.719660+0000","last_active":"2024-09-13T06:31:25.493692+0000","last_peered":"2024-09-13T06:31:25.493692+0000","last_clean":"2024-09-13T06:31:25.493692+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:31:25.493692+0000","last_undegraded":"2024-09-13T06:31:25.493692+0000","last_fullsized":"2024-09-13T06:31:25.493692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.753509+0000","last_change":"2024-09-13T06:32:49.753509+0000","last_active":"2024-09-13T06:32:49.753509+0000","last_peered":"2024-09-13T06:32:49.753509+0000","last_clean":"2024-09-13T06:32:49.753509+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:32:49.753509+0000","last_undegraded":"2024-09-13T06:32:49.753509+0000","last_fullsized":"2024-09-13T06:32:49.753509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.753224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:01.369372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.357261+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:32:45.357261+0000","last_peered":"2024-09-13T06:32:45.357261+0000","last_clean":"2024-09-13T06:32:45.357261+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:32:45.357261+0000","last_undegraded":"2024-09-13T06:32:45.357261+0000","last_fullsized":"2024-09-13T06:32:45.357261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.274398+0000","last_change":"2024-09-13T06:32:54.274454+0000","last_active":"2024-09-13T06:32:54.274398+0000","last_peered":"2024-09-13T06:32:54.274398+0000","last_clean":"2024-09-13T06:32:54.274398+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:32:54.274398+0000","last_undegraded":"2024-09-13T06:32:54.274398+0000","last_fullsized":"2024-09-13T06:32:54.274398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.274196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:07.867699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.935216+0000","last_change":"2024-09-13T06:33:25.935337+0000","last_active":"2024-09-13T06:33:25.935216+0000","last_peered":"2024-09-13T06:33:25.935216+0000","last_clean":"2024-09-13T06:33:25.935216+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:33:25.935216+0000","last_undegraded":"2024-09-13T06:33:25.935216+0000","last_fullsized":"2024-09-13T06:33:25.935216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:33:25.934938+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:33:25.934938+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.934938+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:59.560535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.646553+0000","last_change":"2024-09-13T06:33:17.646610+0000","last_active":"2024-09-13T06:33:17.646553+0000","last_peered":"2024-09-13T06:33:17.646553+0000","last_clean":"2024-09-13T06:33:17.646553+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:33:17.646553+0000","last_undegraded":"2024-09-13T06:33:17.646553+0000","last_fullsized":"2024-09-13T06:33:17.646553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:17.646356+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:17.646356+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.646356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:49.505268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:25.497301+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:31:25.497301+0000","last_peered":"2024-09-13T06:31:25.497301+0000","last_clean":"2024-09-13T06:31:25.497301+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:31:25.497301+0000","last_undegraded":"2024-09-13T06:31:25.497301+0000","last_fullsized":"2024-09-13T06:31:25.497301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.697900+0000","last_change":"2024-09-13T06:32:56.697900+0000","last_active":"2024-09-13T06:32:56.697900+0000","last_peered":"2024-09-13T06:32:56.697900+0000","last_clean":"2024-09-13T06:32:56.697900+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:32:56.697900+0000","last_undegraded":"2024-09-13T06:32:56.697900+0000","last_fullsized":"2024-09-13T06:32:56.697900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.697652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:22.332592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.976806+0000","last_change":"2024-09-13T06:33:11.976895+0000","last_active":"2024-09-13T06:33:11.976806+0000","last_peered":"2024-09-13T06:33:11.976806+0000","last_clean":"2024-09-13T06:33:11.976806+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:33:11.976806+0000","last_undegraded":"2024-09-13T06:33:11.976806+0000","last_fullsized":"2024-09-13T06:33:11.976806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-13T06:33:11.976609+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-13T06:33:11.976609+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.976609+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:51.788958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.617551+0000","last_change":"2024-09-13T06:32:55.617654+0000","last_active":"2024-09-13T06:32:55.617551+0000","last_peered":"2024-09-13T06:32:55.617551+0000","last_clean":"2024-09-13T06:32:55.617551+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:32:55.617551+0000","last_undegraded":"2024-09-13T06:32:55.617551+0000","last_fullsized":"2024-09-13T06:32:55.617551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.617324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:18.790664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496938+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:31:29.496938+0000","last_peered":"2024-09-13T06:31:29.496938+0000","last_clean":"2024-09-13T06:31:29.496938+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:31:29.496938+0000","last_undegraded":"2024-09-13T06:31:29.496938+0000","last_fullsized":"2024-09-13T06:31:29.496938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.877273+0000","last_change":"2024-09-13T06:33:18.877332+0000","last_active":"2024-09-13T06:33:18.877273+0000","last_peered":"2024-09-13T06:33:18.877273+0000","last_clean":"2024-09-13T06:33:18.877273+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:33:18.877273+0000","last_undegraded":"2024-09-13T06:33:18.877273+0000","last_fullsized":"2024-09-13T06:33:18.877273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:18.877085+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:18.877085+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.877085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:40.890221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496979+0000","last_change":"2024-09-13T06:28:58.716000+0000","last_active":"2024-09-13T06:31:29.496979+0000","last_peered":"2024-09-13T06:31:29.496979+0000","last_clean":"2024-09-13T06:31:29.496979+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:31:29.496979+0000","last_undegraded":"2024-09-13T06:31:29.496979+0000","last_fullsized":"2024-09-13T06:31:29.496979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.707846+0000","last_change":"2024-09-13T06:32:57.707902+0000","last_active":"2024-09-13T06:32:57.707846+0000","last_peered":"2024-09-13T06:32:57.707846+0000","last_clean":"2024-09-13T06:32:57.707846+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:32:57.707846+0000","last_undegraded":"2024-09-13T06:32:57.707846+0000","last_fullsized":"2024-09-13T06:32:57.707846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.707651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:17.993090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.851372+0000","last_change":"2024-09-13T06:33:10.851372+0000","last_active":"2024-09-13T06:33:10.851372+0000","last_peered":"2024-09-13T06:33:10.851372+0000","last_clean":"2024-09-13T06:33:10.851372+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:33:10.851372+0000","last_undegraded":"2024-09-13T06:33:10.851372+0000","last_fullsized":"2024-09-13T06:33:10.851372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:33:10.851101+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:33:10.851101+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.851101+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:34.627562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.614320+0000","last_change":"2024-09-13T06:32:54.614320+0000","last_active":"2024-09-13T06:32:54.614320+0000","last_peered":"2024-09-13T06:32:54.614320+0000","last_clean":"2024-09-13T06:32:54.614320+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:32:54.614320+0000","last_undegraded":"2024-09-13T06:32:54.614320+0000","last_fullsized":"2024-09-13T06:32:54.614320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.614081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:41.070050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.054745+0000","last_change":"2024-09-13T06:33:27.054804+0000","last_active":"2024-09-13T06:33:27.054745+0000","last_peered":"2024-09-13T06:33:27.054745+0000","last_clean":"2024-09-13T06:33:27.054745+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:33:27.054745+0000","last_undegraded":"2024-09-13T06:33:27.054745+0000","last_fullsized":"2024-09-13T06:33:27.054745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:27.054550+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:27.054550+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.054550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:49.713766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.101486+0000","last_change":"2024-09-13T06:33:15.101549+0000","last_active":"2024-09-13T06:33:15.101486+0000","last_peered":"2024-09-13T06:33:15.101486+0000","last_clean":"2024-09-13T06:33:15.101486+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:33:15.101486+0000","last_undegraded":"2024-09-13T06:33:15.101486+0000","last_fullsized":"2024-09-13T06:33:15.101486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:15.101239+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:15.101239+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.101239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:32.810161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.327818+0000","last_change":"2024-09-13T06:28:58.705967+0000","last_active":"2024-09-13T06:32:45.327818+0000","last_peered":"2024-09-13T06:32:45.327818+0000","last_clean":"2024-09-13T06:32:45.327818+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:32:45.327818+0000","last_undegraded":"2024-09-13T06:32:45.327818+0000","last_fullsized":"2024-09-13T06:32:45.327818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":32,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.593003+0000","last_change":"2024-09-13T06:33:09.593055+0000","last_active":"2024-09-13T06:33:09.593003+0000","last_peered":"2024-09-13T06:33:09.593003+0000","last_clean":"2024-09-13T06:33:09.593003+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:33:09.593003+0000","last_undegraded":"2024-09-13T06:33:09.593003+0000","last_fullsized":"2024-09-13T06:33:09.593003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:09.592809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:09.592809+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.592809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:07.716160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.955220+0000","last_change":"2024-09-13T06:33:06.955303+0000","last_active":"2024-09-13T06:33:06.955220+0000","last_peered":"2024-09-13T06:33:06.955220+0000","last_clean":"2024-09-13T06:33:06.955220+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:33:06.955220+0000","last_undegraded":"2024-09-13T06:33:06.955220+0000","last_fullsized":"2024-09-13T06:33:06.955220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:33:06.955042+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:33:06.955042+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.955042+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:20.072308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'286","reported_seq":436,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.962258+0000","last_change":"2024-09-13T06:33:18.962258+0000","last_active":"2024-09-13T06:33:18.962258+0000","last_peered":"2024-09-13T06:33:18.962258+0000","last_clean":"2024-09-13T06:33:18.962258+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:33:18.962258+0000","last_undegraded":"2024-09-13T06:33:18.962258+0000","last_fullsized":"2024-09-13T06:33:18.962258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:33:18.961843+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:33:18.961843+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.961843+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:37.540052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.496734+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:31:29.496734+0000","last_peered":"2024-09-13T06:31:29.496734+0000","last_clean":"2024-09-13T06:31:29.496734+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:31:29.496734+0000","last_undegraded":"2024-09-13T06:31:29.496734+0000","last_fullsized":"2024-09-13T06:31:29.496734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.115244+0000","last_change":"2024-09-13T06:33:14.115307+0000","last_active":"2024-09-13T06:33:14.115244+0000","last_peered":"2024-09-13T06:33:14.115244+0000","last_clean":"2024-09-13T06:33:14.115244+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:33:14.115244+0000","last_undegraded":"2024-09-13T06:33:14.115244+0000","last_fullsized":"2024-09-13T06:33:14.115244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:14.115056+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:14.115056+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.115056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:50:00.143967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.498755+0000","last_change":"2024-09-13T06:28:58.727668+0000","last_active":"2024-09-13T06:31:30.498755+0000","last_peered":"2024-09-13T06:31:30.498755+0000","last_clean":"2024-09-13T06:31:30.498755+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:31:30.498755+0000","last_undegraded":"2024-09-13T06:31:30.498755+0000","last_fullsized":"2024-09-13T06:31:30.498755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.672367+0000","last_change":"2024-09-13T06:32:51.672474+0000","last_active":"2024-09-13T06:32:51.672367+0000","last_peered":"2024-09-13T06:32:51.672367+0000","last_clean":"2024-09-13T06:32:51.672367+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:32:51.672367+0000","last_undegraded":"2024-09-13T06:32:51.672367+0000","last_fullsized":"2024-09-13T06:32:51.672367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.672122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:22.074076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.867341+0000","last_change":"2024-09-13T06:33:05.867420+0000","last_active":"2024-09-13T06:33:05.867341+0000","last_peered":"2024-09-13T06:33:05.867341+0000","last_clean":"2024-09-13T06:33:05.867341+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:33:05.867341+0000","last_undegraded":"2024-09-13T06:33:05.867341+0000","last_fullsized":"2024-09-13T06:33:05.867341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.867149+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:29.643610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.863742+0000","last_change":"2024-09-13T06:33:03.863795+0000","last_active":"2024-09-13T06:33:03.863742+0000","last_peered":"2024-09-13T06:33:03.863742+0000","last_clean":"2024-09-13T06:33:03.863742+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:33:03.863742+0000","last_undegraded":"2024-09-13T06:33:03.863742+0000","last_fullsized":"2024-09-13T06:33:03.863742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:06.532657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498484+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:31:34.498484+0000","last_peered":"2024-09-13T06:31:34.498484+0000","last_clean":"2024-09-13T06:31:34.498484+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:31:34.498484+0000","last_undegraded":"2024-09-13T06:31:34.498484+0000","last_fullsized":"2024-09-13T06:31:34.498484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.091089+0000","last_change":"2024-09-13T06:33:28.091149+0000","last_active":"2024-09-13T06:33:28.091089+0000","last_peered":"2024-09-13T06:33:28.091089+0000","last_clean":"2024-09-13T06:33:28.091089+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:33:28.091089+0000","last_undegraded":"2024-09-13T06:33:28.091089+0000","last_fullsized":"2024-09-13T06:33:28.091089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:28.090907+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:28.090907+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.090907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:08.553807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497159+0000","last_change":"2024-09-13T06:28:58.706848+0000","last_active":"2024-09-13T06:31:29.497159+0000","last_peered":"2024-09-13T06:31:29.497159+0000","last_clean":"2024-09-13T06:31:29.497159+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:31:29.497159+0000","last_undegraded":"2024-09-13T06:31:29.497159+0000","last_fullsized":"2024-09-13T06:31:29.497159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.931795+0000","last_change":"2024-09-13T06:33:13.931847+0000","last_active":"2024-09-13T06:33:13.931795+0000","last_peered":"2024-09-13T06:33:13.931795+0000","last_clean":"2024-09-13T06:33:13.931795+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:33:13.931795+0000","last_undegraded":"2024-09-13T06:33:13.931795+0000","last_fullsized":"2024-09-13T06:33:13.931795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:13.931595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:13.931595+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.931595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:35.944731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.274280+0000","last_change":"2024-09-13T06:33:02.274362+0000","last_active":"2024-09-13T06:33:02.274280+0000","last_peered":"2024-09-13T06:33:02.274280+0000","last_clean":"2024-09-13T06:33:02.274280+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:33:02.274280+0000","last_undegraded":"2024-09-13T06:33:02.274280+0000","last_fullsized":"2024-09-13T06:33:02.274280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.274058+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:13.067392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.898001+0000","last_change":"2024-09-13T06:33:14.898055+0000","last_active":"2024-09-13T06:33:14.898001+0000","last_peered":"2024-09-13T06:33:14.898001+0000","last_clean":"2024-09-13T06:33:14.898001+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:33:14.898001+0000","last_undegraded":"2024-09-13T06:33:14.898001+0000","last_fullsized":"2024-09-13T06:33:14.898001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.897808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.897808+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.897808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:16.950204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.789069+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.789069+0000","last_peered":"2024-09-13T06:32:13.789069+0000","last_clean":"2024-09-13T06:32:13.789069+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.789069+0000","last_undegraded":"2024-09-13T06:32:13.789069+0000","last_fullsized":"2024-09-13T06:32:13.789069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.945780+0000","last_change":"2024-09-13T06:33:27.945840+0000","last_active":"2024-09-13T06:33:27.945780+0000","last_peered":"2024-09-13T06:33:27.945780+0000","last_clean":"2024-09-13T06:33:27.945780+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:33:27.945780+0000","last_undegraded":"2024-09-13T06:33:27.945780+0000","last_fullsized":"2024-09-13T06:33:27.945780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:27.945583+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:27.945583+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.945583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:33.066698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987954+0000","last_change":"2024-09-13T06:28:58.728835+0000","last_active":"2024-09-13T06:32:49.987954+0000","last_peered":"2024-09-13T06:32:49.987954+0000","last_clean":"2024-09-13T06:32:49.987954+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:32:49.987954+0000","last_undegraded":"2024-09-13T06:32:49.987954+0000","last_fullsized":"2024-09-13T06:32:49.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.607615+0000","last_change":"2024-09-13T06:33:07.607668+0000","last_active":"2024-09-13T06:33:07.607615+0000","last_peered":"2024-09-13T06:33:07.607615+0000","last_clean":"2024-09-13T06:33:07.607615+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:33:07.607615+0000","last_undegraded":"2024-09-13T06:33:07.607615+0000","last_fullsized":"2024-09-13T06:33:07.607615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:07.607411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:07.607411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.607411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:38.467546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'31","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.922489+0000","last_change":"2024-09-13T06:32:51.922559+0000","last_active":"2024-09-13T06:32:51.922489+0000","last_peered":"2024-09-13T06:32:51.922489+0000","last_clean":"2024-09-13T06:32:51.922489+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:32:51.922489+0000","last_undegraded":"2024-09-13T06:32:51.922489+0000","last_fullsized":"2024-09-13T06:32:51.922489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31","last_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_deep_scrub":"35'31","last_deep_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.922288+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:42.602059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.849119+0000","last_change":"2024-09-13T06:33:03.849171+0000","last_active":"2024-09-13T06:33:03.849119+0000","last_peered":"2024-09-13T06:33:03.849119+0000","last_clean":"2024-09-13T06:33:03.849119+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:33:03.849119+0000","last_undegraded":"2024-09-13T06:33:03.849119+0000","last_fullsized":"2024-09-13T06:33:03.849119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:53.988212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.976294+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.976294+0000","last_peered":"2024-09-13T06:32:13.976294+0000","last_clean":"2024-09-13T06:32:13.976294+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.976294+0000","last_undegraded":"2024-09-13T06:32:13.976294+0000","last_fullsized":"2024-09-13T06:32:13.976294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.041473+0000","last_change":"2024-09-13T06:33:21.041537+0000","last_active":"2024-09-13T06:33:21.041473+0000","last_peered":"2024-09-13T06:33:21.041473+0000","last_clean":"2024-09-13T06:33:21.041473+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:33:21.041473+0000","last_undegraded":"2024-09-13T06:33:21.041473+0000","last_fullsized":"2024-09-13T06:33:21.041473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:21.041255+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:21.041255+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.041255+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:54.666853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085288+0000","last_change":"2024-09-13T06:28:58.709396+0000","last_active":"2024-09-13T06:32:49.085288+0000","last_peered":"2024-09-13T06:32:49.085288+0000","last_clean":"2024-09-13T06:32:49.085288+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:32:49.085288+0000","last_undegraded":"2024-09-13T06:32:49.085288+0000","last_fullsized":"2024-09-13T06:32:49.085288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.629912+0000","last_change":"2024-09-13T06:33:04.629973+0000","last_active":"2024-09-13T06:33:04.629912+0000","last_peered":"2024-09-13T06:33:04.629912+0000","last_clean":"2024-09-13T06:33:04.629912+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:33:04.629912+0000","last_undegraded":"2024-09-13T06:33:04.629912+0000","last_fullsized":"2024-09-13T06:33:04.629912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.629731+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:04.692060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.731460+0000","last_change":"2024-09-13T06:32:58.731638+0000","last_active":"2024-09-13T06:32:58.731460+0000","last_peered":"2024-09-13T06:32:58.731460+0000","last_clean":"2024-09-13T06:32:58.731460+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:58.731460+0000","last_undegraded":"2024-09-13T06:32:58.731460+0000","last_fullsized":"2024-09-13T06:32:58.731460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.731244+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:01.400357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.185822+0000","last_change":"2024-09-13T06:32:51.185958+0000","last_active":"2024-09-13T06:32:51.185822+0000","last_peered":"2024-09-13T06:32:51.185822+0000","last_clean":"2024-09-13T06:32:51.185822+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:32:51.185822+0000","last_undegraded":"2024-09-13T06:32:51.185822+0000","last_fullsized":"2024-09-13T06:32:51.185822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.185604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:49.642143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:29.497070+0000","last_change":"2024-09-13T06:29:08.770047+0000","last_active":"2024-09-13T06:31:29.497070+0000","last_peered":"2024-09-13T06:31:29.497070+0000","last_clean":"2024-09-13T06:31:29.497070+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:31:29.497070+0000","last_undegraded":"2024-09-13T06:31:29.497070+0000","last_fullsized":"2024-09-13T06:31:29.497070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.086026+0000","last_change":"2024-09-13T06:29:00.723899+0000","last_active":"2024-09-13T06:32:49.086026+0000","last_peered":"2024-09-13T06:32:49.086026+0000","last_clean":"2024-09-13T06:32:49.086026+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:32:49.086026+0000","last_undegraded":"2024-09-13T06:32:49.086026+0000","last_fullsized":"2024-09-13T06:32:49.086026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.067199+0000","last_change":"2024-09-13T06:33:27.067258+0000","last_active":"2024-09-13T06:33:27.067199+0000","last_peered":"2024-09-13T06:33:27.067199+0000","last_clean":"2024-09-13T06:33:27.067199+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:33:27.067199+0000","last_undegraded":"2024-09-13T06:33:27.067199+0000","last_fullsized":"2024-09-13T06:33:27.067199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:27.066998+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:27.066998+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.066998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:52.009796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.837544+0000","last_change":"2024-09-13T06:33:24.837691+0000","last_active":"2024-09-13T06:33:24.837544+0000","last_peered":"2024-09-13T06:33:24.837544+0000","last_clean":"2024-09-13T06:33:24.837544+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:33:24.837544+0000","last_undegraded":"2024-09-13T06:33:24.837544+0000","last_fullsized":"2024-09-13T06:33:24.837544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:24.837307+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:24.837307+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.837307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:23.934356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.046267+0000","last_change":"2024-09-13T06:33:26.046329+0000","last_active":"2024-09-13T06:33:26.046267+0000","last_peered":"2024-09-13T06:33:26.046267+0000","last_clean":"2024-09-13T06:33:26.046267+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:33:26.046267+0000","last_undegraded":"2024-09-13T06:33:26.046267+0000","last_fullsized":"2024-09-13T06:33:26.046267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:26.046070+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:26.046070+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.046070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:20.651280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.121391+0000","last_change":"2024-09-13T06:29:39.540853+0000","last_active":"2024-09-13T06:32:14.121391+0000","last_peered":"2024-09-13T06:32:14.121391+0000","last_clean":"2024-09-13T06:32:14.121391+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:32:14.121391+0000","last_undegraded":"2024-09-13T06:32:14.121391+0000","last_fullsized":"2024-09-13T06:32:14.121391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987946+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:32:49.987946+0000","last_peered":"2024-09-13T06:32:49.987946+0000","last_clean":"2024-09-13T06:32:49.987946+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:32:49.987946+0000","last_undegraded":"2024-09-13T06:32:49.987946+0000","last_fullsized":"2024-09-13T06:32:49.987946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.877803+0000","last_change":"2024-09-13T06:33:26.877864+0000","last_active":"2024-09-13T06:33:26.877803+0000","last_peered":"2024-09-13T06:33:26.877803+0000","last_clean":"2024-09-13T06:33:26.877803+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:33:26.877803+0000","last_undegraded":"2024-09-13T06:33:26.877803+0000","last_fullsized":"2024-09-13T06:33:26.877803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:26.877608+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.877608+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.877608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:37:11.045713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.062645+0000","last_change":"2024-09-13T06:33:22.062702+0000","last_active":"2024-09-13T06:33:22.062645+0000","last_peered":"2024-09-13T06:33:22.062645+0000","last_clean":"2024-09-13T06:33:22.062645+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:33:22.062645+0000","last_undegraded":"2024-09-13T06:33:22.062645+0000","last_fullsized":"2024-09-13T06:33:22.062645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:22.062429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:22.062429+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.062429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:05.066689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.433374+0000","last_change":"2024-09-13T06:29:39.527461+0000","last_active":"2024-09-13T06:32:13.433374+0000","last_peered":"2024-09-13T06:32:13.433374+0000","last_clean":"2024-09-13T06:32:13.433374+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:32:13.433374+0000","last_undegraded":"2024-09-13T06:32:13.433374+0000","last_fullsized":"2024-09-13T06:32:13.433374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988048+0000","last_change":"2024-09-13T06:28:58.724998+0000","last_active":"2024-09-13T06:32:49.988048+0000","last_peered":"2024-09-13T06:32:49.988048+0000","last_clean":"2024-09-13T06:32:49.988048+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:32:49.988048+0000","last_undegraded":"2024-09-13T06:32:49.988048+0000","last_fullsized":"2024-09-13T06:32:49.988048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085972+0000","last_change":"2024-09-13T06:29:00.723960+0000","last_active":"2024-09-13T06:32:49.085972+0000","last_peered":"2024-09-13T06:32:49.085972+0000","last_clean":"2024-09-13T06:32:49.085972+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:32:49.085972+0000","last_undegraded":"2024-09-13T06:32:49.085972+0000","last_fullsized":"2024-09-13T06:32:49.085972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.773785+0000","last_change":"2024-09-13T06:33:29.773840+0000","last_active":"2024-09-13T06:33:29.773785+0000","last_peered":"2024-09-13T06:33:29.773785+0000","last_clean":"2024-09-13T06:33:29.773785+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:33:29.773785+0000","last_undegraded":"2024-09-13T06:33:29.773785+0000","last_fullsized":"2024-09-13T06:33:29.773785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:29.773588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:29.773588+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.773588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:14.414714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.973311+0000","last_change":"2024-09-13T06:33:24.973365+0000","last_active":"2024-09-13T06:33:24.973311+0000","last_peered":"2024-09-13T06:33:24.973311+0000","last_clean":"2024-09-13T06:33:24.973311+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:33:24.973311+0000","last_undegraded":"2024-09-13T06:33:24.973311+0000","last_fullsized":"2024-09-13T06:33:24.973311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:24.973113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:24.973113+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.973113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:37.936190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.040708+0000","last_change":"2024-09-13T06:33:24.040796+0000","last_active":"2024-09-13T06:33:24.040708+0000","last_peered":"2024-09-13T06:33:24.040708+0000","last_clean":"2024-09-13T06:33:24.040708+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:33:24.040708+0000","last_undegraded":"2024-09-13T06:33:24.040708+0000","last_fullsized":"2024-09-13T06:33:24.040708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:24.040517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:24.040517+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.040517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:50.780198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.623073+0000","last_change":"2024-09-13T06:29:00.715113+0000","last_active":"2024-09-13T06:32:48.623073+0000","last_peered":"2024-09-13T06:32:48.623073+0000","last_clean":"2024-09-13T06:32:48.623073+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:32:48.623073+0000","last_undegraded":"2024-09-13T06:32:48.623073+0000","last_fullsized":"2024-09-13T06:32:48.623073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987994+0000","last_change":"2024-09-13T06:28:58.725590+0000","last_active":"2024-09-13T06:32:49.987994+0000","last_peered":"2024-09-13T06:32:49.987994+0000","last_clean":"2024-09-13T06:32:49.987994+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:32:49.987994+0000","last_undegraded":"2024-09-13T06:32:49.987994+0000","last_fullsized":"2024-09-13T06:32:49.987994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.854781+0000","last_change":"2024-09-13T06:33:25.854840+0000","last_active":"2024-09-13T06:33:25.854781+0000","last_peered":"2024-09-13T06:33:25.854781+0000","last_clean":"2024-09-13T06:33:25.854781+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:33:25.854781+0000","last_undegraded":"2024-09-13T06:33:25.854781+0000","last_fullsized":"2024-09-13T06:33:25.854781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:25.854592+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:25.854592+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.854592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:47.867728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.743269+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.743269+0000","last_peered":"2024-09-13T06:32:13.743269+0000","last_clean":"2024-09-13T06:32:13.743269+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.743269+0000","last_undegraded":"2024-09-13T06:32:13.743269+0000","last_fullsized":"2024-09-13T06:32:13.743269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.908221+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:13.908221+0000","last_peered":"2024-09-13T06:32:13.908221+0000","last_clean":"2024-09-13T06:32:13.908221+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:13.908221+0000","last_undegraded":"2024-09-13T06:32:13.908221+0000","last_fullsized":"2024-09-13T06:32:13.908221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987911+0000","last_change":"2024-09-13T06:28:58.705020+0000","last_active":"2024-09-13T06:32:49.987911+0000","last_peered":"2024-09-13T06:32:49.987911+0000","last_clean":"2024-09-13T06:32:49.987911+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:32:49.987911+0000","last_undegraded":"2024-09-13T06:32:49.987911+0000","last_fullsized":"2024-09-13T06:32:49.987911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.038770+0000","last_change":"2024-09-13T06:33:18.038770+0000","last_active":"2024-09-13T06:33:18.038770+0000","last_peered":"2024-09-13T06:33:18.038770+0000","last_clean":"2024-09-13T06:33:18.038770+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:33:18.038770+0000","last_undegraded":"2024-09-13T06:33:18.038770+0000","last_fullsized":"2024-09-13T06:33:18.038770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:18.038512+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:18.038512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.038512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:32.926333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622715+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:32:48.622715+0000","last_peered":"2024-09-13T06:32:48.622715+0000","last_clean":"2024-09-13T06:32:48.622715+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:32:48.622715+0000","last_undegraded":"2024-09-13T06:32:48.622715+0000","last_fullsized":"2024-09-13T06:32:48.622715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.613487+0000","last_change":"2024-09-13T06:33:13.613487+0000","last_active":"2024-09-13T06:33:13.613487+0000","last_peered":"2024-09-13T06:33:13.613487+0000","last_clean":"2024-09-13T06:33:13.613487+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:33:13.613487+0000","last_undegraded":"2024-09-13T06:33:13.613487+0000","last_fullsized":"2024-09-13T06:33:13.613487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:33:13.613227+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:33:13.613227+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.613227+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:19.840240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085309+0000","last_change":"2024-09-13T06:28:58.716875+0000","last_active":"2024-09-13T06:32:49.085309+0000","last_peered":"2024-09-13T06:32:49.085309+0000","last_clean":"2024-09-13T06:32:49.085309+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:32:49.085309+0000","last_undegraded":"2024-09-13T06:32:49.085309+0000","last_fullsized":"2024-09-13T06:32:49.085309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.035789+0000","last_change":"2024-09-13T06:33:26.035852+0000","last_active":"2024-09-13T06:33:26.035789+0000","last_peered":"2024-09-13T06:33:26.035789+0000","last_clean":"2024-09-13T06:33:26.035789+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:33:26.035789+0000","last_undegraded":"2024-09-13T06:33:26.035789+0000","last_fullsized":"2024-09-13T06:33:26.035789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:26.035608+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.035608+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.035608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:46.324701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988162+0000","last_change":"2024-09-13T06:28:58.725136+0000","last_active":"2024-09-13T06:32:49.988162+0000","last_peered":"2024-09-13T06:32:49.988162+0000","last_clean":"2024-09-13T06:32:49.988162+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:32:49.988162+0000","last_undegraded":"2024-09-13T06:32:49.988162+0000","last_fullsized":"2024-09-13T06:32:49.988162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.702980+0000","last_change":"2024-09-13T06:33:20.702980+0000","last_active":"2024-09-13T06:33:20.702980+0000","last_peered":"2024-09-13T06:33:20.702980+0000","last_clean":"2024-09-13T06:33:20.702980+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:33:20.702980+0000","last_undegraded":"2024-09-13T06:33:20.702980+0000","last_fullsized":"2024-09-13T06:33:20.702980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:20.702727+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:20.702727+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.702727+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:41.365268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988026+0000","last_change":"2024-09-13T06:28:58.720437+0000","last_active":"2024-09-13T06:32:49.988026+0000","last_peered":"2024-09-13T06:32:49.988026+0000","last_clean":"2024-09-13T06:32:49.988026+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:32:49.988026+0000","last_undegraded":"2024-09-13T06:32:49.988026+0000","last_fullsized":"2024-09-13T06:32:49.988026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.929692+0000","last_change":"2024-09-13T06:33:23.929692+0000","last_active":"2024-09-13T06:33:23.929692+0000","last_peered":"2024-09-13T06:33:23.929692+0000","last_clean":"2024-09-13T06:33:23.929692+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:33:23.929692+0000","last_undegraded":"2024-09-13T06:33:23.929692+0000","last_fullsized":"2024-09-13T06:33:23.929692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:23.929409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:23.929409+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.929409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:42.507618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.029288+0000","last_change":"2024-09-13T06:33:25.029352+0000","last_active":"2024-09-13T06:33:25.029288+0000","last_peered":"2024-09-13T06:33:25.029288+0000","last_clean":"2024-09-13T06:33:25.029288+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:33:25.029288+0000","last_undegraded":"2024-09-13T06:33:25.029288+0000","last_fullsized":"2024-09-13T06:33:25.029288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:25.029092+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:25.029092+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.029092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:58.332786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.051952+0000","last_change":"2024-09-13T06:33:25.052020+0000","last_active":"2024-09-13T06:33:25.051952+0000","last_peered":"2024-09-13T06:33:25.051952+0000","last_clean":"2024-09-13T06:33:25.051952+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:33:25.051952+0000","last_undegraded":"2024-09-13T06:33:25.051952+0000","last_fullsized":"2024-09-13T06:33:25.051952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:25.051763+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:25.051763+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.051763+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:43.405467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.492786+0000","last_change":"2024-09-13T06:28:58.720596+0000","last_active":"2024-09-13T06:31:20.492786+0000","last_peered":"2024-09-13T06:31:20.492786+0000","last_clean":"2024-09-13T06:31:20.492786+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:31:20.492786+0000","last_undegraded":"2024-09-13T06:31:20.492786+0000","last_fullsized":"2024-09-13T06:31:20.492786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:19.494281+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:31:19.494281+0000","last_peered":"2024-09-13T06:31:19.494281+0000","last_clean":"2024-09-13T06:31:19.494281+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:31:19.494281+0000","last_undegraded":"2024-09-13T06:31:19.494281+0000","last_fullsized":"2024-09-13T06:31:19.494281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.195367+0000","last_change":"2024-09-13T06:33:09.195428+0000","last_active":"2024-09-13T06:33:09.195367+0000","last_peered":"2024-09-13T06:33:09.195367+0000","last_clean":"2024-09-13T06:33:09.195367+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:33:09.195367+0000","last_undegraded":"2024-09-13T06:33:09.195367+0000","last_fullsized":"2024-09-13T06:33:09.195367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:09.195134+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:09.195134+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.195134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:24.446576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:20.495693+0000","last_change":"2024-09-13T06:28:58.716677+0000","last_active":"2024-09-13T06:31:20.495693+0000","last_peered":"2024-09-13T06:31:20.495693+0000","last_clean":"2024-09-13T06:31:20.495693+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:31:20.495693+0000","last_undegraded":"2024-09-13T06:31:20.495693+0000","last_fullsized":"2024-09-13T06:31:20.495693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.987735+0000","last_change":"2024-09-13T06:29:39.515090+0000","last_active":"2024-09-13T06:32:13.987735+0000","last_peered":"2024-09-13T06:32:13.987735+0000","last_clean":"2024-09-13T06:32:13.987735+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:32:13.987735+0000","last_undegraded":"2024-09-13T06:32:13.987735+0000","last_fullsized":"2024-09-13T06:32:13.987735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":446464,"data_stored":151533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673021,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":740673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673021,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":742577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":153065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:33:31.187 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.187 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.187 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.187 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.187 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.188 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.188 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.188 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.188 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.188 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.188 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.189 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.189 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.189 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.189 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.189 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.189 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.190 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.190 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.190 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.190 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.190 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.190 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.191 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.191 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.191 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.191 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.192 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.192 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.192 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.192 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.192 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.192 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.193 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.193 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.193 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.193 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.193 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.193 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.194 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:28:46.906198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.194 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.194 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.194 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.194 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.194 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.195 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.195 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.195 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.195 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.195 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.195 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.196 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.196 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.196 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.196 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.196 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.196 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.197 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.197 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.197 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.197 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.197 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.197 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.198 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.198 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.198 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.198 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.198 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.198 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.199 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.199 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.199 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.199 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.199 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.199 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.200 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.200 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.200 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.200 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.200 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.200 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.201 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.201 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.201 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.201 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.201 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.201 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.202 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.203 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.204 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:31.204 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:33:51.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:33:51.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.329+0000 7fa793a07640 1 Processor -- start 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.329+0000 7fa793a07640 1 -- start start 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa78c06dbd0 0x7fa78c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c071c10 con 0x7fa78c06d0e0 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c072230 con 0x7fa78c06dbd0 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa790fa2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa78c06dbd0 0x7fa78c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa790fa2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa78c06dbd0 0x7fa78c131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51960/0 (socket says 172.21.15.112:51960) 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa790fa2640 1 -- 172.21.15.112:0/2942762325 learned_addr learned my addr 172.21.15.112:0/2942762325 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa7917a3640 1 --1- 172.21.15.112:0/2942762325 >> v1:172.21.15.112:6789/0 conn(0x7fa78c06d0e0 0x7fa78c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43832/0 (socket says 172.21.15.112:43832) 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa790fa2640 1 -- 172.21.15.112:0/2942762325 >> v1:172.21.15.112:6789/0 conn(0x7fa78c06d0e0 legacy=0x7fa78c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T06:33:51.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa790fa2640 1 -- 172.21.15.112:0/2942762325 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0709e0 con 0x7fa78c06dbd0 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa790fa2640 1 --2- 172.21.15.112:0/2942762325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06dbd0 0x7fa78c131e60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7880097f0 tx=0x7fa78801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f0c0c2283d0406 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa783fff640 1 -- 172.21.15.112:0/2942762325 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7880b0070 con 0x7fa78c06dbd0 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa783fff640 1 -- 172.21.15.112:0/2942762325 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7880ab530 con 0x7fa78c06dbd0 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa783fff640 1 -- 172.21.15.112:0/2942762325 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7880ab830 con 0x7fa78c06dbd0 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 -- 172.21.15.112:0/2942762325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06dbd0 msgr2=0x7fa78c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 --2- 172.21.15.112:0/2942762325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06dbd0 0x7fa78c131e60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7880097f0 tx=0x7fa78801c3f0 comp rx=0 tx=0).stop 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 -- 172.21.15.112:0/2942762325 shutdown_connections 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 --2- 172.21.15.112:0/2942762325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06dbd0 0x7fa78c131e60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 -- 172.21.15.112:0/2942762325 >> 172.21.15.112:0/2942762325 conn(0x7fa78c099a50 msgr2=0x7fa78c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.333+0000 7fa793a07640 1 -- 172.21.15.112:0/2942762325 shutdown_connections 2024-09-13T06:33:51.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 -- 172.21.15.112:0/2942762325 wait complete. 2024-09-13T06:33:51.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 Processor -- start 2024-09-13T06:33:51.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 -- start start 2024-09-13T06:33:51.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 0x7fa78c129360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:51.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c134d40 con 0x7fa78c06d0e0 2024-09-13T06:33:51.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa7917a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 0x7fa78c129360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa7917a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 0x7fa78c129360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51972/0 (socket says 172.21.15.112:51972) 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa7917a3640 1 -- 172.21.15.112:0/3608175202 learned_addr learned my addr 172.21.15.112:0/3608175202 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa7917a3640 1 -- 172.21.15.112:0/3608175202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c1284a0 con 0x7fa78c06d0e0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa7917a3640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 0x7fa78c129360 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c3e0 tx=0x7fa77c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c017070 con 0x7fa78c06d0e0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c007430 con 0x7fa78c06d0e0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c005800 con 0x7fa78c06d0e0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c127fe0 con 0x7fa78c06d0e0 2024-09-13T06:33:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c129a70 con 0x7fa78c06d0e0 2024-09-13T06:33:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.337+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c06d4c0 con 0x7fa78c06d0e0 2024-09-13T06:33:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.341+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa77c01a070 con 0x7fa78c06d0e0 2024-09-13T06:33:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.341+0000 7fa781ffb640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa770035db0 0x7fa770038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:33:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.341+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7fa77c0484e0 con 0x7fa78c06d0e0 2024-09-13T06:33:51.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.341+0000 7fa790fa2640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa770035db0 0x7fa770038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:33:51.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.341+0000 7fa790fa2640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa770035db0 0x7fa770038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa7880ad000 tx=0x7fa7880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:33:51.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.345+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa77c019e10 con 0x7fa78c06d0e0 2024-09-13T06:33:51.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.505+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa78c128780 con 0x7fa770035db0 2024-09-13T06:33:51.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.549+0000 7fa781ffb640 1 -- 172.21.15.112:0/3608175202 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664649 (secure 0 0 0) 0x7fa7880b1040 con 0x7fa770035db0 2024-09-13T06:33:51.558 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:33:51.564 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:33:51.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa770035db0 msgr2=0x7fa770038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:51.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa770035db0 0x7fa770038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa7880ad000 tx=0x7fa7880a6000 comp rx=0 tx=0).stop 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 msgr2=0x7fa78c129360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 0x7fa78c129360 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c3e0 tx=0x7fa77c00c8a0 comp rx=0 tx=0).stop 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 shutdown_connections 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7fa770035db0 0x7fa770038270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 --2- 172.21.15.112:0/3608175202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa78c06d0e0 0x7fa78c129360 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 >> 172.21.15.112:0/3608175202 conn(0x7fa78c099a50 msgr2=0x7fa78c09b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 shutdown_connections 2024-09-13T06:33:51.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:33:51.553+0000 7fa793a07640 1 -- 172.21.15.112:0/3608175202 wait complete. 2024-09-13T06:33:51.579 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-09-13T06:33:50.539157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5100,"num_read_kb":4685,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4781,"ondisk_log_size":4781,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156800,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330560,"statfs":{"total":386547056640,"available":386386493440,"internally_reserved":0,"allocated":3014656,"data_stored":1787848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.157322+0000","last_change":"2024-09-13T06:33:33.157397+0000","last_active":"2024-09-13T06:33:33.157322+0000","last_peered":"2024-09-13T06:33:33.157322+0000","last_clean":"2024-09-13T06:33:33.157322+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:33:33.157322+0000","last_undegraded":"2024-09-13T06:33:33.157322+0000","last_fullsized":"2024-09-13T06:33:33.157322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:33.157130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:33.157130+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.157130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:42.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.071994+0000","last_change":"2024-09-13T06:33:29.072054+0000","last_active":"2024-09-13T06:33:29.071994+0000","last_peered":"2024-09-13T06:33:29.071994+0000","last_clean":"2024-09-13T06:33:29.071994+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:33:29.071994+0000","last_undegraded":"2024-09-13T06:33:29.071994+0000","last_fullsized":"2024-09-13T06:33:29.071994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:29.071796+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:29.071796+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.071796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:41.533368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.733998+0000","last_change":"2024-09-13T06:33:33.734130+0000","last_active":"2024-09-13T06:33:33.733998+0000","last_peered":"2024-09-13T06:33:33.733998+0000","last_clean":"2024-09-13T06:33:33.733998+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:33:33.733998+0000","last_undegraded":"2024-09-13T06:33:33.733998+0000","last_fullsized":"2024-09-13T06:33:33.733998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:33.733759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:33.733759+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.733759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:07.359357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.953235+0000","last_change":"2024-09-13T06:33:28.953296+0000","last_active":"2024-09-13T06:33:28.953235+0000","last_peered":"2024-09-13T06:33:28.953235+0000","last_clean":"2024-09-13T06:33:28.953235+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:33:28.953235+0000","last_undegraded":"2024-09-13T06:33:28.953235+0000","last_fullsized":"2024-09-13T06:33:28.953235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:28.953054+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:28.953054+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.953054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:07.494409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.840607+0000","last_change":"2024-09-13T06:33:35.840718+0000","last_active":"2024-09-13T06:33:35.840607+0000","last_peered":"2024-09-13T06:33:35.840607+0000","last_clean":"2024-09-13T06:33:35.840607+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:33:35.840607+0000","last_undegraded":"2024-09-13T06:33:35.840607+0000","last_fullsized":"2024-09-13T06:33:35.840607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:35.840309+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:35.840309+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.840309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:45.942898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:43.735093+0000","last_change":"2024-09-13T06:33:43.735154+0000","last_active":"2024-09-13T06:33:43.735093+0000","last_peered":"2024-09-13T06:33:43.735093+0000","last_clean":"2024-09-13T06:33:43.735093+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:33:43.735093+0000","last_undegraded":"2024-09-13T06:33:43.735093+0000","last_fullsized":"2024-09-13T06:33:43.735093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:43.734903+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:43.734903+0000","last_clean_scrub_stamp":"2024-09-13T06:33:43.734903+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:02:02.921235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.058932+0000","last_change":"2024-09-13T06:33:28.058989+0000","last_active":"2024-09-13T06:33:28.058932+0000","last_peered":"2024-09-13T06:33:28.058932+0000","last_clean":"2024-09-13T06:33:28.058932+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:33:28.058932+0000","last_undegraded":"2024-09-13T06:33:28.058932+0000","last_fullsized":"2024-09-13T06:33:28.058932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:28.058693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:28.058693+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.058693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:14.652930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:45.697182+0000","last_change":"2024-09-13T06:33:45.697243+0000","last_active":"2024-09-13T06:33:45.697182+0000","last_peered":"2024-09-13T06:33:45.697182+0000","last_clean":"2024-09-13T06:33:45.697182+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:33:45.697182+0000","last_undegraded":"2024-09-13T06:33:45.697182+0000","last_fullsized":"2024-09-13T06:33:45.697182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:45.696996+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:45.696996+0000","last_clean_scrub_stamp":"2024-09-13T06:33:45.696996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:58.187246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:46.053762+0000","last_change":"2024-09-13T06:33:46.053892+0000","last_active":"2024-09-13T06:33:46.053762+0000","last_peered":"2024-09-13T06:33:46.053762+0000","last_clean":"2024-09-13T06:33:46.053762+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:33:46.053762+0000","last_undegraded":"2024-09-13T06:33:46.053762+0000","last_fullsized":"2024-09-13T06:33:46.053762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:46.053513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:46.053513+0000","last_clean_scrub_stamp":"2024-09-13T06:33:46.053513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:10:35.709191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.653904+0000","last_change":"2024-09-13T06:33:15.653971+0000","last_active":"2024-09-13T06:33:15.653904+0000","last_peered":"2024-09-13T06:33:15.653904+0000","last_clean":"2024-09-13T06:33:15.653904+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:33:15.653904+0000","last_undegraded":"2024-09-13T06:33:15.653904+0000","last_fullsized":"2024-09-13T06:33:15.653904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:15.653721+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:15.653721+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.653721+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:58.261366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:41.125886+0000","last_change":"2024-09-13T06:33:41.125939+0000","last_active":"2024-09-13T06:33:41.125886+0000","last_peered":"2024-09-13T06:33:41.125886+0000","last_clean":"2024-09-13T06:33:41.125886+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:33:41.125886+0000","last_undegraded":"2024-09-13T06:33:41.125886+0000","last_fullsized":"2024-09-13T06:33:41.125886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:41.125689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:41.125689+0000","last_clean_scrub_stamp":"2024-09-13T06:33:41.125689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:53.615939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.975152+0000","last_change":"2024-09-13T06:33:16.975268+0000","last_active":"2024-09-13T06:33:16.975152+0000","last_peered":"2024-09-13T06:33:16.975152+0000","last_clean":"2024-09-13T06:33:16.975152+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:33:16.975152+0000","last_undegraded":"2024-09-13T06:33:16.975152+0000","last_fullsized":"2024-09-13T06:33:16.975152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:16.974924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:16.974924+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.974924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:32.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495163+0000","last_change":"2024-09-13T06:28:58.719307+0000","last_active":"2024-09-13T06:31:30.495163+0000","last_peered":"2024-09-13T06:31:30.495163+0000","last_clean":"2024-09-13T06:31:30.495163+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:31:30.495163+0000","last_undegraded":"2024-09-13T06:31:30.495163+0000","last_fullsized":"2024-09-13T06:31:30.495163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.944658+0000","last_change":"2024-09-13T06:33:15.944720+0000","last_active":"2024-09-13T06:33:15.944658+0000","last_peered":"2024-09-13T06:33:15.944658+0000","last_clean":"2024-09-13T06:33:15.944658+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:33:15.944658+0000","last_undegraded":"2024-09-13T06:33:15.944658+0000","last_fullsized":"2024-09-13T06:33:15.944658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:15.944444+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:15.944444+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.944444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:43.352704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:30.495042+0000","last_change":"2024-09-13T06:28:58.711558+0000","last_active":"2024-09-13T06:31:30.495042+0000","last_peered":"2024-09-13T06:31:30.495042+0000","last_clean":"2024-09-13T06:31:30.495042+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:31:30.495042+0000","last_undegraded":"2024-09-13T06:31:30.495042+0000","last_fullsized":"2024-09-13T06:31:30.495042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.112970+0000","last_change":"2024-09-13T06:33:11.113036+0000","last_active":"2024-09-13T06:33:11.112970+0000","last_peered":"2024-09-13T06:33:11.112970+0000","last_clean":"2024-09-13T06:33:11.112970+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:33:11.112970+0000","last_undegraded":"2024-09-13T06:33:11.112970+0000","last_fullsized":"2024-09-13T06:33:11.112970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:11.112754+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:11.112754+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.112754+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:55:36.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.623277+0000","last_change":"2024-09-13T06:29:00.714459+0000","last_active":"2024-09-13T06:32:48.623277+0000","last_peered":"2024-09-13T06:32:48.623277+0000","last_clean":"2024-09-13T06:32:48.623277+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:32:48.623277+0000","last_undegraded":"2024-09-13T06:32:48.623277+0000","last_fullsized":"2024-09-13T06:32:48.623277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.837021+0000","last_change":"2024-09-13T06:33:27.837021+0000","last_active":"2024-09-13T06:33:27.837021+0000","last_peered":"2024-09-13T06:33:27.837021+0000","last_clean":"2024-09-13T06:33:27.837021+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:33:27.837021+0000","last_undegraded":"2024-09-13T06:33:27.837021+0000","last_fullsized":"2024-09-13T06:33:27.837021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:27.836778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:27.836778+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.836778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:55.245038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.996229+0000","last_change":"2024-09-13T06:33:17.996229+0000","last_active":"2024-09-13T06:33:17.996229+0000","last_peered":"2024-09-13T06:33:17.996229+0000","last_clean":"2024-09-13T06:33:17.996229+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:33:17.996229+0000","last_undegraded":"2024-09-13T06:33:17.996229+0000","last_fullsized":"2024-09-13T06:33:17.996229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:17.995815+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:17.995815+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.995815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:56.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.068513+0000","last_change":"2024-09-13T06:33:30.068513+0000","last_active":"2024-09-13T06:33:30.068513+0000","last_peered":"2024-09-13T06:33:30.068513+0000","last_clean":"2024-09-13T06:33:30.068513+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:33:30.068513+0000","last_undegraded":"2024-09-13T06:33:30.068513+0000","last_fullsized":"2024-09-13T06:33:30.068513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:30.068258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:30.068258+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.068258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:55.393231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:47.045448+0000","last_change":"2024-09-13T06:33:47.045508+0000","last_active":"2024-09-13T06:33:47.045448+0000","last_peered":"2024-09-13T06:33:47.045448+0000","last_clean":"2024-09-13T06:33:47.045448+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:33:47.045448+0000","last_undegraded":"2024-09-13T06:33:47.045448+0000","last_fullsized":"2024-09-13T06:33:47.045448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:47.045239+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:47.045239+0000","last_clean_scrub_stamp":"2024-09-13T06:33:47.045239+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:39.517142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:45.045509+0000","last_change":"2024-09-13T06:33:45.045509+0000","last_active":"2024-09-13T06:33:45.045509+0000","last_peered":"2024-09-13T06:33:45.045509+0000","last_clean":"2024-09-13T06:33:45.045509+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:33:45.045509+0000","last_undegraded":"2024-09-13T06:33:45.045509+0000","last_fullsized":"2024-09-13T06:33:45.045509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:45.045236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:45.045236+0000","last_clean_scrub_stamp":"2024-09-13T06:33:45.045236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:26.491949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.253201+0000","last_change":"2024-09-13T06:33:07.253201+0000","last_active":"2024-09-13T06:33:07.253201+0000","last_peered":"2024-09-13T06:33:07.253201+0000","last_clean":"2024-09-13T06:33:07.253201+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:33:07.253201+0000","last_undegraded":"2024-09-13T06:33:07.253201+0000","last_fullsized":"2024-09-13T06:33:07.253201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:07.252909+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:07.252909+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.252909+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:11.908729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:44.082595+0000","last_change":"2024-09-13T06:33:44.082595+0000","last_active":"2024-09-13T06:33:44.082595+0000","last_peered":"2024-09-13T06:33:44.082595+0000","last_clean":"2024-09-13T06:33:44.082595+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:33:44.082595+0000","last_undegraded":"2024-09-13T06:33:44.082595+0000","last_fullsized":"2024-09-13T06:33:44.082595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:44.082336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:44.082336+0000","last_clean_scrub_stamp":"2024-09-13T06:33:44.082336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:56.848272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.148134+0000","last_change":"2024-09-13T06:33:10.148134+0000","last_active":"2024-09-13T06:33:10.148134+0000","last_peered":"2024-09-13T06:33:10.148134+0000","last_clean":"2024-09-13T06:33:10.148134+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:33:10.148134+0000","last_undegraded":"2024-09-13T06:33:10.148134+0000","last_fullsized":"2024-09-13T06:33:10.148134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:10.147709+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:10.147709+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.147709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.231738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:49.717319+0000","last_change":"2024-09-13T06:33:49.717319+0000","last_active":"2024-09-13T06:33:49.717319+0000","last_peered":"2024-09-13T06:33:49.717319+0000","last_clean":"2024-09-13T06:33:49.717319+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:33:49.717319+0000","last_undegraded":"2024-09-13T06:33:49.717319+0000","last_fullsized":"2024-09-13T06:33:49.717319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:49.717062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:49.717062+0000","last_clean_scrub_stamp":"2024-09-13T06:33:49.717062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:02.482998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.703315+0000","last_change":"2024-09-13T06:33:36.703315+0000","last_active":"2024-09-13T06:33:36.703315+0000","last_peered":"2024-09-13T06:33:36.703315+0000","last_clean":"2024-09-13T06:33:36.703315+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:33:36.703315+0000","last_undegraded":"2024-09-13T06:33:36.703315+0000","last_fullsized":"2024-09-13T06:33:36.703315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:36.703076+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:36.703076+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.703076+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:38.252127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.903679+0000","last_change":"2024-09-13T06:33:33.903679+0000","last_active":"2024-09-13T06:33:33.903679+0000","last_peered":"2024-09-13T06:33:33.903679+0000","last_clean":"2024-09-13T06:33:33.903679+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:33:33.903679+0000","last_undegraded":"2024-09-13T06:33:33.903679+0000","last_fullsized":"2024-09-13T06:33:33.903679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:33.903434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:33.903434+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.903434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:46.365006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'37","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:14.009354+0000","last_change":"2024-09-13T06:29:08.789945+0000","last_active":"2024-09-13T06:32:14.009354+0000","last_peered":"2024-09-13T06:32:14.009354+0000","last_clean":"2024-09-13T06:32:14.009354+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:32:14.009354+0000","last_undegraded":"2024-09-13T06:32:14.009354+0000","last_fullsized":"2024-09-13T06:32:14.009354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.905011+0000","last_change":"2024-09-13T06:33:22.905011+0000","last_active":"2024-09-13T06:33:22.905011+0000","last_peered":"2024-09-13T06:33:22.905011+0000","last_clean":"2024-09-13T06:33:22.905011+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:33:22.905011+0000","last_undegraded":"2024-09-13T06:33:22.905011+0000","last_fullsized":"2024-09-13T06:33:22.905011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:22.904618+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:22.904618+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.904618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:50:01.871288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987839+0000","last_change":"2024-09-13T06:28:58.714485+0000","last_active":"2024-09-13T06:32:49.987839+0000","last_peered":"2024-09-13T06:32:49.987839+0000","last_clean":"2024-09-13T06:32:49.987839+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:32:49.987839+0000","last_undegraded":"2024-09-13T06:32:49.987839+0000","last_fullsized":"2024-09-13T06:32:49.987839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.834815+0000","last_change":"2024-09-13T06:33:11.834872+0000","last_active":"2024-09-13T06:33:11.834815+0000","last_peered":"2024-09-13T06:33:11.834815+0000","last_clean":"2024-09-13T06:33:11.834815+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:33:11.834815+0000","last_undegraded":"2024-09-13T06:33:11.834815+0000","last_fullsized":"2024-09-13T06:33:11.834815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:11.834596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:11.834596+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.834596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:06.219464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.894997+0000","last_change":"2024-09-13T06:33:04.895065+0000","last_active":"2024-09-13T06:33:04.894997+0000","last_peered":"2024-09-13T06:33:04.894997+0000","last_clean":"2024-09-13T06:33:04.894997+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:33:04.894997+0000","last_undegraded":"2024-09-13T06:33:04.894997+0000","last_fullsized":"2024-09-13T06:33:04.894997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.894816+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:27.810903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.054401+0000","last_change":"2024-09-13T06:33:23.054454+0000","last_active":"2024-09-13T06:33:23.054401+0000","last_peered":"2024-09-13T06:33:23.054401+0000","last_clean":"2024-09-13T06:33:23.054401+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:33:23.054401+0000","last_undegraded":"2024-09-13T06:33:23.054401+0000","last_fullsized":"2024-09-13T06:33:23.054401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:23.054208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:23.054208+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.054208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:28.175323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498132+0000","last_change":"2024-09-13T06:29:08.770580+0000","last_active":"2024-09-13T06:31:34.498132+0000","last_peered":"2024-09-13T06:31:34.498132+0000","last_clean":"2024-09-13T06:31:34.498132+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:31:34.498132+0000","last_undegraded":"2024-09-13T06:31:34.498132+0000","last_fullsized":"2024-09-13T06:31:34.498132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:41.786937+0000","last_change":"2024-09-13T06:33:41.786937+0000","last_active":"2024-09-13T06:33:41.786937+0000","last_peered":"2024-09-13T06:33:41.786937+0000","last_clean":"2024-09-13T06:33:41.786937+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:33:41.786937+0000","last_undegraded":"2024-09-13T06:33:41.786937+0000","last_fullsized":"2024-09-13T06:33:41.786937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:41.786685+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:41.786685+0000","last_clean_scrub_stamp":"2024-09-13T06:33:41.786685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:29.422606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.069387+0000","last_change":"2024-09-13T06:33:29.069387+0000","last_active":"2024-09-13T06:33:29.069387+0000","last_peered":"2024-09-13T06:33:29.069387+0000","last_clean":"2024-09-13T06:33:29.069387+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:33:29.069387+0000","last_undegraded":"2024-09-13T06:33:29.069387+0000","last_fullsized":"2024-09-13T06:33:29.069387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:29.069109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:29.069109+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.069109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:06.525435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":235,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.805487+0000","last_change":"2024-09-13T06:33:15.805487+0000","last_active":"2024-09-13T06:33:15.805487+0000","last_peered":"2024-09-13T06:33:15.805487+0000","last_clean":"2024-09-13T06:33:15.805487+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:33:15.805487+0000","last_undegraded":"2024-09-13T06:33:15.805487+0000","last_fullsized":"2024-09-13T06:33:15.805487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:15.805232+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:15.805232+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.805232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:47.324786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.637045+0000","last_change":"2024-09-13T06:33:03.637131+0000","last_active":"2024-09-13T06:33:03.637045+0000","last_peered":"2024-09-13T06:33:03.637045+0000","last_clean":"2024-09-13T06:33:03.637045+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:33:03.637045+0000","last_undegraded":"2024-09-13T06:33:03.637045+0000","last_fullsized":"2024-09-13T06:33:03.637045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.636833+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:45.356483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.925817+0000","last_change":"2024-09-13T06:33:10.925869+0000","last_active":"2024-09-13T06:33:10.925817+0000","last_peered":"2024-09-13T06:33:10.925817+0000","last_clean":"2024-09-13T06:33:10.925817+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:33:10.925817+0000","last_undegraded":"2024-09-13T06:33:10.925817+0000","last_fullsized":"2024-09-13T06:33:10.925817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:10.925618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:10.925618+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.925618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:42.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.497745+0000","last_change":"2024-09-13T06:29:08.793304+0000","last_active":"2024-09-13T06:31:40.497745+0000","last_peered":"2024-09-13T06:31:40.497745+0000","last_clean":"2024-09-13T06:31:40.497745+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:31:40.497745+0000","last_undegraded":"2024-09-13T06:31:40.497745+0000","last_fullsized":"2024-09-13T06:31:40.497745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.922941+0000","last_change":"2024-09-13T06:33:26.922941+0000","last_active":"2024-09-13T06:33:26.922941+0000","last_peered":"2024-09-13T06:33:26.922941+0000","last_clean":"2024-09-13T06:33:26.922941+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:33:26.922941+0000","last_undegraded":"2024-09-13T06:33:26.922941+0000","last_fullsized":"2024-09-13T06:33:26.922941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T06:33:26.922557+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.922557+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.922557+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:01.027984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.166111+0000","last_change":"2024-09-13T06:33:34.166111+0000","last_active":"2024-09-13T06:33:34.166111+0000","last_peered":"2024-09-13T06:33:34.166111+0000","last_clean":"2024-09-13T06:33:34.166111+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:33:34.166111+0000","last_undegraded":"2024-09-13T06:33:34.166111+0000","last_fullsized":"2024-09-13T06:33:34.166111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:34.165835+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:34.165835+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.165835+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:51:15.809690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.848302+0000","last_change":"2024-09-13T06:32:56.848353+0000","last_active":"2024-09-13T06:32:56.848302+0000","last_peered":"2024-09-13T06:32:56.848302+0000","last_clean":"2024-09-13T06:32:56.848302+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:32:56.848302+0000","last_undegraded":"2024-09-13T06:32:56.848302+0000","last_fullsized":"2024-09-13T06:32:56.848302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.848110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:46.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'16","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.240975+0000","last_change":"2024-09-13T06:33:03.240975+0000","last_active":"2024-09-13T06:33:03.240975+0000","last_peered":"2024-09-13T06:33:03.240975+0000","last_clean":"2024-09-13T06:33:03.240975+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:33:03.240975+0000","last_undegraded":"2024-09-13T06:33:03.240975+0000","last_fullsized":"2024-09-13T06:33:03.240975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.240667+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:49.440163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.778213+0000","last_change":"2024-09-13T06:33:01.778272+0000","last_active":"2024-09-13T06:33:01.778213+0000","last_peered":"2024-09-13T06:33:01.778213+0000","last_clean":"2024-09-13T06:33:01.778213+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:33:01.778213+0000","last_undegraded":"2024-09-13T06:33:01.778213+0000","last_fullsized":"2024-09-13T06:33:01.778213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.777993+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:14.895259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'3","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.159993+0000","last_change":"2024-09-13T06:32:50.160119+0000","last_active":"2024-09-13T06:32:50.159993+0000","last_peered":"2024-09-13T06:32:50.159993+0000","last_clean":"2024-09-13T06:32:50.159993+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:50.159993+0000","last_undegraded":"2024-09-13T06:32:50.159993+0000","last_fullsized":"2024-09-13T06:32:50.159993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.159726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:36:19.505279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.839536+0000","last_change":"2024-09-13T06:33:16.839536+0000","last_active":"2024-09-13T06:33:16.839536+0000","last_peered":"2024-09-13T06:33:16.839536+0000","last_clean":"2024-09-13T06:33:16.839536+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:33:16.839536+0000","last_undegraded":"2024-09-13T06:33:16.839536+0000","last_fullsized":"2024-09-13T06:33:16.839536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:16.839234+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:16.839234+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.839234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:56.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:40.094984+0000","last_change":"2024-09-13T06:33:40.095103+0000","last_active":"2024-09-13T06:33:40.094984+0000","last_peered":"2024-09-13T06:33:40.094984+0000","last_clean":"2024-09-13T06:33:40.094984+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:33:40.094984+0000","last_undegraded":"2024-09-13T06:33:40.094984+0000","last_fullsized":"2024-09-13T06:33:40.094984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:40.094753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:40.094753+0000","last_clean_scrub_stamp":"2024-09-13T06:33:40.094753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:45.387897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.951734+0000","last_change":"2024-09-13T06:33:12.951791+0000","last_active":"2024-09-13T06:33:12.951734+0000","last_peered":"2024-09-13T06:33:12.951734+0000","last_clean":"2024-09-13T06:33:12.951734+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:33:12.951734+0000","last_undegraded":"2024-09-13T06:33:12.951734+0000","last_fullsized":"2024-09-13T06:33:12.951734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.951537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.951537+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.951537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:01.784492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.920916+0000","last_change":"2024-09-13T06:33:09.920987+0000","last_active":"2024-09-13T06:33:09.920916+0000","last_peered":"2024-09-13T06:33:09.920916+0000","last_clean":"2024-09-13T06:33:09.920916+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:33:09.920916+0000","last_undegraded":"2024-09-13T06:33:09.920916+0000","last_fullsized":"2024-09-13T06:33:09.920916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:09.920723+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:09.920723+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.920723+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:18:43.608859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":419,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.878079+0000","last_change":"2024-09-13T06:33:09.878079+0000","last_active":"2024-09-13T06:33:09.878079+0000","last_peered":"2024-09-13T06:33:09.878079+0000","last_clean":"2024-09-13T06:33:09.878079+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:33:09.878079+0000","last_undegraded":"2024-09-13T06:33:09.878079+0000","last_fullsized":"2024-09-13T06:33:09.878079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:09.877840+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:09.877840+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.877840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:33.591992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.136077+0000","last_change":"2024-09-13T06:33:37.136142+0000","last_active":"2024-09-13T06:33:37.136077+0000","last_peered":"2024-09-13T06:33:37.136077+0000","last_clean":"2024-09-13T06:33:37.136077+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:33:37.136077+0000","last_undegraded":"2024-09-13T06:33:37.136077+0000","last_fullsized":"2024-09-13T06:33:37.136077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:37.135886+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:37.135886+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.135886+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:02:55.426032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.152928+0000","last_change":"2024-09-13T06:33:38.152986+0000","last_active":"2024-09-13T06:33:38.152928+0000","last_peered":"2024-09-13T06:33:38.152928+0000","last_clean":"2024-09-13T06:33:38.152928+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:33:38.152928+0000","last_undegraded":"2024-09-13T06:33:38.152928+0000","last_fullsized":"2024-09-13T06:33:38.152928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:38.152743+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:38.152743+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.152743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:27.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.602144+0000","last_change":"2024-09-13T06:33:05.602144+0000","last_active":"2024-09-13T06:33:05.602144+0000","last_peered":"2024-09-13T06:33:05.602144+0000","last_clean":"2024-09-13T06:33:05.602144+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:33:05.602144+0000","last_undegraded":"2024-09-13T06:33:05.602144+0000","last_fullsized":"2024-09-13T06:33:05.602144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:05.601881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:05.601881+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.601881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:26.049665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'52","reported_seq":117,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.790158+0000","last_change":"2024-09-13T06:32:50.790158+0000","last_active":"2024-09-13T06:32:50.790158+0000","last_peered":"2024-09-13T06:32:50.790158+0000","last_clean":"2024-09-13T06:32:50.790158+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:32:50.790158+0000","last_undegraded":"2024-09-13T06:32:50.790158+0000","last_fullsized":"2024-09-13T06:32:50.790158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'52","last_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_deep_scrub":"35'52","last_deep_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.789873+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:31.896380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.587596+0000","last_change":"2024-09-13T06:32:56.587596+0000","last_active":"2024-09-13T06:32:56.587596+0000","last_peered":"2024-09-13T06:32:56.587596+0000","last_clean":"2024-09-13T06:32:56.587596+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:32:56.587596+0000","last_undegraded":"2024-09-13T06:32:56.587596+0000","last_fullsized":"2024-09-13T06:32:56.587596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.587340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:07:15.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.131201+0000","last_change":"2024-09-13T06:33:32.131265+0000","last_active":"2024-09-13T06:33:32.131201+0000","last_peered":"2024-09-13T06:33:32.131201+0000","last_clean":"2024-09-13T06:33:32.131201+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:33:32.131201+0000","last_undegraded":"2024-09-13T06:33:32.131201+0000","last_fullsized":"2024-09-13T06:33:32.131201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T06:33:32.130996+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T06:33:32.130996+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.130996+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:18.817438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'26","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.850829+0000","last_change":"2024-09-13T06:33:48.850894+0000","last_active":"2024-09-13T06:33:48.850829+0000","last_peered":"2024-09-13T06:33:48.850829+0000","last_clean":"2024-09-13T06:33:48.850829+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:33:48.850829+0000","last_undegraded":"2024-09-13T06:33:48.850829+0000","last_fullsized":"2024-09-13T06:33:48.850829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'26","last_scrub_stamp":"2024-09-13T06:33:48.850637+0000","last_deep_scrub":"35'26","last_deep_scrub_stamp":"2024-09-13T06:33:48.850637+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.850637+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:11.141910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622588+0000","last_change":"2024-09-13T06:28:58.706321+0000","last_active":"2024-09-13T06:32:48.622588+0000","last_peered":"2024-09-13T06:32:48.622588+0000","last_clean":"2024-09-13T06:32:48.622588+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:32:48.622588+0000","last_undegraded":"2024-09-13T06:32:48.622588+0000","last_fullsized":"2024-09-13T06:32:48.622588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.100618+0000","last_change":"2024-09-13T06:33:31.100669+0000","last_active":"2024-09-13T06:33:31.100618+0000","last_peered":"2024-09-13T06:33:31.100618+0000","last_clean":"2024-09-13T06:33:31.100618+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:33:31.100618+0000","last_undegraded":"2024-09-13T06:33:31.100618+0000","last_fullsized":"2024-09-13T06:33:31.100618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:31.100424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:31.100424+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.100424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:11.313219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.915760+0000","last_change":"2024-09-13T06:33:07.915760+0000","last_active":"2024-09-13T06:33:07.915760+0000","last_peered":"2024-09-13T06:33:07.915760+0000","last_clean":"2024-09-13T06:33:07.915760+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:33:07.915760+0000","last_undegraded":"2024-09-13T06:33:07.915760+0000","last_fullsized":"2024-09-13T06:33:07.915760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:07.915512+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:07.915512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.915512+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:06.613007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.875693+0000","last_change":"2024-09-13T06:33:02.875693+0000","last_active":"2024-09-13T06:33:02.875693+0000","last_peered":"2024-09-13T06:33:02.875693+0000","last_clean":"2024-09-13T06:33:02.875693+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:33:02.875693+0000","last_undegraded":"2024-09-13T06:33:02.875693+0000","last_fullsized":"2024-09-13T06:33:02.875693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.875433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:23.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"35'4","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.634982+0000","last_change":"2024-09-13T06:33:06.634982+0000","last_active":"2024-09-13T06:33:06.634982+0000","last_peered":"2024-09-13T06:33:06.634982+0000","last_clean":"2024-09-13T06:33:06.634982+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:33:06.634982+0000","last_undegraded":"2024-09-13T06:33:06.634982+0000","last_fullsized":"2024-09-13T06:33:06.634982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:06.634723+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:06.634723+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.634723+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:25.705695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.013201+0000","last_change":"2024-09-13T06:33:22.013201+0000","last_active":"2024-09-13T06:33:22.013201+0000","last_peered":"2024-09-13T06:33:22.013201+0000","last_clean":"2024-09-13T06:33:22.013201+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:33:22.013201+0000","last_undegraded":"2024-09-13T06:33:22.013201+0000","last_fullsized":"2024-09-13T06:33:22.013201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:22.012950+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:22.012950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.012950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:56.118377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:43.073363+0000","last_change":"2024-09-13T06:33:43.073457+0000","last_active":"2024-09-13T06:33:43.073363+0000","last_peered":"2024-09-13T06:33:43.073363+0000","last_clean":"2024-09-13T06:33:43.073363+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:33:43.073363+0000","last_undegraded":"2024-09-13T06:33:43.073363+0000","last_fullsized":"2024-09-13T06:33:43.073363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:43.073151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:43.073151+0000","last_clean_scrub_stamp":"2024-09-13T06:33:43.073151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:08.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.061702+0000","last_change":"2024-09-13T06:33:21.061702+0000","last_active":"2024-09-13T06:33:21.061702+0000","last_peered":"2024-09-13T06:33:21.061702+0000","last_clean":"2024-09-13T06:33:21.061702+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:33:21.061702+0000","last_undegraded":"2024-09-13T06:33:21.061702+0000","last_fullsized":"2024-09-13T06:33:21.061702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:21.061418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:21.061418+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.061418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:06.847057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.700748+0000","last_change":"2024-09-13T06:32:52.700748+0000","last_active":"2024-09-13T06:32:52.700748+0000","last_peered":"2024-09-13T06:32:52.700748+0000","last_clean":"2024-09-13T06:32:52.700748+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:32:52.700748+0000","last_undegraded":"2024-09-13T06:32:52.700748+0000","last_fullsized":"2024-09-13T06:32:52.700748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.700351+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.206602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":366,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.207721+0000","last_change":"2024-09-13T06:32:52.207721+0000","last_active":"2024-09-13T06:32:52.207721+0000","last_peered":"2024-09-13T06:32:52.207721+0000","last_clean":"2024-09-13T06:32:52.207721+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:52.207721+0000","last_undegraded":"2024-09-13T06:32:52.207721+0000","last_fullsized":"2024-09-13T06:32:52.207721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.207476+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:15:03.889652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.619884+0000","last_change":"2024-09-13T06:33:14.619884+0000","last_active":"2024-09-13T06:33:14.619884+0000","last_peered":"2024-09-13T06:33:14.619884+0000","last_clean":"2024-09-13T06:33:14.619884+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:33:14.619884+0000","last_undegraded":"2024-09-13T06:33:14.619884+0000","last_fullsized":"2024-09-13T06:33:14.619884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.619652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.619652+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.619652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:27.736918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.135567+0000","last_change":"2024-09-13T06:33:13.135567+0000","last_active":"2024-09-13T06:33:13.135567+0000","last_peered":"2024-09-13T06:33:13.135567+0000","last_clean":"2024-09-13T06:33:13.135567+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:33:13.135567+0000","last_undegraded":"2024-09-13T06:33:13.135567+0000","last_fullsized":"2024-09-13T06:33:13.135567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:13.135326+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:13.135326+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.135326+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622484+0000","last_change":"2024-09-13T06:30:39.578921+0000","last_active":"2024-09-13T06:32:48.622484+0000","last_peered":"2024-09-13T06:32:48.622484+0000","last_clean":"2024-09-13T06:32:48.622484+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:32:48.622484+0000","last_undegraded":"2024-09-13T06:32:48.622484+0000","last_fullsized":"2024-09-13T06:32:48.622484+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.223643+0000","last_change":"2024-09-13T06:33:04.223643+0000","last_active":"2024-09-13T06:33:04.223643+0000","last_peered":"2024-09-13T06:33:04.223643+0000","last_clean":"2024-09-13T06:33:04.223643+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:33:04.223643+0000","last_undegraded":"2024-09-13T06:33:04.223643+0000","last_fullsized":"2024-09-13T06:33:04.223643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.223407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:38.136551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'64","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.859700+0000","last_change":"2024-09-13T06:32:54.859700+0000","last_active":"2024-09-13T06:32:54.859700+0000","last_peered":"2024-09-13T06:32:54.859700+0000","last_clean":"2024-09-13T06:32:54.859700+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:32:54.859700+0000","last_undegraded":"2024-09-13T06:32:54.859700+0000","last_fullsized":"2024-09-13T06:32:54.859700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'64","last_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_deep_scrub":"35'64","last_deep_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.859285+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:01.758392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.285702+0000","last_change":"2024-09-13T06:32:59.285702+0000","last_active":"2024-09-13T06:32:59.285702+0000","last_peered":"2024-09-13T06:32:59.285702+0000","last_clean":"2024-09-13T06:32:59.285702+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:32:59.285702+0000","last_undegraded":"2024-09-13T06:32:59.285702+0000","last_fullsized":"2024-09-13T06:32:59.285702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.285313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:24.231597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.087324+0000","last_change":"2024-09-13T06:29:08.790553+0000","last_active":"2024-09-13T06:32:49.087324+0000","last_peered":"2024-09-13T06:32:49.087324+0000","last_clean":"2024-09-13T06:32:49.087324+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:32:49.087324+0000","last_undegraded":"2024-09-13T06:32:49.087324+0000","last_fullsized":"2024-09-13T06:32:49.087324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.739584+0000","last_change":"2024-09-13T06:33:21.739584+0000","last_active":"2024-09-13T06:33:21.739584+0000","last_peered":"2024-09-13T06:33:21.739584+0000","last_clean":"2024-09-13T06:33:21.739584+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:33:21.739584+0000","last_undegraded":"2024-09-13T06:33:21.739584+0000","last_fullsized":"2024-09-13T06:33:21.739584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:21.739350+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:21.739350+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.739350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.637065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:44.722265+0000","last_change":"2024-09-13T06:33:44.722324+0000","last_active":"2024-09-13T06:33:44.722265+0000","last_peered":"2024-09-13T06:33:44.722265+0000","last_clean":"2024-09-13T06:33:44.722265+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:33:44.722265+0000","last_undegraded":"2024-09-13T06:33:44.722265+0000","last_fullsized":"2024-09-13T06:33:44.722265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:44.722066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:44.722066+0000","last_clean_scrub_stamp":"2024-09-13T06:33:44.722066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:50.015211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.082652+0000","last_change":"2024-09-13T06:33:17.082652+0000","last_active":"2024-09-13T06:33:17.082652+0000","last_peered":"2024-09-13T06:33:17.082652+0000","last_clean":"2024-09-13T06:33:17.082652+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:33:17.082652+0000","last_undegraded":"2024-09-13T06:33:17.082652+0000","last_fullsized":"2024-09-13T06:33:17.082652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:17.082403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:17.082403+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.082403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:38:22.197973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.766296+0000","last_change":"2024-09-13T06:32:48.766296+0000","last_active":"2024-09-13T06:32:48.766296+0000","last_peered":"2024-09-13T06:32:48.766296+0000","last_clean":"2024-09-13T06:32:48.766296+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:32:48.766296+0000","last_undegraded":"2024-09-13T06:32:48.766296+0000","last_fullsized":"2024-09-13T06:32:48.766296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_clean_scrub_stamp":"2024-09-13T06:32:48.766165+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:25.779327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.914294+0000","last_change":"2024-09-13T06:33:05.914294+0000","last_active":"2024-09-13T06:33:05.914294+0000","last_peered":"2024-09-13T06:33:05.914294+0000","last_clean":"2024-09-13T06:33:05.914294+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:33:05.914294+0000","last_undegraded":"2024-09-13T06:33:05.914294+0000","last_fullsized":"2024-09-13T06:33:05.914294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:05.914013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:05.914013+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.914013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.141026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.922077+0000","last_change":"2024-09-13T06:33:29.922140+0000","last_active":"2024-09-13T06:33:29.922077+0000","last_peered":"2024-09-13T06:33:29.922077+0000","last_clean":"2024-09-13T06:33:29.922077+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:33:29.922077+0000","last_undegraded":"2024-09-13T06:33:29.922077+0000","last_fullsized":"2024-09-13T06:33:29.922077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:29.921858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:29.921858+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.921858+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:48.275561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.116652+0000","last_change":"2024-09-13T06:33:32.116652+0000","last_active":"2024-09-13T06:33:32.116652+0000","last_peered":"2024-09-13T06:33:32.116652+0000","last_clean":"2024-09-13T06:33:32.116652+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:33:32.116652+0000","last_undegraded":"2024-09-13T06:33:32.116652+0000","last_fullsized":"2024-09-13T06:33:32.116652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:32.116397+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:32.116397+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.116397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:46.941512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.162920+0000","last_change":"2024-09-13T06:33:35.162971+0000","last_active":"2024-09-13T06:33:35.162920+0000","last_peered":"2024-09-13T06:33:35.162920+0000","last_clean":"2024-09-13T06:33:35.162920+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:33:35.162920+0000","last_undegraded":"2024-09-13T06:33:35.162920+0000","last_fullsized":"2024-09-13T06:33:35.162920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:35.162724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:35.162724+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.162724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:56:50.432197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.582513+0000","last_change":"2024-09-13T06:33:08.582513+0000","last_active":"2024-09-13T06:33:08.582513+0000","last_peered":"2024-09-13T06:33:08.582513+0000","last_clean":"2024-09-13T06:33:08.582513+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:33:08.582513+0000","last_undegraded":"2024-09-13T06:33:08.582513+0000","last_fullsized":"2024-09-13T06:33:08.582513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:08.582269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:08.582269+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.582269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:12.495423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.303475+0000","last_change":"2024-09-13T06:33:00.303475+0000","last_active":"2024-09-13T06:33:00.303475+0000","last_peered":"2024-09-13T06:33:00.303475+0000","last_clean":"2024-09-13T06:33:00.303475+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:33:00.303475+0000","last_undegraded":"2024-09-13T06:33:00.303475+0000","last_fullsized":"2024-09-13T06:33:00.303475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.303147+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:58.846618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.270712+0000","last_change":"2024-09-13T06:32:58.270712+0000","last_active":"2024-09-13T06:32:58.270712+0000","last_peered":"2024-09-13T06:32:58.270712+0000","last_clean":"2024-09-13T06:32:58.270712+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:58.270712+0000","last_undegraded":"2024-09-13T06:32:58.270712+0000","last_fullsized":"2024-09-13T06:32:58.270712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.270455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:12.264581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'15","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.561385+0000","last_change":"2024-09-13T06:33:10.561385+0000","last_active":"2024-09-13T06:33:10.561385+0000","last_peered":"2024-09-13T06:33:10.561385+0000","last_clean":"2024-09-13T06:33:10.561385+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:33:10.561385+0000","last_undegraded":"2024-09-13T06:33:10.561385+0000","last_fullsized":"2024-09-13T06:33:10.561385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:33:10.561099+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:33:10.561099+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.561099+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:30.846539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.087093+0000","last_change":"2024-09-13T06:33:12.087093+0000","last_active":"2024-09-13T06:33:12.087093+0000","last_peered":"2024-09-13T06:33:12.087093+0000","last_clean":"2024-09-13T06:33:12.087093+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:33:12.087093+0000","last_undegraded":"2024-09-13T06:33:12.087093+0000","last_fullsized":"2024-09-13T06:33:12.087093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:12.086827+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:12.086827+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.086827+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:09.434984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:40.810245+0000","last_change":"2024-09-13T06:33:40.810303+0000","last_active":"2024-09-13T06:33:40.810245+0000","last_peered":"2024-09-13T06:33:40.810245+0000","last_clean":"2024-09-13T06:33:40.810245+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:33:40.810245+0000","last_undegraded":"2024-09-13T06:33:40.810245+0000","last_fullsized":"2024-09-13T06:33:40.810245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:40.810050+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:40.810050+0000","last_clean_scrub_stamp":"2024-09-13T06:33:40.810050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:31.719902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":434,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.623406+0000","last_change":"2024-09-13T06:29:39.536344+0000","last_active":"2024-09-13T06:32:48.623406+0000","last_peered":"2024-09-13T06:32:48.623406+0000","last_clean":"2024-09-13T06:32:48.623406+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:32:48.623406+0000","last_undegraded":"2024-09-13T06:32:48.623406+0000","last_fullsized":"2024-09-13T06:32:48.623406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:01.690319+0000","last_clean_scrub_stamp":"2024-09-13T06:29:01.690319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.883556+0000","last_change":"2024-09-13T06:32:52.883556+0000","last_active":"2024-09-13T06:32:52.883556+0000","last_peered":"2024-09-13T06:32:52.883556+0000","last_clean":"2024-09-13T06:32:52.883556+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:32:52.883556+0000","last_undegraded":"2024-09-13T06:32:52.883556+0000","last_fullsized":"2024-09-13T06:32:52.883556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.883251+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:35.305885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":483,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.772503+0000","last_change":"2024-09-13T06:33:00.772503+0000","last_active":"2024-09-13T06:33:00.772503+0000","last_peered":"2024-09-13T06:33:00.772503+0000","last_clean":"2024-09-13T06:33:00.772503+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:33:00.772503+0000","last_undegraded":"2024-09-13T06:33:00.772503+0000","last_fullsized":"2024-09-13T06:33:00.772503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.772062+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:06.999075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.090208+0000","last_change":"2024-09-13T06:33:33.090269+0000","last_active":"2024-09-13T06:33:33.090208+0000","last_peered":"2024-09-13T06:33:33.090208+0000","last_clean":"2024-09-13T06:33:33.090208+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:33:33.090208+0000","last_undegraded":"2024-09-13T06:33:33.090208+0000","last_fullsized":"2024-09-13T06:33:33.090208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:33.090024+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:33.090024+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.090024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:42.079817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.640866+0000","last_change":"2024-09-13T06:33:16.640866+0000","last_active":"2024-09-13T06:33:16.640866+0000","last_peered":"2024-09-13T06:33:16.640866+0000","last_clean":"2024-09-13T06:33:16.640866+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:33:16.640866+0000","last_undegraded":"2024-09-13T06:33:16.640866+0000","last_fullsized":"2024-09-13T06:33:16.640866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:16.640589+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:16.640589+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.640589+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:17:00.531843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:46.662525+0000","last_change":"2024-09-13T06:33:46.662591+0000","last_active":"2024-09-13T06:33:46.662525+0000","last_peered":"2024-09-13T06:33:46.662525+0000","last_clean":"2024-09-13T06:33:46.662525+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:33:46.662525+0000","last_undegraded":"2024-09-13T06:33:46.662525+0000","last_fullsized":"2024-09-13T06:33:46.662525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:46.662329+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:46.662329+0000","last_clean_scrub_stamp":"2024-09-13T06:33:46.662329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:42.606357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.787639+0000","last_change":"2024-09-13T06:33:12.787639+0000","last_active":"2024-09-13T06:33:12.787639+0000","last_peered":"2024-09-13T06:33:12.787639+0000","last_clean":"2024-09-13T06:33:12.787639+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:33:12.787639+0000","last_undegraded":"2024-09-13T06:33:12.787639+0000","last_fullsized":"2024-09-13T06:33:12.787639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.787273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.787273+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.787273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:37:33.223408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.874009+0000","last_change":"2024-09-13T06:33:07.874009+0000","last_active":"2024-09-13T06:33:07.874009+0000","last_peered":"2024-09-13T06:33:07.874009+0000","last_clean":"2024-09-13T06:33:07.874009+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:33:07.874009+0000","last_undegraded":"2024-09-13T06:33:07.874009+0000","last_fullsized":"2024-09-13T06:33:07.874009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.873746+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:28.536287+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.843311+0000","last_change":"2024-09-13T06:33:06.843311+0000","last_active":"2024-09-13T06:33:06.843311+0000","last_peered":"2024-09-13T06:33:06.843311+0000","last_clean":"2024-09-13T06:33:06.843311+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:33:06.843311+0000","last_undegraded":"2024-09-13T06:33:06.843311+0000","last_fullsized":"2024-09-13T06:33:06.843311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.843049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:01.227917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.680373+0000","last_change":"2024-09-13T06:33:02.680373+0000","last_active":"2024-09-13T06:33:02.680373+0000","last_peered":"2024-09-13T06:33:02.680373+0000","last_clean":"2024-09-13T06:33:02.680373+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:33:02.680373+0000","last_undegraded":"2024-09-13T06:33:02.680373+0000","last_fullsized":"2024-09-13T06:33:02.680373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.680110+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:47.873890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.996699+0000","last_change":"2024-09-13T06:33:19.996757+0000","last_active":"2024-09-13T06:33:19.996699+0000","last_peered":"2024-09-13T06:33:19.996699+0000","last_clean":"2024-09-13T06:33:19.996699+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:33:19.996699+0000","last_undegraded":"2024-09-13T06:33:19.996699+0000","last_fullsized":"2024-09-13T06:33:19.996699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:19.996506+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:19.996506+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.996506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:32.959583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":217,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:40.749350+0000","last_change":"2024-09-13T06:33:40.749499+0000","last_active":"2024-09-13T06:33:40.749350+0000","last_peered":"2024-09-13T06:33:40.749350+0000","last_clean":"2024-09-13T06:33:40.749350+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:33:40.749350+0000","last_undegraded":"2024-09-13T06:33:40.749350+0000","last_fullsized":"2024-09-13T06:33:40.749350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-13T06:33:40.749128+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-13T06:33:40.749128+0000","last_clean_scrub_stamp":"2024-09-13T06:33:40.749128+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:05.460741+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622346+0000","last_change":"2024-09-13T06:28:52.961108+0000","last_active":"2024-09-13T06:32:48.622346+0000","last_peered":"2024-09-13T06:32:48.622346+0000","last_clean":"2024-09-13T06:32:48.622346+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:32:48.622346+0000","last_undegraded":"2024-09-13T06:32:48.622346+0000","last_fullsized":"2024-09-13T06:32:48.622346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987769+0000","last_change":"2024-09-13T06:28:58.714159+0000","last_active":"2024-09-13T06:32:49.987769+0000","last_peered":"2024-09-13T06:32:49.987769+0000","last_clean":"2024-09-13T06:32:49.987769+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:32:49.987769+0000","last_undegraded":"2024-09-13T06:32:49.987769+0000","last_fullsized":"2024-09-13T06:32:49.987769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.600470+0000","last_change":"2024-09-13T06:33:12.600470+0000","last_active":"2024-09-13T06:33:12.600470+0000","last_peered":"2024-09-13T06:33:12.600470+0000","last_clean":"2024-09-13T06:33:12.600470+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:33:12.600470+0000","last_undegraded":"2024-09-13T06:33:12.600470+0000","last_fullsized":"2024-09-13T06:33:12.600470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.600063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.600063+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.600063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:35.516149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'87","reported_seq":182,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.822144+0000","last_change":"2024-09-13T06:33:04.822144+0000","last_active":"2024-09-13T06:33:04.822144+0000","last_peered":"2024-09-13T06:33:04.822144+0000","last_clean":"2024-09-13T06:33:04.822144+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:33:04.822144+0000","last_undegraded":"2024-09-13T06:33:04.822144+0000","last_fullsized":"2024-09-13T06:33:04.822144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'87","last_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_deep_scrub":"35'87","last_deep_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.821761+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:28.535913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.856678+0000","last_change":"2024-09-13T06:33:17.856678+0000","last_active":"2024-09-13T06:33:17.856678+0000","last_peered":"2024-09-13T06:33:17.856678+0000","last_clean":"2024-09-13T06:33:17.856678+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:33:17.856678+0000","last_undegraded":"2024-09-13T06:33:17.856678+0000","last_fullsized":"2024-09-13T06:33:17.856678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:17.856435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:17.856435+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.856435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:06.689390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.252336+0000","last_change":"2024-09-13T06:33:05.252336+0000","last_active":"2024-09-13T06:33:05.252336+0000","last_peered":"2024-09-13T06:33:05.252336+0000","last_clean":"2024-09-13T06:33:05.252336+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:33:05.252336+0000","last_undegraded":"2024-09-13T06:33:05.252336+0000","last_fullsized":"2024-09-13T06:33:05.252336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.252089+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:32.271264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.883826+0000","last_change":"2024-09-13T06:33:19.883826+0000","last_active":"2024-09-13T06:33:19.883826+0000","last_peered":"2024-09-13T06:33:19.883826+0000","last_clean":"2024-09-13T06:33:19.883826+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:33:19.883826+0000","last_undegraded":"2024-09-13T06:33:19.883826+0000","last_fullsized":"2024-09-13T06:33:19.883826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:19.883447+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:19.883447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.883447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:21.935843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622325+0000","last_change":"2024-09-13T06:28:52.959276+0000","last_active":"2024-09-13T06:32:48.622325+0000","last_peered":"2024-09-13T06:32:48.622325+0000","last_clean":"2024-09-13T06:32:48.622325+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:32:48.622325+0000","last_undegraded":"2024-09-13T06:32:48.622325+0000","last_fullsized":"2024-09-13T06:32:48.622325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:46.798598+0000","last_change":"2024-09-13T06:33:46.798712+0000","last_active":"2024-09-13T06:33:46.798598+0000","last_peered":"2024-09-13T06:33:46.798598+0000","last_clean":"2024-09-13T06:33:46.798598+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:33:46.798598+0000","last_undegraded":"2024-09-13T06:33:46.798598+0000","last_fullsized":"2024-09-13T06:33:46.798598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:46.798341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:46.798341+0000","last_clean_scrub_stamp":"2024-09-13T06:33:46.798341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:57.880169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.659844+0000","last_change":"2024-09-13T06:32:53.659844+0000","last_active":"2024-09-13T06:32:53.659844+0000","last_peered":"2024-09-13T06:32:53.659844+0000","last_clean":"2024-09-13T06:32:53.659844+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:32:53.659844+0000","last_undegraded":"2024-09-13T06:32:53.659844+0000","last_fullsized":"2024-09-13T06:32:53.659844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.659599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:12.730571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":521,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.680200+0000","last_change":"2024-09-13T06:33:01.680200+0000","last_active":"2024-09-13T06:33:01.680200+0000","last_peered":"2024-09-13T06:33:01.680200+0000","last_clean":"2024-09-13T06:33:01.680200+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:33:01.680200+0000","last_undegraded":"2024-09-13T06:33:01.680200+0000","last_fullsized":"2024-09-13T06:33:01.680200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.679952+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:20.338166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.834458+0000","last_change":"2024-09-13T06:32:59.834458+0000","last_active":"2024-09-13T06:32:59.834458+0000","last_peered":"2024-09-13T06:32:59.834458+0000","last_clean":"2024-09-13T06:32:59.834458+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:32:59.834458+0000","last_undegraded":"2024-09-13T06:32:59.834458+0000","last_fullsized":"2024-09-13T06:32:59.834458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.834212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:30.694348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.688785+0000","last_change":"2024-09-13T06:33:18.688785+0000","last_active":"2024-09-13T06:33:18.688785+0000","last_peered":"2024-09-13T06:33:18.688785+0000","last_clean":"2024-09-13T06:33:18.688785+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:33:18.688785+0000","last_undegraded":"2024-09-13T06:33:18.688785+0000","last_fullsized":"2024-09-13T06:33:18.688785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:33:18.688519+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:33:18.688519+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.688519+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:20.053682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.806444+0000","last_change":"2024-09-13T06:33:23.806507+0000","last_active":"2024-09-13T06:33:23.806444+0000","last_peered":"2024-09-13T06:33:23.806444+0000","last_clean":"2024-09-13T06:33:23.806444+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:33:23.806444+0000","last_undegraded":"2024-09-13T06:33:23.806444+0000","last_fullsized":"2024-09-13T06:33:23.806444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:23.806244+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:23.806244+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.806244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:32.624319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.025941+0000","last_change":"2024-09-13T06:33:23.025994+0000","last_active":"2024-09-13T06:33:23.025941+0000","last_peered":"2024-09-13T06:33:23.025941+0000","last_clean":"2024-09-13T06:33:23.025941+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:33:23.025941+0000","last_undegraded":"2024-09-13T06:33:23.025941+0000","last_fullsized":"2024-09-13T06:33:23.025941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:23.025749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:23.025749+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.025749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:38:38.648553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:45.840806+0000","last_change":"2024-09-13T06:33:45.840864+0000","last_active":"2024-09-13T06:33:45.840806+0000","last_peered":"2024-09-13T06:33:45.840806+0000","last_clean":"2024-09-13T06:33:45.840806+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:33:45.840806+0000","last_undegraded":"2024-09-13T06:33:45.840806+0000","last_fullsized":"2024-09-13T06:33:45.840806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:45.840584+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:45.840584+0000","last_clean_scrub_stamp":"2024-09-13T06:33:45.840584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:51.437297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.076554+0000","last_change":"2024-09-13T06:33:19.076554+0000","last_active":"2024-09-13T06:33:19.076554+0000","last_peered":"2024-09-13T06:33:19.076554+0000","last_clean":"2024-09-13T06:33:19.076554+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:33:19.076554+0000","last_undegraded":"2024-09-13T06:33:19.076554+0000","last_fullsized":"2024-09-13T06:33:19.076554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:19.076294+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:19.076294+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.076294+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:30.638206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.784194+0000","last_change":"2024-09-13T06:32:49.784194+0000","last_active":"2024-09-13T06:32:49.784194+0000","last_peered":"2024-09-13T06:32:49.784194+0000","last_clean":"2024-09-13T06:32:49.784194+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:49.784194+0000","last_undegraded":"2024-09-13T06:32:49.784194+0000","last_fullsized":"2024-09-13T06:32:49.784194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.784073+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:56.683180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.634660+0000","last_change":"2024-09-13T06:32:52.634660+0000","last_active":"2024-09-13T06:32:52.634660+0000","last_peered":"2024-09-13T06:32:52.634660+0000","last_clean":"2024-09-13T06:32:52.634660+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:32:52.634660+0000","last_undegraded":"2024-09-13T06:32:52.634660+0000","last_fullsized":"2024-09-13T06:32:52.634660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.634413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:42.199135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.989827+0000","last_change":"2024-09-13T06:29:08.788703+0000","last_active":"2024-09-13T06:32:49.989827+0000","last_peered":"2024-09-13T06:32:49.989827+0000","last_clean":"2024-09-13T06:32:49.989827+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:32:49.989827+0000","last_undegraded":"2024-09-13T06:32:49.989827+0000","last_fullsized":"2024-09-13T06:32:49.989827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.789715+0000","last_change":"2024-09-13T06:33:28.789779+0000","last_active":"2024-09-13T06:33:28.789715+0000","last_peered":"2024-09-13T06:33:28.789715+0000","last_clean":"2024-09-13T06:33:28.789715+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:33:28.789715+0000","last_undegraded":"2024-09-13T06:33:28.789715+0000","last_fullsized":"2024-09-13T06:33:28.789715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:28.789499+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:28.789499+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.789499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:44.042017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622325+0000","last_change":"2024-09-13T06:28:52.960423+0000","last_active":"2024-09-13T06:32:48.622325+0000","last_peered":"2024-09-13T06:32:48.622325+0000","last_clean":"2024-09-13T06:32:48.622325+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:32:48.622325+0000","last_undegraded":"2024-09-13T06:32:48.622325+0000","last_fullsized":"2024-09-13T06:32:48.622325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:42.102307+0000","last_change":"2024-09-13T06:33:42.102405+0000","last_active":"2024-09-13T06:33:42.102307+0000","last_peered":"2024-09-13T06:33:42.102307+0000","last_clean":"2024-09-13T06:33:42.102307+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:33:42.102307+0000","last_undegraded":"2024-09-13T06:33:42.102307+0000","last_fullsized":"2024-09-13T06:33:42.102307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:42.102068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:42.102068+0000","last_clean_scrub_stamp":"2024-09-13T06:33:42.102068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:39.673463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.568967+0000","last_change":"2024-09-13T06:33:11.568967+0000","last_active":"2024-09-13T06:33:11.568967+0000","last_peered":"2024-09-13T06:33:11.568967+0000","last_clean":"2024-09-13T06:33:11.568967+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:33:11.568967+0000","last_undegraded":"2024-09-13T06:33:11.568967+0000","last_fullsized":"2024-09-13T06:33:11.568967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:11.568707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:11.568707+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.568707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:51.583587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.926512+0000","last_change":"2024-09-13T06:33:08.926512+0000","last_active":"2024-09-13T06:33:08.926512+0000","last_peered":"2024-09-13T06:33:08.926512+0000","last_clean":"2024-09-13T06:33:08.926512+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:33:08.926512+0000","last_undegraded":"2024-09-13T06:33:08.926512+0000","last_fullsized":"2024-09-13T06:33:08.926512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:33:08.926230+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:33:08.926230+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.926230+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:59.065492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.902142+0000","last_change":"2024-09-13T06:33:21.902142+0000","last_active":"2024-09-13T06:33:21.902142+0000","last_peered":"2024-09-13T06:33:21.902142+0000","last_clean":"2024-09-13T06:33:21.902142+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:33:21.902142+0000","last_undegraded":"2024-09-13T06:33:21.902142+0000","last_fullsized":"2024-09-13T06:33:21.902142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:21.901902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:21.901902+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.901902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:37.154420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.087343+0000","last_change":"2024-09-13T06:29:08.792711+0000","last_active":"2024-09-13T06:32:49.087343+0000","last_peered":"2024-09-13T06:32:49.087343+0000","last_clean":"2024-09-13T06:32:49.087343+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:32:49.087343+0000","last_undegraded":"2024-09-13T06:32:49.087343+0000","last_fullsized":"2024-09-13T06:32:49.087343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.656394+0000","last_change":"2024-09-13T06:33:19.656461+0000","last_active":"2024-09-13T06:33:19.656394+0000","last_peered":"2024-09-13T06:33:19.656394+0000","last_clean":"2024-09-13T06:33:19.656394+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:33:19.656394+0000","last_undegraded":"2024-09-13T06:33:19.656394+0000","last_fullsized":"2024-09-13T06:33:19.656394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:19.656196+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:19.656196+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.656196+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:18.571062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:39.126658+0000","last_change":"2024-09-13T06:33:39.126710+0000","last_active":"2024-09-13T06:33:39.126658+0000","last_peered":"2024-09-13T06:33:39.126658+0000","last_clean":"2024-09-13T06:33:39.126658+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:33:39.126658+0000","last_undegraded":"2024-09-13T06:33:39.126658+0000","last_fullsized":"2024-09-13T06:33:39.126658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:39.126463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:39.126463+0000","last_clean_scrub_stamp":"2024-09-13T06:33:39.126463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:01:58.312795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:42.817285+0000","last_change":"2024-09-13T06:33:42.817343+0000","last_active":"2024-09-13T06:33:42.817285+0000","last_peered":"2024-09-13T06:33:42.817285+0000","last_clean":"2024-09-13T06:33:42.817285+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:33:42.817285+0000","last_undegraded":"2024-09-13T06:33:42.817285+0000","last_fullsized":"2024-09-13T06:33:42.817285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:42.817080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:42.817080+0000","last_clean_scrub_stamp":"2024-09-13T06:33:42.817080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:10.531170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.252073+0000","last_change":"2024-09-13T06:33:06.252073+0000","last_active":"2024-09-13T06:33:06.252073+0000","last_peered":"2024-09-13T06:33:06.252073+0000","last_clean":"2024-09-13T06:33:06.252073+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:33:06.252073+0000","last_undegraded":"2024-09-13T06:33:06.252073+0000","last_fullsized":"2024-09-13T06:33:06.252073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:06.251809+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:06.251809+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.251809+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:29.249309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.618221+0000","last_change":"2024-09-13T06:32:57.618221+0000","last_active":"2024-09-13T06:32:57.618221+0000","last_peered":"2024-09-13T06:32:57.618221+0000","last_clean":"2024-09-13T06:32:57.618221+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:32:57.618221+0000","last_undegraded":"2024-09-13T06:32:57.618221+0000","last_fullsized":"2024-09-13T06:32:57.618221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.617910+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:37.547222+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.822112+0000","last_change":"2024-09-13T06:33:02.822112+0000","last_active":"2024-09-13T06:33:02.822112+0000","last_peered":"2024-09-13T06:33:02.822112+0000","last_clean":"2024-09-13T06:33:02.822112+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:33:02.822112+0000","last_undegraded":"2024-09-13T06:33:02.822112+0000","last_fullsized":"2024-09-13T06:33:02.822112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.821863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:01.519357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.307014+0000","last_change":"2024-09-13T06:32:57.307014+0000","last_active":"2024-09-13T06:32:57.307014+0000","last_peered":"2024-09-13T06:32:57.307014+0000","last_clean":"2024-09-13T06:32:57.307014+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:32:57.307014+0000","last_undegraded":"2024-09-13T06:32:57.307014+0000","last_fullsized":"2024-09-13T06:32:57.307014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.306761+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:57.594334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.779665+0000","last_change":"2024-09-13T06:33:38.779734+0000","last_active":"2024-09-13T06:33:38.779665+0000","last_peered":"2024-09-13T06:33:38.779665+0000","last_clean":"2024-09-13T06:33:38.779665+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:33:38.779665+0000","last_undegraded":"2024-09-13T06:33:38.779665+0000","last_fullsized":"2024-09-13T06:33:38.779665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:38.779464+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:38.779464+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.779464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:59.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:43.812925+0000","last_change":"2024-09-13T06:33:43.812985+0000","last_active":"2024-09-13T06:33:43.812925+0000","last_peered":"2024-09-13T06:33:43.812925+0000","last_clean":"2024-09-13T06:33:43.812925+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:33:43.812925+0000","last_undegraded":"2024-09-13T06:33:43.812925+0000","last_fullsized":"2024-09-13T06:33:43.812925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:43.812737+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:43.812737+0000","last_clean_scrub_stamp":"2024-09-13T06:33:43.812737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:50.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.986271+0000","last_change":"2024-09-13T06:33:48.986323+0000","last_active":"2024-09-13T06:33:48.986271+0000","last_peered":"2024-09-13T06:33:48.986271+0000","last_clean":"2024-09-13T06:33:48.986271+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:33:48.986271+0000","last_undegraded":"2024-09-13T06:33:48.986271+0000","last_fullsized":"2024-09-13T06:33:48.986271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:48.986082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:48.986082+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.986082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:49.637396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.733063+0000","last_change":"2024-09-13T06:32:51.733063+0000","last_active":"2024-09-13T06:32:51.733063+0000","last_peered":"2024-09-13T06:32:51.733063+0000","last_clean":"2024-09-13T06:32:51.733063+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:32:51.733063+0000","last_undegraded":"2024-09-13T06:32:51.733063+0000","last_fullsized":"2024-09-13T06:32:51.733063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.732823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:41.778673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.654307+0000","last_change":"2024-09-13T06:32:59.654307+0000","last_active":"2024-09-13T06:32:59.654307+0000","last_peered":"2024-09-13T06:32:59.654307+0000","last_clean":"2024-09-13T06:32:59.654307+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:32:59.654307+0000","last_undegraded":"2024-09-13T06:32:59.654307+0000","last_fullsized":"2024-09-13T06:32:59.654307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.654023+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:07.752313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":373,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.632949+0000","last_change":"2024-09-13T06:32:58.632949+0000","last_active":"2024-09-13T06:32:58.632949+0000","last_peered":"2024-09-13T06:32:58.632949+0000","last_clean":"2024-09-13T06:32:58.632949+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:58.632949+0000","last_undegraded":"2024-09-13T06:32:58.632949+0000","last_fullsized":"2024-09-13T06:32:58.632949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.632636+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:48.468583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.990336+0000","last_change":"2024-09-13T06:29:08.792014+0000","last_active":"2024-09-13T06:32:49.990336+0000","last_peered":"2024-09-13T06:32:49.990336+0000","last_clean":"2024-09-13T06:32:49.990336+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:32:49.990336+0000","last_undegraded":"2024-09-13T06:32:49.990336+0000","last_fullsized":"2024-09-13T06:32:49.990336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.859873+0000","last_change":"2024-09-13T06:33:20.859949+0000","last_active":"2024-09-13T06:33:20.859873+0000","last_peered":"2024-09-13T06:33:20.859873+0000","last_clean":"2024-09-13T06:33:20.859873+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:33:20.859873+0000","last_undegraded":"2024-09-13T06:33:20.859873+0000","last_fullsized":"2024-09-13T06:33:20.859873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:20.859664+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:20.859664+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.859664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:48.267924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.863141+0000","last_change":"2024-09-13T06:33:34.863197+0000","last_active":"2024-09-13T06:33:34.863141+0000","last_peered":"2024-09-13T06:33:34.863141+0000","last_clean":"2024-09-13T06:33:34.863141+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:33:34.863141+0000","last_undegraded":"2024-09-13T06:33:34.863141+0000","last_fullsized":"2024-09-13T06:33:34.863141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:34.862954+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:34.862954+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.862954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:00.324438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:41.771603+0000","last_change":"2024-09-13T06:33:41.771737+0000","last_active":"2024-09-13T06:33:41.771603+0000","last_peered":"2024-09-13T06:33:41.771603+0000","last_clean":"2024-09-13T06:33:41.771603+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:33:41.771603+0000","last_undegraded":"2024-09-13T06:33:41.771603+0000","last_fullsized":"2024-09-13T06:33:41.771603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:41.771376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:41.771376+0000","last_clean_scrub_stamp":"2024-09-13T06:33:41.771376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:49.642536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.771819+0000","last_change":"2024-09-13T06:32:59.771819+0000","last_active":"2024-09-13T06:32:59.771819+0000","last_peered":"2024-09-13T06:32:59.771819+0000","last_clean":"2024-09-13T06:32:59.771819+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:32:59.771819+0000","last_undegraded":"2024-09-13T06:32:59.771819+0000","last_fullsized":"2024-09-13T06:32:59.771819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.771488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:22.687574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.946526+0000","last_change":"2024-09-13T06:32:50.946526+0000","last_active":"2024-09-13T06:32:50.946526+0000","last_peered":"2024-09-13T06:32:50.946526+0000","last_clean":"2024-09-13T06:32:50.946526+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:32:50.946526+0000","last_undegraded":"2024-09-13T06:32:50.946526+0000","last_fullsized":"2024-09-13T06:32:50.946526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.946266+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:40.782214+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.832186+0000","last_change":"2024-09-13T06:33:13.832186+0000","last_active":"2024-09-13T06:33:13.832186+0000","last_peered":"2024-09-13T06:33:13.832186+0000","last_clean":"2024-09-13T06:33:13.832186+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:33:13.832186+0000","last_undegraded":"2024-09-13T06:33:13.832186+0000","last_fullsized":"2024-09-13T06:33:13.832186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:13.831936+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:13.831936+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.831936+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:36.729651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:49.822469+0000","last_change":"2024-09-13T06:33:49.822531+0000","last_active":"2024-09-13T06:33:49.822469+0000","last_peered":"2024-09-13T06:33:49.822469+0000","last_clean":"2024-09-13T06:33:49.822469+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:33:49.822469+0000","last_undegraded":"2024-09-13T06:33:49.822469+0000","last_fullsized":"2024-09-13T06:33:49.822469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-13T06:33:49.822274+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-13T06:33:49.822274+0000","last_clean_scrub_stamp":"2024-09-13T06:33:49.822274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:03.370189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.125509+0000","last_change":"2024-09-13T06:33:16.125567+0000","last_active":"2024-09-13T06:33:16.125509+0000","last_peered":"2024-09-13T06:33:16.125509+0000","last_clean":"2024-09-13T06:33:16.125509+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:33:16.125509+0000","last_undegraded":"2024-09-13T06:33:16.125509+0000","last_fullsized":"2024-09-13T06:33:16.125509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:16.125320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:16.125320+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.125320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:47.327725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:39.756612+0000","last_change":"2024-09-13T06:33:39.756754+0000","last_active":"2024-09-13T06:33:39.756612+0000","last_peered":"2024-09-13T06:33:39.756612+0000","last_clean":"2024-09-13T06:33:39.756612+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:33:39.756612+0000","last_undegraded":"2024-09-13T06:33:39.756612+0000","last_fullsized":"2024-09-13T06:33:39.756612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:39.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:39.756389+0000","last_clean_scrub_stamp":"2024-09-13T06:33:39.756389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:02.415606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622542+0000","last_change":"2024-09-13T06:28:52.961183+0000","last_active":"2024-09-13T06:32:48.622542+0000","last_peered":"2024-09-13T06:32:48.622542+0000","last_clean":"2024-09-13T06:32:48.622542+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:32:48.622542+0000","last_undegraded":"2024-09-13T06:32:48.622542+0000","last_fullsized":"2024-09-13T06:32:48.622542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:49.924907+0000","last_clean_scrub_stamp":"2024-09-13T06:28:49.924907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.863331+0000","last_change":"2024-09-13T06:32:55.863331+0000","last_active":"2024-09-13T06:32:55.863331+0000","last_peered":"2024-09-13T06:32:55.863331+0000","last_clean":"2024-09-13T06:32:55.863331+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:32:55.863331+0000","last_undegraded":"2024-09-13T06:32:55.863331+0000","last_fullsized":"2024-09-13T06:32:55.863331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.863065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:36.969572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'98","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.660166+0000","last_change":"2024-09-13T06:32:54.660166+0000","last_active":"2024-09-13T06:32:54.660166+0000","last_peered":"2024-09-13T06:32:54.660166+0000","last_clean":"2024-09-13T06:32:54.660166+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:32:54.660166+0000","last_undegraded":"2024-09-13T06:32:54.660166+0000","last_fullsized":"2024-09-13T06:32:54.660166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'98","last_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_deep_scrub":"35'98","last_deep_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.659885+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:25.520020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.816350+0000","last_change":"2024-09-13T06:33:00.816350+0000","last_active":"2024-09-13T06:33:00.816350+0000","last_peered":"2024-09-13T06:33:00.816350+0000","last_clean":"2024-09-13T06:33:00.816350+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:33:00.816350+0000","last_undegraded":"2024-09-13T06:33:00.816350+0000","last_fullsized":"2024-09-13T06:33:00.816350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.816103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:13.549745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.317544+0000","last_change":"2024-09-13T06:33:01.317544+0000","last_active":"2024-09-13T06:33:01.317544+0000","last_peered":"2024-09-13T06:33:01.317544+0000","last_clean":"2024-09-13T06:33:01.317544+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:33:01.317544+0000","last_undegraded":"2024-09-13T06:33:01.317544+0000","last_fullsized":"2024-09-13T06:33:01.317544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.317139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:36:04.823983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.229760+0000","last_change":"2024-09-13T06:32:53.229760+0000","last_active":"2024-09-13T06:32:53.229760+0000","last_peered":"2024-09-13T06:32:53.229760+0000","last_clean":"2024-09-13T06:32:53.229760+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:32:53.229760+0000","last_undegraded":"2024-09-13T06:32:53.229760+0000","last_fullsized":"2024-09-13T06:32:53.229760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.229470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:36.522566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.231055+0000","last_change":"2024-09-13T06:33:08.231055+0000","last_active":"2024-09-13T06:33:08.231055+0000","last_peered":"2024-09-13T06:33:08.231055+0000","last_clean":"2024-09-13T06:33:08.231055+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:33:08.231055+0000","last_undegraded":"2024-09-13T06:33:08.231055+0000","last_fullsized":"2024-09-13T06:33:08.231055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:08.230807+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:08.230807+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.230807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:34.071921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622496+0000","last_change":"2024-09-13T06:28:58.706331+0000","last_active":"2024-09-13T06:32:48.622496+0000","last_peered":"2024-09-13T06:32:48.622496+0000","last_clean":"2024-09-13T06:32:48.622496+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:32:48.622496+0000","last_undegraded":"2024-09-13T06:32:48.622496+0000","last_fullsized":"2024-09-13T06:32:48.622496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.713077+0000","last_change":"2024-09-13T06:32:50.713077+0000","last_active":"2024-09-13T06:32:50.713077+0000","last_peered":"2024-09-13T06:32:50.713077+0000","last_clean":"2024-09-13T06:32:50.713077+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:32:50.713077+0000","last_undegraded":"2024-09-13T06:32:50.713077+0000","last_fullsized":"2024-09-13T06:32:50.713077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.712808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:55.564878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.849575+0000","last_change":"2024-09-13T06:32:57.849575+0000","last_active":"2024-09-13T06:32:57.849575+0000","last_peered":"2024-09-13T06:32:57.849575+0000","last_clean":"2024-09-13T06:32:57.849575+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:32:57.849575+0000","last_undegraded":"2024-09-13T06:32:57.849575+0000","last_fullsized":"2024-09-13T06:32:57.849575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.849298+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:27.355549+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.864660+0000","last_change":"2024-09-13T06:33:01.864660+0000","last_active":"2024-09-13T06:33:01.864660+0000","last_peered":"2024-09-13T06:33:01.864660+0000","last_clean":"2024-09-13T06:33:01.864660+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:33:01.864660+0000","last_undegraded":"2024-09-13T06:33:01.864660+0000","last_fullsized":"2024-09-13T06:33:01.864660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.864411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:27.499351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.990248+0000","last_change":"2024-09-13T06:29:08.787324+0000","last_active":"2024-09-13T06:32:49.990248+0000","last_peered":"2024-09-13T06:32:49.990248+0000","last_clean":"2024-09-13T06:32:49.990248+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:32:49.990248+0000","last_undegraded":"2024-09-13T06:32:49.990248+0000","last_fullsized":"2024-09-13T06:32:49.990248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.709781+0000","last_change":"2024-09-13T06:33:34.709781+0000","last_active":"2024-09-13T06:33:34.709781+0000","last_peered":"2024-09-13T06:33:34.709781+0000","last_clean":"2024-09-13T06:33:34.709781+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:33:34.709781+0000","last_undegraded":"2024-09-13T06:33:34.709781+0000","last_fullsized":"2024-09-13T06:33:34.709781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:34.709529+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:34.709529+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.709529+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:41.731330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.107595+0000","last_change":"2024-09-13T06:33:20.107595+0000","last_active":"2024-09-13T06:33:20.107595+0000","last_peered":"2024-09-13T06:33:20.107595+0000","last_clean":"2024-09-13T06:33:20.107595+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:33:20.107595+0000","last_undegraded":"2024-09-13T06:33:20.107595+0000","last_fullsized":"2024-09-13T06:33:20.107595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:20.107242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:20.107242+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.107242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:23.355872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.849630+0000","last_change":"2024-09-13T06:32:58.849630+0000","last_active":"2024-09-13T06:32:58.849630+0000","last_peered":"2024-09-13T06:32:58.849630+0000","last_clean":"2024-09-13T06:32:58.849630+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:32:58.849630+0000","last_undegraded":"2024-09-13T06:32:58.849630+0000","last_fullsized":"2024-09-13T06:32:58.849630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.849384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:17.920356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.666422+0000","last_change":"2024-09-13T06:33:00.666422+0000","last_active":"2024-09-13T06:33:00.666422+0000","last_peered":"2024-09-13T06:33:00.666422+0000","last_clean":"2024-09-13T06:33:00.666422+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:33:00.666422+0000","last_undegraded":"2024-09-13T06:33:00.666422+0000","last_fullsized":"2024-09-13T06:33:00.666422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.666162+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:43.088796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.237529+0000","last_change":"2024-09-13T06:32:55.237529+0000","last_active":"2024-09-13T06:32:55.237529+0000","last_peered":"2024-09-13T06:32:55.237529+0000","last_clean":"2024-09-13T06:32:55.237529+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:32:55.237529+0000","last_undegraded":"2024-09-13T06:32:55.237529+0000","last_fullsized":"2024-09-13T06:32:55.237529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.237184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:16.278907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.768692+0000","last_change":"2024-09-13T06:33:22.768779+0000","last_active":"2024-09-13T06:33:22.768692+0000","last_peered":"2024-09-13T06:33:22.768692+0000","last_clean":"2024-09-13T06:33:22.768692+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:33:22.768692+0000","last_undegraded":"2024-09-13T06:33:22.768692+0000","last_fullsized":"2024-09-13T06:33:22.768692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T06:33:22.768486+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T06:33:22.768486+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.768486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:11.301142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'8","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.919076+0000","last_change":"2024-09-13T06:33:30.919076+0000","last_active":"2024-09-13T06:33:30.919076+0000","last_peered":"2024-09-13T06:33:30.919076+0000","last_clean":"2024-09-13T06:33:30.919076+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:33:30.919076+0000","last_undegraded":"2024-09-13T06:33:30.919076+0000","last_fullsized":"2024-09-13T06:33:30.919076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:30.918821+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:30.918821+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.918821+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:51.207914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.116635+0000","last_change":"2024-09-13T06:33:37.116635+0000","last_active":"2024-09-13T06:33:37.116635+0000","last_peered":"2024-09-13T06:33:37.116635+0000","last_clean":"2024-09-13T06:33:37.116635+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:33:37.116635+0000","last_undegraded":"2024-09-13T06:33:37.116635+0000","last_fullsized":"2024-09-13T06:33:37.116635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:37.116247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:37.116247+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.116247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:24.752169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'5","reported_seq":243,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.668036+0000","last_change":"2024-09-13T06:32:55.668036+0000","last_active":"2024-09-13T06:32:55.668036+0000","last_peered":"2024-09-13T06:32:55.668036+0000","last_clean":"2024-09-13T06:32:55.668036+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:32:55.668036+0000","last_undegraded":"2024-09-13T06:32:55.668036+0000","last_fullsized":"2024-09-13T06:32:55.668036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.667780+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:08.401422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'48","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.902064+0000","last_change":"2024-09-13T06:32:53.902064+0000","last_active":"2024-09-13T06:32:53.902064+0000","last_peered":"2024-09-13T06:32:53.902064+0000","last_clean":"2024-09-13T06:32:53.902064+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:53.902064+0000","last_undegraded":"2024-09-13T06:32:53.902064+0000","last_fullsized":"2024-09-13T06:32:53.902064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.901815+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:12.560029+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.629571+0000","last_change":"2024-09-13T06:32:53.629571+0000","last_active":"2024-09-13T06:32:53.629571+0000","last_peered":"2024-09-13T06:32:53.629571+0000","last_clean":"2024-09-13T06:32:53.629571+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:32:53.629571+0000","last_undegraded":"2024-09-13T06:32:53.629571+0000","last_fullsized":"2024-09-13T06:32:53.629571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.629307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:49.351038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:40.497847+0000","last_change":"2024-09-13T06:29:08.786717+0000","last_active":"2024-09-13T06:31:40.497847+0000","last_peered":"2024-09-13T06:31:40.497847+0000","last_clean":"2024-09-13T06:31:40.497847+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:31:40.497847+0000","last_undegraded":"2024-09-13T06:31:40.497847+0000","last_fullsized":"2024-09-13T06:31:40.497847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.118797+0000","last_change":"2024-09-13T06:33:34.118855+0000","last_active":"2024-09-13T06:33:34.118797+0000","last_peered":"2024-09-13T06:33:34.118797+0000","last_clean":"2024-09-13T06:33:34.118797+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:33:34.118797+0000","last_undegraded":"2024-09-13T06:33:34.118797+0000","last_fullsized":"2024-09-13T06:33:34.118797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:34.118610+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:34.118610+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.118610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:42.780087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:47.842240+0000","last_change":"2024-09-13T06:33:47.842240+0000","last_active":"2024-09-13T06:33:47.842240+0000","last_peered":"2024-09-13T06:33:47.842240+0000","last_clean":"2024-09-13T06:33:47.842240+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:33:47.842240+0000","last_undegraded":"2024-09-13T06:33:47.842240+0000","last_fullsized":"2024-09-13T06:33:47.842240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:47.841961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:47.841961+0000","last_clean_scrub_stamp":"2024-09-13T06:33:47.841961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:30.356748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.851375+0000","last_change":"2024-09-13T06:33:14.851375+0000","last_active":"2024-09-13T06:33:14.851375+0000","last_peered":"2024-09-13T06:33:14.851375+0000","last_clean":"2024-09-13T06:33:14.851375+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:33:14.851375+0000","last_undegraded":"2024-09-13T06:33:14.851375+0000","last_fullsized":"2024-09-13T06:33:14.851375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.851131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.851131+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.851131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:18:48.539267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.919713+0000","last_change":"2024-09-13T06:33:08.919713+0000","last_active":"2024-09-13T06:33:08.919713+0000","last_peered":"2024-09-13T06:33:08.919713+0000","last_clean":"2024-09-13T06:33:08.919713+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:33:08.919713+0000","last_undegraded":"2024-09-13T06:33:08.919713+0000","last_fullsized":"2024-09-13T06:33:08.919713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.919447+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:31.817162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.257263+0000","last_change":"2024-09-13T06:32:56.257263+0000","last_active":"2024-09-13T06:32:56.257263+0000","last_peered":"2024-09-13T06:32:56.257263+0000","last_clean":"2024-09-13T06:32:56.257263+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:32:56.257263+0000","last_undegraded":"2024-09-13T06:32:56.257263+0000","last_fullsized":"2024-09-13T06:32:56.257263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.256983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:15.836617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.024597+0000","last_change":"2024-09-13T06:33:24.024657+0000","last_active":"2024-09-13T06:33:24.024597+0000","last_peered":"2024-09-13T06:33:24.024597+0000","last_clean":"2024-09-13T06:33:24.024597+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:33:24.024597+0000","last_undegraded":"2024-09-13T06:33:24.024597+0000","last_fullsized":"2024-09-13T06:33:24.024597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:24.024411+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:24.024411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.024411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:02.565766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:42.772666+0000","last_change":"2024-09-13T06:33:42.772666+0000","last_active":"2024-09-13T06:33:42.772666+0000","last_peered":"2024-09-13T06:33:42.772666+0000","last_clean":"2024-09-13T06:33:42.772666+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:33:42.772666+0000","last_undegraded":"2024-09-13T06:33:42.772666+0000","last_fullsized":"2024-09-13T06:33:42.772666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:42.772315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:42.772315+0000","last_clean_scrub_stamp":"2024-09-13T06:33:42.772315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:43.604943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.753509+0000","last_change":"2024-09-13T06:32:49.753509+0000","last_active":"2024-09-13T06:32:49.753509+0000","last_peered":"2024-09-13T06:32:49.753509+0000","last_clean":"2024-09-13T06:32:49.753509+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:32:49.753509+0000","last_undegraded":"2024-09-13T06:32:49.753509+0000","last_fullsized":"2024-09-13T06:32:49.753509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.753224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:01.369372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'61","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:45.357261+0000","last_change":"2024-09-13T06:29:39.548127+0000","last_active":"2024-09-13T06:32:45.357261+0000","last_peered":"2024-09-13T06:32:45.357261+0000","last_clean":"2024-09-13T06:32:45.357261+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:32:45.357261+0000","last_undegraded":"2024-09-13T06:32:45.357261+0000","last_fullsized":"2024-09-13T06:32:45.357261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:03.699132+0000","last_clean_scrub_stamp":"2024-09-13T06:29:03.699132+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.274398+0000","last_change":"2024-09-13T06:32:54.274454+0000","last_active":"2024-09-13T06:32:54.274398+0000","last_peered":"2024-09-13T06:32:54.274398+0000","last_clean":"2024-09-13T06:32:54.274398+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:32:54.274398+0000","last_undegraded":"2024-09-13T06:32:54.274398+0000","last_fullsized":"2024-09-13T06:32:54.274398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.274196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:07.867699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.935337+0000","last_change":"2024-09-13T06:33:25.935337+0000","last_active":"2024-09-13T06:33:25.935337+0000","last_peered":"2024-09-13T06:33:25.935337+0000","last_clean":"2024-09-13T06:33:25.935337+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:33:25.935337+0000","last_undegraded":"2024-09-13T06:33:25.935337+0000","last_fullsized":"2024-09-13T06:33:25.935337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:33:25.934938+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:33:25.934938+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.934938+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:59.560535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.646553+0000","last_change":"2024-09-13T06:33:17.646610+0000","last_active":"2024-09-13T06:33:17.646553+0000","last_peered":"2024-09-13T06:33:17.646553+0000","last_clean":"2024-09-13T06:33:17.646553+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:33:17.646553+0000","last_undegraded":"2024-09-13T06:33:17.646553+0000","last_fullsized":"2024-09-13T06:33:17.646553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:17.646356+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:17.646356+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.646356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:49.505268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.085347+0000","last_change":"2024-09-13T06:29:39.514037+0000","last_active":"2024-09-13T06:32:49.085347+0000","last_peered":"2024-09-13T06:32:49.085347+0000","last_clean":"2024-09-13T06:32:49.085347+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:32:49.085347+0000","last_undegraded":"2024-09-13T06:32:49.085347+0000","last_fullsized":"2024-09-13T06:32:49.085347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.697900+0000","last_change":"2024-09-13T06:32:56.697900+0000","last_active":"2024-09-13T06:32:56.697900+0000","last_peered":"2024-09-13T06:32:56.697900+0000","last_clean":"2024-09-13T06:32:56.697900+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:32:56.697900+0000","last_undegraded":"2024-09-13T06:32:56.697900+0000","last_fullsized":"2024-09-13T06:32:56.697900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.697652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:22.332592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.976806+0000","last_change":"2024-09-13T06:33:11.976895+0000","last_active":"2024-09-13T06:33:11.976806+0000","last_peered":"2024-09-13T06:33:11.976806+0000","last_clean":"2024-09-13T06:33:11.976806+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:33:11.976806+0000","last_undegraded":"2024-09-13T06:33:11.976806+0000","last_fullsized":"2024-09-13T06:33:11.976806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-13T06:33:11.976609+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-13T06:33:11.976609+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.976609+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:51.788958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.617551+0000","last_change":"2024-09-13T06:32:55.617654+0000","last_active":"2024-09-13T06:32:55.617551+0000","last_peered":"2024-09-13T06:32:55.617551+0000","last_clean":"2024-09-13T06:32:55.617551+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:32:55.617551+0000","last_undegraded":"2024-09-13T06:32:55.617551+0000","last_fullsized":"2024-09-13T06:32:55.617551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.617324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:18.790664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.624047+0000","last_change":"2024-09-13T06:29:08.792052+0000","last_active":"2024-09-13T06:32:48.624047+0000","last_peered":"2024-09-13T06:32:48.624047+0000","last_clean":"2024-09-13T06:32:48.624047+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:32:48.624047+0000","last_undegraded":"2024-09-13T06:32:48.624047+0000","last_fullsized":"2024-09-13T06:32:48.624047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.877273+0000","last_change":"2024-09-13T06:33:18.877332+0000","last_active":"2024-09-13T06:33:18.877273+0000","last_peered":"2024-09-13T06:33:18.877273+0000","last_clean":"2024-09-13T06:33:18.877273+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:33:18.877273+0000","last_undegraded":"2024-09-13T06:33:18.877273+0000","last_fullsized":"2024-09-13T06:33:18.877273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:18.877085+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:18.877085+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.877085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:40.890221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.149871+0000","last_change":"2024-09-13T06:33:36.149934+0000","last_active":"2024-09-13T06:33:36.149871+0000","last_peered":"2024-09-13T06:33:36.149871+0000","last_clean":"2024-09-13T06:33:36.149871+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:33:36.149871+0000","last_undegraded":"2024-09-13T06:33:36.149871+0000","last_fullsized":"2024-09-13T06:33:36.149871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:36.149676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:36.149676+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.149676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:27.059528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.707846+0000","last_change":"2024-09-13T06:32:57.707902+0000","last_active":"2024-09-13T06:32:57.707846+0000","last_peered":"2024-09-13T06:32:57.707846+0000","last_clean":"2024-09-13T06:32:57.707846+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:32:57.707846+0000","last_undegraded":"2024-09-13T06:32:57.707846+0000","last_fullsized":"2024-09-13T06:32:57.707846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.707651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:17.993090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.851372+0000","last_change":"2024-09-13T06:33:10.851372+0000","last_active":"2024-09-13T06:33:10.851372+0000","last_peered":"2024-09-13T06:33:10.851372+0000","last_clean":"2024-09-13T06:33:10.851372+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:33:10.851372+0000","last_undegraded":"2024-09-13T06:33:10.851372+0000","last_fullsized":"2024-09-13T06:33:10.851372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:33:10.851101+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:33:10.851101+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.851101+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:34.627562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.614320+0000","last_change":"2024-09-13T06:32:54.614320+0000","last_active":"2024-09-13T06:32:54.614320+0000","last_peered":"2024-09-13T06:32:54.614320+0000","last_clean":"2024-09-13T06:32:54.614320+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:32:54.614320+0000","last_undegraded":"2024-09-13T06:32:54.614320+0000","last_fullsized":"2024-09-13T06:32:54.614320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.614081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:41.070050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.054804+0000","last_change":"2024-09-13T06:33:27.054804+0000","last_active":"2024-09-13T06:33:27.054804+0000","last_peered":"2024-09-13T06:33:27.054804+0000","last_clean":"2024-09-13T06:33:27.054804+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:33:27.054804+0000","last_undegraded":"2024-09-13T06:33:27.054804+0000","last_fullsized":"2024-09-13T06:33:27.054804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:27.054550+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:27.054550+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.054550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:49.713766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.101486+0000","last_change":"2024-09-13T06:33:15.101549+0000","last_active":"2024-09-13T06:33:15.101486+0000","last_peered":"2024-09-13T06:33:15.101486+0000","last_clean":"2024-09-13T06:33:15.101486+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:33:15.101486+0000","last_undegraded":"2024-09-13T06:33:15.101486+0000","last_fullsized":"2024-09-13T06:33:15.101486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:15.101239+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:15.101239+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.101239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:32.810161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.730610+0000","last_change":"2024-09-13T06:33:48.730735+0000","last_active":"2024-09-13T06:33:48.730610+0000","last_peered":"2024-09-13T06:33:48.730610+0000","last_clean":"2024-09-13T06:33:48.730610+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:33:48.730610+0000","last_undegraded":"2024-09-13T06:33:48.730610+0000","last_fullsized":"2024-09-13T06:33:48.730610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:48.730321+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:48.730321+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.730321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:14.015785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":32,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.593003+0000","last_change":"2024-09-13T06:33:09.593055+0000","last_active":"2024-09-13T06:33:09.593003+0000","last_peered":"2024-09-13T06:33:09.593003+0000","last_clean":"2024-09-13T06:33:09.593003+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:33:09.593003+0000","last_undegraded":"2024-09-13T06:33:09.593003+0000","last_fullsized":"2024-09-13T06:33:09.593003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:09.592809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:09.592809+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.592809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:07.716160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.955220+0000","last_change":"2024-09-13T06:33:06.955303+0000","last_active":"2024-09-13T06:33:06.955220+0000","last_peered":"2024-09-13T06:33:06.955220+0000","last_clean":"2024-09-13T06:33:06.955220+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:33:06.955220+0000","last_undegraded":"2024-09-13T06:33:06.955220+0000","last_fullsized":"2024-09-13T06:33:06.955220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:33:06.955042+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:33:06.955042+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.955042+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:20.072308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'286","reported_seq":436,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.962258+0000","last_change":"2024-09-13T06:33:18.962258+0000","last_active":"2024-09-13T06:33:18.962258+0000","last_peered":"2024-09-13T06:33:18.962258+0000","last_clean":"2024-09-13T06:33:18.962258+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:33:18.962258+0000","last_undegraded":"2024-09-13T06:33:18.962258+0000","last_fullsized":"2024-09-13T06:33:18.962258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:33:18.961843+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:33:18.961843+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.961843+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:37.540052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.624066+0000","last_change":"2024-09-13T06:29:08.788900+0000","last_active":"2024-09-13T06:32:48.624066+0000","last_peered":"2024-09-13T06:32:48.624066+0000","last_clean":"2024-09-13T06:32:48.624066+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:32:48.624066+0000","last_undegraded":"2024-09-13T06:32:48.624066+0000","last_fullsized":"2024-09-13T06:32:48.624066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.115244+0000","last_change":"2024-09-13T06:33:14.115307+0000","last_active":"2024-09-13T06:33:14.115244+0000","last_peered":"2024-09-13T06:33:14.115244+0000","last_clean":"2024-09-13T06:33:14.115244+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:33:14.115244+0000","last_undegraded":"2024-09-13T06:33:14.115244+0000","last_fullsized":"2024-09-13T06:33:14.115244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:14.115056+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:14.115056+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.115056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:50:00.143967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.814627+0000","last_change":"2024-09-13T06:33:31.814678+0000","last_active":"2024-09-13T06:33:31.814627+0000","last_peered":"2024-09-13T06:33:31.814627+0000","last_clean":"2024-09-13T06:33:31.814627+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:33:31.814627+0000","last_undegraded":"2024-09-13T06:33:31.814627+0000","last_fullsized":"2024-09-13T06:33:31.814627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:31.814428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:31.814428+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.814428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:22.586005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.672367+0000","last_change":"2024-09-13T06:32:51.672474+0000","last_active":"2024-09-13T06:32:51.672367+0000","last_peered":"2024-09-13T06:32:51.672367+0000","last_clean":"2024-09-13T06:32:51.672367+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:32:51.672367+0000","last_undegraded":"2024-09-13T06:32:51.672367+0000","last_fullsized":"2024-09-13T06:32:51.672367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.672122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:22.074076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.867341+0000","last_change":"2024-09-13T06:33:05.867420+0000","last_active":"2024-09-13T06:33:05.867341+0000","last_peered":"2024-09-13T06:33:05.867341+0000","last_clean":"2024-09-13T06:33:05.867341+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:33:05.867341+0000","last_undegraded":"2024-09-13T06:33:05.867341+0000","last_fullsized":"2024-09-13T06:33:05.867341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.867149+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:29.643610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.863742+0000","last_change":"2024-09-13T06:33:03.863795+0000","last_active":"2024-09-13T06:33:03.863742+0000","last_peered":"2024-09-13T06:33:03.863742+0000","last_clean":"2024-09-13T06:33:03.863742+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:33:03.863742+0000","last_undegraded":"2024-09-13T06:33:03.863742+0000","last_fullsized":"2024-09-13T06:33:03.863742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:06.532657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:31:34.498484+0000","last_change":"2024-09-13T06:29:08.774273+0000","last_active":"2024-09-13T06:31:34.498484+0000","last_peered":"2024-09-13T06:31:34.498484+0000","last_clean":"2024-09-13T06:31:34.498484+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:31:34.498484+0000","last_undegraded":"2024-09-13T06:31:34.498484+0000","last_fullsized":"2024-09-13T06:31:34.498484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.091089+0000","last_change":"2024-09-13T06:33:28.091149+0000","last_active":"2024-09-13T06:33:28.091089+0000","last_peered":"2024-09-13T06:33:28.091089+0000","last_clean":"2024-09-13T06:33:28.091089+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:33:28.091089+0000","last_undegraded":"2024-09-13T06:33:28.091089+0000","last_fullsized":"2024-09-13T06:33:28.091089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:28.090907+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:28.090907+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.090907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:08.553807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.013712+0000","last_change":"2024-09-13T06:33:48.013769+0000","last_active":"2024-09-13T06:33:48.013712+0000","last_peered":"2024-09-13T06:33:48.013712+0000","last_clean":"2024-09-13T06:33:48.013712+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:33:48.013712+0000","last_undegraded":"2024-09-13T06:33:48.013712+0000","last_fullsized":"2024-09-13T06:33:48.013712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:48.013512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:48.013512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.013512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:23.000202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.931795+0000","last_change":"2024-09-13T06:33:13.931847+0000","last_active":"2024-09-13T06:33:13.931795+0000","last_peered":"2024-09-13T06:33:13.931795+0000","last_clean":"2024-09-13T06:33:13.931795+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:33:13.931795+0000","last_undegraded":"2024-09-13T06:33:13.931795+0000","last_fullsized":"2024-09-13T06:33:13.931795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:13.931595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:13.931595+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.931595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:35.944731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.274280+0000","last_change":"2024-09-13T06:33:02.274362+0000","last_active":"2024-09-13T06:33:02.274280+0000","last_peered":"2024-09-13T06:33:02.274280+0000","last_clean":"2024-09-13T06:33:02.274280+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:33:02.274280+0000","last_undegraded":"2024-09-13T06:33:02.274280+0000","last_fullsized":"2024-09-13T06:33:02.274280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.274058+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:13.067392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.898001+0000","last_change":"2024-09-13T06:33:14.898055+0000","last_active":"2024-09-13T06:33:14.898001+0000","last_peered":"2024-09-13T06:33:14.898001+0000","last_clean":"2024-09-13T06:33:14.898001+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:33:14.898001+0000","last_undegraded":"2024-09-13T06:33:14.898001+0000","last_fullsized":"2024-09-13T06:33:14.898001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.897808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.897808+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.897808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:16.950204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.789069+0000","last_change":"2024-09-13T06:29:08.793365+0000","last_active":"2024-09-13T06:32:13.789069+0000","last_peered":"2024-09-13T06:32:13.789069+0000","last_clean":"2024-09-13T06:32:13.789069+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:32:13.789069+0000","last_undegraded":"2024-09-13T06:32:13.789069+0000","last_fullsized":"2024-09-13T06:32:13.789069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.945840+0000","last_change":"2024-09-13T06:33:27.945840+0000","last_active":"2024-09-13T06:33:27.945840+0000","last_peered":"2024-09-13T06:33:27.945840+0000","last_clean":"2024-09-13T06:33:27.945840+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:33:27.945840+0000","last_undegraded":"2024-09-13T06:33:27.945840+0000","last_fullsized":"2024-09-13T06:33:27.945840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:27.945583+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:27.945583+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.945583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:33.066698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:39.831973+0000","last_change":"2024-09-13T06:33:39.832075+0000","last_active":"2024-09-13T06:33:39.831973+0000","last_peered":"2024-09-13T06:33:39.831973+0000","last_clean":"2024-09-13T06:33:39.831973+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:33:39.831973+0000","last_undegraded":"2024-09-13T06:33:39.831973+0000","last_fullsized":"2024-09-13T06:33:39.831973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:39.831716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:39.831716+0000","last_clean_scrub_stamp":"2024-09-13T06:33:39.831716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:56.636121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.607615+0000","last_change":"2024-09-13T06:33:07.607668+0000","last_active":"2024-09-13T06:33:07.607615+0000","last_peered":"2024-09-13T06:33:07.607615+0000","last_clean":"2024-09-13T06:33:07.607615+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:33:07.607615+0000","last_undegraded":"2024-09-13T06:33:07.607615+0000","last_fullsized":"2024-09-13T06:33:07.607615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:07.607411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:07.607411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.607411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:38.467546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'31","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.922489+0000","last_change":"2024-09-13T06:32:51.922559+0000","last_active":"2024-09-13T06:32:51.922489+0000","last_peered":"2024-09-13T06:32:51.922489+0000","last_clean":"2024-09-13T06:32:51.922489+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:32:51.922489+0000","last_undegraded":"2024-09-13T06:32:51.922489+0000","last_fullsized":"2024-09-13T06:32:51.922489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31","last_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_deep_scrub":"35'31","last_deep_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.922288+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:42.602059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.849119+0000","last_change":"2024-09-13T06:33:03.849171+0000","last_active":"2024-09-13T06:33:03.849119+0000","last_peered":"2024-09-13T06:33:03.849119+0000","last_clean":"2024-09-13T06:33:03.849119+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:33:03.849119+0000","last_undegraded":"2024-09-13T06:33:03.849119+0000","last_fullsized":"2024-09-13T06:33:03.849119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:53.988212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.976294+0000","last_change":"2024-09-13T06:29:08.791696+0000","last_active":"2024-09-13T06:32:13.976294+0000","last_peered":"2024-09-13T06:32:13.976294+0000","last_clean":"2024-09-13T06:32:13.976294+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:32:13.976294+0000","last_undegraded":"2024-09-13T06:32:13.976294+0000","last_fullsized":"2024-09-13T06:32:13.976294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:29:07.728358+0000","last_clean_scrub_stamp":"2024-09-13T06:29:07.728358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.041473+0000","last_change":"2024-09-13T06:33:21.041537+0000","last_active":"2024-09-13T06:33:21.041473+0000","last_peered":"2024-09-13T06:33:21.041473+0000","last_clean":"2024-09-13T06:33:21.041473+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:33:21.041473+0000","last_undegraded":"2024-09-13T06:33:21.041473+0000","last_fullsized":"2024-09-13T06:33:21.041473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:21.041255+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:21.041255+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.041255+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:54.666853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:44.828095+0000","last_change":"2024-09-13T06:33:44.828245+0000","last_active":"2024-09-13T06:33:44.828095+0000","last_peered":"2024-09-13T06:33:44.828095+0000","last_clean":"2024-09-13T06:33:44.828095+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:33:44.828095+0000","last_undegraded":"2024-09-13T06:33:44.828095+0000","last_fullsized":"2024-09-13T06:33:44.828095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:44.827784+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:44.827784+0000","last_clean_scrub_stamp":"2024-09-13T06:33:44.827784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:13.508582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.629912+0000","last_change":"2024-09-13T06:33:04.629973+0000","last_active":"2024-09-13T06:33:04.629912+0000","last_peered":"2024-09-13T06:33:04.629912+0000","last_clean":"2024-09-13T06:33:04.629912+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:33:04.629912+0000","last_undegraded":"2024-09-13T06:33:04.629912+0000","last_fullsized":"2024-09-13T06:33:04.629912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.629731+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:04.692060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.731460+0000","last_change":"2024-09-13T06:32:58.731638+0000","last_active":"2024-09-13T06:32:58.731460+0000","last_peered":"2024-09-13T06:32:58.731460+0000","last_clean":"2024-09-13T06:32:58.731460+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:58.731460+0000","last_undegraded":"2024-09-13T06:32:58.731460+0000","last_fullsized":"2024-09-13T06:32:58.731460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.731244+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:01.400357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.185822+0000","last_change":"2024-09-13T06:32:51.185958+0000","last_active":"2024-09-13T06:32:51.185822+0000","last_peered":"2024-09-13T06:32:51.185822+0000","last_clean":"2024-09-13T06:32:51.185822+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:32:51.185822+0000","last_undegraded":"2024-09-13T06:32:51.185822+0000","last_fullsized":"2024-09-13T06:32:51.185822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.185604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:49.642143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.096228+0000","last_change":"2024-09-13T06:33:31.096228+0000","last_active":"2024-09-13T06:33:31.096228+0000","last_peered":"2024-09-13T06:33:31.096228+0000","last_clean":"2024-09-13T06:33:31.096228+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:33:31.096228+0000","last_undegraded":"2024-09-13T06:33:31.096228+0000","last_fullsized":"2024-09-13T06:33:31.096228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:31.095990+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:31.095990+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.095990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:41.198579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.823591+0000","last_change":"2024-09-13T06:33:30.823656+0000","last_active":"2024-09-13T06:33:30.823591+0000","last_peered":"2024-09-13T06:33:30.823591+0000","last_clean":"2024-09-13T06:33:30.823591+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:33:30.823591+0000","last_undegraded":"2024-09-13T06:33:30.823591+0000","last_fullsized":"2024-09-13T06:33:30.823591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T06:33:30.823386+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T06:33:30.823386+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.823386+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:49.401595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.067199+0000","last_change":"2024-09-13T06:33:27.067258+0000","last_active":"2024-09-13T06:33:27.067199+0000","last_peered":"2024-09-13T06:33:27.067199+0000","last_clean":"2024-09-13T06:33:27.067199+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:33:27.067199+0000","last_undegraded":"2024-09-13T06:33:27.067199+0000","last_fullsized":"2024-09-13T06:33:27.067199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:27.066998+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:27.066998+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.066998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:52.009796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.837544+0000","last_change":"2024-09-13T06:33:24.837691+0000","last_active":"2024-09-13T06:33:24.837544+0000","last_peered":"2024-09-13T06:33:24.837544+0000","last_clean":"2024-09-13T06:33:24.837544+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:33:24.837544+0000","last_undegraded":"2024-09-13T06:33:24.837544+0000","last_fullsized":"2024-09-13T06:33:24.837544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:24.837307+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:24.837307+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.837307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:23.934356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.046267+0000","last_change":"2024-09-13T06:33:26.046329+0000","last_active":"2024-09-13T06:33:26.046267+0000","last_peered":"2024-09-13T06:33:26.046267+0000","last_clean":"2024-09-13T06:33:26.046267+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:33:26.046267+0000","last_undegraded":"2024-09-13T06:33:26.046267+0000","last_fullsized":"2024-09-13T06:33:26.046267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:26.046070+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:26.046070+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.046070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:20.651280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.117633+0000","last_change":"2024-09-13T06:33:38.117706+0000","last_active":"2024-09-13T06:33:38.117633+0000","last_peered":"2024-09-13T06:33:38.117633+0000","last_clean":"2024-09-13T06:33:38.117633+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:33:38.117633+0000","last_undegraded":"2024-09-13T06:33:38.117633+0000","last_fullsized":"2024-09-13T06:33:38.117633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:38.117422+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:38.117422+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.117422+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:47.641415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.987946+0000","last_change":"2024-09-13T06:28:58.711396+0000","last_active":"2024-09-13T06:32:49.987946+0000","last_peered":"2024-09-13T06:32:49.987946+0000","last_clean":"2024-09-13T06:32:49.987946+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:32:49.987946+0000","last_undegraded":"2024-09-13T06:32:49.987946+0000","last_fullsized":"2024-09-13T06:32:49.987946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.877803+0000","last_change":"2024-09-13T06:33:26.877864+0000","last_active":"2024-09-13T06:33:26.877803+0000","last_peered":"2024-09-13T06:33:26.877803+0000","last_clean":"2024-09-13T06:33:26.877803+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:33:26.877803+0000","last_undegraded":"2024-09-13T06:33:26.877803+0000","last_fullsized":"2024-09-13T06:33:26.877803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:26.877608+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.877608+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.877608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:37:11.045713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.062645+0000","last_change":"2024-09-13T06:33:22.062702+0000","last_active":"2024-09-13T06:33:22.062645+0000","last_peered":"2024-09-13T06:33:22.062645+0000","last_clean":"2024-09-13T06:33:22.062645+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:33:22.062645+0000","last_undegraded":"2024-09-13T06:33:22.062645+0000","last_fullsized":"2024-09-13T06:33:22.062645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:22.062429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:22.062429+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.062429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:05.066689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.111643+0000","last_change":"2024-09-13T06:33:36.111643+0000","last_active":"2024-09-13T06:33:36.111643+0000","last_peered":"2024-09-13T06:33:36.111643+0000","last_clean":"2024-09-13T06:33:36.111643+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:33:36.111643+0000","last_undegraded":"2024-09-13T06:33:36.111643+0000","last_fullsized":"2024-09-13T06:33:36.111643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:33:36.111388+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:33:36.111388+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.111388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:49.313244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.890275+0000","last_change":"2024-09-13T06:33:32.890326+0000","last_active":"2024-09-13T06:33:32.890275+0000","last_peered":"2024-09-13T06:33:32.890275+0000","last_clean":"2024-09-13T06:33:32.890275+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:33:32.890275+0000","last_undegraded":"2024-09-13T06:33:32.890275+0000","last_fullsized":"2024-09-13T06:33:32.890275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:32.890090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:32.890090+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.890090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:13.352990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.767417+0000","last_change":"2024-09-13T06:33:32.767478+0000","last_active":"2024-09-13T06:33:32.767417+0000","last_peered":"2024-09-13T06:33:32.767417+0000","last_clean":"2024-09-13T06:33:32.767417+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:33:32.767417+0000","last_undegraded":"2024-09-13T06:33:32.767417+0000","last_fullsized":"2024-09-13T06:33:32.767417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:32.767197+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:32.767197+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.767197+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:58:34.425175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.773785+0000","last_change":"2024-09-13T06:33:29.773840+0000","last_active":"2024-09-13T06:33:29.773785+0000","last_peered":"2024-09-13T06:33:29.773785+0000","last_clean":"2024-09-13T06:33:29.773785+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:33:29.773785+0000","last_undegraded":"2024-09-13T06:33:29.773785+0000","last_fullsized":"2024-09-13T06:33:29.773785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:29.773588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:29.773588+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.773588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:14.414714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.973311+0000","last_change":"2024-09-13T06:33:24.973365+0000","last_active":"2024-09-13T06:33:24.973311+0000","last_peered":"2024-09-13T06:33:24.973311+0000","last_clean":"2024-09-13T06:33:24.973311+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:33:24.973311+0000","last_undegraded":"2024-09-13T06:33:24.973311+0000","last_fullsized":"2024-09-13T06:33:24.973311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:24.973113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:24.973113+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.973113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:37.936190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.040708+0000","last_change":"2024-09-13T06:33:24.040796+0000","last_active":"2024-09-13T06:33:24.040708+0000","last_peered":"2024-09-13T06:33:24.040708+0000","last_clean":"2024-09-13T06:33:24.040708+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:33:24.040708+0000","last_undegraded":"2024-09-13T06:33:24.040708+0000","last_fullsized":"2024-09-13T06:33:24.040708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:24.040517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:24.040517+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.040517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:50.780198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.114852+0000","last_change":"2024-09-13T06:33:30.114911+0000","last_active":"2024-09-13T06:33:30.114852+0000","last_peered":"2024-09-13T06:33:30.114852+0000","last_clean":"2024-09-13T06:33:30.114852+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:33:30.114852+0000","last_undegraded":"2024-09-13T06:33:30.114852+0000","last_fullsized":"2024-09-13T06:33:30.114852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T06:33:30.114659+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T06:33:30.114659+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.114659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:55.576143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.803610+0000","last_change":"2024-09-13T06:33:37.803674+0000","last_active":"2024-09-13T06:33:37.803610+0000","last_peered":"2024-09-13T06:33:37.803610+0000","last_clean":"2024-09-13T06:33:37.803610+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:33:37.803610+0000","last_undegraded":"2024-09-13T06:33:37.803610+0000","last_fullsized":"2024-09-13T06:33:37.803610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:37.803422+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:37.803422+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.803422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:47.227293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.854840+0000","last_change":"2024-09-13T06:33:25.854840+0000","last_active":"2024-09-13T06:33:25.854840+0000","last_peered":"2024-09-13T06:33:25.854840+0000","last_clean":"2024-09-13T06:33:25.854840+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:33:25.854840+0000","last_undegraded":"2024-09-13T06:33:25.854840+0000","last_fullsized":"2024-09-13T06:33:25.854840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:25.854592+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:25.854592+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.854592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:47.867728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:13.743269+0000","last_change":"2024-09-13T06:29:39.522620+0000","last_active":"2024-09-13T06:32:13.743269+0000","last_peered":"2024-09-13T06:32:13.743269+0000","last_clean":"2024-09-13T06:32:13.743269+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:32:13.743269+0000","last_undegraded":"2024-09-13T06:32:13.743269+0000","last_fullsized":"2024-09-13T06:32:13.743269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.988751+0000","last_change":"2024-09-13T06:29:00.708049+0000","last_active":"2024-09-13T06:32:49.988751+0000","last_peered":"2024-09-13T06:32:49.988751+0000","last_clean":"2024-09-13T06:32:49.988751+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:32:49.988751+0000","last_undegraded":"2024-09-13T06:32:49.988751+0000","last_fullsized":"2024-09-13T06:32:49.988751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:59.685759+0000","last_clean_scrub_stamp":"2024-09-13T06:28:59.685759+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:47.699409+0000","last_change":"2024-09-13T06:33:47.699466+0000","last_active":"2024-09-13T06:33:47.699409+0000","last_peered":"2024-09-13T06:33:47.699409+0000","last_clean":"2024-09-13T06:33:47.699409+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:33:47.699409+0000","last_undegraded":"2024-09-13T06:33:47.699409+0000","last_fullsized":"2024-09-13T06:33:47.699409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:47.699219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:47.699219+0000","last_clean_scrub_stamp":"2024-09-13T06:33:47.699219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:45.270614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.038770+0000","last_change":"2024-09-13T06:33:18.038770+0000","last_active":"2024-09-13T06:33:18.038770+0000","last_peered":"2024-09-13T06:33:18.038770+0000","last_clean":"2024-09-13T06:33:18.038770+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:33:18.038770+0000","last_undegraded":"2024-09-13T06:33:18.038770+0000","last_fullsized":"2024-09-13T06:33:18.038770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:18.038512+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:18.038512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.038512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:32.926333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622715+0000","last_change":"2024-09-13T06:29:39.511735+0000","last_active":"2024-09-13T06:32:48.622715+0000","last_peered":"2024-09-13T06:32:48.622715+0000","last_clean":"2024-09-13T06:32:48.622715+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:32:48.622715+0000","last_undegraded":"2024-09-13T06:32:48.622715+0000","last_fullsized":"2024-09-13T06:32:48.622715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.613487+0000","last_change":"2024-09-13T06:33:13.613487+0000","last_active":"2024-09-13T06:33:13.613487+0000","last_peered":"2024-09-13T06:33:13.613487+0000","last_clean":"2024-09-13T06:33:13.613487+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:33:13.613487+0000","last_undegraded":"2024-09-13T06:33:13.613487+0000","last_fullsized":"2024-09-13T06:33:13.613487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:33:13.613227+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:33:13.613227+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.613227+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:19.840240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.691779+0000","last_change":"2024-09-13T06:33:35.691835+0000","last_active":"2024-09-13T06:33:35.691779+0000","last_peered":"2024-09-13T06:33:35.691779+0000","last_clean":"2024-09-13T06:33:35.691779+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:33:35.691779+0000","last_undegraded":"2024-09-13T06:33:35.691779+0000","last_fullsized":"2024-09-13T06:33:35.691779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:35.691591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:35.691591+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.691591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:58.329653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.035852+0000","last_change":"2024-09-13T06:33:26.035852+0000","last_active":"2024-09-13T06:33:26.035852+0000","last_peered":"2024-09-13T06:33:26.035852+0000","last_clean":"2024-09-13T06:33:26.035852+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:33:26.035852+0000","last_undegraded":"2024-09-13T06:33:26.035852+0000","last_fullsized":"2024-09-13T06:33:26.035852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:26.035608+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.035608+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.035608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:46.324701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.896327+0000","last_change":"2024-09-13T06:33:31.896388+0000","last_active":"2024-09-13T06:33:31.896327+0000","last_peered":"2024-09-13T06:33:31.896327+0000","last_clean":"2024-09-13T06:33:31.896327+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:33:31.896327+0000","last_undegraded":"2024-09-13T06:33:31.896327+0000","last_fullsized":"2024-09-13T06:33:31.896327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:31.896110+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:31.896110+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.896110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:54.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.702980+0000","last_change":"2024-09-13T06:33:20.702980+0000","last_active":"2024-09-13T06:33:20.702980+0000","last_peered":"2024-09-13T06:33:20.702980+0000","last_clean":"2024-09-13T06:33:20.702980+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:33:20.702980+0000","last_undegraded":"2024-09-13T06:33:20.702980+0000","last_fullsized":"2024-09-13T06:33:20.702980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:20.702727+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:20.702727+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.702727+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:41.365268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.811394+0000","last_change":"2024-09-13T06:33:38.811495+0000","last_active":"2024-09-13T06:33:38.811394+0000","last_peered":"2024-09-13T06:33:38.811394+0000","last_clean":"2024-09-13T06:33:38.811394+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:33:38.811394+0000","last_undegraded":"2024-09-13T06:33:38.811394+0000","last_fullsized":"2024-09-13T06:33:38.811394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:38.811108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:38.811108+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.811108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:51:20.454962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.929692+0000","last_change":"2024-09-13T06:33:23.929692+0000","last_active":"2024-09-13T06:33:23.929692+0000","last_peered":"2024-09-13T06:33:23.929692+0000","last_clean":"2024-09-13T06:33:23.929692+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:33:23.929692+0000","last_undegraded":"2024-09-13T06:33:23.929692+0000","last_fullsized":"2024-09-13T06:33:23.929692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:23.929409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:23.929409+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.929409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:42.507618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.029352+0000","last_change":"2024-09-13T06:33:25.029352+0000","last_active":"2024-09-13T06:33:25.029352+0000","last_peered":"2024-09-13T06:33:25.029352+0000","last_clean":"2024-09-13T06:33:25.029352+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:33:25.029352+0000","last_undegraded":"2024-09-13T06:33:25.029352+0000","last_fullsized":"2024-09-13T06:33:25.029352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:25.029092+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:25.029092+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.029092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:58.332786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.051952+0000","last_change":"2024-09-13T06:33:25.052020+0000","last_active":"2024-09-13T06:33:25.051952+0000","last_peered":"2024-09-13T06:33:25.051952+0000","last_clean":"2024-09-13T06:33:25.051952+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:33:25.051952+0000","last_undegraded":"2024-09-13T06:33:25.051952+0000","last_fullsized":"2024-09-13T06:33:25.051952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:25.051763+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:25.051763+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.051763+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:43.405467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.805101+0000","last_change":"2024-09-13T06:33:36.805101+0000","last_active":"2024-09-13T06:33:36.805101+0000","last_peered":"2024-09-13T06:33:36.805101+0000","last_clean":"2024-09-13T06:33:36.805101+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:33:36.805101+0000","last_undegraded":"2024-09-13T06:33:36.805101+0000","last_fullsized":"2024-09-13T06:33:36.805101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:36.804846+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:36.804846+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.804846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:51.629962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.622665+0000","last_change":"2024-09-13T06:28:58.706507+0000","last_active":"2024-09-13T06:32:48.622665+0000","last_peered":"2024-09-13T06:32:48.622665+0000","last_clean":"2024-09-13T06:32:48.622665+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:32:48.622665+0000","last_undegraded":"2024-09-13T06:32:48.622665+0000","last_fullsized":"2024-09-13T06:32:48.622665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:28:57.963506+0000","last_clean_scrub_stamp":"2024-09-13T06:28:57.963506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.195428+0000","last_change":"2024-09-13T06:33:09.195428+0000","last_active":"2024-09-13T06:33:09.195428+0000","last_peered":"2024-09-13T06:33:09.195428+0000","last_clean":"2024-09-13T06:33:09.195428+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:33:09.195428+0000","last_undegraded":"2024-09-13T06:33:09.195428+0000","last_fullsized":"2024-09-13T06:33:09.195428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:09.195134+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:09.195134+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.195134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:24.446576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.751132+0000","last_change":"2024-09-13T06:33:37.751132+0000","last_active":"2024-09-13T06:33:37.751132+0000","last_peered":"2024-09-13T06:33:37.751132+0000","last_clean":"2024-09-13T06:33:37.751132+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:33:37.751132+0000","last_undegraded":"2024-09-13T06:33:37.751132+0000","last_fullsized":"2024-09-13T06:33:37.751132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:37.750898+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:37.750898+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.750898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.156762+0000","last_change":"2024-09-13T06:33:35.156921+0000","last_active":"2024-09-13T06:33:35.156762+0000","last_peered":"2024-09-13T06:33:35.156762+0000","last_clean":"2024-09-13T06:33:35.156762+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:33:35.156762+0000","last_undegraded":"2024-09-13T06:33:35.156762+0000","last_fullsized":"2024-09-13T06:33:35.156762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:35.156512+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:35.156512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.156512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:55.781468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":446464,"data_stored":151533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":740673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673025,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":742577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":153065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:33:51.589 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.589 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.589 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.589 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.590 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.590 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.590 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.590 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.590 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.591 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.591 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T06:29:01.690319+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.591 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.591 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.591 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.592 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.592 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.592 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.592 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.592 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:28:49.924907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=49, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.593 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.593 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.593 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.593 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T06:29:03.699132+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.593 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.594 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.594 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.594 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.594 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.594 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:29:07.728358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=29, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.595 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.595 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.595 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:28:59.685759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.595 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.595 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:28:57.963506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=28, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=32, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:33:51.595 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:34:11.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.725+0000 7f66a2d3d640 1 Processor -- start 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.725+0000 7f66a2d3d640 1 -- start start 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.725+0000 7f66a2d3d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f669c06d0e0 0x7f669c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.725+0000 7f66a2d3d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c071c10 con 0x7f669c06da00 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.725+0000 7f66a2d3d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f669c072230 con 0x7f669c06d0e0 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a0ad9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f669c06d0e0 0x7f669c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f669bfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f669c06da00 0x7f669c12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41774/0 (socket says 172.21.15.112:41774) 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a0ad9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f669c06d0e0 0x7f669c06d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54512/0 (socket says 172.21.15.112:54512) 2024-09-13T06:34:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f669bfff640 1 -- 172.21.15.112:0/106956700 learned_addr learned my addr 172.21.15.112:0/106956700 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:34:11.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a0ad9640 1 -- 172.21.15.112:0/106956700 >> v1:172.21.15.112:6789/0 conn(0x7f669c06da00 legacy=0x7f669c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:11.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f669b7fe640 1 -- 172.21.15.112:0/106956700 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556615916 0 0) 0x7f669c071c10 con 0x7f669c06da00 2024-09-13T06:34:11.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a0ad9640 1 -- 172.21.15.112:0/106956700 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c0709e0 con 0x7f669c06d0e0 2024-09-13T06:34:11.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a0ad9640 1 --2- 172.21.15.112:0/106956700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c06d4c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f668c009740 tx=0x7f668c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17ab2c516f645c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:34:11.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f669b7fe640 1 -- 172.21.15.112:0/106956700 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f668c0b0070 con 0x7f669c06d0e0 2024-09-13T06:34:11.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f669b7fe640 1 -- 172.21.15.112:0/106956700 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c0ab530 con 0x7f669c06d0e0 2024-09-13T06:34:11.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f669b7fe640 1 -- 172.21.15.112:0/106956700 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f668c0ab830 con 0x7f669c06d0e0 2024-09-13T06:34:11.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 -- 172.21.15.112:0/106956700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 msgr2=0x7f669c06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:11.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 --2- 172.21.15.112:0/106956700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c06d4c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f668c009740 tx=0x7f668c01c370 comp rx=0 tx=0).stop 2024-09-13T06:34:11.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 -- 172.21.15.112:0/106956700 shutdown_connections 2024-09-13T06:34:11.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 --2- 172.21.15.112:0/106956700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c06d4c0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:34:11.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 -- 172.21.15.112:0/106956700 >> 172.21.15.112:0/106956700 conn(0x7f669c099a50 msgr2=0x7f669c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:34:11.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 -- 172.21.15.112:0/106956700 shutdown_connections 2024-09-13T06:34:11.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.729+0000 7f66a2d3d640 1 -- 172.21.15.112:0/106956700 wait complete. 2024-09-13T06:34:11.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 Processor -- start 2024-09-13T06:34:11.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 -- start start 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c1279b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f669c134e80 con 0x7f669c06d0e0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a0ad9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c1279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a0ad9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c1279b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54520/0 (socket says 172.21.15.112:54520) 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a0ad9640 1 -- 172.21.15.112:0/4217592634 learned_addr learned my addr 172.21.15.112:0/4217592634 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a0ad9640 1 -- 172.21.15.112:0/4217592634 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c129e40 con 0x7f669c06d0e0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a0ad9640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c1279b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f668c019fa0 tx=0x7f668c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f668c0b0050 con 0x7f669c06d0e0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c0b1040 con 0x7f669c06d0e0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f668c0b5740 con 0x7f669c06d0e0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669c072710 con 0x7f669c06d0e0 2024-09-13T06:34:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669c12a4d0 con 0x7f669c06d0e0 2024-09-13T06:34:11.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669c06d4c0 con 0x7f669c06d0e0 2024-09-13T06:34:11.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f668c0be030 con 0x7f669c06d0e0 2024-09-13T06:34:11.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66997fa640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6688035db0 0x7f6688038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:34:11.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f668c0bc070 con 0x7f669c06d0e0 2024-09-13T06:34:11.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.733+0000 7f669bfff640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6688035db0 0x7f6688038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:34:11.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.737+0000 7f669bfff640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6688035db0 0x7f6688038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6690007fd0 tx=0x7f6690007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:34:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.737+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f668c0c5020 con 0x7f669c06d0e0 2024-09-13T06:34:11.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.897+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 --> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f669c073790 con 0x7f6688035db0 2024-09-13T06:34:11.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.941+0000 7f66997fa640 1 -- 172.21.15.112:0/4217592634 <== mgr.4101 v2:172.21.15.169:6824/2981546611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665971 (secure 0 0 0) 0x7f669c073790 con 0x7f6688035db0 2024-09-13T06:34:11.950 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-13T06:34:11.957 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-13T06:34:11.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.949+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6688035db0 msgr2=0x7f6688038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:11.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.949+0000 7f66a2d3d640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6688035db0 0x7f6688038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6690007fd0 tx=0x7f6690007980 comp rx=0 tx=0).stop 2024-09-13T06:34:11.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.949+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 msgr2=0x7f669c1279b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.949+0000 7f66a2d3d640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c1279b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f668c019fa0 tx=0x7f668c01abb0 comp rx=0 tx=0).stop 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.953+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 shutdown_connections 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.953+0000 7f66a2d3d640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f6688035db0 0x7f6688038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.953+0000 7f66a2d3d640 1 --2- 172.21.15.112:0/4217592634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f669c06d0e0 0x7f669c1279b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.953+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 >> 172.21.15.112:0/4217592634 conn(0x7f669c099a50 msgr2=0x7f669c131c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.953+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 shutdown_connections 2024-09-13T06:34:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:11.953+0000 7f66a2d3d640 1 -- 172.21.15.112:0/4217592634 wait complete. 2024-09-13T06:34:11.975 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-13T06:34:10.549479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5100,"num_read_kb":4685,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":640184,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4794,"ondisk_log_size":4794,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160960,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326400,"statfs":{"total":386547056640,"available":386382233600,"internally_reserved":0,"allocated":3014656,"data_stored":1787848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005702"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.157322+0000","last_change":"2024-09-13T06:33:33.157397+0000","last_active":"2024-09-13T06:33:33.157322+0000","last_peered":"2024-09-13T06:33:33.157322+0000","last_clean":"2024-09-13T06:33:33.157322+0000","last_became_active":"2024-09-13T06:28:58.715633+0000","last_became_peered":"2024-09-13T06:28:58.715633+0000","last_unstale":"2024-09-13T06:33:33.157322+0000","last_undegraded":"2024-09-13T06:33:33.157322+0000","last_fullsized":"2024-09-13T06:33:33.157322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:33.157130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:33.157130+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.157130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:42.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"35'16","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.072054+0000","last_change":"2024-09-13T06:33:29.072054+0000","last_active":"2024-09-13T06:33:29.072054+0000","last_peered":"2024-09-13T06:33:29.072054+0000","last_clean":"2024-09-13T06:33:29.072054+0000","last_became_active":"2024-09-13T06:29:00.712856+0000","last_became_peered":"2024-09-13T06:29:00.712856+0000","last_unstale":"2024-09-13T06:33:29.072054+0000","last_undegraded":"2024-09-13T06:33:29.072054+0000","last_fullsized":"2024-09-13T06:33:29.072054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:29.071796+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:29.071796+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.071796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:41.533368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.733998+0000","last_change":"2024-09-13T06:33:33.734130+0000","last_active":"2024-09-13T06:33:33.733998+0000","last_peered":"2024-09-13T06:33:33.733998+0000","last_clean":"2024-09-13T06:33:33.733998+0000","last_became_active":"2024-09-13T06:28:58.726657+0000","last_became_peered":"2024-09-13T06:28:58.726657+0000","last_unstale":"2024-09-13T06:33:33.733998+0000","last_undegraded":"2024-09-13T06:33:33.733998+0000","last_fullsized":"2024-09-13T06:33:33.733998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:33.733759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:33.733759+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.733759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:07.359357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.953296+0000","last_change":"2024-09-13T06:33:28.953296+0000","last_active":"2024-09-13T06:33:28.953296+0000","last_peered":"2024-09-13T06:33:28.953296+0000","last_clean":"2024-09-13T06:33:28.953296+0000","last_became_active":"2024-09-13T06:29:00.709331+0000","last_became_peered":"2024-09-13T06:29:00.709331+0000","last_unstale":"2024-09-13T06:33:28.953296+0000","last_undegraded":"2024-09-13T06:33:28.953296+0000","last_fullsized":"2024-09-13T06:33:28.953296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:28.953054+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:28.953054+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.953054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:07.494409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.840607+0000","last_change":"2024-09-13T06:33:35.840718+0000","last_active":"2024-09-13T06:33:35.840607+0000","last_peered":"2024-09-13T06:33:35.840607+0000","last_clean":"2024-09-13T06:33:35.840607+0000","last_became_active":"2024-09-13T06:28:58.725120+0000","last_became_peered":"2024-09-13T06:28:58.725120+0000","last_unstale":"2024-09-13T06:33:35.840607+0000","last_undegraded":"2024-09-13T06:33:35.840607+0000","last_fullsized":"2024-09-13T06:33:35.840607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:35.840309+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:35.840309+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.840309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:45.942898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:43.735154+0000","last_change":"2024-09-13T06:33:43.735154+0000","last_active":"2024-09-13T06:33:43.735154+0000","last_peered":"2024-09-13T06:33:43.735154+0000","last_clean":"2024-09-13T06:33:43.735154+0000","last_became_active":"2024-09-13T06:29:00.706751+0000","last_became_peered":"2024-09-13T06:29:00.706751+0000","last_unstale":"2024-09-13T06:33:43.735154+0000","last_undegraded":"2024-09-13T06:33:43.735154+0000","last_fullsized":"2024-09-13T06:33:43.735154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:43.734903+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:43.734903+0000","last_clean_scrub_stamp":"2024-09-13T06:33:43.734903+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:02:02.921235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.058932+0000","last_change":"2024-09-13T06:33:28.058989+0000","last_active":"2024-09-13T06:33:28.058932+0000","last_peered":"2024-09-13T06:33:28.058932+0000","last_clean":"2024-09-13T06:33:28.058932+0000","last_became_active":"2024-09-13T06:28:58.721338+0000","last_became_peered":"2024-09-13T06:28:58.721338+0000","last_unstale":"2024-09-13T06:33:28.058932+0000","last_undegraded":"2024-09-13T06:33:28.058932+0000","last_fullsized":"2024-09-13T06:33:28.058932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:28.058693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:28.058693+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.058693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:14.652930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:45.697243+0000","last_change":"2024-09-13T06:33:45.697243+0000","last_active":"2024-09-13T06:33:45.697243+0000","last_peered":"2024-09-13T06:33:45.697243+0000","last_clean":"2024-09-13T06:33:45.697243+0000","last_became_active":"2024-09-13T06:29:00.707428+0000","last_became_peered":"2024-09-13T06:29:00.707428+0000","last_unstale":"2024-09-13T06:33:45.697243+0000","last_undegraded":"2024-09-13T06:33:45.697243+0000","last_fullsized":"2024-09-13T06:33:45.697243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:45.696996+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:45.696996+0000","last_clean_scrub_stamp":"2024-09-13T06:33:45.696996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:58.187246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:46.053892+0000","last_change":"2024-09-13T06:33:46.053892+0000","last_active":"2024-09-13T06:33:46.053892+0000","last_peered":"2024-09-13T06:33:46.053892+0000","last_clean":"2024-09-13T06:33:46.053892+0000","last_became_active":"2024-09-13T06:28:58.705426+0000","last_became_peered":"2024-09-13T06:28:58.705426+0000","last_unstale":"2024-09-13T06:33:46.053892+0000","last_undegraded":"2024-09-13T06:33:46.053892+0000","last_fullsized":"2024-09-13T06:33:46.053892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:46.053513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:46.053513+0000","last_clean_scrub_stamp":"2024-09-13T06:33:46.053513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:10:35.709191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"35'8","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.653904+0000","last_change":"2024-09-13T06:33:15.653971+0000","last_active":"2024-09-13T06:33:15.653904+0000","last_peered":"2024-09-13T06:33:15.653904+0000","last_clean":"2024-09-13T06:33:15.653904+0000","last_became_active":"2024-09-13T06:29:00.729283+0000","last_became_peered":"2024-09-13T06:29:00.729283+0000","last_unstale":"2024-09-13T06:33:15.653904+0000","last_undegraded":"2024-09-13T06:33:15.653904+0000","last_fullsized":"2024-09-13T06:33:15.653904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:15.653721+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:15.653721+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.653721+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:58.261366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:41.125939+0000","last_change":"2024-09-13T06:33:41.125939+0000","last_active":"2024-09-13T06:33:41.125939+0000","last_peered":"2024-09-13T06:33:41.125939+0000","last_clean":"2024-09-13T06:33:41.125939+0000","last_became_active":"2024-09-13T06:28:58.733904+0000","last_became_peered":"2024-09-13T06:28:58.733904+0000","last_unstale":"2024-09-13T06:33:41.125939+0000","last_undegraded":"2024-09-13T06:33:41.125939+0000","last_fullsized":"2024-09-13T06:33:41.125939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:41.125689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:41.125689+0000","last_clean_scrub_stamp":"2024-09-13T06:33:41.125689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:53.615939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.975152+0000","last_change":"2024-09-13T06:33:16.975268+0000","last_active":"2024-09-13T06:33:16.975152+0000","last_peered":"2024-09-13T06:33:16.975152+0000","last_clean":"2024-09-13T06:33:16.975152+0000","last_became_active":"2024-09-13T06:29:00.726162+0000","last_became_peered":"2024-09-13T06:29:00.726162+0000","last_unstale":"2024-09-13T06:33:16.975152+0000","last_undegraded":"2024-09-13T06:33:16.975152+0000","last_fullsized":"2024-09-13T06:33:16.975152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:16.974924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:16.974924+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.974924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:32.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"33'3","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:54.795108+0000","last_change":"2024-09-13T06:33:54.795108+0000","last_active":"2024-09-13T06:33:54.795108+0000","last_peered":"2024-09-13T06:33:54.795108+0000","last_clean":"2024-09-13T06:33:54.795108+0000","last_became_active":"2024-09-13T06:28:58.717241+0000","last_became_peered":"2024-09-13T06:28:58.717241+0000","last_unstale":"2024-09-13T06:33:54.795108+0000","last_undegraded":"2024-09-13T06:33:54.795108+0000","last_fullsized":"2024-09-13T06:33:54.795108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T06:33:54.794813+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T06:33:54.794813+0000","last_clean_scrub_stamp":"2024-09-13T06:33:54.794813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:52.164727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.944658+0000","last_change":"2024-09-13T06:33:15.944720+0000","last_active":"2024-09-13T06:33:15.944658+0000","last_peered":"2024-09-13T06:33:15.944658+0000","last_clean":"2024-09-13T06:33:15.944658+0000","last_became_active":"2024-09-13T06:29:00.726481+0000","last_became_peered":"2024-09-13T06:29:00.726481+0000","last_unstale":"2024-09-13T06:33:15.944658+0000","last_undegraded":"2024-09-13T06:33:15.944658+0000","last_fullsized":"2024-09-13T06:33:15.944658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:15.944444+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:15.944444+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.944444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:43.352704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:51.745739+0000","last_change":"2024-09-13T06:33:51.745739+0000","last_active":"2024-09-13T06:33:51.745739+0000","last_peered":"2024-09-13T06:33:51.745739+0000","last_clean":"2024-09-13T06:33:51.745739+0000","last_became_active":"2024-09-13T06:28:58.711049+0000","last_became_peered":"2024-09-13T06:28:58.711049+0000","last_unstale":"2024-09-13T06:33:51.745739+0000","last_undegraded":"2024-09-13T06:33:51.745739+0000","last_fullsized":"2024-09-13T06:33:51.745739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:51.745459+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:51.745459+0000","last_clean_scrub_stamp":"2024-09-13T06:33:51.745459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:10:41.401138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"35'2","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.112970+0000","last_change":"2024-09-13T06:33:11.113036+0000","last_active":"2024-09-13T06:33:11.112970+0000","last_peered":"2024-09-13T06:33:11.112970+0000","last_clean":"2024-09-13T06:33:11.112970+0000","last_became_active":"2024-09-13T06:29:00.709642+0000","last_became_peered":"2024-09-13T06:29:00.709642+0000","last_unstale":"2024-09-13T06:33:11.112970+0000","last_undegraded":"2024-09-13T06:33:11.112970+0000","last_fullsized":"2024-09-13T06:33:11.112970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:11.112754+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:11.112754+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.112754+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:55:36.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:57.121373+0000","last_change":"2024-09-13T06:33:57.121439+0000","last_active":"2024-09-13T06:33:57.121373+0000","last_peered":"2024-09-13T06:33:57.121373+0000","last_clean":"2024-09-13T06:33:57.121373+0000","last_became_active":"2024-09-13T06:29:00.710884+0000","last_became_peered":"2024-09-13T06:29:00.710884+0000","last_unstale":"2024-09-13T06:33:57.121373+0000","last_undegraded":"2024-09-13T06:33:57.121373+0000","last_fullsized":"2024-09-13T06:33:57.121373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:57.121166+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:57.121166+0000","last_clean_scrub_stamp":"2024-09-13T06:33:57.121166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:16:02.265592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.837021+0000","last_change":"2024-09-13T06:33:27.837021+0000","last_active":"2024-09-13T06:33:27.837021+0000","last_peered":"2024-09-13T06:33:27.837021+0000","last_clean":"2024-09-13T06:33:27.837021+0000","last_became_active":"2024-09-13T06:28:58.730273+0000","last_became_peered":"2024-09-13T06:28:58.730273+0000","last_unstale":"2024-09-13T06:33:27.837021+0000","last_undegraded":"2024-09-13T06:33:27.837021+0000","last_fullsized":"2024-09-13T06:33:27.837021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:27.836778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:27.836778+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.836778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:55.245038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.996229+0000","last_change":"2024-09-13T06:33:17.996229+0000","last_active":"2024-09-13T06:33:17.996229+0000","last_peered":"2024-09-13T06:33:17.996229+0000","last_clean":"2024-09-13T06:33:17.996229+0000","last_became_active":"2024-09-13T06:29:00.722722+0000","last_became_peered":"2024-09-13T06:29:00.722722+0000","last_unstale":"2024-09-13T06:33:17.996229+0000","last_undegraded":"2024-09-13T06:33:17.996229+0000","last_fullsized":"2024-09-13T06:33:17.996229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:17.995815+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:17.995815+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.995815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:56.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.068513+0000","last_change":"2024-09-13T06:33:30.068513+0000","last_active":"2024-09-13T06:33:30.068513+0000","last_peered":"2024-09-13T06:33:30.068513+0000","last_clean":"2024-09-13T06:33:30.068513+0000","last_became_active":"2024-09-13T06:28:58.721161+0000","last_became_peered":"2024-09-13T06:28:58.721161+0000","last_unstale":"2024-09-13T06:33:30.068513+0000","last_undegraded":"2024-09-13T06:33:30.068513+0000","last_fullsized":"2024-09-13T06:33:30.068513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:30.068258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:30.068258+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.068258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:59:55.393231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'12","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:47.045448+0000","last_change":"2024-09-13T06:33:47.045508+0000","last_active":"2024-09-13T06:33:47.045448+0000","last_peered":"2024-09-13T06:33:47.045448+0000","last_clean":"2024-09-13T06:33:47.045448+0000","last_became_active":"2024-09-13T06:29:00.713177+0000","last_became_peered":"2024-09-13T06:29:00.713177+0000","last_unstale":"2024-09-13T06:33:47.045448+0000","last_undegraded":"2024-09-13T06:33:47.045448+0000","last_fullsized":"2024-09-13T06:33:47.045448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:47.045239+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:47.045239+0000","last_clean_scrub_stamp":"2024-09-13T06:33:47.045239+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:39.517142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:45.045509+0000","last_change":"2024-09-13T06:33:45.045509+0000","last_active":"2024-09-13T06:33:45.045509+0000","last_peered":"2024-09-13T06:33:45.045509+0000","last_clean":"2024-09-13T06:33:45.045509+0000","last_became_active":"2024-09-13T06:28:58.734286+0000","last_became_peered":"2024-09-13T06:28:58.734286+0000","last_unstale":"2024-09-13T06:33:45.045509+0000","last_undegraded":"2024-09-13T06:33:45.045509+0000","last_fullsized":"2024-09-13T06:33:45.045509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:45.045236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:45.045236+0000","last_clean_scrub_stamp":"2024-09-13T06:33:45.045236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:26.491949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.253201+0000","last_change":"2024-09-13T06:33:07.253201+0000","last_active":"2024-09-13T06:33:07.253201+0000","last_peered":"2024-09-13T06:33:07.253201+0000","last_clean":"2024-09-13T06:33:07.253201+0000","last_became_active":"2024-09-13T06:29:00.706583+0000","last_became_peered":"2024-09-13T06:29:00.706583+0000","last_unstale":"2024-09-13T06:33:07.253201+0000","last_undegraded":"2024-09-13T06:33:07.253201+0000","last_fullsized":"2024-09-13T06:33:07.253201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:07.252909+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:07.252909+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.252909+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:11.908729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:44.082595+0000","last_change":"2024-09-13T06:33:44.082595+0000","last_active":"2024-09-13T06:33:44.082595+0000","last_peered":"2024-09-13T06:33:44.082595+0000","last_clean":"2024-09-13T06:33:44.082595+0000","last_became_active":"2024-09-13T06:28:58.713866+0000","last_became_peered":"2024-09-13T06:28:58.713866+0000","last_unstale":"2024-09-13T06:33:44.082595+0000","last_undegraded":"2024-09-13T06:33:44.082595+0000","last_fullsized":"2024-09-13T06:33:44.082595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:44.082336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:44.082336+0000","last_clean_scrub_stamp":"2024-09-13T06:33:44.082336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:56.848272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.148134+0000","last_change":"2024-09-13T06:33:10.148134+0000","last_active":"2024-09-13T06:33:10.148134+0000","last_peered":"2024-09-13T06:33:10.148134+0000","last_clean":"2024-09-13T06:33:10.148134+0000","last_became_active":"2024-09-13T06:29:00.705822+0000","last_became_peered":"2024-09-13T06:29:00.705822+0000","last_unstale":"2024-09-13T06:33:10.148134+0000","last_undegraded":"2024-09-13T06:33:10.148134+0000","last_fullsized":"2024-09-13T06:33:10.148134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:10.147709+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:10.147709+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.147709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:32.231738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:49.717319+0000","last_change":"2024-09-13T06:33:49.717319+0000","last_active":"2024-09-13T06:33:49.717319+0000","last_peered":"2024-09-13T06:33:49.717319+0000","last_clean":"2024-09-13T06:33:49.717319+0000","last_became_active":"2024-09-13T06:28:58.706413+0000","last_became_peered":"2024-09-13T06:28:58.706413+0000","last_unstale":"2024-09-13T06:33:49.717319+0000","last_undegraded":"2024-09-13T06:33:49.717319+0000","last_fullsized":"2024-09-13T06:33:49.717319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:49.717062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:49.717062+0000","last_clean_scrub_stamp":"2024-09-13T06:33:49.717062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:02.482998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'8","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.703315+0000","last_change":"2024-09-13T06:33:36.703315+0000","last_active":"2024-09-13T06:33:36.703315+0000","last_peered":"2024-09-13T06:33:36.703315+0000","last_clean":"2024-09-13T06:33:36.703315+0000","last_became_active":"2024-09-13T06:29:00.724375+0000","last_became_peered":"2024-09-13T06:29:00.724375+0000","last_unstale":"2024-09-13T06:33:36.703315+0000","last_undegraded":"2024-09-13T06:33:36.703315+0000","last_fullsized":"2024-09-13T06:33:36.703315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:36.703076+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:36.703076+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.703076+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:38.252127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.903679+0000","last_change":"2024-09-13T06:33:33.903679+0000","last_active":"2024-09-13T06:33:33.903679+0000","last_peered":"2024-09-13T06:33:33.903679+0000","last_clean":"2024-09-13T06:33:33.903679+0000","last_became_active":"2024-09-13T06:28:58.717613+0000","last_became_peered":"2024-09-13T06:28:58.717613+0000","last_unstale":"2024-09-13T06:33:33.903679+0000","last_undegraded":"2024-09-13T06:33:33.903679+0000","last_fullsized":"2024-09-13T06:33:33.903679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:33.903434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:33.903434+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.903434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:46.365006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'38","reported_seq":116,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:50.869619+0000","last_change":"2024-09-13T06:33:50.869619+0000","last_active":"2024-09-13T06:33:50.869619+0000","last_peered":"2024-09-13T06:33:50.869619+0000","last_clean":"2024-09-13T06:33:50.869619+0000","last_became_active":"2024-09-13T06:29:08.789320+0000","last_became_peered":"2024-09-13T06:29:08.789320+0000","last_unstale":"2024-09-13T06:33:50.869619+0000","last_undegraded":"2024-09-13T06:33:50.869619+0000","last_fullsized":"2024-09-13T06:33:50.869619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'38","last_scrub_stamp":"2024-09-13T06:33:50.869375+0000","last_deep_scrub":"35'38","last_deep_scrub_stamp":"2024-09-13T06:33:50.869375+0000","last_clean_scrub_stamp":"2024-09-13T06:33:50.869375+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.054328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.905011+0000","last_change":"2024-09-13T06:33:22.905011+0000","last_active":"2024-09-13T06:33:22.905011+0000","last_peered":"2024-09-13T06:33:22.905011+0000","last_clean":"2024-09-13T06:33:22.905011+0000","last_became_active":"2024-09-13T06:29:00.722632+0000","last_became_peered":"2024-09-13T06:29:00.722632+0000","last_unstale":"2024-09-13T06:33:22.905011+0000","last_undegraded":"2024-09-13T06:33:22.905011+0000","last_fullsized":"2024-09-13T06:33:22.905011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:22.904618+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:22.904618+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.904618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:50:01.871288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'2","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:53.758079+0000","last_change":"2024-09-13T06:33:53.758223+0000","last_active":"2024-09-13T06:33:53.758079+0000","last_peered":"2024-09-13T06:33:53.758079+0000","last_clean":"2024-09-13T06:33:53.758079+0000","last_became_active":"2024-09-13T06:28:58.714083+0000","last_became_peered":"2024-09-13T06:28:58.714083+0000","last_unstale":"2024-09-13T06:33:53.758079+0000","last_undegraded":"2024-09-13T06:33:53.758079+0000","last_fullsized":"2024-09-13T06:33:53.758079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T06:33:53.757850+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T06:33:53.757850+0000","last_clean_scrub_stamp":"2024-09-13T06:33:53.757850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:36:32.117911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.834872+0000","last_change":"2024-09-13T06:33:11.834872+0000","last_active":"2024-09-13T06:33:11.834872+0000","last_peered":"2024-09-13T06:33:11.834872+0000","last_clean":"2024-09-13T06:33:11.834872+0000","last_became_active":"2024-09-13T06:29:02.739286+0000","last_became_peered":"2024-09-13T06:29:02.739286+0000","last_unstale":"2024-09-13T06:33:11.834872+0000","last_undegraded":"2024-09-13T06:33:11.834872+0000","last_fullsized":"2024-09-13T06:33:11.834872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:11.834596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:11.834596+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.834596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:06.219464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.895065+0000","last_change":"2024-09-13T06:33:04.895065+0000","last_active":"2024-09-13T06:33:04.895065+0000","last_peered":"2024-09-13T06:33:04.895065+0000","last_clean":"2024-09-13T06:33:04.895065+0000","last_became_active":"2024-09-13T06:29:04.755462+0000","last_became_peered":"2024-09-13T06:29:04.755462+0000","last_unstale":"2024-09-13T06:33:04.895065+0000","last_undegraded":"2024-09-13T06:33:04.895065+0000","last_fullsized":"2024-09-13T06:33:04.895065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:04.894816+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.894816+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:27.810903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.054454+0000","last_change":"2024-09-13T06:33:23.054454+0000","last_active":"2024-09-13T06:33:23.054454+0000","last_peered":"2024-09-13T06:33:23.054454+0000","last_clean":"2024-09-13T06:33:23.054454+0000","last_became_active":"2024-09-13T06:29:06.774032+0000","last_became_peered":"2024-09-13T06:29:06.774032+0000","last_unstale":"2024-09-13T06:33:23.054454+0000","last_undegraded":"2024-09-13T06:33:23.054454+0000","last_fullsized":"2024-09-13T06:33:23.054454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:23.054208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:23.054208+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.054208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:28.175323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:58.104045+0000","last_change":"2024-09-13T06:33:58.104045+0000","last_active":"2024-09-13T06:33:58.104045+0000","last_peered":"2024-09-13T06:33:58.104045+0000","last_clean":"2024-09-13T06:33:58.104045+0000","last_became_active":"2024-09-13T06:29:08.769000+0000","last_became_peered":"2024-09-13T06:29:08.769000+0000","last_unstale":"2024-09-13T06:33:58.104045+0000","last_undegraded":"2024-09-13T06:33:58.104045+0000","last_fullsized":"2024-09-13T06:33:58.104045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T06:33:58.103616+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T06:33:58.103616+0000","last_clean_scrub_stamp":"2024-09-13T06:33:58.103616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:39.251527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:41.786937+0000","last_change":"2024-09-13T06:33:41.786937+0000","last_active":"2024-09-13T06:33:41.786937+0000","last_peered":"2024-09-13T06:33:41.786937+0000","last_clean":"2024-09-13T06:33:41.786937+0000","last_became_active":"2024-09-13T06:29:00.706668+0000","last_became_peered":"2024-09-13T06:29:00.706668+0000","last_unstale":"2024-09-13T06:33:41.786937+0000","last_undegraded":"2024-09-13T06:33:41.786937+0000","last_fullsized":"2024-09-13T06:33:41.786937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:41.786685+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:41.786685+0000","last_clean_scrub_stamp":"2024-09-13T06:33:41.786685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:29.422606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.069387+0000","last_change":"2024-09-13T06:33:29.069387+0000","last_active":"2024-09-13T06:33:29.069387+0000","last_peered":"2024-09-13T06:33:29.069387+0000","last_clean":"2024-09-13T06:33:29.069387+0000","last_became_active":"2024-09-13T06:28:58.721577+0000","last_became_peered":"2024-09-13T06:28:58.721577+0000","last_unstale":"2024-09-13T06:33:29.069387+0000","last_undegraded":"2024-09-13T06:33:29.069387+0000","last_fullsized":"2024-09-13T06:33:29.069387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:29.069109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:29.069109+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.069109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:06.525435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":235,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.805487+0000","last_change":"2024-09-13T06:33:15.805487+0000","last_active":"2024-09-13T06:33:15.805487+0000","last_peered":"2024-09-13T06:33:15.805487+0000","last_clean":"2024-09-13T06:33:15.805487+0000","last_became_active":"2024-09-13T06:29:02.717202+0000","last_became_peered":"2024-09-13T06:29:02.717202+0000","last_unstale":"2024-09-13T06:33:15.805487+0000","last_undegraded":"2024-09-13T06:33:15.805487+0000","last_fullsized":"2024-09-13T06:33:15.805487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:15.805232+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:15.805232+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.805232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:47.324786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.637131+0000","last_change":"2024-09-13T06:33:03.637131+0000","last_active":"2024-09-13T06:33:03.637131+0000","last_peered":"2024-09-13T06:33:03.637131+0000","last_clean":"2024-09-13T06:33:03.637131+0000","last_became_active":"2024-09-13T06:29:04.733523+0000","last_became_peered":"2024-09-13T06:29:04.733523+0000","last_unstale":"2024-09-13T06:33:03.637131+0000","last_undegraded":"2024-09-13T06:33:03.637131+0000","last_fullsized":"2024-09-13T06:33:03.637131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:03.636833+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.636833+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:45.356483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.925869+0000","last_change":"2024-09-13T06:33:10.925869+0000","last_active":"2024-09-13T06:33:10.925869+0000","last_peered":"2024-09-13T06:33:10.925869+0000","last_clean":"2024-09-13T06:33:10.925869+0000","last_became_active":"2024-09-13T06:29:06.773557+0000","last_became_peered":"2024-09-13T06:29:06.773557+0000","last_unstale":"2024-09-13T06:33:10.925869+0000","last_undegraded":"2024-09-13T06:33:10.925869+0000","last_fullsized":"2024-09-13T06:33:10.925869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:10.925618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:10.925618+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.925618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:42.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:01.843398+0000","last_change":"2024-09-13T06:34:01.843398+0000","last_active":"2024-09-13T06:34:01.843398+0000","last_peered":"2024-09-13T06:34:01.843398+0000","last_clean":"2024-09-13T06:34:01.843398+0000","last_became_active":"2024-09-13T06:29:08.792218+0000","last_became_peered":"2024-09-13T06:29:08.792218+0000","last_unstale":"2024-09-13T06:34:01.843398+0000","last_undegraded":"2024-09-13T06:34:01.843398+0000","last_fullsized":"2024-09-13T06:34:01.843398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T06:34:01.843109+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T06:34:01.843109+0000","last_clean_scrub_stamp":"2024-09-13T06:34:01.843109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:37.753686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"33'6","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.922941+0000","last_change":"2024-09-13T06:33:26.922941+0000","last_active":"2024-09-13T06:33:26.922941+0000","last_peered":"2024-09-13T06:33:26.922941+0000","last_clean":"2024-09-13T06:33:26.922941+0000","last_became_active":"2024-09-13T06:29:00.718006+0000","last_became_peered":"2024-09-13T06:29:00.718006+0000","last_unstale":"2024-09-13T06:33:26.922941+0000","last_undegraded":"2024-09-13T06:33:26.922941+0000","last_fullsized":"2024-09-13T06:33:26.922941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T06:33:26.922557+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.922557+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.922557+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:01.027984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"33'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.166111+0000","last_change":"2024-09-13T06:33:34.166111+0000","last_active":"2024-09-13T06:33:34.166111+0000","last_peered":"2024-09-13T06:33:34.166111+0000","last_clean":"2024-09-13T06:33:34.166111+0000","last_became_active":"2024-09-13T06:28:58.715826+0000","last_became_peered":"2024-09-13T06:28:58.715826+0000","last_unstale":"2024-09-13T06:33:34.166111+0000","last_undegraded":"2024-09-13T06:33:34.166111+0000","last_fullsized":"2024-09-13T06:33:34.166111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:34.165835+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:34.165835+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.165835+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:51:15.809690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.848353+0000","last_change":"2024-09-13T06:32:56.848353+0000","last_active":"2024-09-13T06:32:56.848353+0000","last_peered":"2024-09-13T06:32:56.848353+0000","last_clean":"2024-09-13T06:32:56.848353+0000","last_became_active":"2024-09-13T06:29:02.743658+0000","last_became_peered":"2024-09-13T06:29:02.743658+0000","last_unstale":"2024-09-13T06:32:56.848353+0000","last_undegraded":"2024-09-13T06:32:56.848353+0000","last_fullsized":"2024-09-13T06:32:56.848353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.848110+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.848110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:46.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'16","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.240975+0000","last_change":"2024-09-13T06:33:03.240975+0000","last_active":"2024-09-13T06:33:03.240975+0000","last_peered":"2024-09-13T06:33:03.240975+0000","last_clean":"2024-09-13T06:33:03.240975+0000","last_became_active":"2024-09-13T06:29:04.722873+0000","last_became_peered":"2024-09-13T06:29:04.722873+0000","last_unstale":"2024-09-13T06:33:03.240975+0000","last_undegraded":"2024-09-13T06:33:03.240975+0000","last_fullsized":"2024-09-13T06:33:03.240975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:03.240667+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.240667+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:49.440163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.778272+0000","last_change":"2024-09-13T06:33:01.778272+0000","last_active":"2024-09-13T06:33:01.778272+0000","last_peered":"2024-09-13T06:33:01.778272+0000","last_clean":"2024-09-13T06:33:01.778272+0000","last_became_active":"2024-09-13T06:29:06.750710+0000","last_became_peered":"2024-09-13T06:29:06.750710+0000","last_unstale":"2024-09-13T06:33:01.778272+0000","last_undegraded":"2024-09-13T06:33:01.778272+0000","last_fullsized":"2024-09-13T06:33:01.778272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:01.777993+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.777993+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:14.895259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"35'3","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.160119+0000","last_change":"2024-09-13T06:32:50.160119+0000","last_active":"2024-09-13T06:32:50.160119+0000","last_peered":"2024-09-13T06:32:50.160119+0000","last_clean":"2024-09-13T06:32:50.160119+0000","last_became_active":"2024-09-13T06:29:08.760721+0000","last_became_peered":"2024-09-13T06:29:08.760721+0000","last_unstale":"2024-09-13T06:32:50.160119+0000","last_undegraded":"2024-09-13T06:32:50.160119+0000","last_fullsized":"2024-09-13T06:32:50.160119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:32:50.159726+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.159726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:36:19.505279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.839536+0000","last_change":"2024-09-13T06:33:16.839536+0000","last_active":"2024-09-13T06:33:16.839536+0000","last_peered":"2024-09-13T06:33:16.839536+0000","last_clean":"2024-09-13T06:33:16.839536+0000","last_became_active":"2024-09-13T06:29:00.732716+0000","last_became_peered":"2024-09-13T06:29:00.732716+0000","last_unstale":"2024-09-13T06:33:16.839536+0000","last_undegraded":"2024-09-13T06:33:16.839536+0000","last_fullsized":"2024-09-13T06:33:16.839536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:16.839234+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:16.839234+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.839234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:56.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:40.094984+0000","last_change":"2024-09-13T06:33:40.095103+0000","last_active":"2024-09-13T06:33:40.094984+0000","last_peered":"2024-09-13T06:33:40.094984+0000","last_clean":"2024-09-13T06:33:40.094984+0000","last_became_active":"2024-09-13T06:28:58.714100+0000","last_became_peered":"2024-09-13T06:28:58.714100+0000","last_unstale":"2024-09-13T06:33:40.094984+0000","last_undegraded":"2024-09-13T06:33:40.094984+0000","last_fullsized":"2024-09-13T06:33:40.094984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:40.094753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:40.094753+0000","last_clean_scrub_stamp":"2024-09-13T06:33:40.094753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:45.387897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.951791+0000","last_change":"2024-09-13T06:33:12.951791+0000","last_active":"2024-09-13T06:33:12.951791+0000","last_peered":"2024-09-13T06:33:12.951791+0000","last_clean":"2024-09-13T06:33:12.951791+0000","last_became_active":"2024-09-13T06:29:02.715081+0000","last_became_peered":"2024-09-13T06:29:02.715081+0000","last_unstale":"2024-09-13T06:33:12.951791+0000","last_undegraded":"2024-09-13T06:33:12.951791+0000","last_fullsized":"2024-09-13T06:33:12.951791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.951537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.951537+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.951537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:01.784492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.920987+0000","last_change":"2024-09-13T06:33:09.920987+0000","last_active":"2024-09-13T06:33:09.920987+0000","last_peered":"2024-09-13T06:33:09.920987+0000","last_clean":"2024-09-13T06:33:09.920987+0000","last_became_active":"2024-09-13T06:29:04.732525+0000","last_became_peered":"2024-09-13T06:29:04.732525+0000","last_unstale":"2024-09-13T06:33:09.920987+0000","last_undegraded":"2024-09-13T06:33:09.920987+0000","last_fullsized":"2024-09-13T06:33:09.920987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:09.920723+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:09.920723+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.920723+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:18:43.608859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":419,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.878079+0000","last_change":"2024-09-13T06:33:09.878079+0000","last_active":"2024-09-13T06:33:09.878079+0000","last_peered":"2024-09-13T06:33:09.878079+0000","last_clean":"2024-09-13T06:33:09.878079+0000","last_became_active":"2024-09-13T06:29:06.767313+0000","last_became_peered":"2024-09-13T06:29:06.767313+0000","last_unstale":"2024-09-13T06:33:09.878079+0000","last_undegraded":"2024-09-13T06:33:09.878079+0000","last_fullsized":"2024-09-13T06:33:09.878079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:09.877840+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:09.877840+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.877840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:33.591992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"35'12","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.136142+0000","last_change":"2024-09-13T06:33:37.136142+0000","last_active":"2024-09-13T06:33:37.136142+0000","last_peered":"2024-09-13T06:33:37.136142+0000","last_clean":"2024-09-13T06:33:37.136142+0000","last_became_active":"2024-09-13T06:29:39.503205+0000","last_became_peered":"2024-09-13T06:29:39.503205+0000","last_unstale":"2024-09-13T06:33:37.136142+0000","last_undegraded":"2024-09-13T06:33:37.136142+0000","last_fullsized":"2024-09-13T06:33:37.136142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:37.135886+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:37.135886+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.135886+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:02:55.426032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"35'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.152928+0000","last_change":"2024-09-13T06:33:38.152986+0000","last_active":"2024-09-13T06:33:38.152928+0000","last_peered":"2024-09-13T06:33:38.152928+0000","last_clean":"2024-09-13T06:33:38.152928+0000","last_became_active":"2024-09-13T06:28:58.714702+0000","last_became_peered":"2024-09-13T06:28:58.714702+0000","last_unstale":"2024-09-13T06:33:38.152928+0000","last_undegraded":"2024-09-13T06:33:38.152928+0000","last_fullsized":"2024-09-13T06:33:38.152928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:38.152743+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:38.152743+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.152743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:27.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.602144+0000","last_change":"2024-09-13T06:33:05.602144+0000","last_active":"2024-09-13T06:33:05.602144+0000","last_peered":"2024-09-13T06:33:05.602144+0000","last_clean":"2024-09-13T06:33:05.602144+0000","last_became_active":"2024-09-13T06:29:02.731099+0000","last_became_peered":"2024-09-13T06:29:02.731099+0000","last_unstale":"2024-09-13T06:33:05.602144+0000","last_undegraded":"2024-09-13T06:33:05.602144+0000","last_fullsized":"2024-09-13T06:33:05.602144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:05.601881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:05.601881+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.601881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:39:26.049665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'52","reported_seq":117,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.790158+0000","last_change":"2024-09-13T06:32:50.790158+0000","last_active":"2024-09-13T06:32:50.790158+0000","last_peered":"2024-09-13T06:32:50.790158+0000","last_clean":"2024-09-13T06:32:50.790158+0000","last_became_active":"2024-09-13T06:29:04.731065+0000","last_became_peered":"2024-09-13T06:29:04.731065+0000","last_unstale":"2024-09-13T06:32:50.790158+0000","last_undegraded":"2024-09-13T06:32:50.790158+0000","last_fullsized":"2024-09-13T06:32:50.790158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'52","last_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_deep_scrub":"35'52","last_deep_scrub_stamp":"2024-09-13T06:32:50.789873+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.789873+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:31.896380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.587596+0000","last_change":"2024-09-13T06:32:56.587596+0000","last_active":"2024-09-13T06:32:56.587596+0000","last_peered":"2024-09-13T06:32:56.587596+0000","last_clean":"2024-09-13T06:32:56.587596+0000","last_became_active":"2024-09-13T06:29:06.747069+0000","last_became_peered":"2024-09-13T06:29:06.747069+0000","last_unstale":"2024-09-13T06:32:56.587596+0000","last_undegraded":"2024-09-13T06:32:56.587596+0000","last_fullsized":"2024-09-13T06:32:56.587596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.587340+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.587340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:07:15.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.131201+0000","last_change":"2024-09-13T06:33:32.131265+0000","last_active":"2024-09-13T06:33:32.131201+0000","last_peered":"2024-09-13T06:33:32.131201+0000","last_clean":"2024-09-13T06:33:32.131201+0000","last_became_active":"2024-09-13T06:29:08.790729+0000","last_became_peered":"2024-09-13T06:29:08.790729+0000","last_unstale":"2024-09-13T06:33:32.131201+0000","last_undegraded":"2024-09-13T06:33:32.131201+0000","last_fullsized":"2024-09-13T06:33:32.131201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T06:33:32.130996+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T06:33:32.130996+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.130996+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:18.817438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'26","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.850829+0000","last_change":"2024-09-13T06:33:48.850894+0000","last_active":"2024-09-13T06:33:48.850829+0000","last_peered":"2024-09-13T06:33:48.850829+0000","last_clean":"2024-09-13T06:33:48.850829+0000","last_became_active":"2024-09-13T06:29:00.726177+0000","last_became_peered":"2024-09-13T06:29:00.726177+0000","last_unstale":"2024-09-13T06:33:48.850829+0000","last_undegraded":"2024-09-13T06:33:48.850829+0000","last_fullsized":"2024-09-13T06:33:48.850829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'26","last_scrub_stamp":"2024-09-13T06:33:48.850637+0000","last_deep_scrub":"35'26","last_deep_scrub_stamp":"2024-09-13T06:33:48.850637+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.850637+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:11.141910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":29,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:54.064888+0000","last_change":"2024-09-13T06:33:54.064949+0000","last_active":"2024-09-13T06:33:54.064888+0000","last_peered":"2024-09-13T06:33:54.064888+0000","last_clean":"2024-09-13T06:33:54.064888+0000","last_became_active":"2024-09-13T06:28:58.705510+0000","last_became_peered":"2024-09-13T06:28:58.705510+0000","last_unstale":"2024-09-13T06:33:54.064888+0000","last_undegraded":"2024-09-13T06:33:54.064888+0000","last_fullsized":"2024-09-13T06:33:54.064888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:54.064698+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:54.064698+0000","last_clean_scrub_stamp":"2024-09-13T06:33:54.064698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:58:40.389546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.100618+0000","last_change":"2024-09-13T06:33:31.100669+0000","last_active":"2024-09-13T06:33:31.100618+0000","last_peered":"2024-09-13T06:33:31.100618+0000","last_clean":"2024-09-13T06:33:31.100618+0000","last_became_active":"2024-09-13T06:29:02.724146+0000","last_became_peered":"2024-09-13T06:29:02.724146+0000","last_unstale":"2024-09-13T06:33:31.100618+0000","last_undegraded":"2024-09-13T06:33:31.100618+0000","last_fullsized":"2024-09-13T06:33:31.100618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:31.100424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:31.100424+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.100424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:11.313219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.915760+0000","last_change":"2024-09-13T06:33:07.915760+0000","last_active":"2024-09-13T06:33:07.915760+0000","last_peered":"2024-09-13T06:33:07.915760+0000","last_clean":"2024-09-13T06:33:07.915760+0000","last_became_active":"2024-09-13T06:29:04.753339+0000","last_became_peered":"2024-09-13T06:29:04.753339+0000","last_unstale":"2024-09-13T06:33:07.915760+0000","last_undegraded":"2024-09-13T06:33:07.915760+0000","last_fullsized":"2024-09-13T06:33:07.915760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:07.915512+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:07.915512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.915512+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:06.613007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.875693+0000","last_change":"2024-09-13T06:33:02.875693+0000","last_active":"2024-09-13T06:33:02.875693+0000","last_peered":"2024-09-13T06:33:02.875693+0000","last_clean":"2024-09-13T06:33:02.875693+0000","last_became_active":"2024-09-13T06:29:06.762051+0000","last_became_peered":"2024-09-13T06:29:06.762051+0000","last_unstale":"2024-09-13T06:33:02.875693+0000","last_undegraded":"2024-09-13T06:33:02.875693+0000","last_fullsized":"2024-09-13T06:33:02.875693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.875433+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.875433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:23.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"35'4","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.634982+0000","last_change":"2024-09-13T06:33:06.634982+0000","last_active":"2024-09-13T06:33:06.634982+0000","last_peered":"2024-09-13T06:33:06.634982+0000","last_clean":"2024-09-13T06:33:06.634982+0000","last_became_active":"2024-09-13T06:29:08.765457+0000","last_became_peered":"2024-09-13T06:29:08.765457+0000","last_unstale":"2024-09-13T06:33:06.634982+0000","last_undegraded":"2024-09-13T06:33:06.634982+0000","last_fullsized":"2024-09-13T06:33:06.634982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:06.634723+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:06.634723+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.634723+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:25.705695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.013201+0000","last_change":"2024-09-13T06:33:22.013201+0000","last_active":"2024-09-13T06:33:22.013201+0000","last_peered":"2024-09-13T06:33:22.013201+0000","last_clean":"2024-09-13T06:33:22.013201+0000","last_became_active":"2024-09-13T06:29:00.716867+0000","last_became_peered":"2024-09-13T06:29:00.716867+0000","last_unstale":"2024-09-13T06:33:22.013201+0000","last_undegraded":"2024-09-13T06:33:22.013201+0000","last_fullsized":"2024-09-13T06:33:22.013201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:22.012950+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:22.012950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.012950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:56.118377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:43.073363+0000","last_change":"2024-09-13T06:33:43.073457+0000","last_active":"2024-09-13T06:33:43.073363+0000","last_peered":"2024-09-13T06:33:43.073363+0000","last_clean":"2024-09-13T06:33:43.073363+0000","last_became_active":"2024-09-13T06:28:58.733248+0000","last_became_peered":"2024-09-13T06:28:58.733248+0000","last_unstale":"2024-09-13T06:33:43.073363+0000","last_undegraded":"2024-09-13T06:33:43.073363+0000","last_fullsized":"2024-09-13T06:33:43.073363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:43.073151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:43.073151+0000","last_clean_scrub_stamp":"2024-09-13T06:33:43.073151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:08.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.061702+0000","last_change":"2024-09-13T06:33:21.061702+0000","last_active":"2024-09-13T06:33:21.061702+0000","last_peered":"2024-09-13T06:33:21.061702+0000","last_clean":"2024-09-13T06:33:21.061702+0000","last_became_active":"2024-09-13T06:29:02.721834+0000","last_became_peered":"2024-09-13T06:29:02.721834+0000","last_unstale":"2024-09-13T06:33:21.061702+0000","last_undegraded":"2024-09-13T06:33:21.061702+0000","last_fullsized":"2024-09-13T06:33:21.061702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:21.061418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:21.061418+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.061418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:06.847057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.700748+0000","last_change":"2024-09-13T06:32:52.700748+0000","last_active":"2024-09-13T06:32:52.700748+0000","last_peered":"2024-09-13T06:32:52.700748+0000","last_clean":"2024-09-13T06:32:52.700748+0000","last_became_active":"2024-09-13T06:29:04.731331+0000","last_became_peered":"2024-09-13T06:29:04.731331+0000","last_unstale":"2024-09-13T06:32:52.700748+0000","last_undegraded":"2024-09-13T06:32:52.700748+0000","last_fullsized":"2024-09-13T06:32:52.700748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:32:52.700351+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.700351+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.206602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":366,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.207721+0000","last_change":"2024-09-13T06:32:52.207721+0000","last_active":"2024-09-13T06:32:52.207721+0000","last_peered":"2024-09-13T06:32:52.207721+0000","last_clean":"2024-09-13T06:32:52.207721+0000","last_became_active":"2024-09-13T06:29:06.771847+0000","last_became_peered":"2024-09-13T06:29:06.771847+0000","last_unstale":"2024-09-13T06:32:52.207721+0000","last_undegraded":"2024-09-13T06:32:52.207721+0000","last_fullsized":"2024-09-13T06:32:52.207721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:52.207476+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.207476+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:15:03.889652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.619884+0000","last_change":"2024-09-13T06:33:14.619884+0000","last_active":"2024-09-13T06:33:14.619884+0000","last_peered":"2024-09-13T06:33:14.619884+0000","last_clean":"2024-09-13T06:33:14.619884+0000","last_became_active":"2024-09-13T06:29:08.777153+0000","last_became_peered":"2024-09-13T06:29:08.777153+0000","last_unstale":"2024-09-13T06:33:14.619884+0000","last_undegraded":"2024-09-13T06:33:14.619884+0000","last_fullsized":"2024-09-13T06:33:14.619884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.619652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.619652+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.619652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:27.736918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"35'12","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.135567+0000","last_change":"2024-09-13T06:33:13.135567+0000","last_active":"2024-09-13T06:33:13.135567+0000","last_peered":"2024-09-13T06:33:13.135567+0000","last_clean":"2024-09-13T06:33:13.135567+0000","last_became_active":"2024-09-13T06:29:00.718363+0000","last_became_peered":"2024-09-13T06:29:00.718363+0000","last_unstale":"2024-09-13T06:33:13.135567+0000","last_undegraded":"2024-09-13T06:33:13.135567+0000","last_fullsized":"2024-09-13T06:33:13.135567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:13.135326+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:13.135326+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.135326+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'4","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:04.015273+0000","last_change":"2024-09-13T06:34:04.015404+0000","last_active":"2024-09-13T06:34:04.015273+0000","last_peered":"2024-09-13T06:34:04.015273+0000","last_clean":"2024-09-13T06:34:04.015273+0000","last_became_active":"2024-09-13T06:30:39.578313+0000","last_became_peered":"2024-09-13T06:30:39.578313+0000","last_unstale":"2024-09-13T06:34:04.015273+0000","last_undegraded":"2024-09-13T06:34:04.015273+0000","last_fullsized":"2024-09-13T06:34:04.015273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:34:04.015020+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:34:04.015020+0000","last_clean_scrub_stamp":"2024-09-13T06:34:04.015020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:28.441677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.223643+0000","last_change":"2024-09-13T06:33:04.223643+0000","last_active":"2024-09-13T06:33:04.223643+0000","last_peered":"2024-09-13T06:33:04.223643+0000","last_clean":"2024-09-13T06:33:04.223643+0000","last_became_active":"2024-09-13T06:29:02.740140+0000","last_became_peered":"2024-09-13T06:29:02.740140+0000","last_unstale":"2024-09-13T06:33:04.223643+0000","last_undegraded":"2024-09-13T06:33:04.223643+0000","last_fullsized":"2024-09-13T06:33:04.223643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:04.223407+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.223407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:38.136551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'64","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.859700+0000","last_change":"2024-09-13T06:32:54.859700+0000","last_active":"2024-09-13T06:32:54.859700+0000","last_peered":"2024-09-13T06:32:54.859700+0000","last_clean":"2024-09-13T06:32:54.859700+0000","last_became_active":"2024-09-13T06:29:04.745704+0000","last_became_peered":"2024-09-13T06:29:04.745704+0000","last_unstale":"2024-09-13T06:32:54.859700+0000","last_undegraded":"2024-09-13T06:32:54.859700+0000","last_fullsized":"2024-09-13T06:32:54.859700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'64","last_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_deep_scrub":"35'64","last_deep_scrub_stamp":"2024-09-13T06:32:54.859285+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.859285+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:01.758392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.285702+0000","last_change":"2024-09-13T06:32:59.285702+0000","last_active":"2024-09-13T06:32:59.285702+0000","last_peered":"2024-09-13T06:32:59.285702+0000","last_clean":"2024-09-13T06:32:59.285702+0000","last_became_active":"2024-09-13T06:29:06.760811+0000","last_became_peered":"2024-09-13T06:29:06.760811+0000","last_unstale":"2024-09-13T06:32:59.285702+0000","last_undegraded":"2024-09-13T06:32:59.285702+0000","last_fullsized":"2024-09-13T06:32:59.285702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.285313+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.285313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:24.231597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:51.893760+0000","last_change":"2024-09-13T06:33:51.893837+0000","last_active":"2024-09-13T06:33:51.893760+0000","last_peered":"2024-09-13T06:33:51.893760+0000","last_clean":"2024-09-13T06:33:51.893760+0000","last_became_active":"2024-09-13T06:29:08.786310+0000","last_became_peered":"2024-09-13T06:29:08.786310+0000","last_unstale":"2024-09-13T06:33:51.893760+0000","last_undegraded":"2024-09-13T06:33:51.893760+0000","last_fullsized":"2024-09-13T06:33:51.893760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:33:51.893570+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:33:51.893570+0000","last_clean_scrub_stamp":"2024-09-13T06:33:51.893570+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:41.724604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.739584+0000","last_change":"2024-09-13T06:33:21.739584+0000","last_active":"2024-09-13T06:33:21.739584+0000","last_peered":"2024-09-13T06:33:21.739584+0000","last_clean":"2024-09-13T06:33:21.739584+0000","last_became_active":"2024-09-13T06:29:00.726630+0000","last_became_peered":"2024-09-13T06:29:00.726630+0000","last_unstale":"2024-09-13T06:33:21.739584+0000","last_undegraded":"2024-09-13T06:33:21.739584+0000","last_fullsized":"2024-09-13T06:33:21.739584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:21.739350+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:21.739350+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.739350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.637065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:44.722265+0000","last_change":"2024-09-13T06:33:44.722324+0000","last_active":"2024-09-13T06:33:44.722265+0000","last_peered":"2024-09-13T06:33:44.722265+0000","last_clean":"2024-09-13T06:33:44.722265+0000","last_became_active":"2024-09-13T06:28:58.717727+0000","last_became_peered":"2024-09-13T06:28:58.717727+0000","last_unstale":"2024-09-13T06:33:44.722265+0000","last_undegraded":"2024-09-13T06:33:44.722265+0000","last_fullsized":"2024-09-13T06:33:44.722265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:44.722066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:44.722066+0000","last_clean_scrub_stamp":"2024-09-13T06:33:44.722066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:50.015211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.082652+0000","last_change":"2024-09-13T06:33:17.082652+0000","last_active":"2024-09-13T06:33:17.082652+0000","last_peered":"2024-09-13T06:33:17.082652+0000","last_clean":"2024-09-13T06:33:17.082652+0000","last_became_active":"2024-09-13T06:29:02.712517+0000","last_became_peered":"2024-09-13T06:29:02.712517+0000","last_unstale":"2024-09-13T06:33:17.082652+0000","last_undegraded":"2024-09-13T06:33:17.082652+0000","last_fullsized":"2024-09-13T06:33:17.082652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:17.082403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:17.082403+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.082403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:38:22.197973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:48.766296+0000","last_change":"2024-09-13T06:32:48.766296+0000","last_active":"2024-09-13T06:32:48.766296+0000","last_peered":"2024-09-13T06:32:48.766296+0000","last_clean":"2024-09-13T06:32:48.766296+0000","last_became_active":"2024-09-13T06:29:04.730246+0000","last_became_peered":"2024-09-13T06:29:04.730246+0000","last_unstale":"2024-09-13T06:32:48.766296+0000","last_undegraded":"2024-09-13T06:32:48.766296+0000","last_fullsized":"2024-09-13T06:32:48.766296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:48.766165+0000","last_clean_scrub_stamp":"2024-09-13T06:32:48.766165+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:25.779327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.914294+0000","last_change":"2024-09-13T06:33:05.914294+0000","last_active":"2024-09-13T06:33:05.914294+0000","last_peered":"2024-09-13T06:33:05.914294+0000","last_clean":"2024-09-13T06:33:05.914294+0000","last_became_active":"2024-09-13T06:29:06.768502+0000","last_became_peered":"2024-09-13T06:29:06.768502+0000","last_unstale":"2024-09-13T06:33:05.914294+0000","last_undegraded":"2024-09-13T06:33:05.914294+0000","last_fullsized":"2024-09-13T06:33:05.914294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:05.914013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:05.914013+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.914013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.141026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.922077+0000","last_change":"2024-09-13T06:33:29.922140+0000","last_active":"2024-09-13T06:33:29.922077+0000","last_peered":"2024-09-13T06:33:29.922077+0000","last_clean":"2024-09-13T06:33:29.922077+0000","last_became_active":"2024-09-13T06:29:08.784502+0000","last_became_peered":"2024-09-13T06:29:08.784502+0000","last_unstale":"2024-09-13T06:33:29.922077+0000","last_undegraded":"2024-09-13T06:33:29.922077+0000","last_fullsized":"2024-09-13T06:33:29.922077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:29.921858+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:29.921858+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.921858+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:48.275561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'4","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.116652+0000","last_change":"2024-09-13T06:33:32.116652+0000","last_active":"2024-09-13T06:33:32.116652+0000","last_peered":"2024-09-13T06:33:32.116652+0000","last_clean":"2024-09-13T06:33:32.116652+0000","last_became_active":"2024-09-13T06:29:00.712821+0000","last_became_peered":"2024-09-13T06:29:00.712821+0000","last_unstale":"2024-09-13T06:33:32.116652+0000","last_undegraded":"2024-09-13T06:33:32.116652+0000","last_fullsized":"2024-09-13T06:33:32.116652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:32.116397+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:32.116397+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.116397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:46.941512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.162920+0000","last_change":"2024-09-13T06:33:35.162971+0000","last_active":"2024-09-13T06:33:35.162920+0000","last_peered":"2024-09-13T06:33:35.162920+0000","last_clean":"2024-09-13T06:33:35.162920+0000","last_became_active":"2024-09-13T06:28:58.714016+0000","last_became_peered":"2024-09-13T06:28:58.714016+0000","last_unstale":"2024-09-13T06:33:35.162920+0000","last_undegraded":"2024-09-13T06:33:35.162920+0000","last_fullsized":"2024-09-13T06:33:35.162920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:35.162724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:35.162724+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.162724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:56:50.432197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.582513+0000","last_change":"2024-09-13T06:33:08.582513+0000","last_active":"2024-09-13T06:33:08.582513+0000","last_peered":"2024-09-13T06:33:08.582513+0000","last_clean":"2024-09-13T06:33:08.582513+0000","last_became_active":"2024-09-13T06:29:02.726942+0000","last_became_peered":"2024-09-13T06:29:02.726942+0000","last_unstale":"2024-09-13T06:33:08.582513+0000","last_undegraded":"2024-09-13T06:33:08.582513+0000","last_fullsized":"2024-09-13T06:33:08.582513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:08.582269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:08.582269+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.582269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:12.495423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'45","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.303475+0000","last_change":"2024-09-13T06:33:00.303475+0000","last_active":"2024-09-13T06:33:00.303475+0000","last_peered":"2024-09-13T06:33:00.303475+0000","last_clean":"2024-09-13T06:33:00.303475+0000","last_became_active":"2024-09-13T06:29:04.745414+0000","last_became_peered":"2024-09-13T06:29:04.745414+0000","last_unstale":"2024-09-13T06:33:00.303475+0000","last_undegraded":"2024-09-13T06:33:00.303475+0000","last_fullsized":"2024-09-13T06:33:00.303475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:00.303147+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.303147+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:58.846618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.270712+0000","last_change":"2024-09-13T06:32:58.270712+0000","last_active":"2024-09-13T06:32:58.270712+0000","last_peered":"2024-09-13T06:32:58.270712+0000","last_clean":"2024-09-13T06:32:58.270712+0000","last_became_active":"2024-09-13T06:29:06.761135+0000","last_became_peered":"2024-09-13T06:29:06.761135+0000","last_unstale":"2024-09-13T06:32:58.270712+0000","last_undegraded":"2024-09-13T06:32:58.270712+0000","last_fullsized":"2024-09-13T06:32:58.270712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.270455+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.270455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:12.264581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'15","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.561385+0000","last_change":"2024-09-13T06:33:10.561385+0000","last_active":"2024-09-13T06:33:10.561385+0000","last_peered":"2024-09-13T06:33:10.561385+0000","last_clean":"2024-09-13T06:33:10.561385+0000","last_became_active":"2024-09-13T06:29:08.767966+0000","last_became_peered":"2024-09-13T06:29:08.767966+0000","last_unstale":"2024-09-13T06:33:10.561385+0000","last_undegraded":"2024-09-13T06:33:10.561385+0000","last_fullsized":"2024-09-13T06:33:10.561385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:33:10.561099+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:33:10.561099+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.561099+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:30.846539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.087093+0000","last_change":"2024-09-13T06:33:12.087093+0000","last_active":"2024-09-13T06:33:12.087093+0000","last_peered":"2024-09-13T06:33:12.087093+0000","last_clean":"2024-09-13T06:33:12.087093+0000","last_became_active":"2024-09-13T06:29:00.703420+0000","last_became_peered":"2024-09-13T06:29:00.703420+0000","last_unstale":"2024-09-13T06:33:12.087093+0000","last_undegraded":"2024-09-13T06:33:12.087093+0000","last_fullsized":"2024-09-13T06:33:12.087093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:12.086827+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:12.086827+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.086827+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:09.434984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:40.810245+0000","last_change":"2024-09-13T06:33:40.810303+0000","last_active":"2024-09-13T06:33:40.810245+0000","last_peered":"2024-09-13T06:33:40.810245+0000","last_clean":"2024-09-13T06:33:40.810245+0000","last_became_active":"2024-09-13T06:28:58.719864+0000","last_became_peered":"2024-09-13T06:28:58.719864+0000","last_unstale":"2024-09-13T06:33:40.810245+0000","last_undegraded":"2024-09-13T06:33:40.810245+0000","last_fullsized":"2024-09-13T06:33:40.810245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:40.810050+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:40.810050+0000","last_clean_scrub_stamp":"2024-09-13T06:33:40.810050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:31.719902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":444,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:03.067948+0000","last_change":"2024-09-13T06:34:03.068020+0000","last_active":"2024-09-13T06:34:03.067948+0000","last_peered":"2024-09-13T06:34:03.067948+0000","last_clean":"2024-09-13T06:34:03.067948+0000","last_became_active":"2024-09-13T06:29:39.515485+0000","last_became_peered":"2024-09-13T06:29:39.515485+0000","last_unstale":"2024-09-13T06:34:03.067948+0000","last_undegraded":"2024-09-13T06:34:03.067948+0000","last_fullsized":"2024-09-13T06:34:03.067948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:34:03.067758+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:34:03.067758+0000","last_clean_scrub_stamp":"2024-09-13T06:34:03.067758+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:15.686890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.883556+0000","last_change":"2024-09-13T06:32:52.883556+0000","last_active":"2024-09-13T06:32:52.883556+0000","last_peered":"2024-09-13T06:32:52.883556+0000","last_clean":"2024-09-13T06:32:52.883556+0000","last_became_active":"2024-09-13T06:29:04.748405+0000","last_became_peered":"2024-09-13T06:29:04.748405+0000","last_unstale":"2024-09-13T06:32:52.883556+0000","last_undegraded":"2024-09-13T06:32:52.883556+0000","last_fullsized":"2024-09-13T06:32:52.883556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:32:52.883251+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.883251+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:35.305885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":483,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.772503+0000","last_change":"2024-09-13T06:33:00.772503+0000","last_active":"2024-09-13T06:33:00.772503+0000","last_peered":"2024-09-13T06:33:00.772503+0000","last_clean":"2024-09-13T06:33:00.772503+0000","last_became_active":"2024-09-13T06:29:06.750761+0000","last_became_peered":"2024-09-13T06:29:06.750761+0000","last_unstale":"2024-09-13T06:33:00.772503+0000","last_undegraded":"2024-09-13T06:33:00.772503+0000","last_fullsized":"2024-09-13T06:33:00.772503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:00.772062+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.772062+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:06.999075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:33.090208+0000","last_change":"2024-09-13T06:33:33.090269+0000","last_active":"2024-09-13T06:33:33.090208+0000","last_peered":"2024-09-13T06:33:33.090208+0000","last_clean":"2024-09-13T06:33:33.090208+0000","last_became_active":"2024-09-13T06:29:08.791986+0000","last_became_peered":"2024-09-13T06:29:08.791986+0000","last_unstale":"2024-09-13T06:33:33.090208+0000","last_undegraded":"2024-09-13T06:33:33.090208+0000","last_fullsized":"2024-09-13T06:33:33.090208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:33.090024+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:33.090024+0000","last_clean_scrub_stamp":"2024-09-13T06:33:33.090024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:42.079817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.640866+0000","last_change":"2024-09-13T06:33:16.640866+0000","last_active":"2024-09-13T06:33:16.640866+0000","last_peered":"2024-09-13T06:33:16.640866+0000","last_clean":"2024-09-13T06:33:16.640866+0000","last_became_active":"2024-09-13T06:29:00.727095+0000","last_became_peered":"2024-09-13T06:29:00.727095+0000","last_unstale":"2024-09-13T06:33:16.640866+0000","last_undegraded":"2024-09-13T06:33:16.640866+0000","last_fullsized":"2024-09-13T06:33:16.640866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:16.640589+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:16.640589+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.640589+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:17:00.531843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:46.662525+0000","last_change":"2024-09-13T06:33:46.662591+0000","last_active":"2024-09-13T06:33:46.662525+0000","last_peered":"2024-09-13T06:33:46.662525+0000","last_clean":"2024-09-13T06:33:46.662525+0000","last_became_active":"2024-09-13T06:28:58.717445+0000","last_became_peered":"2024-09-13T06:28:58.717445+0000","last_unstale":"2024-09-13T06:33:46.662525+0000","last_undegraded":"2024-09-13T06:33:46.662525+0000","last_fullsized":"2024-09-13T06:33:46.662525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:46.662329+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:46.662329+0000","last_clean_scrub_stamp":"2024-09-13T06:33:46.662329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:42.606357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.787639+0000","last_change":"2024-09-13T06:33:12.787639+0000","last_active":"2024-09-13T06:33:12.787639+0000","last_peered":"2024-09-13T06:33:12.787639+0000","last_clean":"2024-09-13T06:33:12.787639+0000","last_became_active":"2024-09-13T06:29:02.720914+0000","last_became_peered":"2024-09-13T06:29:02.720914+0000","last_unstale":"2024-09-13T06:33:12.787639+0000","last_undegraded":"2024-09-13T06:33:12.787639+0000","last_fullsized":"2024-09-13T06:33:12.787639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.787273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.787273+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.787273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:37:33.223408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.874009+0000","last_change":"2024-09-13T06:33:07.874009+0000","last_active":"2024-09-13T06:33:07.874009+0000","last_peered":"2024-09-13T06:33:07.874009+0000","last_clean":"2024-09-13T06:33:07.874009+0000","last_became_active":"2024-09-13T06:29:04.735949+0000","last_became_peered":"2024-09-13T06:29:04.735949+0000","last_unstale":"2024-09-13T06:33:07.874009+0000","last_undegraded":"2024-09-13T06:33:07.874009+0000","last_fullsized":"2024-09-13T06:33:07.874009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:33:07.873746+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.873746+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:28.536287+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.843311+0000","last_change":"2024-09-13T06:33:06.843311+0000","last_active":"2024-09-13T06:33:06.843311+0000","last_peered":"2024-09-13T06:33:06.843311+0000","last_clean":"2024-09-13T06:33:06.843311+0000","last_became_active":"2024-09-13T06:29:06.765019+0000","last_became_peered":"2024-09-13T06:29:06.765019+0000","last_unstale":"2024-09-13T06:33:06.843311+0000","last_undegraded":"2024-09-13T06:33:06.843311+0000","last_fullsized":"2024-09-13T06:33:06.843311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:06.843049+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.843049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:01.227917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.680373+0000","last_change":"2024-09-13T06:33:02.680373+0000","last_active":"2024-09-13T06:33:02.680373+0000","last_peered":"2024-09-13T06:33:02.680373+0000","last_clean":"2024-09-13T06:33:02.680373+0000","last_became_active":"2024-09-13T06:29:08.764444+0000","last_became_peered":"2024-09-13T06:29:08.764444+0000","last_unstale":"2024-09-13T06:33:02.680373+0000","last_undegraded":"2024-09-13T06:33:02.680373+0000","last_fullsized":"2024-09-13T06:33:02.680373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:33:02.680110+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.680110+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:47.873890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.996699+0000","last_change":"2024-09-13T06:33:19.996757+0000","last_active":"2024-09-13T06:33:19.996699+0000","last_peered":"2024-09-13T06:33:19.996699+0000","last_clean":"2024-09-13T06:33:19.996699+0000","last_became_active":"2024-09-13T06:29:00.722702+0000","last_became_peered":"2024-09-13T06:29:00.722702+0000","last_unstale":"2024-09-13T06:33:19.996699+0000","last_undegraded":"2024-09-13T06:33:19.996699+0000","last_fullsized":"2024-09-13T06:33:19.996699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:19.996506+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:19.996506+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.996506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:32.959583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":217,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:40.749350+0000","last_change":"2024-09-13T06:33:40.749499+0000","last_active":"2024-09-13T06:33:40.749350+0000","last_peered":"2024-09-13T06:33:40.749350+0000","last_clean":"2024-09-13T06:33:40.749350+0000","last_became_active":"2024-09-13T06:28:48.278651+0000","last_became_peered":"2024-09-13T06:28:48.278651+0000","last_unstale":"2024-09-13T06:33:40.749350+0000","last_undegraded":"2024-09-13T06:33:40.749350+0000","last_fullsized":"2024-09-13T06:33:40.749350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-13T06:33:40.749128+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-13T06:33:40.749128+0000","last_clean_scrub_stamp":"2024-09-13T06:33:40.749128+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:05.460741+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:50.002002+0000","last_change":"2024-09-13T06:33:50.002065+0000","last_active":"2024-09-13T06:33:50.002002+0000","last_peered":"2024-09-13T06:33:50.002002+0000","last_clean":"2024-09-13T06:33:50.002002+0000","last_became_active":"2024-09-13T06:28:50.948100+0000","last_became_peered":"2024-09-13T06:28:50.948100+0000","last_unstale":"2024-09-13T06:33:50.002002+0000","last_undegraded":"2024-09-13T06:33:50.002002+0000","last_fullsized":"2024-09-13T06:33:50.002002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:50.001828+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:50.001828+0000","last_clean_scrub_stamp":"2024-09-13T06:33:50.001828+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:05:00.919656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002536104,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:52.763606+0000","last_change":"2024-09-13T06:33:52.763667+0000","last_active":"2024-09-13T06:33:52.763606+0000","last_peered":"2024-09-13T06:33:52.763606+0000","last_clean":"2024-09-13T06:33:52.763606+0000","last_became_active":"2024-09-13T06:28:58.710743+0000","last_became_peered":"2024-09-13T06:28:58.710743+0000","last_unstale":"2024-09-13T06:33:52.763606+0000","last_undegraded":"2024-09-13T06:33:52.763606+0000","last_fullsized":"2024-09-13T06:33:52.763606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:52.763413+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:52.763413+0000","last_clean_scrub_stamp":"2024-09-13T06:33:52.763413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:45.235316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:12.600470+0000","last_change":"2024-09-13T06:33:12.600470+0000","last_active":"2024-09-13T06:33:12.600470+0000","last_peered":"2024-09-13T06:33:12.600470+0000","last_clean":"2024-09-13T06:33:12.600470+0000","last_became_active":"2024-09-13T06:29:02.723301+0000","last_became_peered":"2024-09-13T06:29:02.723301+0000","last_unstale":"2024-09-13T06:33:12.600470+0000","last_undegraded":"2024-09-13T06:33:12.600470+0000","last_fullsized":"2024-09-13T06:33:12.600470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:12.600063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:12.600063+0000","last_clean_scrub_stamp":"2024-09-13T06:33:12.600063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:35.516149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'87","reported_seq":182,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.822144+0000","last_change":"2024-09-13T06:33:04.822144+0000","last_active":"2024-09-13T06:33:04.822144+0000","last_peered":"2024-09-13T06:33:04.822144+0000","last_clean":"2024-09-13T06:33:04.822144+0000","last_became_active":"2024-09-13T06:29:04.750026+0000","last_became_peered":"2024-09-13T06:29:04.750026+0000","last_unstale":"2024-09-13T06:33:04.822144+0000","last_undegraded":"2024-09-13T06:33:04.822144+0000","last_fullsized":"2024-09-13T06:33:04.822144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'87","last_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_deep_scrub":"35'87","last_deep_scrub_stamp":"2024-09-13T06:33:04.821761+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.821761+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:28.535913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.856678+0000","last_change":"2024-09-13T06:33:17.856678+0000","last_active":"2024-09-13T06:33:17.856678+0000","last_peered":"2024-09-13T06:33:17.856678+0000","last_clean":"2024-09-13T06:33:17.856678+0000","last_became_active":"2024-09-13T06:29:06.773307+0000","last_became_peered":"2024-09-13T06:29:06.773307+0000","last_unstale":"2024-09-13T06:33:17.856678+0000","last_undegraded":"2024-09-13T06:33:17.856678+0000","last_fullsized":"2024-09-13T06:33:17.856678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:17.856435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:17.856435+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.856435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:06.689390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.252336+0000","last_change":"2024-09-13T06:33:05.252336+0000","last_active":"2024-09-13T06:33:05.252336+0000","last_peered":"2024-09-13T06:33:05.252336+0000","last_clean":"2024-09-13T06:33:05.252336+0000","last_became_active":"2024-09-13T06:29:08.790354+0000","last_became_peered":"2024-09-13T06:29:08.790354+0000","last_unstale":"2024-09-13T06:33:05.252336+0000","last_undegraded":"2024-09-13T06:33:05.252336+0000","last_fullsized":"2024-09-13T06:33:05.252336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:33:05.252089+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.252089+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:32.271264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.883826+0000","last_change":"2024-09-13T06:33:19.883826+0000","last_active":"2024-09-13T06:33:19.883826+0000","last_peered":"2024-09-13T06:33:19.883826+0000","last_clean":"2024-09-13T06:33:19.883826+0000","last_became_active":"2024-09-13T06:29:00.723791+0000","last_became_peered":"2024-09-13T06:29:00.723791+0000","last_unstale":"2024-09-13T06:33:19.883826+0000","last_undegraded":"2024-09-13T06:33:19.883826+0000","last_fullsized":"2024-09-13T06:33:19.883826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:19.883447+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:19.883447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.883447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:21.935843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:53.020484+0000","last_change":"2024-09-13T06:33:53.020543+0000","last_active":"2024-09-13T06:33:53.020484+0000","last_peered":"2024-09-13T06:33:53.020484+0000","last_clean":"2024-09-13T06:33:53.020484+0000","last_became_active":"2024-09-13T06:28:50.951474+0000","last_became_peered":"2024-09-13T06:28:50.951474+0000","last_unstale":"2024-09-13T06:33:53.020484+0000","last_undegraded":"2024-09-13T06:33:53.020484+0000","last_fullsized":"2024-09-13T06:33:53.020484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:53.020260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:53.020260+0000","last_clean_scrub_stamp":"2024-09-13T06:33:53.020260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:29.171662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088540000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:46.798598+0000","last_change":"2024-09-13T06:33:46.798712+0000","last_active":"2024-09-13T06:33:46.798598+0000","last_peered":"2024-09-13T06:33:46.798598+0000","last_clean":"2024-09-13T06:33:46.798598+0000","last_became_active":"2024-09-13T06:28:58.711016+0000","last_became_peered":"2024-09-13T06:28:58.711016+0000","last_unstale":"2024-09-13T06:33:46.798598+0000","last_undegraded":"2024-09-13T06:33:46.798598+0000","last_fullsized":"2024-09-13T06:33:46.798598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:46.798341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:46.798341+0000","last_clean_scrub_stamp":"2024-09-13T06:33:46.798341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:57.880169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.659844+0000","last_change":"2024-09-13T06:32:53.659844+0000","last_active":"2024-09-13T06:32:53.659844+0000","last_peered":"2024-09-13T06:32:53.659844+0000","last_clean":"2024-09-13T06:32:53.659844+0000","last_became_active":"2024-09-13T06:29:02.738613+0000","last_became_peered":"2024-09-13T06:29:02.738613+0000","last_unstale":"2024-09-13T06:32:53.659844+0000","last_undegraded":"2024-09-13T06:32:53.659844+0000","last_fullsized":"2024-09-13T06:32:53.659844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.659599+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.659599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:12.730571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":521,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.680200+0000","last_change":"2024-09-13T06:33:01.680200+0000","last_active":"2024-09-13T06:33:01.680200+0000","last_peered":"2024-09-13T06:33:01.680200+0000","last_clean":"2024-09-13T06:33:01.680200+0000","last_became_active":"2024-09-13T06:29:04.739795+0000","last_became_peered":"2024-09-13T06:29:04.739795+0000","last_unstale":"2024-09-13T06:33:01.680200+0000","last_undegraded":"2024-09-13T06:33:01.680200+0000","last_fullsized":"2024-09-13T06:33:01.680200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-09-13T06:33:01.679952+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.679952+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:20.338166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.834458+0000","last_change":"2024-09-13T06:32:59.834458+0000","last_active":"2024-09-13T06:32:59.834458+0000","last_peered":"2024-09-13T06:32:59.834458+0000","last_clean":"2024-09-13T06:32:59.834458+0000","last_became_active":"2024-09-13T06:29:06.767614+0000","last_became_peered":"2024-09-13T06:29:06.767614+0000","last_unstale":"2024-09-13T06:32:59.834458+0000","last_undegraded":"2024-09-13T06:32:59.834458+0000","last_fullsized":"2024-09-13T06:32:59.834458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.834212+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.834212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:30.694348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.688785+0000","last_change":"2024-09-13T06:33:18.688785+0000","last_active":"2024-09-13T06:33:18.688785+0000","last_peered":"2024-09-13T06:33:18.688785+0000","last_clean":"2024-09-13T06:33:18.688785+0000","last_became_active":"2024-09-13T06:29:08.785112+0000","last_became_peered":"2024-09-13T06:29:08.785112+0000","last_unstale":"2024-09-13T06:33:18.688785+0000","last_undegraded":"2024-09-13T06:33:18.688785+0000","last_fullsized":"2024-09-13T06:33:18.688785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:33:18.688519+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:33:18.688519+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.688519+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:20.053682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'12","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.806444+0000","last_change":"2024-09-13T06:33:23.806507+0000","last_active":"2024-09-13T06:33:23.806444+0000","last_peered":"2024-09-13T06:33:23.806444+0000","last_clean":"2024-09-13T06:33:23.806444+0000","last_became_active":"2024-09-13T06:29:00.726451+0000","last_became_peered":"2024-09-13T06:29:00.726451+0000","last_unstale":"2024-09-13T06:33:23.806444+0000","last_undegraded":"2024-09-13T06:33:23.806444+0000","last_fullsized":"2024-09-13T06:33:23.806444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:23.806244+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:23.806244+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.806244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:32.624319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.025941+0000","last_change":"2024-09-13T06:33:23.025994+0000","last_active":"2024-09-13T06:33:23.025941+0000","last_peered":"2024-09-13T06:33:23.025941+0000","last_clean":"2024-09-13T06:33:23.025941+0000","last_became_active":"2024-09-13T06:28:51.371903+0000","last_became_peered":"2024-09-13T06:28:51.371903+0000","last_unstale":"2024-09-13T06:33:23.025941+0000","last_undegraded":"2024-09-13T06:33:23.025941+0000","last_fullsized":"2024-09-13T06:33:23.025941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:23.025749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:23.025749+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.025749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:38:38.648553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00076182400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:45.840806+0000","last_change":"2024-09-13T06:33:45.840864+0000","last_active":"2024-09-13T06:33:45.840806+0000","last_peered":"2024-09-13T06:33:45.840806+0000","last_clean":"2024-09-13T06:33:45.840806+0000","last_became_active":"2024-09-13T06:28:58.710281+0000","last_became_peered":"2024-09-13T06:28:58.710281+0000","last_unstale":"2024-09-13T06:33:45.840806+0000","last_undegraded":"2024-09-13T06:33:45.840806+0000","last_fullsized":"2024-09-13T06:33:45.840806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:45.840584+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:45.840584+0000","last_clean_scrub_stamp":"2024-09-13T06:33:45.840584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:51.437297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.076554+0000","last_change":"2024-09-13T06:33:19.076554+0000","last_active":"2024-09-13T06:33:19.076554+0000","last_peered":"2024-09-13T06:33:19.076554+0000","last_clean":"2024-09-13T06:33:19.076554+0000","last_became_active":"2024-09-13T06:29:02.715289+0000","last_became_peered":"2024-09-13T06:29:02.715289+0000","last_unstale":"2024-09-13T06:33:19.076554+0000","last_undegraded":"2024-09-13T06:33:19.076554+0000","last_fullsized":"2024-09-13T06:33:19.076554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:19.076294+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:19.076294+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.076294+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:30.638206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.784194+0000","last_change":"2024-09-13T06:32:49.784194+0000","last_active":"2024-09-13T06:32:49.784194+0000","last_peered":"2024-09-13T06:32:49.784194+0000","last_clean":"2024-09-13T06:32:49.784194+0000","last_became_active":"2024-09-13T06:29:04.729837+0000","last_became_peered":"2024-09-13T06:29:04.729837+0000","last_unstale":"2024-09-13T06:32:49.784194+0000","last_undegraded":"2024-09-13T06:32:49.784194+0000","last_fullsized":"2024-09-13T06:32:49.784194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:32:49.784073+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.784073+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:56.683180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:52.634660+0000","last_change":"2024-09-13T06:32:52.634660+0000","last_active":"2024-09-13T06:32:52.634660+0000","last_peered":"2024-09-13T06:32:52.634660+0000","last_clean":"2024-09-13T06:32:52.634660+0000","last_became_active":"2024-09-13T06:29:06.765448+0000","last_became_peered":"2024-09-13T06:29:06.765448+0000","last_unstale":"2024-09-13T06:32:52.634660+0000","last_undegraded":"2024-09-13T06:32:52.634660+0000","last_fullsized":"2024-09-13T06:32:52.634660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:52.634413+0000","last_clean_scrub_stamp":"2024-09-13T06:32:52.634413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:42.199135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:58.788312+0000","last_change":"2024-09-13T06:33:58.788371+0000","last_active":"2024-09-13T06:33:58.788312+0000","last_peered":"2024-09-13T06:33:58.788312+0000","last_clean":"2024-09-13T06:33:58.788312+0000","last_became_active":"2024-09-13T06:29:08.787920+0000","last_became_peered":"2024-09-13T06:29:08.787920+0000","last_unstale":"2024-09-13T06:33:58.788312+0000","last_undegraded":"2024-09-13T06:33:58.788312+0000","last_fullsized":"2024-09-13T06:33:58.788312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:58.788124+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:58.788124+0000","last_clean_scrub_stamp":"2024-09-13T06:33:58.788124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:34.939526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'4","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.789715+0000","last_change":"2024-09-13T06:33:28.789779+0000","last_active":"2024-09-13T06:33:28.789715+0000","last_peered":"2024-09-13T06:33:28.789715+0000","last_clean":"2024-09-13T06:33:28.789715+0000","last_became_active":"2024-09-13T06:29:00.721420+0000","last_became_peered":"2024-09-13T06:29:00.721420+0000","last_unstale":"2024-09-13T06:33:28.789715+0000","last_undegraded":"2024-09-13T06:33:28.789715+0000","last_fullsized":"2024-09-13T06:33:28.789715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:28.789499+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:28.789499+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.789499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:44.042017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:51.005774+0000","last_change":"2024-09-13T06:33:51.005839+0000","last_active":"2024-09-13T06:33:51.005774+0000","last_peered":"2024-09-13T06:33:51.005774+0000","last_clean":"2024-09-13T06:33:51.005774+0000","last_became_active":"2024-09-13T06:28:50.949031+0000","last_became_peered":"2024-09-13T06:28:50.949031+0000","last_unstale":"2024-09-13T06:33:51.005774+0000","last_undegraded":"2024-09-13T06:33:51.005774+0000","last_fullsized":"2024-09-13T06:33:51.005774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:51.005579+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:51.005579+0000","last_clean_scrub_stamp":"2024-09-13T06:33:51.005579+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:58:02.813124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0019067489999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:42.102307+0000","last_change":"2024-09-13T06:33:42.102405+0000","last_active":"2024-09-13T06:33:42.102307+0000","last_peered":"2024-09-13T06:33:42.102307+0000","last_clean":"2024-09-13T06:33:42.102307+0000","last_became_active":"2024-09-13T06:28:58.713766+0000","last_became_peered":"2024-09-13T06:28:58.713766+0000","last_unstale":"2024-09-13T06:33:42.102307+0000","last_undegraded":"2024-09-13T06:33:42.102307+0000","last_fullsized":"2024-09-13T06:33:42.102307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:42.102068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:42.102068+0000","last_clean_scrub_stamp":"2024-09-13T06:33:42.102068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:39.673463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.568967+0000","last_change":"2024-09-13T06:33:11.568967+0000","last_active":"2024-09-13T06:33:11.568967+0000","last_peered":"2024-09-13T06:33:11.568967+0000","last_clean":"2024-09-13T06:33:11.568967+0000","last_became_active":"2024-09-13T06:29:02.724097+0000","last_became_peered":"2024-09-13T06:29:02.724097+0000","last_unstale":"2024-09-13T06:33:11.568967+0000","last_undegraded":"2024-09-13T06:33:11.568967+0000","last_fullsized":"2024-09-13T06:33:11.568967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:11.568707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:11.568707+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.568707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:51.583587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.926512+0000","last_change":"2024-09-13T06:33:08.926512+0000","last_active":"2024-09-13T06:33:08.926512+0000","last_peered":"2024-09-13T06:33:08.926512+0000","last_clean":"2024-09-13T06:33:08.926512+0000","last_became_active":"2024-09-13T06:29:04.752376+0000","last_became_peered":"2024-09-13T06:29:04.752376+0000","last_unstale":"2024-09-13T06:33:08.926512+0000","last_undegraded":"2024-09-13T06:33:08.926512+0000","last_fullsized":"2024-09-13T06:33:08.926512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:33:08.926230+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:33:08.926230+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.926230+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:59.065492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.902142+0000","last_change":"2024-09-13T06:33:21.902142+0000","last_active":"2024-09-13T06:33:21.902142+0000","last_peered":"2024-09-13T06:33:21.902142+0000","last_clean":"2024-09-13T06:33:21.902142+0000","last_became_active":"2024-09-13T06:29:06.774614+0000","last_became_peered":"2024-09-13T06:29:06.774614+0000","last_unstale":"2024-09-13T06:33:21.902142+0000","last_undegraded":"2024-09-13T06:33:21.902142+0000","last_fullsized":"2024-09-13T06:33:21.902142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:21.901902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:21.901902+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.901902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:37.154420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'10","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:52.908408+0000","last_change":"2024-09-13T06:33:52.908469+0000","last_active":"2024-09-13T06:33:52.908408+0000","last_peered":"2024-09-13T06:33:52.908408+0000","last_clean":"2024-09-13T06:33:52.908408+0000","last_became_active":"2024-09-13T06:29:08.790662+0000","last_became_peered":"2024-09-13T06:29:08.790662+0000","last_unstale":"2024-09-13T06:33:52.908408+0000","last_undegraded":"2024-09-13T06:33:52.908408+0000","last_fullsized":"2024-09-13T06:33:52.908408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:52.908192+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:52.908192+0000","last_clean_scrub_stamp":"2024-09-13T06:33:52.908192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:08.389320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'10","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:19.656394+0000","last_change":"2024-09-13T06:33:19.656461+0000","last_active":"2024-09-13T06:33:19.656394+0000","last_peered":"2024-09-13T06:33:19.656394+0000","last_clean":"2024-09-13T06:33:19.656394+0000","last_became_active":"2024-09-13T06:29:00.729056+0000","last_became_peered":"2024-09-13T06:29:00.729056+0000","last_unstale":"2024-09-13T06:33:19.656394+0000","last_undegraded":"2024-09-13T06:33:19.656394+0000","last_fullsized":"2024-09-13T06:33:19.656394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:19.656196+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:19.656196+0000","last_clean_scrub_stamp":"2024-09-13T06:33:19.656196+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:18.571062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:39.126658+0000","last_change":"2024-09-13T06:33:39.126710+0000","last_active":"2024-09-13T06:33:39.126658+0000","last_peered":"2024-09-13T06:33:39.126658+0000","last_clean":"2024-09-13T06:33:39.126658+0000","last_became_active":"2024-09-13T06:28:58.733219+0000","last_became_peered":"2024-09-13T06:28:58.733219+0000","last_unstale":"2024-09-13T06:33:39.126658+0000","last_undegraded":"2024-09-13T06:33:39.126658+0000","last_fullsized":"2024-09-13T06:33:39.126658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:39.126463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:39.126463+0000","last_clean_scrub_stamp":"2024-09-13T06:33:39.126463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:01:58.312795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:42.817285+0000","last_change":"2024-09-13T06:33:42.817343+0000","last_active":"2024-09-13T06:33:42.817285+0000","last_peered":"2024-09-13T06:33:42.817285+0000","last_clean":"2024-09-13T06:33:42.817285+0000","last_became_active":"2024-09-13T06:28:51.371655+0000","last_became_peered":"2024-09-13T06:28:51.371655+0000","last_unstale":"2024-09-13T06:33:42.817285+0000","last_undegraded":"2024-09-13T06:33:42.817285+0000","last_fullsized":"2024-09-13T06:33:42.817285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:42.817080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:42.817080+0000","last_clean_scrub_stamp":"2024-09-13T06:33:42.817080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:10.531170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000884756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.252073+0000","last_change":"2024-09-13T06:33:06.252073+0000","last_active":"2024-09-13T06:33:06.252073+0000","last_peered":"2024-09-13T06:33:06.252073+0000","last_clean":"2024-09-13T06:33:06.252073+0000","last_became_active":"2024-09-13T06:29:02.740124+0000","last_became_peered":"2024-09-13T06:29:02.740124+0000","last_unstale":"2024-09-13T06:33:06.252073+0000","last_undegraded":"2024-09-13T06:33:06.252073+0000","last_fullsized":"2024-09-13T06:33:06.252073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:06.251809+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:06.251809+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.251809+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:29.249309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.618221+0000","last_change":"2024-09-13T06:32:57.618221+0000","last_active":"2024-09-13T06:32:57.618221+0000","last_peered":"2024-09-13T06:32:57.618221+0000","last_clean":"2024-09-13T06:32:57.618221+0000","last_became_active":"2024-09-13T06:29:04.746305+0000","last_became_peered":"2024-09-13T06:29:04.746305+0000","last_unstale":"2024-09-13T06:32:57.618221+0000","last_undegraded":"2024-09-13T06:32:57.618221+0000","last_fullsized":"2024-09-13T06:32:57.618221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:32:57.617910+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.617910+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:37.547222+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.822112+0000","last_change":"2024-09-13T06:33:02.822112+0000","last_active":"2024-09-13T06:33:02.822112+0000","last_peered":"2024-09-13T06:33:02.822112+0000","last_clean":"2024-09-13T06:33:02.822112+0000","last_became_active":"2024-09-13T06:29:06.755712+0000","last_became_peered":"2024-09-13T06:29:06.755712+0000","last_unstale":"2024-09-13T06:33:02.822112+0000","last_undegraded":"2024-09-13T06:33:02.822112+0000","last_fullsized":"2024-09-13T06:33:02.822112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:02.821863+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.821863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:01.519357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.307014+0000","last_change":"2024-09-13T06:32:57.307014+0000","last_active":"2024-09-13T06:32:57.307014+0000","last_peered":"2024-09-13T06:32:57.307014+0000","last_clean":"2024-09-13T06:32:57.307014+0000","last_became_active":"2024-09-13T06:29:08.774808+0000","last_became_peered":"2024-09-13T06:29:08.774808+0000","last_unstale":"2024-09-13T06:32:57.307014+0000","last_undegraded":"2024-09-13T06:32:57.307014+0000","last_fullsized":"2024-09-13T06:32:57.307014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:32:57.306761+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.306761+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:57.594334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.779665+0000","last_change":"2024-09-13T06:33:38.779734+0000","last_active":"2024-09-13T06:33:38.779665+0000","last_peered":"2024-09-13T06:33:38.779665+0000","last_clean":"2024-09-13T06:33:38.779665+0000","last_became_active":"2024-09-13T06:29:00.726081+0000","last_became_peered":"2024-09-13T06:29:00.726081+0000","last_unstale":"2024-09-13T06:33:38.779665+0000","last_undegraded":"2024-09-13T06:33:38.779665+0000","last_fullsized":"2024-09-13T06:33:38.779665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:38.779464+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:38.779464+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.779464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:59.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:43.812925+0000","last_change":"2024-09-13T06:33:43.812985+0000","last_active":"2024-09-13T06:33:43.812925+0000","last_peered":"2024-09-13T06:33:43.812925+0000","last_clean":"2024-09-13T06:33:43.812925+0000","last_became_active":"2024-09-13T06:28:58.708916+0000","last_became_peered":"2024-09-13T06:28:58.708916+0000","last_unstale":"2024-09-13T06:33:43.812925+0000","last_undegraded":"2024-09-13T06:33:43.812925+0000","last_fullsized":"2024-09-13T06:33:43.812925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:43.812737+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:43.812737+0000","last_clean_scrub_stamp":"2024-09-13T06:33:43.812737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:50.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.986271+0000","last_change":"2024-09-13T06:33:48.986323+0000","last_active":"2024-09-13T06:33:48.986271+0000","last_peered":"2024-09-13T06:33:48.986271+0000","last_clean":"2024-09-13T06:33:48.986271+0000","last_became_active":"2024-09-13T06:28:50.948062+0000","last_became_peered":"2024-09-13T06:28:50.948062+0000","last_unstale":"2024-09-13T06:33:48.986271+0000","last_undegraded":"2024-09-13T06:33:48.986271+0000","last_fullsized":"2024-09-13T06:33:48.986271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:48.986082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:48.986082+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.986082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:49.637396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002057611,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.733063+0000","last_change":"2024-09-13T06:32:51.733063+0000","last_active":"2024-09-13T06:32:51.733063+0000","last_peered":"2024-09-13T06:32:51.733063+0000","last_clean":"2024-09-13T06:32:51.733063+0000","last_became_active":"2024-09-13T06:29:02.746962+0000","last_became_peered":"2024-09-13T06:29:02.746962+0000","last_unstale":"2024-09-13T06:32:51.733063+0000","last_undegraded":"2024-09-13T06:32:51.733063+0000","last_fullsized":"2024-09-13T06:32:51.733063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.732823+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.732823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:41.778673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.654307+0000","last_change":"2024-09-13T06:32:59.654307+0000","last_active":"2024-09-13T06:32:59.654307+0000","last_peered":"2024-09-13T06:32:59.654307+0000","last_clean":"2024-09-13T06:32:59.654307+0000","last_became_active":"2024-09-13T06:29:04.746306+0000","last_became_peered":"2024-09-13T06:29:04.746306+0000","last_unstale":"2024-09-13T06:32:59.654307+0000","last_undegraded":"2024-09-13T06:32:59.654307+0000","last_fullsized":"2024-09-13T06:32:59.654307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:32:59.654023+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.654023+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:07.752313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":373,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.632949+0000","last_change":"2024-09-13T06:32:58.632949+0000","last_active":"2024-09-13T06:32:58.632949+0000","last_peered":"2024-09-13T06:32:58.632949+0000","last_clean":"2024-09-13T06:32:58.632949+0000","last_became_active":"2024-09-13T06:29:06.771921+0000","last_became_peered":"2024-09-13T06:29:06.771921+0000","last_unstale":"2024-09-13T06:32:58.632949+0000","last_undegraded":"2024-09-13T06:32:58.632949+0000","last_fullsized":"2024-09-13T06:32:58.632949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:32:58.632636+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.632636+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:48.468583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:00.798753+0000","last_change":"2024-09-13T06:34:00.798814+0000","last_active":"2024-09-13T06:34:00.798753+0000","last_peered":"2024-09-13T06:34:00.798753+0000","last_clean":"2024-09-13T06:34:00.798753+0000","last_became_active":"2024-09-13T06:29:08.790923+0000","last_became_peered":"2024-09-13T06:29:08.790923+0000","last_unstale":"2024-09-13T06:34:00.798753+0000","last_undegraded":"2024-09-13T06:34:00.798753+0000","last_fullsized":"2024-09-13T06:34:00.798753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T06:34:00.798552+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T06:34:00.798552+0000","last_clean_scrub_stamp":"2024-09-13T06:34:00.798552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:21:52.129204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.859873+0000","last_change":"2024-09-13T06:33:20.859949+0000","last_active":"2024-09-13T06:33:20.859873+0000","last_peered":"2024-09-13T06:33:20.859873+0000","last_clean":"2024-09-13T06:33:20.859873+0000","last_became_active":"2024-09-13T06:29:00.722775+0000","last_became_peered":"2024-09-13T06:29:00.722775+0000","last_unstale":"2024-09-13T06:33:20.859873+0000","last_undegraded":"2024-09-13T06:33:20.859873+0000","last_fullsized":"2024-09-13T06:33:20.859873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:20.859664+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:20.859664+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.859664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:48.267924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.863141+0000","last_change":"2024-09-13T06:33:34.863197+0000","last_active":"2024-09-13T06:33:34.863141+0000","last_peered":"2024-09-13T06:33:34.863141+0000","last_clean":"2024-09-13T06:33:34.863141+0000","last_became_active":"2024-09-13T06:28:58.720203+0000","last_became_peered":"2024-09-13T06:28:58.720203+0000","last_unstale":"2024-09-13T06:33:34.863141+0000","last_undegraded":"2024-09-13T06:33:34.863141+0000","last_fullsized":"2024-09-13T06:33:34.863141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:34.862954+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:34.862954+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.862954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:00.324438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:41.771603+0000","last_change":"2024-09-13T06:33:41.771737+0000","last_active":"2024-09-13T06:33:41.771603+0000","last_peered":"2024-09-13T06:33:41.771603+0000","last_clean":"2024-09-13T06:33:41.771603+0000","last_became_active":"2024-09-13T06:28:50.942587+0000","last_became_peered":"2024-09-13T06:28:50.942587+0000","last_unstale":"2024-09-13T06:33:41.771603+0000","last_undegraded":"2024-09-13T06:33:41.771603+0000","last_fullsized":"2024-09-13T06:33:41.771603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:41.771376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:41.771376+0000","last_clean_scrub_stamp":"2024-09-13T06:33:41.771376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:49.642536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088555700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:59.771819+0000","last_change":"2024-09-13T06:32:59.771819+0000","last_active":"2024-09-13T06:32:59.771819+0000","last_peered":"2024-09-13T06:32:59.771819+0000","last_clean":"2024-09-13T06:32:59.771819+0000","last_became_active":"2024-09-13T06:29:02.715354+0000","last_became_peered":"2024-09-13T06:29:02.715354+0000","last_unstale":"2024-09-13T06:32:59.771819+0000","last_undegraded":"2024-09-13T06:32:59.771819+0000","last_fullsized":"2024-09-13T06:32:59.771819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:59.771488+0000","last_clean_scrub_stamp":"2024-09-13T06:32:59.771488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:40:22.687574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.946526+0000","last_change":"2024-09-13T06:32:50.946526+0000","last_active":"2024-09-13T06:32:50.946526+0000","last_peered":"2024-09-13T06:32:50.946526+0000","last_clean":"2024-09-13T06:32:50.946526+0000","last_became_active":"2024-09-13T06:29:04.745341+0000","last_became_peered":"2024-09-13T06:29:04.745341+0000","last_unstale":"2024-09-13T06:32:50.946526+0000","last_undegraded":"2024-09-13T06:32:50.946526+0000","last_fullsized":"2024-09-13T06:32:50.946526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:32:50.946266+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.946266+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:40.782214+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.832186+0000","last_change":"2024-09-13T06:33:13.832186+0000","last_active":"2024-09-13T06:33:13.832186+0000","last_peered":"2024-09-13T06:33:13.832186+0000","last_clean":"2024-09-13T06:33:13.832186+0000","last_became_active":"2024-09-13T06:29:06.768771+0000","last_became_peered":"2024-09-13T06:29:06.768771+0000","last_unstale":"2024-09-13T06:33:13.832186+0000","last_undegraded":"2024-09-13T06:33:13.832186+0000","last_fullsized":"2024-09-13T06:33:13.832186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:33:13.831936+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:33:13.831936+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.831936+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:36.729651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:49.822469+0000","last_change":"2024-09-13T06:33:49.822531+0000","last_active":"2024-09-13T06:33:49.822469+0000","last_peered":"2024-09-13T06:33:49.822469+0000","last_clean":"2024-09-13T06:33:49.822469+0000","last_became_active":"2024-09-13T06:29:08.789227+0000","last_became_peered":"2024-09-13T06:29:08.789227+0000","last_unstale":"2024-09-13T06:33:49.822469+0000","last_undegraded":"2024-09-13T06:33:49.822469+0000","last_fullsized":"2024-09-13T06:33:49.822469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-13T06:33:49.822274+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-13T06:33:49.822274+0000","last_clean_scrub_stamp":"2024-09-13T06:33:49.822274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:03.370189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:16.125509+0000","last_change":"2024-09-13T06:33:16.125567+0000","last_active":"2024-09-13T06:33:16.125509+0000","last_peered":"2024-09-13T06:33:16.125509+0000","last_clean":"2024-09-13T06:33:16.125509+0000","last_became_active":"2024-09-13T06:29:00.703456+0000","last_became_peered":"2024-09-13T06:29:00.703456+0000","last_unstale":"2024-09-13T06:33:16.125509+0000","last_undegraded":"2024-09-13T06:33:16.125509+0000","last_fullsized":"2024-09-13T06:33:16.125509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:16.125320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:16.125320+0000","last_clean_scrub_stamp":"2024-09-13T06:33:16.125320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:47.327725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:39.756612+0000","last_change":"2024-09-13T06:33:39.756754+0000","last_active":"2024-09-13T06:33:39.756612+0000","last_peered":"2024-09-13T06:33:39.756612+0000","last_clean":"2024-09-13T06:33:39.756612+0000","last_became_active":"2024-09-13T06:28:58.716154+0000","last_became_peered":"2024-09-13T06:28:58.716154+0000","last_unstale":"2024-09-13T06:33:39.756612+0000","last_undegraded":"2024-09-13T06:33:39.756612+0000","last_fullsized":"2024-09-13T06:33:39.756612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:39.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:39.756389+0000","last_clean_scrub_stamp":"2024-09-13T06:33:39.756389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:02.415606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:51.984586+0000","last_change":"2024-09-13T06:33:51.984641+0000","last_active":"2024-09-13T06:33:51.984586+0000","last_peered":"2024-09-13T06:33:51.984586+0000","last_clean":"2024-09-13T06:33:51.984586+0000","last_became_active":"2024-09-13T06:28:50.948776+0000","last_became_peered":"2024-09-13T06:28:50.948776+0000","last_unstale":"2024-09-13T06:33:51.984586+0000","last_undegraded":"2024-09-13T06:33:51.984586+0000","last_fullsized":"2024-09-13T06:33:51.984586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:51.984392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:51.984392+0000","last_clean_scrub_stamp":"2024-09-13T06:33:51.984392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:12.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025635739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.863331+0000","last_change":"2024-09-13T06:32:55.863331+0000","last_active":"2024-09-13T06:32:55.863331+0000","last_peered":"2024-09-13T06:32:55.863331+0000","last_clean":"2024-09-13T06:32:55.863331+0000","last_became_active":"2024-09-13T06:29:02.743713+0000","last_became_peered":"2024-09-13T06:29:02.743713+0000","last_unstale":"2024-09-13T06:32:55.863331+0000","last_undegraded":"2024-09-13T06:32:55.863331+0000","last_fullsized":"2024-09-13T06:32:55.863331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.863065+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.863065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:36.969572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'98","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.660166+0000","last_change":"2024-09-13T06:32:54.660166+0000","last_active":"2024-09-13T06:32:54.660166+0000","last_peered":"2024-09-13T06:32:54.660166+0000","last_clean":"2024-09-13T06:32:54.660166+0000","last_became_active":"2024-09-13T06:29:04.731524+0000","last_became_peered":"2024-09-13T06:29:04.731524+0000","last_unstale":"2024-09-13T06:32:54.660166+0000","last_undegraded":"2024-09-13T06:32:54.660166+0000","last_fullsized":"2024-09-13T06:32:54.660166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'98","last_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_deep_scrub":"35'98","last_deep_scrub_stamp":"2024-09-13T06:32:54.659885+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.659885+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:25.520020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.816350+0000","last_change":"2024-09-13T06:33:00.816350+0000","last_active":"2024-09-13T06:33:00.816350+0000","last_peered":"2024-09-13T06:33:00.816350+0000","last_clean":"2024-09-13T06:33:00.816350+0000","last_became_active":"2024-09-13T06:29:06.766455+0000","last_became_peered":"2024-09-13T06:29:06.766455+0000","last_unstale":"2024-09-13T06:33:00.816350+0000","last_undegraded":"2024-09-13T06:33:00.816350+0000","last_fullsized":"2024-09-13T06:33:00.816350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:00.816103+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.816103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:13.549745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.317544+0000","last_change":"2024-09-13T06:33:01.317544+0000","last_active":"2024-09-13T06:33:01.317544+0000","last_peered":"2024-09-13T06:33:01.317544+0000","last_clean":"2024-09-13T06:33:01.317544+0000","last_became_active":"2024-09-13T06:29:08.777263+0000","last_became_peered":"2024-09-13T06:29:08.777263+0000","last_unstale":"2024-09-13T06:33:01.317544+0000","last_undegraded":"2024-09-13T06:33:01.317544+0000","last_fullsized":"2024-09-13T06:33:01.317544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.317139+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.317139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:36:04.823983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.229760+0000","last_change":"2024-09-13T06:32:53.229760+0000","last_active":"2024-09-13T06:32:53.229760+0000","last_peered":"2024-09-13T06:32:53.229760+0000","last_clean":"2024-09-13T06:32:53.229760+0000","last_became_active":"2024-09-13T06:29:08.774528+0000","last_became_peered":"2024-09-13T06:29:08.774528+0000","last_unstale":"2024-09-13T06:32:53.229760+0000","last_undegraded":"2024-09-13T06:32:53.229760+0000","last_fullsized":"2024-09-13T06:32:53.229760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:32:53.229470+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.229470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:36.522566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'12","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.231055+0000","last_change":"2024-09-13T06:33:08.231055+0000","last_active":"2024-09-13T06:33:08.231055+0000","last_peered":"2024-09-13T06:33:08.231055+0000","last_clean":"2024-09-13T06:33:08.231055+0000","last_became_active":"2024-09-13T06:29:00.704695+0000","last_became_peered":"2024-09-13T06:29:00.704695+0000","last_unstale":"2024-09-13T06:33:08.231055+0000","last_undegraded":"2024-09-13T06:33:08.231055+0000","last_fullsized":"2024-09-13T06:33:08.231055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:08.230807+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:08.230807+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.230807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:48:34.071921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:55.105097+0000","last_change":"2024-09-13T06:33:55.105157+0000","last_active":"2024-09-13T06:33:55.105097+0000","last_peered":"2024-09-13T06:33:55.105097+0000","last_clean":"2024-09-13T06:33:55.105097+0000","last_became_active":"2024-09-13T06:28:58.705582+0000","last_became_peered":"2024-09-13T06:28:58.705582+0000","last_unstale":"2024-09-13T06:33:55.105097+0000","last_undegraded":"2024-09-13T06:33:55.105097+0000","last_fullsized":"2024-09-13T06:33:55.105097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:55.104905+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:55.104905+0000","last_clean_scrub_stamp":"2024-09-13T06:33:55.104905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:39.001128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:50.713077+0000","last_change":"2024-09-13T06:32:50.713077+0000","last_active":"2024-09-13T06:32:50.713077+0000","last_peered":"2024-09-13T06:32:50.713077+0000","last_clean":"2024-09-13T06:32:50.713077+0000","last_became_active":"2024-09-13T06:29:02.737025+0000","last_became_peered":"2024-09-13T06:29:02.737025+0000","last_unstale":"2024-09-13T06:32:50.713077+0000","last_undegraded":"2024-09-13T06:32:50.713077+0000","last_fullsized":"2024-09-13T06:32:50.713077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:50.712808+0000","last_clean_scrub_stamp":"2024-09-13T06:32:50.712808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:55.564878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.849575+0000","last_change":"2024-09-13T06:32:57.849575+0000","last_active":"2024-09-13T06:32:57.849575+0000","last_peered":"2024-09-13T06:32:57.849575+0000","last_clean":"2024-09-13T06:32:57.849575+0000","last_became_active":"2024-09-13T06:29:04.748581+0000","last_became_peered":"2024-09-13T06:29:04.748581+0000","last_unstale":"2024-09-13T06:32:57.849575+0000","last_undegraded":"2024-09-13T06:32:57.849575+0000","last_fullsized":"2024-09-13T06:32:57.849575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:32:57.849298+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.849298+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:27.355549+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:01.864660+0000","last_change":"2024-09-13T06:33:01.864660+0000","last_active":"2024-09-13T06:33:01.864660+0000","last_peered":"2024-09-13T06:33:01.864660+0000","last_clean":"2024-09-13T06:33:01.864660+0000","last_became_active":"2024-09-13T06:29:06.768112+0000","last_became_peered":"2024-09-13T06:29:06.768112+0000","last_unstale":"2024-09-13T06:33:01.864660+0000","last_undegraded":"2024-09-13T06:33:01.864660+0000","last_fullsized":"2024-09-13T06:33:01.864660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:01.864411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:01.864411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:27.499351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'3","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:57.810687+0000","last_change":"2024-09-13T06:33:57.810757+0000","last_active":"2024-09-13T06:33:57.810687+0000","last_peered":"2024-09-13T06:33:57.810687+0000","last_clean":"2024-09-13T06:33:57.810687+0000","last_became_active":"2024-09-13T06:29:08.786650+0000","last_became_peered":"2024-09-13T06:29:08.786650+0000","last_unstale":"2024-09-13T06:33:57.810687+0000","last_undegraded":"2024-09-13T06:33:57.810687+0000","last_fullsized":"2024-09-13T06:33:57.810687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:57.810449+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:57.810449+0000","last_clean_scrub_stamp":"2024-09-13T06:33:57.810449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:03:59.449028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.709781+0000","last_change":"2024-09-13T06:33:34.709781+0000","last_active":"2024-09-13T06:33:34.709781+0000","last_peered":"2024-09-13T06:33:34.709781+0000","last_clean":"2024-09-13T06:33:34.709781+0000","last_became_active":"2024-09-13T06:29:00.723781+0000","last_became_peered":"2024-09-13T06:29:00.723781+0000","last_unstale":"2024-09-13T06:33:34.709781+0000","last_undegraded":"2024-09-13T06:33:34.709781+0000","last_fullsized":"2024-09-13T06:33:34.709781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:34.709529+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:34.709529+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.709529+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:41.731330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.107595+0000","last_change":"2024-09-13T06:33:20.107595+0000","last_active":"2024-09-13T06:33:20.107595+0000","last_peered":"2024-09-13T06:33:20.107595+0000","last_clean":"2024-09-13T06:33:20.107595+0000","last_became_active":"2024-09-13T06:28:58.722199+0000","last_became_peered":"2024-09-13T06:28:58.722199+0000","last_unstale":"2024-09-13T06:33:20.107595+0000","last_undegraded":"2024-09-13T06:33:20.107595+0000","last_fullsized":"2024-09-13T06:33:20.107595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:20.107242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:20.107242+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.107242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:23.355872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.849630+0000","last_change":"2024-09-13T06:32:58.849630+0000","last_active":"2024-09-13T06:32:58.849630+0000","last_peered":"2024-09-13T06:32:58.849630+0000","last_clean":"2024-09-13T06:32:58.849630+0000","last_became_active":"2024-09-13T06:29:02.739031+0000","last_became_peered":"2024-09-13T06:29:02.739031+0000","last_unstale":"2024-09-13T06:32:58.849630+0000","last_undegraded":"2024-09-13T06:32:58.849630+0000","last_fullsized":"2024-09-13T06:32:58.849630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:58.849384+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.849384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:17.920356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:00.666422+0000","last_change":"2024-09-13T06:33:00.666422+0000","last_active":"2024-09-13T06:33:00.666422+0000","last_peered":"2024-09-13T06:33:00.666422+0000","last_clean":"2024-09-13T06:33:00.666422+0000","last_became_active":"2024-09-13T06:29:04.740259+0000","last_became_peered":"2024-09-13T06:29:04.740259+0000","last_unstale":"2024-09-13T06:33:00.666422+0000","last_undegraded":"2024-09-13T06:33:00.666422+0000","last_fullsized":"2024-09-13T06:33:00.666422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:33:00.666162+0000","last_clean_scrub_stamp":"2024-09-13T06:33:00.666162+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:22:43.088796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.237529+0000","last_change":"2024-09-13T06:32:55.237529+0000","last_active":"2024-09-13T06:32:55.237529+0000","last_peered":"2024-09-13T06:32:55.237529+0000","last_clean":"2024-09-13T06:32:55.237529+0000","last_became_active":"2024-09-13T06:29:06.764456+0000","last_became_peered":"2024-09-13T06:29:06.764456+0000","last_unstale":"2024-09-13T06:32:55.237529+0000","last_undegraded":"2024-09-13T06:32:55.237529+0000","last_fullsized":"2024-09-13T06:32:55.237529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.237184+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.237184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:16.278907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.768779+0000","last_change":"2024-09-13T06:33:22.768779+0000","last_active":"2024-09-13T06:33:22.768779+0000","last_peered":"2024-09-13T06:33:22.768779+0000","last_clean":"2024-09-13T06:33:22.768779+0000","last_became_active":"2024-09-13T06:29:08.785437+0000","last_became_peered":"2024-09-13T06:29:08.785437+0000","last_unstale":"2024-09-13T06:33:22.768779+0000","last_undegraded":"2024-09-13T06:33:22.768779+0000","last_fullsized":"2024-09-13T06:33:22.768779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T06:33:22.768486+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T06:33:22.768486+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.768486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:11.301142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"35'8","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.919076+0000","last_change":"2024-09-13T06:33:30.919076+0000","last_active":"2024-09-13T06:33:30.919076+0000","last_peered":"2024-09-13T06:33:30.919076+0000","last_clean":"2024-09-13T06:33:30.919076+0000","last_became_active":"2024-09-13T06:29:00.708349+0000","last_became_peered":"2024-09-13T06:29:00.708349+0000","last_unstale":"2024-09-13T06:33:30.919076+0000","last_undegraded":"2024-09-13T06:33:30.919076+0000","last_fullsized":"2024-09-13T06:33:30.919076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:30.918821+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:30.918821+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.918821+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:51.207914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.116635+0000","last_change":"2024-09-13T06:33:37.116635+0000","last_active":"2024-09-13T06:33:37.116635+0000","last_peered":"2024-09-13T06:33:37.116635+0000","last_clean":"2024-09-13T06:33:37.116635+0000","last_became_active":"2024-09-13T06:28:58.715067+0000","last_became_peered":"2024-09-13T06:28:58.715067+0000","last_unstale":"2024-09-13T06:33:37.116635+0000","last_undegraded":"2024-09-13T06:33:37.116635+0000","last_fullsized":"2024-09-13T06:33:37.116635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:37.116247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:37.116247+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.116247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:24.752169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'5","reported_seq":243,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.668036+0000","last_change":"2024-09-13T06:32:55.668036+0000","last_active":"2024-09-13T06:32:55.668036+0000","last_peered":"2024-09-13T06:32:55.668036+0000","last_clean":"2024-09-13T06:32:55.668036+0000","last_became_active":"2024-09-13T06:29:02.727150+0000","last_became_peered":"2024-09-13T06:29:02.727150+0000","last_unstale":"2024-09-13T06:32:55.668036+0000","last_undegraded":"2024-09-13T06:32:55.668036+0000","last_fullsized":"2024-09-13T06:32:55.668036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:32:55.667780+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.667780+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:08.401422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"35'48","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.902064+0000","last_change":"2024-09-13T06:32:53.902064+0000","last_active":"2024-09-13T06:32:53.902064+0000","last_peered":"2024-09-13T06:32:53.902064+0000","last_clean":"2024-09-13T06:32:53.902064+0000","last_became_active":"2024-09-13T06:29:04.749673+0000","last_became_peered":"2024-09-13T06:29:04.749673+0000","last_unstale":"2024-09-13T06:32:53.902064+0000","last_undegraded":"2024-09-13T06:32:53.902064+0000","last_fullsized":"2024-09-13T06:32:53.902064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:32:53.901815+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.901815+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:12.560029+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:53.629571+0000","last_change":"2024-09-13T06:32:53.629571+0000","last_active":"2024-09-13T06:32:53.629571+0000","last_peered":"2024-09-13T06:32:53.629571+0000","last_clean":"2024-09-13T06:32:53.629571+0000","last_became_active":"2024-09-13T06:29:06.764834+0000","last_became_peered":"2024-09-13T06:29:06.764834+0000","last_unstale":"2024-09-13T06:32:53.629571+0000","last_undegraded":"2024-09-13T06:32:53.629571+0000","last_fullsized":"2024-09-13T06:32:53.629571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:53.629307+0000","last_clean_scrub_stamp":"2024-09-13T06:32:53.629307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:49.351038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"33'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:56.792227+0000","last_change":"2024-09-13T06:33:56.792227+0000","last_active":"2024-09-13T06:33:56.792227+0000","last_peered":"2024-09-13T06:33:56.792227+0000","last_clean":"2024-09-13T06:33:56.792227+0000","last_became_active":"2024-09-13T06:29:08.785992+0000","last_became_peered":"2024-09-13T06:29:08.785992+0000","last_unstale":"2024-09-13T06:33:56.792227+0000","last_undegraded":"2024-09-13T06:33:56.792227+0000","last_fullsized":"2024-09-13T06:33:56.792227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T06:33:56.791966+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T06:33:56.791966+0000","last_clean_scrub_stamp":"2024-09-13T06:33:56.791966+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:58:08.599512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:34.118797+0000","last_change":"2024-09-13T06:33:34.118855+0000","last_active":"2024-09-13T06:33:34.118797+0000","last_peered":"2024-09-13T06:33:34.118797+0000","last_clean":"2024-09-13T06:33:34.118797+0000","last_became_active":"2024-09-13T06:29:39.507948+0000","last_became_peered":"2024-09-13T06:29:39.507948+0000","last_unstale":"2024-09-13T06:33:34.118797+0000","last_undegraded":"2024-09-13T06:33:34.118797+0000","last_fullsized":"2024-09-13T06:33:34.118797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:34.118610+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:34.118610+0000","last_clean_scrub_stamp":"2024-09-13T06:33:34.118610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:42.780087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:47.842240+0000","last_change":"2024-09-13T06:33:47.842240+0000","last_active":"2024-09-13T06:33:47.842240+0000","last_peered":"2024-09-13T06:33:47.842240+0000","last_clean":"2024-09-13T06:33:47.842240+0000","last_became_active":"2024-09-13T06:28:58.716126+0000","last_became_peered":"2024-09-13T06:28:58.716126+0000","last_unstale":"2024-09-13T06:33:47.842240+0000","last_undegraded":"2024-09-13T06:33:47.842240+0000","last_fullsized":"2024-09-13T06:33:47.842240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:47.841961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:47.841961+0000","last_clean_scrub_stamp":"2024-09-13T06:33:47.841961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:30.356748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.851375+0000","last_change":"2024-09-13T06:33:14.851375+0000","last_active":"2024-09-13T06:33:14.851375+0000","last_peered":"2024-09-13T06:33:14.851375+0000","last_clean":"2024-09-13T06:33:14.851375+0000","last_became_active":"2024-09-13T06:29:02.717895+0000","last_became_peered":"2024-09-13T06:29:02.717895+0000","last_unstale":"2024-09-13T06:33:14.851375+0000","last_undegraded":"2024-09-13T06:33:14.851375+0000","last_fullsized":"2024-09-13T06:33:14.851375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.851131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.851131+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.851131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:18:48.539267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:08.919713+0000","last_change":"2024-09-13T06:33:08.919713+0000","last_active":"2024-09-13T06:33:08.919713+0000","last_peered":"2024-09-13T06:33:08.919713+0000","last_clean":"2024-09-13T06:33:08.919713+0000","last_became_active":"2024-09-13T06:29:04.733163+0000","last_became_peered":"2024-09-13T06:29:04.733163+0000","last_unstale":"2024-09-13T06:33:08.919713+0000","last_undegraded":"2024-09-13T06:33:08.919713+0000","last_fullsized":"2024-09-13T06:33:08.919713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:08.919447+0000","last_clean_scrub_stamp":"2024-09-13T06:33:08.919447+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:31.817162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.257263+0000","last_change":"2024-09-13T06:32:56.257263+0000","last_active":"2024-09-13T06:32:56.257263+0000","last_peered":"2024-09-13T06:32:56.257263+0000","last_clean":"2024-09-13T06:32:56.257263+0000","last_became_active":"2024-09-13T06:29:06.761750+0000","last_became_peered":"2024-09-13T06:29:06.761750+0000","last_unstale":"2024-09-13T06:32:56.257263+0000","last_undegraded":"2024-09-13T06:32:56.257263+0000","last_fullsized":"2024-09-13T06:32:56.257263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.256983+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.256983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:15.836617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.024597+0000","last_change":"2024-09-13T06:33:24.024657+0000","last_active":"2024-09-13T06:33:24.024597+0000","last_peered":"2024-09-13T06:33:24.024597+0000","last_clean":"2024-09-13T06:33:24.024597+0000","last_became_active":"2024-09-13T06:29:00.715988+0000","last_became_peered":"2024-09-13T06:29:00.715988+0000","last_unstale":"2024-09-13T06:33:24.024597+0000","last_undegraded":"2024-09-13T06:33:24.024597+0000","last_fullsized":"2024-09-13T06:33:24.024597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:24.024411+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:24.024411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.024411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:02.565766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:42.772666+0000","last_change":"2024-09-13T06:33:42.772666+0000","last_active":"2024-09-13T06:33:42.772666+0000","last_peered":"2024-09-13T06:33:42.772666+0000","last_clean":"2024-09-13T06:33:42.772666+0000","last_became_active":"2024-09-13T06:28:58.717628+0000","last_became_peered":"2024-09-13T06:28:58.717628+0000","last_unstale":"2024-09-13T06:33:42.772666+0000","last_undegraded":"2024-09-13T06:33:42.772666+0000","last_fullsized":"2024-09-13T06:33:42.772666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:42.772315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:42.772315+0000","last_clean_scrub_stamp":"2024-09-13T06:33:42.772315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:43.604943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:49.753509+0000","last_change":"2024-09-13T06:32:49.753509+0000","last_active":"2024-09-13T06:32:49.753509+0000","last_peered":"2024-09-13T06:32:49.753509+0000","last_clean":"2024-09-13T06:32:49.753509+0000","last_became_active":"2024-09-13T06:29:02.736948+0000","last_became_peered":"2024-09-13T06:29:02.736948+0000","last_unstale":"2024-09-13T06:32:49.753509+0000","last_undegraded":"2024-09-13T06:32:49.753509+0000","last_fullsized":"2024-09-13T06:32:49.753509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:49.753224+0000","last_clean_scrub_stamp":"2024-09-13T06:32:49.753224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:01.369372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'66","reported_seq":161,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:55.903826+0000","last_change":"2024-09-13T06:33:55.903826+0000","last_active":"2024-09-13T06:33:55.903826+0000","last_peered":"2024-09-13T06:33:55.903826+0000","last_clean":"2024-09-13T06:33:55.903826+0000","last_became_active":"2024-09-13T06:29:39.508159+0000","last_became_peered":"2024-09-13T06:29:39.508159+0000","last_unstale":"2024-09-13T06:33:55.903826+0000","last_undegraded":"2024-09-13T06:33:55.903826+0000","last_fullsized":"2024-09-13T06:33:55.903826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'66","last_scrub_stamp":"2024-09-13T06:33:55.903439+0000","last_deep_scrub":"35'66","last_deep_scrub_stamp":"2024-09-13T06:33:55.903439+0000","last_clean_scrub_stamp":"2024-09-13T06:33:55.903439+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:21.188904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.274454+0000","last_change":"2024-09-13T06:32:54.274454+0000","last_active":"2024-09-13T06:32:54.274454+0000","last_peered":"2024-09-13T06:32:54.274454+0000","last_clean":"2024-09-13T06:32:54.274454+0000","last_became_active":"2024-09-13T06:29:06.769681+0000","last_became_peered":"2024-09-13T06:29:06.769681+0000","last_unstale":"2024-09-13T06:32:54.274454+0000","last_undegraded":"2024-09-13T06:32:54.274454+0000","last_fullsized":"2024-09-13T06:32:54.274454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.274196+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.274196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:07.867699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.935337+0000","last_change":"2024-09-13T06:33:25.935337+0000","last_active":"2024-09-13T06:33:25.935337+0000","last_peered":"2024-09-13T06:33:25.935337+0000","last_clean":"2024-09-13T06:33:25.935337+0000","last_became_active":"2024-09-13T06:29:08.784108+0000","last_became_peered":"2024-09-13T06:29:08.784108+0000","last_unstale":"2024-09-13T06:33:25.935337+0000","last_undegraded":"2024-09-13T06:33:25.935337+0000","last_fullsized":"2024-09-13T06:33:25.935337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:33:25.934938+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:33:25.934938+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.934938+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:59.560535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:17.646553+0000","last_change":"2024-09-13T06:33:17.646610+0000","last_active":"2024-09-13T06:33:17.646553+0000","last_peered":"2024-09-13T06:33:17.646553+0000","last_clean":"2024-09-13T06:33:17.646553+0000","last_became_active":"2024-09-13T06:29:00.729200+0000","last_became_peered":"2024-09-13T06:29:00.729200+0000","last_unstale":"2024-09-13T06:33:17.646553+0000","last_undegraded":"2024-09-13T06:33:17.646553+0000","last_fullsized":"2024-09-13T06:33:17.646553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:17.646356+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:17.646356+0000","last_clean_scrub_stamp":"2024-09-13T06:33:17.646356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:49.505268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:53.881715+0000","last_change":"2024-09-13T06:33:53.881774+0000","last_active":"2024-09-13T06:33:53.881715+0000","last_peered":"2024-09-13T06:33:53.881715+0000","last_clean":"2024-09-13T06:33:53.881715+0000","last_became_active":"2024-09-13T06:29:39.513161+0000","last_became_peered":"2024-09-13T06:29:39.513161+0000","last_unstale":"2024-09-13T06:33:53.881715+0000","last_undegraded":"2024-09-13T06:33:53.881715+0000","last_fullsized":"2024-09-13T06:33:53.881715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:53.881522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:53.881522+0000","last_clean_scrub_stamp":"2024-09-13T06:33:53.881522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:38.991345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:56.697900+0000","last_change":"2024-09-13T06:32:56.697900+0000","last_active":"2024-09-13T06:32:56.697900+0000","last_peered":"2024-09-13T06:32:56.697900+0000","last_clean":"2024-09-13T06:32:56.697900+0000","last_became_active":"2024-09-13T06:29:02.720343+0000","last_became_peered":"2024-09-13T06:29:02.720343+0000","last_unstale":"2024-09-13T06:32:56.697900+0000","last_undegraded":"2024-09-13T06:32:56.697900+0000","last_fullsized":"2024-09-13T06:32:56.697900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:56.697652+0000","last_clean_scrub_stamp":"2024-09-13T06:32:56.697652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:22.332592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:11.976895+0000","last_change":"2024-09-13T06:33:11.976895+0000","last_active":"2024-09-13T06:33:11.976895+0000","last_peered":"2024-09-13T06:33:11.976895+0000","last_clean":"2024-09-13T06:33:11.976895+0000","last_became_active":"2024-09-13T06:29:04.732154+0000","last_became_peered":"2024-09-13T06:29:04.732154+0000","last_unstale":"2024-09-13T06:33:11.976895+0000","last_undegraded":"2024-09-13T06:33:11.976895+0000","last_fullsized":"2024-09-13T06:33:11.976895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-09-13T06:33:11.976609+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-09-13T06:33:11.976609+0000","last_clean_scrub_stamp":"2024-09-13T06:33:11.976609+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:51.788958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:55.617654+0000","last_change":"2024-09-13T06:32:55.617654+0000","last_active":"2024-09-13T06:32:55.617654+0000","last_peered":"2024-09-13T06:32:55.617654+0000","last_clean":"2024-09-13T06:32:55.617654+0000","last_became_active":"2024-09-13T06:29:06.762152+0000","last_became_peered":"2024-09-13T06:29:06.762152+0000","last_unstale":"2024-09-13T06:32:55.617654+0000","last_undegraded":"2024-09-13T06:32:55.617654+0000","last_fullsized":"2024-09-13T06:32:55.617654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:55.617324+0000","last_clean_scrub_stamp":"2024-09-13T06:32:55.617324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:18.790664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:01.090233+0000","last_change":"2024-09-13T06:34:01.090286+0000","last_active":"2024-09-13T06:34:01.090233+0000","last_peered":"2024-09-13T06:34:01.090233+0000","last_clean":"2024-09-13T06:34:01.090233+0000","last_became_active":"2024-09-13T06:29:08.791379+0000","last_became_peered":"2024-09-13T06:29:08.791379+0000","last_unstale":"2024-09-13T06:34:01.090233+0000","last_undegraded":"2024-09-13T06:34:01.090233+0000","last_fullsized":"2024-09-13T06:34:01.090233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:34:01.090029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:34:01.090029+0000","last_clean_scrub_stamp":"2024-09-13T06:34:01.090029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:56:50.747286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"35'12","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.877332+0000","last_change":"2024-09-13T06:33:18.877332+0000","last_active":"2024-09-13T06:33:18.877332+0000","last_peered":"2024-09-13T06:33:18.877332+0000","last_clean":"2024-09-13T06:33:18.877332+0000","last_became_active":"2024-09-13T06:29:00.731971+0000","last_became_peered":"2024-09-13T06:29:00.731971+0000","last_unstale":"2024-09-13T06:33:18.877332+0000","last_undegraded":"2024-09-13T06:33:18.877332+0000","last_fullsized":"2024-09-13T06:33:18.877332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:33:18.877085+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:33:18.877085+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.877085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:40.890221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.149934+0000","last_change":"2024-09-13T06:33:36.149934+0000","last_active":"2024-09-13T06:33:36.149934+0000","last_peered":"2024-09-13T06:33:36.149934+0000","last_clean":"2024-09-13T06:33:36.149934+0000","last_became_active":"2024-09-13T06:28:58.713756+0000","last_became_peered":"2024-09-13T06:28:58.713756+0000","last_unstale":"2024-09-13T06:33:36.149934+0000","last_undegraded":"2024-09-13T06:33:36.149934+0000","last_fullsized":"2024-09-13T06:33:36.149934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:36.149676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:36.149676+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.149676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:27.059528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:57.707902+0000","last_change":"2024-09-13T06:32:57.707902+0000","last_active":"2024-09-13T06:32:57.707902+0000","last_peered":"2024-09-13T06:32:57.707902+0000","last_clean":"2024-09-13T06:32:57.707902+0000","last_became_active":"2024-09-13T06:29:02.717909+0000","last_became_peered":"2024-09-13T06:29:02.717909+0000","last_unstale":"2024-09-13T06:32:57.707902+0000","last_undegraded":"2024-09-13T06:32:57.707902+0000","last_fullsized":"2024-09-13T06:32:57.707902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:57.707651+0000","last_clean_scrub_stamp":"2024-09-13T06:32:57.707651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:17.993090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:10.851372+0000","last_change":"2024-09-13T06:33:10.851372+0000","last_active":"2024-09-13T06:33:10.851372+0000","last_peered":"2024-09-13T06:33:10.851372+0000","last_clean":"2024-09-13T06:33:10.851372+0000","last_became_active":"2024-09-13T06:29:04.751823+0000","last_became_peered":"2024-09-13T06:29:04.751823+0000","last_unstale":"2024-09-13T06:33:10.851372+0000","last_undegraded":"2024-09-13T06:33:10.851372+0000","last_fullsized":"2024-09-13T06:33:10.851372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:33:10.851101+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:33:10.851101+0000","last_clean_scrub_stamp":"2024-09-13T06:33:10.851101+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:34.627562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:54.614320+0000","last_change":"2024-09-13T06:32:54.614320+0000","last_active":"2024-09-13T06:32:54.614320+0000","last_peered":"2024-09-13T06:32:54.614320+0000","last_clean":"2024-09-13T06:32:54.614320+0000","last_became_active":"2024-09-13T06:29:06.766144+0000","last_became_peered":"2024-09-13T06:29:06.766144+0000","last_unstale":"2024-09-13T06:32:54.614320+0000","last_undegraded":"2024-09-13T06:32:54.614320+0000","last_fullsized":"2024-09-13T06:32:54.614320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:54.614081+0000","last_clean_scrub_stamp":"2024-09-13T06:32:54.614081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:41.070050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.054804+0000","last_change":"2024-09-13T06:33:27.054804+0000","last_active":"2024-09-13T06:33:27.054804+0000","last_peered":"2024-09-13T06:33:27.054804+0000","last_clean":"2024-09-13T06:33:27.054804+0000","last_became_active":"2024-09-13T06:29:08.768608+0000","last_became_peered":"2024-09-13T06:29:08.768608+0000","last_unstale":"2024-09-13T06:33:27.054804+0000","last_undegraded":"2024-09-13T06:33:27.054804+0000","last_fullsized":"2024-09-13T06:33:27.054804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:27.054550+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:27.054550+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.054550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:49.713766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"35'4","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:15.101549+0000","last_change":"2024-09-13T06:33:15.101549+0000","last_active":"2024-09-13T06:33:15.101549+0000","last_peered":"2024-09-13T06:33:15.101549+0000","last_clean":"2024-09-13T06:33:15.101549+0000","last_became_active":"2024-09-13T06:29:00.722388+0000","last_became_peered":"2024-09-13T06:29:00.722388+0000","last_unstale":"2024-09-13T06:33:15.101549+0000","last_undegraded":"2024-09-13T06:33:15.101549+0000","last_fullsized":"2024-09-13T06:33:15.101549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:15.101239+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:15.101239+0000","last_clean_scrub_stamp":"2024-09-13T06:33:15.101239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:32.810161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.730735+0000","last_change":"2024-09-13T06:33:48.730735+0000","last_active":"2024-09-13T06:33:48.730735+0000","last_peered":"2024-09-13T06:33:48.730735+0000","last_clean":"2024-09-13T06:33:48.730735+0000","last_became_active":"2024-09-13T06:28:58.705567+0000","last_became_peered":"2024-09-13T06:28:58.705567+0000","last_unstale":"2024-09-13T06:33:48.730735+0000","last_undegraded":"2024-09-13T06:33:48.730735+0000","last_fullsized":"2024-09-13T06:33:48.730735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:48.730321+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:48.730321+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.730321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:14.015785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":32,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.593055+0000","last_change":"2024-09-13T06:33:09.593055+0000","last_active":"2024-09-13T06:33:09.593055+0000","last_peered":"2024-09-13T06:33:09.593055+0000","last_clean":"2024-09-13T06:33:09.593055+0000","last_became_active":"2024-09-13T06:29:02.727050+0000","last_became_peered":"2024-09-13T06:29:02.727050+0000","last_unstale":"2024-09-13T06:33:09.593055+0000","last_undegraded":"2024-09-13T06:33:09.593055+0000","last_fullsized":"2024-09-13T06:33:09.593055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:09.592809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:09.592809+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.592809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:07.716160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:06.955220+0000","last_change":"2024-09-13T06:33:06.955303+0000","last_active":"2024-09-13T06:33:06.955220+0000","last_peered":"2024-09-13T06:33:06.955220+0000","last_clean":"2024-09-13T06:33:06.955220+0000","last_became_active":"2024-09-13T06:29:04.753426+0000","last_became_peered":"2024-09-13T06:29:04.753426+0000","last_unstale":"2024-09-13T06:33:06.955220+0000","last_undegraded":"2024-09-13T06:33:06.955220+0000","last_fullsized":"2024-09-13T06:33:06.955220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:33:06.955042+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:33:06.955042+0000","last_clean_scrub_stamp":"2024-09-13T06:33:06.955042+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:20.072308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'286","reported_seq":436,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.962258+0000","last_change":"2024-09-13T06:33:18.962258+0000","last_active":"2024-09-13T06:33:18.962258+0000","last_peered":"2024-09-13T06:33:18.962258+0000","last_clean":"2024-09-13T06:33:18.962258+0000","last_became_active":"2024-09-13T06:29:06.773792+0000","last_became_peered":"2024-09-13T06:29:06.773792+0000","last_unstale":"2024-09-13T06:33:18.962258+0000","last_undegraded":"2024-09-13T06:33:18.962258+0000","last_fullsized":"2024-09-13T06:33:18.962258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:33:18.961843+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:33:18.961843+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.961843+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:37.540052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:00.055326+0000","last_change":"2024-09-13T06:34:00.055382+0000","last_active":"2024-09-13T06:34:00.055326+0000","last_peered":"2024-09-13T06:34:00.055326+0000","last_clean":"2024-09-13T06:34:00.055326+0000","last_became_active":"2024-09-13T06:29:08.788366+0000","last_became_peered":"2024-09-13T06:29:08.788366+0000","last_unstale":"2024-09-13T06:34:00.055326+0000","last_undegraded":"2024-09-13T06:34:00.055326+0000","last_fullsized":"2024-09-13T06:34:00.055326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:34:00.055110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:34:00.055110+0000","last_clean_scrub_stamp":"2024-09-13T06:34:00.055110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:11.352326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.115307+0000","last_change":"2024-09-13T06:33:14.115307+0000","last_active":"2024-09-13T06:33:14.115307+0000","last_peered":"2024-09-13T06:33:14.115307+0000","last_clean":"2024-09-13T06:33:14.115307+0000","last_became_active":"2024-09-13T06:29:00.702629+0000","last_became_peered":"2024-09-13T06:29:00.702629+0000","last_unstale":"2024-09-13T06:33:14.115307+0000","last_undegraded":"2024-09-13T06:33:14.115307+0000","last_fullsized":"2024-09-13T06:33:14.115307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:14.115056+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:14.115056+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.115056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:50:00.143967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.814678+0000","last_change":"2024-09-13T06:33:31.814678+0000","last_active":"2024-09-13T06:33:31.814678+0000","last_peered":"2024-09-13T06:33:31.814678+0000","last_clean":"2024-09-13T06:33:31.814678+0000","last_became_active":"2024-09-13T06:28:58.727309+0000","last_became_peered":"2024-09-13T06:28:58.727309+0000","last_unstale":"2024-09-13T06:33:31.814678+0000","last_undegraded":"2024-09-13T06:33:31.814678+0000","last_fullsized":"2024-09-13T06:33:31.814678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:31.814428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:31.814428+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.814428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:22.586005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.672474+0000","last_change":"2024-09-13T06:32:51.672474+0000","last_active":"2024-09-13T06:32:51.672474+0000","last_peered":"2024-09-13T06:32:51.672474+0000","last_clean":"2024-09-13T06:32:51.672474+0000","last_became_active":"2024-09-13T06:29:02.727690+0000","last_became_peered":"2024-09-13T06:29:02.727690+0000","last_unstale":"2024-09-13T06:32:51.672474+0000","last_undegraded":"2024-09-13T06:32:51.672474+0000","last_fullsized":"2024-09-13T06:32:51.672474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.672122+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.672122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:22.074076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:05.867420+0000","last_change":"2024-09-13T06:33:05.867420+0000","last_active":"2024-09-13T06:33:05.867420+0000","last_peered":"2024-09-13T06:33:05.867420+0000","last_clean":"2024-09-13T06:33:05.867420+0000","last_became_active":"2024-09-13T06:29:04.736070+0000","last_became_peered":"2024-09-13T06:29:04.736070+0000","last_unstale":"2024-09-13T06:33:05.867420+0000","last_undegraded":"2024-09-13T06:33:05.867420+0000","last_fullsized":"2024-09-13T06:33:05.867420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:33:05.867149+0000","last_clean_scrub_stamp":"2024-09-13T06:33:05.867149+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:29.643610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.863795+0000","last_change":"2024-09-13T06:33:03.863795+0000","last_active":"2024-09-13T06:33:03.863795+0000","last_peered":"2024-09-13T06:33:03.863795+0000","last_clean":"2024-09-13T06:33:03.863795+0000","last_became_active":"2024-09-13T06:29:06.752545+0000","last_became_peered":"2024-09-13T06:29:06.752545+0000","last_unstale":"2024-09-13T06:33:03.863795+0000","last_undegraded":"2024-09-13T06:33:03.863795+0000","last_fullsized":"2024-09-13T06:33:03.863795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.863544+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:06.532657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:59.059962+0000","last_change":"2024-09-13T06:33:59.059962+0000","last_active":"2024-09-13T06:33:59.059962+0000","last_peered":"2024-09-13T06:33:59.059962+0000","last_clean":"2024-09-13T06:33:59.059962+0000","last_became_active":"2024-09-13T06:29:08.773480+0000","last_became_peered":"2024-09-13T06:29:08.773480+0000","last_unstale":"2024-09-13T06:33:59.059962+0000","last_undegraded":"2024-09-13T06:33:59.059962+0000","last_fullsized":"2024-09-13T06:33:59.059962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:59.059695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:59.059695+0000","last_clean_scrub_stamp":"2024-09-13T06:33:59.059695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:47.266322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:28.091149+0000","last_change":"2024-09-13T06:33:28.091149+0000","last_active":"2024-09-13T06:33:28.091149+0000","last_peered":"2024-09-13T06:33:28.091149+0000","last_clean":"2024-09-13T06:33:28.091149+0000","last_became_active":"2024-09-13T06:29:00.715045+0000","last_became_peered":"2024-09-13T06:29:00.715045+0000","last_unstale":"2024-09-13T06:33:28.091149+0000","last_undegraded":"2024-09-13T06:33:28.091149+0000","last_fullsized":"2024-09-13T06:33:28.091149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:28.090907+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:28.090907+0000","last_clean_scrub_stamp":"2024-09-13T06:33:28.090907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:08.553807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:48.013769+0000","last_change":"2024-09-13T06:33:48.013769+0000","last_active":"2024-09-13T06:33:48.013769+0000","last_peered":"2024-09-13T06:33:48.013769+0000","last_clean":"2024-09-13T06:33:48.013769+0000","last_became_active":"2024-09-13T06:28:58.705866+0000","last_became_peered":"2024-09-13T06:28:58.705866+0000","last_unstale":"2024-09-13T06:33:48.013769+0000","last_undegraded":"2024-09-13T06:33:48.013769+0000","last_fullsized":"2024-09-13T06:33:48.013769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:48.013512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:48.013512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:48.013512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:23.000202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.931847+0000","last_change":"2024-09-13T06:33:13.931847+0000","last_active":"2024-09-13T06:33:13.931847+0000","last_peered":"2024-09-13T06:33:13.931847+0000","last_clean":"2024-09-13T06:33:13.931847+0000","last_became_active":"2024-09-13T06:29:02.714480+0000","last_became_peered":"2024-09-13T06:29:02.714480+0000","last_unstale":"2024-09-13T06:33:13.931847+0000","last_undegraded":"2024-09-13T06:33:13.931847+0000","last_fullsized":"2024-09-13T06:33:13.931847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:13.931595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:13.931595+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.931595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:35.944731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"35'36","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:02.274362+0000","last_change":"2024-09-13T06:33:02.274362+0000","last_active":"2024-09-13T06:33:02.274362+0000","last_peered":"2024-09-13T06:33:02.274362+0000","last_clean":"2024-09-13T06:33:02.274362+0000","last_became_active":"2024-09-13T06:29:04.727954+0000","last_became_peered":"2024-09-13T06:29:04.727954+0000","last_unstale":"2024-09-13T06:33:02.274362+0000","last_undegraded":"2024-09-13T06:33:02.274362+0000","last_fullsized":"2024-09-13T06:33:02.274362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:33:02.274058+0000","last_clean_scrub_stamp":"2024-09-13T06:33:02.274058+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:13.067392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:14.898055+0000","last_change":"2024-09-13T06:33:14.898055+0000","last_active":"2024-09-13T06:33:14.898055+0000","last_peered":"2024-09-13T06:33:14.898055+0000","last_clean":"2024-09-13T06:33:14.898055+0000","last_became_active":"2024-09-13T06:29:06.773727+0000","last_became_peered":"2024-09-13T06:29:06.773727+0000","last_unstale":"2024-09-13T06:33:14.898055+0000","last_undegraded":"2024-09-13T06:33:14.898055+0000","last_fullsized":"2024-09-13T06:33:14.898055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:14.897808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:14.897808+0000","last_clean_scrub_stamp":"2024-09-13T06:33:14.897808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:23:16.950204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:02.855722+0000","last_change":"2024-09-13T06:34:02.855790+0000","last_active":"2024-09-13T06:34:02.855722+0000","last_peered":"2024-09-13T06:34:02.855722+0000","last_clean":"2024-09-13T06:34:02.855722+0000","last_became_active":"2024-09-13T06:29:08.791221+0000","last_became_peered":"2024-09-13T06:29:08.791221+0000","last_unstale":"2024-09-13T06:34:02.855722+0000","last_undegraded":"2024-09-13T06:34:02.855722+0000","last_fullsized":"2024-09-13T06:34:02.855722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:34:02.855526+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:34:02.855526+0000","last_clean_scrub_stamp":"2024-09-13T06:34:02.855526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:09.615440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.945840+0000","last_change":"2024-09-13T06:33:27.945840+0000","last_active":"2024-09-13T06:33:27.945840+0000","last_peered":"2024-09-13T06:33:27.945840+0000","last_clean":"2024-09-13T06:33:27.945840+0000","last_became_active":"2024-09-13T06:29:00.709375+0000","last_became_peered":"2024-09-13T06:29:00.709375+0000","last_unstale":"2024-09-13T06:33:27.945840+0000","last_undegraded":"2024-09-13T06:33:27.945840+0000","last_fullsized":"2024-09-13T06:33:27.945840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:27.945583+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:27.945583+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.945583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:33.066698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:39.831973+0000","last_change":"2024-09-13T06:33:39.832075+0000","last_active":"2024-09-13T06:33:39.831973+0000","last_peered":"2024-09-13T06:33:39.831973+0000","last_clean":"2024-09-13T06:33:39.831973+0000","last_became_active":"2024-09-13T06:28:58.728310+0000","last_became_peered":"2024-09-13T06:28:58.728310+0000","last_unstale":"2024-09-13T06:33:39.831973+0000","last_undegraded":"2024-09-13T06:33:39.831973+0000","last_fullsized":"2024-09-13T06:33:39.831973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:39.831716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:39.831716+0000","last_clean_scrub_stamp":"2024-09-13T06:33:39.831716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:56.636121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:07.607668+0000","last_change":"2024-09-13T06:33:07.607668+0000","last_active":"2024-09-13T06:33:07.607668+0000","last_peered":"2024-09-13T06:33:07.607668+0000","last_clean":"2024-09-13T06:33:07.607668+0000","last_became_active":"2024-09-13T06:29:02.730763+0000","last_became_peered":"2024-09-13T06:29:02.730763+0000","last_unstale":"2024-09-13T06:33:07.607668+0000","last_undegraded":"2024-09-13T06:33:07.607668+0000","last_fullsized":"2024-09-13T06:33:07.607668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:07.607411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:07.607411+0000","last_clean_scrub_stamp":"2024-09-13T06:33:07.607411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:38.467546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'31","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.922559+0000","last_change":"2024-09-13T06:32:51.922559+0000","last_active":"2024-09-13T06:32:51.922559+0000","last_peered":"2024-09-13T06:32:51.922559+0000","last_clean":"2024-09-13T06:32:51.922559+0000","last_became_active":"2024-09-13T06:29:04.748658+0000","last_became_peered":"2024-09-13T06:29:04.748658+0000","last_unstale":"2024-09-13T06:32:51.922559+0000","last_undegraded":"2024-09-13T06:32:51.922559+0000","last_fullsized":"2024-09-13T06:32:51.922559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31","last_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_deep_scrub":"35'31","last_deep_scrub_stamp":"2024-09-13T06:32:51.922288+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.922288+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:42.602059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:03.849171+0000","last_change":"2024-09-13T06:33:03.849171+0000","last_active":"2024-09-13T06:33:03.849171+0000","last_peered":"2024-09-13T06:33:03.849171+0000","last_clean":"2024-09-13T06:33:03.849171+0000","last_became_active":"2024-09-13T06:29:06.744365+0000","last_became_peered":"2024-09-13T06:29:06.744365+0000","last_unstale":"2024-09-13T06:33:03.849171+0000","last_undegraded":"2024-09-13T06:33:03.849171+0000","last_fullsized":"2024-09-13T06:33:03.849171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:03.848950+0000","last_clean_scrub_stamp":"2024-09-13T06:33:03.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:53.988212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:59.750050+0000","last_change":"2024-09-13T06:33:59.750050+0000","last_active":"2024-09-13T06:33:59.750050+0000","last_peered":"2024-09-13T06:33:59.750050+0000","last_clean":"2024-09-13T06:33:59.750050+0000","last_became_active":"2024-09-13T06:29:08.791063+0000","last_became_peered":"2024-09-13T06:29:08.791063+0000","last_unstale":"2024-09-13T06:33:59.750050+0000","last_undegraded":"2024-09-13T06:33:59.750050+0000","last_fullsized":"2024-09-13T06:33:59.750050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:59.749785+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:59.749785+0000","last_clean_scrub_stamp":"2024-09-13T06:33:59.749785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:58:46.074633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'16","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:21.041537+0000","last_change":"2024-09-13T06:33:21.041537+0000","last_active":"2024-09-13T06:33:21.041537+0000","last_peered":"2024-09-13T06:33:21.041537+0000","last_clean":"2024-09-13T06:33:21.041537+0000","last_became_active":"2024-09-13T06:29:00.722375+0000","last_became_peered":"2024-09-13T06:29:00.722375+0000","last_unstale":"2024-09-13T06:33:21.041537+0000","last_undegraded":"2024-09-13T06:33:21.041537+0000","last_fullsized":"2024-09-13T06:33:21.041537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:33:21.041255+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:33:21.041255+0000","last_clean_scrub_stamp":"2024-09-13T06:33:21.041255+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:54.666853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"33'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:44.828095+0000","last_change":"2024-09-13T06:33:44.828245+0000","last_active":"2024-09-13T06:33:44.828095+0000","last_peered":"2024-09-13T06:33:44.828095+0000","last_clean":"2024-09-13T06:33:44.828095+0000","last_became_active":"2024-09-13T06:28:58.708846+0000","last_became_peered":"2024-09-13T06:28:58.708846+0000","last_unstale":"2024-09-13T06:33:44.828095+0000","last_undegraded":"2024-09-13T06:33:44.828095+0000","last_fullsized":"2024-09-13T06:33:44.828095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:44.827784+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:44.827784+0000","last_clean_scrub_stamp":"2024-09-13T06:33:44.827784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:13.508582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:04.629973+0000","last_change":"2024-09-13T06:33:04.629973+0000","last_active":"2024-09-13T06:33:04.629973+0000","last_peered":"2024-09-13T06:33:04.629973+0000","last_clean":"2024-09-13T06:33:04.629973+0000","last_became_active":"2024-09-13T06:29:02.730877+0000","last_became_peered":"2024-09-13T06:29:02.730877+0000","last_unstale":"2024-09-13T06:33:04.629973+0000","last_undegraded":"2024-09-13T06:33:04.629973+0000","last_fullsized":"2024-09-13T06:33:04.629973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:33:04.629731+0000","last_clean_scrub_stamp":"2024-09-13T06:33:04.629731+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:04.692060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:58.731638+0000","last_change":"2024-09-13T06:32:58.731638+0000","last_active":"2024-09-13T06:32:58.731638+0000","last_peered":"2024-09-13T06:32:58.731638+0000","last_clean":"2024-09-13T06:32:58.731638+0000","last_became_active":"2024-09-13T06:29:04.732099+0000","last_became_peered":"2024-09-13T06:29:04.732099+0000","last_unstale":"2024-09-13T06:32:58.731638+0000","last_undegraded":"2024-09-13T06:32:58.731638+0000","last_fullsized":"2024-09-13T06:32:58.731638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:32:58.731244+0000","last_clean_scrub_stamp":"2024-09-13T06:32:58.731244+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:01.400357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:32:51.185958+0000","last_change":"2024-09-13T06:32:51.185958+0000","last_active":"2024-09-13T06:32:51.185958+0000","last_peered":"2024-09-13T06:32:51.185958+0000","last_clean":"2024-09-13T06:32:51.185958+0000","last_became_active":"2024-09-13T06:29:06.775678+0000","last_became_peered":"2024-09-13T06:29:06.775678+0000","last_unstale":"2024-09-13T06:32:51.185958+0000","last_undegraded":"2024-09-13T06:32:51.185958+0000","last_fullsized":"2024-09-13T06:32:51.185958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:32:51.185604+0000","last_clean_scrub_stamp":"2024-09-13T06:32:51.185604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:56:49.642143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.096228+0000","last_change":"2024-09-13T06:33:31.096228+0000","last_active":"2024-09-13T06:33:31.096228+0000","last_peered":"2024-09-13T06:33:31.096228+0000","last_clean":"2024-09-13T06:33:31.096228+0000","last_became_active":"2024-09-13T06:29:08.769412+0000","last_became_peered":"2024-09-13T06:29:08.769412+0000","last_unstale":"2024-09-13T06:33:31.096228+0000","last_undegraded":"2024-09-13T06:33:31.096228+0000","last_fullsized":"2024-09-13T06:33:31.096228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:31.095990+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:31.095990+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.095990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:41.198579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.823591+0000","last_change":"2024-09-13T06:33:30.823656+0000","last_active":"2024-09-13T06:33:30.823591+0000","last_peered":"2024-09-13T06:33:30.823591+0000","last_clean":"2024-09-13T06:33:30.823591+0000","last_became_active":"2024-09-13T06:29:00.723574+0000","last_became_peered":"2024-09-13T06:29:00.723574+0000","last_unstale":"2024-09-13T06:33:30.823591+0000","last_undegraded":"2024-09-13T06:33:30.823591+0000","last_fullsized":"2024-09-13T06:33:30.823591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T06:33:30.823386+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T06:33:30.823386+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.823386+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:49.401595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:27.067199+0000","last_change":"2024-09-13T06:33:27.067258+0000","last_active":"2024-09-13T06:33:27.067199+0000","last_peered":"2024-09-13T06:33:27.067199+0000","last_clean":"2024-09-13T06:33:27.067199+0000","last_became_active":"2024-09-13T06:28:58.720705+0000","last_became_peered":"2024-09-13T06:28:58.720705+0000","last_unstale":"2024-09-13T06:33:27.067199+0000","last_undegraded":"2024-09-13T06:33:27.067199+0000","last_fullsized":"2024-09-13T06:33:27.067199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:27.066998+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:27.066998+0000","last_clean_scrub_stamp":"2024-09-13T06:33:27.066998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:52.009796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.837544+0000","last_change":"2024-09-13T06:33:24.837691+0000","last_active":"2024-09-13T06:33:24.837544+0000","last_peered":"2024-09-13T06:33:24.837544+0000","last_clean":"2024-09-13T06:33:24.837544+0000","last_became_active":"2024-09-13T06:29:00.721392+0000","last_became_peered":"2024-09-13T06:29:00.721392+0000","last_unstale":"2024-09-13T06:33:24.837544+0000","last_undegraded":"2024-09-13T06:33:24.837544+0000","last_fullsized":"2024-09-13T06:33:24.837544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:24.837307+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:24.837307+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.837307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:23.934356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.046267+0000","last_change":"2024-09-13T06:33:26.046329+0000","last_active":"2024-09-13T06:33:26.046267+0000","last_peered":"2024-09-13T06:33:26.046267+0000","last_clean":"2024-09-13T06:33:26.046267+0000","last_became_active":"2024-09-13T06:28:58.707777+0000","last_became_peered":"2024-09-13T06:28:58.707777+0000","last_unstale":"2024-09-13T06:33:26.046267+0000","last_undegraded":"2024-09-13T06:33:26.046267+0000","last_fullsized":"2024-09-13T06:33:26.046267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:26.046070+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:26.046070+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.046070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:20.651280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.117706+0000","last_change":"2024-09-13T06:33:38.117706+0000","last_active":"2024-09-13T06:33:38.117706+0000","last_peered":"2024-09-13T06:33:38.117706+0000","last_clean":"2024-09-13T06:33:38.117706+0000","last_became_active":"2024-09-13T06:29:39.516062+0000","last_became_peered":"2024-09-13T06:29:39.516062+0000","last_unstale":"2024-09-13T06:33:38.117706+0000","last_undegraded":"2024-09-13T06:33:38.117706+0000","last_fullsized":"2024-09-13T06:33:38.117706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:38.117422+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:38.117422+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.117422+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:47.641415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:50.722901+0000","last_change":"2024-09-13T06:33:50.722963+0000","last_active":"2024-09-13T06:33:50.722901+0000","last_peered":"2024-09-13T06:33:50.722901+0000","last_clean":"2024-09-13T06:33:50.722901+0000","last_became_active":"2024-09-13T06:28:58.711015+0000","last_became_peered":"2024-09-13T06:28:58.711015+0000","last_unstale":"2024-09-13T06:33:50.722901+0000","last_undegraded":"2024-09-13T06:33:50.722901+0000","last_fullsized":"2024-09-13T06:33:50.722901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:50.722698+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:50.722698+0000","last_clean_scrub_stamp":"2024-09-13T06:33:50.722698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:34.781684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'6","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.877803+0000","last_change":"2024-09-13T06:33:26.877864+0000","last_active":"2024-09-13T06:33:26.877803+0000","last_peered":"2024-09-13T06:33:26.877803+0000","last_clean":"2024-09-13T06:33:26.877803+0000","last_became_active":"2024-09-13T06:29:00.721130+0000","last_became_peered":"2024-09-13T06:29:00.721130+0000","last_unstale":"2024-09-13T06:33:26.877803+0000","last_undegraded":"2024-09-13T06:33:26.877803+0000","last_fullsized":"2024-09-13T06:33:26.877803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:26.877608+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.877608+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.877608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:37:11.045713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:22.062645+0000","last_change":"2024-09-13T06:33:22.062702+0000","last_active":"2024-09-13T06:33:22.062645+0000","last_peered":"2024-09-13T06:33:22.062645+0000","last_clean":"2024-09-13T06:33:22.062645+0000","last_became_active":"2024-09-13T06:28:58.721870+0000","last_became_peered":"2024-09-13T06:28:58.721870+0000","last_unstale":"2024-09-13T06:33:22.062645+0000","last_undegraded":"2024-09-13T06:33:22.062645+0000","last_fullsized":"2024-09-13T06:33:22.062645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:22.062429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:22.062429+0000","last_clean_scrub_stamp":"2024-09-13T06:33:22.062429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:05.066689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"35'22","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.111643+0000","last_change":"2024-09-13T06:33:36.111643+0000","last_active":"2024-09-13T06:33:36.111643+0000","last_peered":"2024-09-13T06:33:36.111643+0000","last_clean":"2024-09-13T06:33:36.111643+0000","last_became_active":"2024-09-13T06:29:39.502560+0000","last_became_peered":"2024-09-13T06:29:39.502560+0000","last_unstale":"2024-09-13T06:33:36.111643+0000","last_undegraded":"2024-09-13T06:33:36.111643+0000","last_fullsized":"2024-09-13T06:33:36.111643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:33:36.111388+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:33:36.111388+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.111388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:49.313244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.890275+0000","last_change":"2024-09-13T06:33:32.890326+0000","last_active":"2024-09-13T06:33:32.890275+0000","last_peered":"2024-09-13T06:33:32.890275+0000","last_clean":"2024-09-13T06:33:32.890275+0000","last_became_active":"2024-09-13T06:28:58.717916+0000","last_became_peered":"2024-09-13T06:28:58.717916+0000","last_unstale":"2024-09-13T06:33:32.890275+0000","last_undegraded":"2024-09-13T06:33:32.890275+0000","last_fullsized":"2024-09-13T06:33:32.890275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:32.890090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:32.890090+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.890090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:13.352990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'10","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:32.767417+0000","last_change":"2024-09-13T06:33:32.767478+0000","last_active":"2024-09-13T06:33:32.767417+0000","last_peered":"2024-09-13T06:33:32.767417+0000","last_clean":"2024-09-13T06:33:32.767417+0000","last_became_active":"2024-09-13T06:29:00.723621+0000","last_became_peered":"2024-09-13T06:29:00.723621+0000","last_unstale":"2024-09-13T06:33:32.767417+0000","last_undegraded":"2024-09-13T06:33:32.767417+0000","last_fullsized":"2024-09-13T06:33:32.767417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:32.767197+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:32.767197+0000","last_clean_scrub_stamp":"2024-09-13T06:33:32.767197+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:58:34.425175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:29.773785+0000","last_change":"2024-09-13T06:33:29.773840+0000","last_active":"2024-09-13T06:33:29.773785+0000","last_peered":"2024-09-13T06:33:29.773785+0000","last_clean":"2024-09-13T06:33:29.773785+0000","last_became_active":"2024-09-13T06:28:58.730300+0000","last_became_peered":"2024-09-13T06:28:58.730300+0000","last_unstale":"2024-09-13T06:33:29.773785+0000","last_undegraded":"2024-09-13T06:33:29.773785+0000","last_fullsized":"2024-09-13T06:33:29.773785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:29.773588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:29.773588+0000","last_clean_scrub_stamp":"2024-09-13T06:33:29.773588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:14.414714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.973311+0000","last_change":"2024-09-13T06:33:24.973365+0000","last_active":"2024-09-13T06:33:24.973311+0000","last_peered":"2024-09-13T06:33:24.973311+0000","last_clean":"2024-09-13T06:33:24.973311+0000","last_became_active":"2024-09-13T06:29:00.716344+0000","last_became_peered":"2024-09-13T06:29:00.716344+0000","last_unstale":"2024-09-13T06:33:24.973311+0000","last_undegraded":"2024-09-13T06:33:24.973311+0000","last_fullsized":"2024-09-13T06:33:24.973311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:24.973113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:24.973113+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.973113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:37.936190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:24.040708+0000","last_change":"2024-09-13T06:33:24.040796+0000","last_active":"2024-09-13T06:33:24.040708+0000","last_peered":"2024-09-13T06:33:24.040708+0000","last_clean":"2024-09-13T06:33:24.040708+0000","last_became_active":"2024-09-13T06:28:58.707165+0000","last_became_peered":"2024-09-13T06:28:58.707165+0000","last_unstale":"2024-09-13T06:33:24.040708+0000","last_undegraded":"2024-09-13T06:33:24.040708+0000","last_fullsized":"2024-09-13T06:33:24.040708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:24.040517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:24.040517+0000","last_clean_scrub_stamp":"2024-09-13T06:33:24.040517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:50.780198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'10","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:30.114852+0000","last_change":"2024-09-13T06:33:30.114911+0000","last_active":"2024-09-13T06:33:30.114852+0000","last_peered":"2024-09-13T06:33:30.114852+0000","last_clean":"2024-09-13T06:33:30.114852+0000","last_became_active":"2024-09-13T06:29:00.711538+0000","last_became_peered":"2024-09-13T06:29:00.711538+0000","last_unstale":"2024-09-13T06:33:30.114852+0000","last_undegraded":"2024-09-13T06:33:30.114852+0000","last_fullsized":"2024-09-13T06:33:30.114852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T06:33:30.114659+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T06:33:30.114659+0000","last_clean_scrub_stamp":"2024-09-13T06:33:30.114659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:55.576143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.803610+0000","last_change":"2024-09-13T06:33:37.803674+0000","last_active":"2024-09-13T06:33:37.803610+0000","last_peered":"2024-09-13T06:33:37.803610+0000","last_clean":"2024-09-13T06:33:37.803610+0000","last_became_active":"2024-09-13T06:28:58.724880+0000","last_became_peered":"2024-09-13T06:28:58.724880+0000","last_unstale":"2024-09-13T06:33:37.803610+0000","last_undegraded":"2024-09-13T06:33:37.803610+0000","last_fullsized":"2024-09-13T06:33:37.803610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:37.803422+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:37.803422+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.803422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:47.227293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.854840+0000","last_change":"2024-09-13T06:33:25.854840+0000","last_active":"2024-09-13T06:33:25.854840+0000","last_peered":"2024-09-13T06:33:25.854840+0000","last_clean":"2024-09-13T06:33:25.854840+0000","last_became_active":"2024-09-13T06:29:00.709857+0000","last_became_peered":"2024-09-13T06:29:00.709857+0000","last_unstale":"2024-09-13T06:33:25.854840+0000","last_undegraded":"2024-09-13T06:33:25.854840+0000","last_fullsized":"2024-09-13T06:33:25.854840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:25.854592+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:25.854592+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.854592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:41:47.867728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'4","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:54.874256+0000","last_change":"2024-09-13T06:33:54.874256+0000","last_active":"2024-09-13T06:33:54.874256+0000","last_peered":"2024-09-13T06:33:54.874256+0000","last_clean":"2024-09-13T06:33:54.874256+0000","last_became_active":"2024-09-13T06:29:39.507699+0000","last_became_peered":"2024-09-13T06:29:39.507699+0000","last_unstale":"2024-09-13T06:33:54.874256+0000","last_undegraded":"2024-09-13T06:33:54.874256+0000","last_fullsized":"2024-09-13T06:33:54.874256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:33:54.873897+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:33:54.873897+0000","last_clean_scrub_stamp":"2024-09-13T06:33:54.873897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:52.445292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"35'22","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:55.805781+0000","last_change":"2024-09-13T06:33:55.805841+0000","last_active":"2024-09-13T06:33:55.805781+0000","last_peered":"2024-09-13T06:33:55.805781+0000","last_clean":"2024-09-13T06:33:55.805781+0000","last_became_active":"2024-09-13T06:29:00.707752+0000","last_became_peered":"2024-09-13T06:29:00.707752+0000","last_unstale":"2024-09-13T06:33:55.805781+0000","last_undegraded":"2024-09-13T06:33:55.805781+0000","last_fullsized":"2024-09-13T06:33:55.805781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:33:55.805581+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:33:55.805581+0000","last_clean_scrub_stamp":"2024-09-13T06:33:55.805581+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:05:06.723410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:47.699409+0000","last_change":"2024-09-13T06:33:47.699466+0000","last_active":"2024-09-13T06:33:47.699409+0000","last_peered":"2024-09-13T06:33:47.699409+0000","last_clean":"2024-09-13T06:33:47.699409+0000","last_became_active":"2024-09-13T06:28:58.704346+0000","last_became_peered":"2024-09-13T06:28:58.704346+0000","last_unstale":"2024-09-13T06:33:47.699409+0000","last_undegraded":"2024-09-13T06:33:47.699409+0000","last_fullsized":"2024-09-13T06:33:47.699409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:47.699219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:47.699219+0000","last_clean_scrub_stamp":"2024-09-13T06:33:47.699219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:45.270614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:18.038770+0000","last_change":"2024-09-13T06:33:18.038770+0000","last_active":"2024-09-13T06:33:18.038770+0000","last_peered":"2024-09-13T06:33:18.038770+0000","last_clean":"2024-09-13T06:33:18.038770+0000","last_became_active":"2024-09-13T06:29:00.702549+0000","last_became_peered":"2024-09-13T06:29:00.702549+0000","last_unstale":"2024-09-13T06:33:18.038770+0000","last_undegraded":"2024-09-13T06:33:18.038770+0000","last_fullsized":"2024-09-13T06:33:18.038770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:18.038512+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:18.038512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:18.038512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:32.926333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:34:02.100005+0000","last_change":"2024-09-13T06:34:02.100061+0000","last_active":"2024-09-13T06:34:02.100005+0000","last_peered":"2024-09-13T06:34:02.100005+0000","last_clean":"2024-09-13T06:34:02.100005+0000","last_became_active":"2024-09-13T06:29:39.511124+0000","last_became_peered":"2024-09-13T06:29:39.511124+0000","last_unstale":"2024-09-13T06:34:02.100005+0000","last_undegraded":"2024-09-13T06:34:02.100005+0000","last_fullsized":"2024-09-13T06:34:02.100005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:34:02.099816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:34:02.099816+0000","last_clean_scrub_stamp":"2024-09-13T06:34:02.099816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:44.788883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'22","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:13.613487+0000","last_change":"2024-09-13T06:33:13.613487+0000","last_active":"2024-09-13T06:33:13.613487+0000","last_peered":"2024-09-13T06:33:13.613487+0000","last_clean":"2024-09-13T06:33:13.613487+0000","last_became_active":"2024-09-13T06:29:00.731838+0000","last_became_peered":"2024-09-13T06:29:00.731838+0000","last_unstale":"2024-09-13T06:33:13.613487+0000","last_undegraded":"2024-09-13T06:33:13.613487+0000","last_fullsized":"2024-09-13T06:33:13.613487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:33:13.613227+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:33:13.613227+0000","last_clean_scrub_stamp":"2024-09-13T06:33:13.613227+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:19.840240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.691779+0000","last_change":"2024-09-13T06:33:35.691835+0000","last_active":"2024-09-13T06:33:35.691779+0000","last_peered":"2024-09-13T06:33:35.691779+0000","last_clean":"2024-09-13T06:33:35.691779+0000","last_became_active":"2024-09-13T06:28:58.716340+0000","last_became_peered":"2024-09-13T06:28:58.716340+0000","last_unstale":"2024-09-13T06:33:35.691779+0000","last_undegraded":"2024-09-13T06:33:35.691779+0000","last_fullsized":"2024-09-13T06:33:35.691779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:35.691591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:35.691591+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.691591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:58.329653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'6","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:26.035852+0000","last_change":"2024-09-13T06:33:26.035852+0000","last_active":"2024-09-13T06:33:26.035852+0000","last_peered":"2024-09-13T06:33:26.035852+0000","last_clean":"2024-09-13T06:33:26.035852+0000","last_became_active":"2024-09-13T06:29:00.715041+0000","last_became_peered":"2024-09-13T06:29:00.715041+0000","last_unstale":"2024-09-13T06:33:26.035852+0000","last_undegraded":"2024-09-13T06:33:26.035852+0000","last_fullsized":"2024-09-13T06:33:26.035852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:33:26.035608+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:33:26.035608+0000","last_clean_scrub_stamp":"2024-09-13T06:33:26.035608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:46.324701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:31.896327+0000","last_change":"2024-09-13T06:33:31.896388+0000","last_active":"2024-09-13T06:33:31.896327+0000","last_peered":"2024-09-13T06:33:31.896327+0000","last_clean":"2024-09-13T06:33:31.896327+0000","last_became_active":"2024-09-13T06:28:58.720695+0000","last_became_peered":"2024-09-13T06:28:58.720695+0000","last_unstale":"2024-09-13T06:33:31.896327+0000","last_undegraded":"2024-09-13T06:33:31.896327+0000","last_fullsized":"2024-09-13T06:33:31.896327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:31.896110+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:31.896110+0000","last_clean_scrub_stamp":"2024-09-13T06:33:31.896110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:54.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:20.702980+0000","last_change":"2024-09-13T06:33:20.702980+0000","last_active":"2024-09-13T06:33:20.702980+0000","last_peered":"2024-09-13T06:33:20.702980+0000","last_clean":"2024-09-13T06:33:20.702980+0000","last_became_active":"2024-09-13T06:29:00.729094+0000","last_became_peered":"2024-09-13T06:29:00.729094+0000","last_unstale":"2024-09-13T06:33:20.702980+0000","last_undegraded":"2024-09-13T06:33:20.702980+0000","last_fullsized":"2024-09-13T06:33:20.702980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:20.702727+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:20.702727+0000","last_clean_scrub_stamp":"2024-09-13T06:33:20.702727+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:41.365268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:38.811394+0000","last_change":"2024-09-13T06:33:38.811495+0000","last_active":"2024-09-13T06:33:38.811394+0000","last_peered":"2024-09-13T06:33:38.811394+0000","last_clean":"2024-09-13T06:33:38.811394+0000","last_became_active":"2024-09-13T06:28:58.720047+0000","last_became_peered":"2024-09-13T06:28:58.720047+0000","last_unstale":"2024-09-13T06:33:38.811394+0000","last_undegraded":"2024-09-13T06:33:38.811394+0000","last_fullsized":"2024-09-13T06:33:38.811394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:33:38.811108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:33:38.811108+0000","last_clean_scrub_stamp":"2024-09-13T06:33:38.811108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:51:20.454962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:23.929692+0000","last_change":"2024-09-13T06:33:23.929692+0000","last_active":"2024-09-13T06:33:23.929692+0000","last_peered":"2024-09-13T06:33:23.929692+0000","last_clean":"2024-09-13T06:33:23.929692+0000","last_became_active":"2024-09-13T06:29:00.722565+0000","last_became_peered":"2024-09-13T06:29:00.722565+0000","last_unstale":"2024-09-13T06:33:23.929692+0000","last_undegraded":"2024-09-13T06:33:23.929692+0000","last_fullsized":"2024-09-13T06:33:23.929692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:23.929409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:23.929409+0000","last_clean_scrub_stamp":"2024-09-13T06:33:23.929409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:04:42.507618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.029352+0000","last_change":"2024-09-13T06:33:25.029352+0000","last_active":"2024-09-13T06:33:25.029352+0000","last_peered":"2024-09-13T06:33:25.029352+0000","last_clean":"2024-09-13T06:33:25.029352+0000","last_became_active":"2024-09-13T06:28:58.707159+0000","last_became_peered":"2024-09-13T06:28:58.707159+0000","last_unstale":"2024-09-13T06:33:25.029352+0000","last_undegraded":"2024-09-13T06:33:25.029352+0000","last_fullsized":"2024-09-13T06:33:25.029352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:25.029092+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:25.029092+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.029092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:58.332786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:25.051952+0000","last_change":"2024-09-13T06:33:25.052020+0000","last_active":"2024-09-13T06:33:25.051952+0000","last_peered":"2024-09-13T06:33:25.051952+0000","last_clean":"2024-09-13T06:33:25.051952+0000","last_became_active":"2024-09-13T06:29:00.716037+0000","last_became_peered":"2024-09-13T06:29:00.716037+0000","last_unstale":"2024-09-13T06:33:25.051952+0000","last_undegraded":"2024-09-13T06:33:25.051952+0000","last_fullsized":"2024-09-13T06:33:25.051952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:33:25.051763+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:33:25.051763+0000","last_clean_scrub_stamp":"2024-09-13T06:33:25.051763+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:43.405467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:36.805101+0000","last_change":"2024-09-13T06:33:36.805101+0000","last_active":"2024-09-13T06:33:36.805101+0000","last_peered":"2024-09-13T06:33:36.805101+0000","last_clean":"2024-09-13T06:33:36.805101+0000","last_became_active":"2024-09-13T06:28:58.719650+0000","last_became_peered":"2024-09-13T06:28:58.719650+0000","last_unstale":"2024-09-13T06:33:36.805101+0000","last_undegraded":"2024-09-13T06:33:36.805101+0000","last_fullsized":"2024-09-13T06:33:36.805101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:36.804846+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:36.804846+0000","last_clean_scrub_stamp":"2024-09-13T06:33:36.804846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:51.629962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"35'2","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:56.079890+0000","last_change":"2024-09-13T06:33:56.079952+0000","last_active":"2024-09-13T06:33:56.079890+0000","last_peered":"2024-09-13T06:33:56.079890+0000","last_clean":"2024-09-13T06:33:56.079890+0000","last_became_active":"2024-09-13T06:28:58.704607+0000","last_became_peered":"2024-09-13T06:28:58.704607+0000","last_unstale":"2024-09-13T06:33:56.079890+0000","last_undegraded":"2024-09-13T06:33:56.079890+0000","last_fullsized":"2024-09-13T06:33:56.079890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:33:56.079705+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:33:56.079705+0000","last_clean_scrub_stamp":"2024-09-13T06:33:56.079705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:50.073703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:09.195428+0000","last_change":"2024-09-13T06:33:09.195428+0000","last_active":"2024-09-13T06:33:09.195428+0000","last_peered":"2024-09-13T06:33:09.195428+0000","last_clean":"2024-09-13T06:33:09.195428+0000","last_became_active":"2024-09-13T06:29:00.708800+0000","last_became_peered":"2024-09-13T06:29:00.708800+0000","last_unstale":"2024-09-13T06:33:09.195428+0000","last_undegraded":"2024-09-13T06:33:09.195428+0000","last_fullsized":"2024-09-13T06:33:09.195428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T06:33:09.195134+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T06:33:09.195134+0000","last_clean_scrub_stamp":"2024-09-13T06:33:09.195134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:24.446576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:37.751132+0000","last_change":"2024-09-13T06:33:37.751132+0000","last_active":"2024-09-13T06:33:37.751132+0000","last_peered":"2024-09-13T06:33:37.751132+0000","last_clean":"2024-09-13T06:33:37.751132+0000","last_became_active":"2024-09-13T06:28:58.716272+0000","last_became_peered":"2024-09-13T06:28:58.716272+0000","last_unstale":"2024-09-13T06:33:37.751132+0000","last_undegraded":"2024-09-13T06:33:37.751132+0000","last_fullsized":"2024-09-13T06:33:37.751132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:33:37.750898+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:33:37.750898+0000","last_clean_scrub_stamp":"2024-09-13T06:33:37.750898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"35'10","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:33:35.156762+0000","last_change":"2024-09-13T06:33:35.156921+0000","last_active":"2024-09-13T06:33:35.156762+0000","last_peered":"2024-09-13T06:33:35.156762+0000","last_clean":"2024-09-13T06:33:35.156762+0000","last_became_active":"2024-09-13T06:29:39.514172+0000","last_became_peered":"2024-09-13T06:29:39.514172+0000","last_unstale":"2024-09-13T06:33:35.156762+0000","last_undegraded":"2024-09-13T06:33:35.156762+0000","last_fullsized":"2024-09-13T06:33:35.156762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:33:35.156512+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:33:35.156512+0000","last_clean_scrub_stamp":"2024-09-13T06:33:35.156512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:55.781468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673028,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":446464,"data_stored":151533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673029,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":740673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":742577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":153065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:34:11.992 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T06:34:12.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f9fd3640 1 Processor -- start 2024-09-13T06:34:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f9fd3640 1 -- start start 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f9fd3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31f40702c0 0x7f31f4130800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f9fd3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f4127f00 con 0x7f31f41283a0 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f9fd3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f31f4073360 con 0x7f31f40702c0 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f31f41283a0 0x7f31f4128780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41786/0 (socket says 172.21.15.112:41786) 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f37fe640 1 -- 172.21.15.112:0/1567533970 learned_addr learned my addr 172.21.15.112:0/1567533970 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f2ffd640 1 --2- 172.21.15.112:0/1567533970 >> v2:172.21.15.112:3300/0 conn(0x7f31f40702c0 0x7f31f4130800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f27fc640 1 -- 172.21.15.112:0/1567533970 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364304034 0 0) 0x7f31f4127f00 con 0x7f31f41283a0 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f27fc640 1 -- 172.21.15.112:0/1567533970 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31d4003530 con 0x7f31f41283a0 2024-09-13T06:34:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f2ffd640 1 -- 172.21.15.112:0/1567533970 >> v1:172.21.15.112:6789/0 conn(0x7f31f41283a0 legacy=0x7f31f4128780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f2ffd640 1 -- 172.21.15.112:0/1567533970 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f41281a0 con 0x7f31f40702c0 2024-09-13T06:34:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f2ffd640 1 --2- 172.21.15.112:0/1567533970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f4130800 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009740 tx=0x7f31dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7597b47c9f74aab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:34:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f27fc640 1 -- 172.21.15.112:0/1567533970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0b0070 con 0x7f31f40702c0 2024-09-13T06:34:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f27fc640 1 -- 172.21.15.112:0/1567533970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0ab530 con 0x7f31f40702c0 2024-09-13T06:34:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.141+0000 7f31f27fc640 1 -- 172.21.15.112:0/1567533970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0ab830 con 0x7f31f40702c0 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1567533970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 msgr2=0x7f31f4130800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 --2- 172.21.15.112:0/1567533970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f4130800 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009740 tx=0x7f31dc01c370 comp rx=0 tx=0).stop 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1567533970 shutdown_connections 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 --2- 172.21.15.112:0/1567533970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f4130800 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1567533970 >> 172.21.15.112:0/1567533970 conn(0x7f31f409a8a0 msgr2=0x7f31f409acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1567533970 shutdown_connections 2024-09-13T06:34:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1567533970 wait complete. 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 Processor -- start 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- start start 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f412c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41338f0 con 0x7f31f40702c0 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f412c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f412c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54536/0 (socket says 172.21.15.112:54536) 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f37fe640 1 -- 172.21.15.112:0/1879123445 learned_addr learned my addr 172.21.15.112:0/1879123445 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f37fe640 1 -- 172.21.15.112:0/1879123445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f4124c30 con 0x7f31f40702c0 2024-09-13T06:34:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f37fe640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f412c5d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f31e400e8c0 tx=0x7f31e400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:34:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4015070 con 0x7f31f40702c0 2024-09-13T06:34:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4005af0 con 0x7f31f40702c0 2024-09-13T06:34:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f412dcb0 con 0x7f31f40702c0 2024-09-13T06:34:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4005df0 con 0x7f31f40702c0 2024-09-13T06:34:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f412cb10 con 0x7f31f40702c0 2024-09-13T06:34:12.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f4125540 con 0x7f31f40702c0 2024-09-13T06:34:12.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31e4018070 con 0x7f31f40702c0 2024-09-13T06:34:12.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31ebfff640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f31d8035db0 0x7f31d8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:34:12.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.145+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6025+0+0 (secure 0 0 0) 0x7f31e404b5d0 con 0x7f31f40702c0 2024-09-13T06:34:12.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.149+0000 7f31f2ffd640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f31d8035db0 0x7f31d8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:34:12.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.149+0000 7f31f2ffd640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f31d8035db0 0x7f31d8038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0ad000 tx=0x7f31dc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:34:12.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.153+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31e400c920 con 0x7f31f40702c0 2024-09-13T06:34:12.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.313+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f31f406bc50 con 0x7f31f40702c0 2024-09-13T06:34:12.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.317+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f31e4007070 con 0x7f31f40702c0 2024-09-13T06:34:12.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.317+0000 7f31ebfff640 1 -- 172.21.15.112:0/1879123445 <== mon.0 v2:172.21.15.112:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f31e400cbf0 con 0x7f31f40702c0 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f31d8035db0 msgr2=0x7f31d8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f31d8035db0 0x7f31d8038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0ad000 tx=0x7f31dc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 msgr2=0x7f31f412c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f412c5d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f31e400e8c0 tx=0x7f31e400ed80 comp rx=0 tx=0).stop 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 shutdown_connections 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.169:6824/2981546611,v1:172.21.15.169:6825/2981546611] conn(0x7f31d8035db0 0x7f31d8038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 --2- 172.21.15.112:0/1879123445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31f40702c0 0x7f31f412c5d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:34:12.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 >> 172.21.15.112:0/1879123445 conn(0x7f31f409a8a0 msgr2=0x7f31f40973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:34:12.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 shutdown_connections 2024-09-13T06:34:12.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-13T06:34:12.321+0000 7f31f9fd3640 1 -- 172.21.15.112:0/1879123445 wait complete. 2024-09-13T06:34:12.341 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T06:34:12.341 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T06:34:12.341 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T06:34:12.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:34:12.439 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T06:34:12.439 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T06:34:12.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:34:12.518 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T06:34:12.518 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T06:34:12.518 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:34:12.607 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T06:34:12.608 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T06:34:12.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:34:12.684 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T06:34:12.684 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T06:34:12.685 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T06:34:12.685 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:34:12.713 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T06:34:12.713 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T06:34:12.713 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T06:34:12.713 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:34:12.734 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T06:34:12.734 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T06:34:12.735 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T06:34:12.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-13T06:34:12.794 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T06:34:13.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:34:13.233 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T06:34:13.469 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:34:13.469 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T06:34:13.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:34:13.638 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T06:34:13.777 INFO:tasks.ceph:Archiving mon data... 2024-09-13T06:34:13.778 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/data/mon.a.tgz 2024-09-13T06:34:13.778 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-13T06:34:13.784 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.1DCTZUTFFu 2024-09-13T06:34:13.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1DCTZUTFFu 2024-09-13T06:34:13.904 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.1DCTZUTFFu 2024-09-13T06:34:13.966 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.1DCTZUTFFu is 274KB 2024-09-13T06:34:14.024 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.1DCTZUTFFu 2024-09-13T06:34:14.030 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T06:34:14.030 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T06:34:14.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T06:34:14.135 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T06:34:14.141 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T06:34:14.141 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T06:34:14.142 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/remote/smithi112/crash 2024-09-13T06:34:14.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T06:34:14.191 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/remote/smithi169/crash 2024-09-13T06:34:14.192 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T06:34:14.206 INFO:tasks.ceph:Compressing logs... 2024-09-13T06:34:14.206 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T06:34:14.236 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T06:34:14.263 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25501.log 2024-09-13T06:34:14.264 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25748.log 2024-09-13T06:34:14.264 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24983.log 2024-09-13T06:34:14.265 INFO:teuthology.orchestra.run.smithi112.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25501.log.gz 2024-09-13T06:34:14.265 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25148.log 2024-09-13T06:34:14.265 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25748.log.gz 2024-09-13T06:34:14.266 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.24983.log: /var/log/ceph/ceph-client.admin.25148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25252.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25148.log.gz 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.0.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24983.log.gz 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25982.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25617.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25932.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.25252.log.gz 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25982.log.gz 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25774.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25617.log.gz 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23784.log 2024-09-13T06:34:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25774.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25932.log.gz 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22926.log 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25774.log.gz 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.23784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25356.log 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23784.log.gz 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25059.log 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22926.log.gz 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25149.log 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25356.log.gz 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25059.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25059.log.gz 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22816.log 2024-09-13T06:34:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.a.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25149.log.gz 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25800.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.22816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25696.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.22816.log.gz 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25039.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25800.log.gz 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25958.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25826.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.25696.log.gz 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25958.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.25039.log.gz 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25251.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25958.log.gz 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25852.log 2024-09-13T06:34:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25251.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25826.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25539.log 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.25251.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25670.log 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25852.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25644.log 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25539.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25722.log 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25644.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25670.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25565.log 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25644.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25146.log 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25565.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25722.log.gz 2024-09-13T06:34:14.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25904.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25565.log.gz 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25111.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.25146.log.gz 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25349.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25904.log.gz 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22886.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25111.log.gz 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25141.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25349.log: /var/log/ceph/ceph-client.admin.22886.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.25349.log.gz 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.22886.log.gz 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.25141.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25878.log 2024-09-13T06:34:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25141.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25085.log 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25345.log 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25878.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25357.log 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25085.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25345.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25357.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21552.log 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25345.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.25357.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25475.log 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T06:34:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.tmp-client.admin.21552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25253.log 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21552.log.gz 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25449.log 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25475.log.gz 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25014.log 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25449.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25253.log.gz 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25241.log 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.25449.log.gz 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25591.log 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25014.log.gz 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.25241.log: /var/log/ceph/ceph-client.admin.25591.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25241.log.gz 2024-09-13T06:34:14.300 INFO:teuthology.orchestra.run.smithi112.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25591.log.gz 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54911.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38920.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.54911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84971.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.38920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77915.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.84971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25150.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.77915.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54911.log.gz 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47180.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45410.log 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25150.log: /var/log/ceph/ceph-client.0.47180.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77915.log.gz 2024-09-13T06:34:14.314 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38920.log.gz 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25150.log.gz 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83201.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.45410.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84971.log.gz 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66711.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47180.log.gz 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.83201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53141.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.66711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39510.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45410.log.gz 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.53141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61401.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83201.log.gz 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.39510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29383.log 2024-09-13T06:34:14.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.61401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77331.log 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.29383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86151.log 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr: 86.9%/var/log/ceph/ceph-client.0.77331.log: -- replaced with /var/log/ceph/ceph-client.admin.29383.log.gz 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.66711.log.gz 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46590.log 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39510.log.gz 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77331.log.gz 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.53141.log.gz 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.86151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38330.log 2024-09-13T06:34:14.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.46590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67891.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.38330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36560.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61401.log.gz 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25174.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.67891.log: -- replaced with /var/log/ceph/ceph-client.0.86151.log.gz 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.36560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85561.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25174.log: gzip -5 --verbose -- 91.5% /var/log/ceph/ceph-client.0.64351.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.38330.log.gz 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.46590.log.gz 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.25174.log.gz 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.85561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31256.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36560.log.gz 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.64351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51371.log 2024-09-13T06:34:14.317 INFO:teuthology.orchestra.run.smithi169.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67891.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70251.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.31256.log: /var/log/ceph/ceph-client.0.51371.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85561.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25102.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.70251.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64351.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68481.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr: 85.4%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.25102.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50781.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51371.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.68481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75561.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.31256.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.50781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76151.log 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70251.log.gz 2024-09-13T06:34:14.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.75561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37740.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.76151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69661.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68481.log.gz 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.37740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35970.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% 91.3% -- replaced with /var/log/ceph/ceph-client.0.50781.log.gz 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55501.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.75561.log.gz 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.69661.log: /var/log/ceph/ceph-client.0.35970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66121.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.55501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80841.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4%/var/log/ceph/ceph-client.0.66121.log: -- replaced with /var/log/ceph/ceph-client.0.37740.log.gz 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76151.log.gz 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58451.log 2024-09-13T06:34:14.319 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.35970.log.gz 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.80841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72021.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69661.log.gz 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55501.log.gz 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.66121.log.gz 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.58451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73791.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.72021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53731.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80841.log.gz 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.73791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57271.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.53731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43640.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.57271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74381.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.58451.log.gz 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25126.log 2024-09-13T06:34:14.320 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3%/var/log/ceph/ceph-client.0.74381.log: -- replaced with /var/log/ceph/ceph-client.0.72021.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53731.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57271.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73791.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31846.log 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.43640.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76741.log 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.25126.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.31846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49011.log 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.76741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87331.log 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74381.log.gz 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.49011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40690.log 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.87331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80251.log 2024-09-13T06:34:14.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.40690.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83791.log 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.31846.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.76741.log.gz 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.80251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60221.log 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49011.log.gz 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.83791.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87331.log.gz 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.60221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44230.log 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40690.log.gz 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70841.log 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56681.log 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4%/var/log/ceph/ceph-client.0.44230.log: -- replaced with /var/log/ceph/ceph-client.0.80251.log.gz 2024-09-13T06:34:14.322 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83791.log.gz 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.70841.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60221.log.gz 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69071.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44230.log.gz 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70841.log.gz 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.56681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61991.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.69071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73201.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.61991.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.73201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67301.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56681.log.gz 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.1.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69071.log.gz 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41870.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.67301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35380.log 2024-09-13T06:34:14.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.41870.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73201.log.gz 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29407.log 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.35380.log: 91.9% 93.5% -- replaced with /var/log/ceph/ceph-client.0.61991.log.gz 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.67301.log.gz 91.5% -- replaced with /var/log/ceph/ceph-client.0.41870.log.gz 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79083.log 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.29407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78499.log 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr: 86.6%/var/log/ceph/ceph-client.0.79083.log: -- replaced with /var/log/ceph/ceph-client.admin.29407.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.88516.log 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35380.log.gz 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.78499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72611.log 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79083.log.gz 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.88516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30666.log 2024-09-13T06:34:14.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.72611.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78499.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62581.log 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.30666.log: /var/log/ceph/ceph-client.0.62581.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72611.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30666.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30076.log 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.88516.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62581.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34790.log 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.30076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84381.log 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.34790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60811.log 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.84381.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.30076.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34790.log.gz 2024-09-13T06:34:14.325 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84381.log.gz 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82611.log 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.60811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46000.log 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.82611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64941.log 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.46000.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60811.log.gz 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82611.log.gz 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46000.log.gz 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81431.log 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50191.log 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.64941.log: /var/log/ceph/ceph-client.0.81431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48421.log 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.50191.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81431.log.gz 2024-09-13T06:34:14.326 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.50191.log.gz 2024-09-13T06:34:14.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59631.log 2024-09-13T06:34:14.338 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.64941.log.gz/var/log/ceph/ceph-client.0.48421.log: 2024-09-13T06:34:14.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63761.log 2024-09-13T06:34:14.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.59631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40100.log 2024-09-13T06:34:14.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.63761.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.48421.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.59631.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63761.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63171.log 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71431.log 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.40100.log: /var/log/ceph/ceph-client.0.63171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59041.log 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.71431.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40100.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.63171.log.gzgzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71431.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.59041.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42460.log 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.59041.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T06:34:14.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49601.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.42460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52551.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8%/var/log/ceph/ceph-client.0.49601.log: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57861.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87921.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.52551.log: /var/log/ceph/ceph-client.0.57861.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.42460.log.gz 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34200.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.49601.log.gz 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.87921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43050.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.34200.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52551.log.gz 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57861.log.gz 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56091.log 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87921.log.gz 2024-09-13T06:34:14.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29359.log 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.43050.log: 91.6%/var/log/ceph/ceph-client.0.56091.log: -- replaced with /var/log/ceph/ceph-client.0.34200.log.gz 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82021.log 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.29359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29335.log 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr: 86.5%/var/log/ceph/ceph-client.0.82021.log: -- replaced with /var/log/ceph/ceph-client.admin.29359.log.gz 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33610.log 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.29335.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56091.log.gz 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43050.log.gz 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29335.log.gz 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51961.log 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82021.log.gz 2024-09-13T06:34:14.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37150.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.33610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79667.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.51961.log: /var/log/ceph/ceph-client.0.37150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33026.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.79667.log: 90.7% 91.5% -- replaced with /var/log/ceph/ceph-client.0.79667.log.gz 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.51961.log.gz 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37150.log.gz 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33610.log.gz 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41280.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.33026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47801.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.41280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65531.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.33026.log.gz 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.47801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54321.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44820.log 2024-09-13T06:34:14.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.65531.log: /var/log/ceph/ceph-client.0.54321.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41280.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32436.log 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr: 92.2%/var/log/ceph/ceph-client.0.44820.log: -- replaced with /var/log/ceph/ceph-client.0.47801.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65531.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54321.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86741.log 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.32436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74971.log 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44820.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.86741.log: /var/log/ceph/ceph-client.0.74971.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.32436.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.74971.log.gz 2024-09-13T06:34:14.343 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86741.log.gz 2024-09-13T06:34:14.359 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T06:34:14.465 INFO:teuthology.orchestra.run.smithi112.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T06:34:15.034 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T06:34:15.218 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T06:34:15.219 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T06:34:15.221 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-13T06:34:15.221 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m0.968s 2024-09-13T06:34:15.222 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m2.834s 2024-09-13T06:34:15.222 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.165s 2024-09-13T06:34:15.281 INFO:teuthology.orchestra.run.smithi112.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T06:34:15.283 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-13T06:34:15.283 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m1.045s 2024-09-13T06:34:15.283 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m1.211s 2024-09-13T06:34:15.283 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.080s 2024-09-13T06:34:15.283 INFO:tasks.ceph:Archiving logs... 2024-09-13T06:34:15.284 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/remote/smithi112/log 2024-09-13T06:34:15.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T06:34:15.523 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/remote/smithi169/log 2024-09-13T06:34:15.524 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T06:34:15.954 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T06:34:15.966 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T06:34:15.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T06:34:15.969 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T06:34:16.050 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T06:34:16.059 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T06:34:16.059 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:34:16.062 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:34:16.072 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:34:16.072 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-13T06:34:16.072 INFO:teuthology.orchestra.run.smithi112.stdout:+hv01.front.sepi 67.205.162.81 3 u 8 64 377 0.088 -0.973 2.901 2024-09-13T06:34:16.072 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 12 64 377 0.089 -2.157 2.948 2024-09-13T06:34:16.072 INFO:teuthology.orchestra.run.smithi112.stdout:*hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.104 -0.782 2.897 2024-09-13T06:34:16.072 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:34:16.077 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:34:16.078 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-09-13T06:34:16.078 INFO:teuthology.orchestra.run.smithi169.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.053 -2.012 0.714 2024-09-13T06:34:16.078 INFO:teuthology.orchestra.run.smithi169.stdout:+hv02.front.sepi 63.231.80.2 3 u 12 64 377 0.137 +1.114 0.669 2024-09-13T06:34:16.078 INFO:teuthology.orchestra.run.smithi169.stdout:*hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.095 -1.736 0.629 2024-09-13T06:34:16.078 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:34:16.078 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T06:34:16.087 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T06:34:16.087 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T06:34:16.095 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T06:34:16.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T06:34:16.111 INFO:teuthology.task.internal:Duration was 932.804589 seconds 2024-09-13T06:34:16.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T06:34:16.119 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T06:34:16.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T06:34:16.122 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T06:34:16.159 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T06:34:16.159 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-13T06:34:16.159 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T06:34:16.208 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-13T06:34:16.208 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T06:34:16.218 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T06:34:16.218 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:34:16.256 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:34:16.288 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T06:34:16.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T06:34:16.323 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T06:34:16.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T06:34:16.392 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T06:34:16.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T06:34:16.404 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T06:34:16.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T06:34:16.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:34:16.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:34:16.459 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-13T06:34:16.466 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-13T06:34:16.588 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:34:16.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:34:16.594 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:34:16.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:34:16.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T06:34:16.645 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T06:34:16.646 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/remote/smithi112 2024-09-13T06:34:16.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T06:34:16.668 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903289/remote/smithi169 2024-09-13T06:34:16.668 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T06:34:16.698 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T06:34:16.699 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T06:34:16.712 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T06:34:16.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T06:34:16.753 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T06:34:16.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T06:34:16.762 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T06:34:16.762 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T06:34:16.765 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T06:34:16.769 INFO:teuthology.orchestra.run.smithi112.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:34 /home/ubuntu/cephtest 2024-09-13T06:34:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:34 /home/ubuntu/cephtest 2024-09-13T06:34:16.792 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T06:34:16.802 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T06:34:16.823 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} duration: 932.8045887947083 flavor: default owner: scheduled_tchandra@teuthology success: true 2024-09-13T06:34:16.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T06:34:16.921 INFO:teuthology.run:pass